Anatomy-Evaluation-20130603

SNOMED CT Anatomy
Redesign Project Evaluation
Subproject parts, dependencies, and criteria for evaluation
Date 20130603
Version 0.2
Amendment History
Version
Date
Editor
Comments
0.1
20130126
Kent Spackman
First draft
0.2
20130603
Kent Spackman
Expansion for review by standing committees
Review Timetable
Review date
Responsible owner
Comments
YYYYMMDD
Person/group responsible
Summary of action
(remove or add rows if necessary)
© International Health Terminology Standards Development Organisation 2013. All rights reserved.
SNOMED CT® was originally created by the College of American Pathologists.
This document forms part of the International Release of SNOMED CT® distributed by the International Health Terminology Standards
Development Organisation (IHTSDO), and is subject to the IHTSDO’s SNOMED CT® Affiliate Licence. Details of the SNOMED CT® Affiliate
Licence may be found at http://www.ihtsdo.org/our-standards/licensing/.
No part of this document may be reproduced or transmitted in any form or by any means, or stored in any kind of retrieval system, except by
an Affiliate of the IHTSDO in accordance with the SNOMED CT® Affiliate Licence. Any modification of this document (including without
limitation the removal or modification of this notice) is prohibited without the express written permission of the IHTSDO.
Any copy of this document that is not obtained directly from the IHTSDO [or a Member of the IHTSDO] is not controlled by the IHTSDO, and
may have been modified and may be out of date. Any recipient of this document who has received it by other means is encouraged to obtain
a copy directly from the IHTSDO [or a Member of the IHTSDO. Details of the Members of the IHTSDO may be found at
http://www.ihtsdo.org/members/].
SNOMED CT Anatomy Redesign Project Evaluation
Page 2 of 11
Table of Contents
1 Introduction............................................................................................................................ 4
2 Project Overall Description and Aims .................................................................................... 4
2.1 Problems to be solved ................................................................................................................. 4
2.1.1 Specifying site and laterality – too difficult ............................................................................................... 4
2.1.2 Errors, omissions and inconsistencies .................................................................................................... 4
2.1.3 Maintenance burden ................................................................................................................................ 4
2.1.4 Coordination with other anatomy terminologies ...................................................................................... 5
2.1.5 Inadequate adoption and use of tools ..................................................................................................... 5
3 Background – what is the current model? ............................................................................. 5
4 Project Parts .......................................................................................................................... 6
4.1 SEP Assignment ......................................................................................................................... 6
4.2 Laterality Assignment .................................................................................................................. 6
4.3 Assignment of Subtype and Subpart Relationships ..................................................................... 6
4.4 Creation of Sufficient DL Definitions for Entire (E) Codes ............................................................ 7
4.5 Systematic Naming ..................................................................................................................... 7
4.6 Coordination with FMA ................................................................................................................ 7
4.7 Revisions to SNOMED CT to Eliminate S Codes ........................................................................ 7
5 Items to be evaluated, and some suggested criteria ............................................................. 8
5.1 SEP Assignment ......................................................................................................................... 8
5.2 Laterality Assignment .................................................................................................................. 8
5.3 Is-a and part-of differentiation...................................................................................................... 9
5.4 Creating sufficient definitions for E concepts ............................................................................... 9
5.5 Systematic naming ...................................................................................................................... 9
5.6 Mapping to FMA ........................................................................................................................ 10
5.7 Revision of concept model to get rid of S nodes ........................................................................ 10
6 Appendix: Assigning type S or E to concepts ...................................................................... 11
SNOMED CT Anatomy Redesign Project Evaluation
Page 3 of 11
1 Introduction
This document is to be used by those planning and executing an evaluation of the SNOMED CT
Anatomy Redesign Project, listed as artf6206 at csfe.aceworkspace.net. The project is too large to
evaluate as a single unit. Each sub-project can be assessed for its value to end users and
stakeholders, its degree of completeness and consistency, and its potential disruptive impacts on
implementers; and this will enable the IHTSDO to make decisions that will deliver high-value lowimpact quality-assured parts while keeping the option of deferring, doing further development, or
scrapping other parts. In addition, each sub-part of the project deserves its own tailored specific
evaluation effort, each with specific goals, objectives, methodologies and outcomes. This document
identifies the sub-projects, their dependencies, and general criteria by which they should be judged.
2 Project Overall Description and Aims
Simple Title: “Anatomy”. Expanded Title (as reviewed by the project group in 2011): “Revising the
anatomy model to improve usability and correctness”.
2.1 Problems to be solved
2.1.1 Specifying site and laterality – too difficult
The site and laterality of a disorder or procedure should be easy to specify, whether via pre- or postcoordination. This is one of the most common requirements of users, but currently the anatomy names
are confusing (“structure of ...”, “entire ...”), and anatomy organization appears awkward and
duplicative, even when strictly correct.
2.1.2 Errors, omissions and inconsistencies
The hierarchies in clinical findings and procedures depend on the anatomy hierarchies to determine
their structure, but anatomy contains many errors, omissions and inconsistencies, leading to the kind
of error that has been characterized in journal articles as having the “foot in the pelvis”. These errors
tend to be systematic and require scaled-up solutions, not merely one-by-one minor tweaks.
2.1.3 Maintenance burden
Because of the complex design structure adopted in the merger between SNOMED RT and CTV3, the
anatomy section inherently requires the manual checking of multiple hierarchical relationships for each
change. All changes are laborious, time-consuming, error-prone, and fraught with traps and pitfalls.
Any error in anatomy propagates (or has the potential to propagate) to the rest of the terminology. It is
very difficult to explain the model and train editors to be able to properly edit it. These negative
characteristics are not necessary, and could (and should) be significantly simplified and automated.
SNOMED CT Anatomy Redesign Project Evaluation
Page 4 of 11
2.1.4 Coordination with other anatomy terminologies
It is unclear how to coordinate SNOMED CT with “outside” resources. Some specialties have created
their own special-purpose clinical anatomy terminologies. For example, Radlex has a significant
anatomy section that supports clinical imaging applications. It would be desirable to coordinate with
(map to, or provide other types of linkages to) Radlex and probably other clinical anatomy
terminologies.
Many of the bioinformatics and biomedical research organizations have adopted the Foundational
Model of Anatomy (FMA) for annotating research data, and it would be desirable for SNOMED CT and
clinical data based on SNOMED CT to be compatible with or mapped to FMA. Some people have
even suggested that IHTSDO should “outsource” its anatomy model to an established external
anatomical standard such as FMA. Evaluation of SNOMED CT anatomy, and the mapping to FMA,
should provide some clear evidence of the actual strengths and weaknesses of each. The evaluation
of the mapping would be expected to provide a clearer picture that can assist decision-making that
considers such proposals or related suggestions for improving the maintenance, correctness and
usability of the anatomy section of SNOMED CT.
2.1.5 Inadequate adoption and use of tools
IHTSDO has invested in a workbench and description logic (DL) classifier tools, but uses these in only
a limited way in the current anatomy. All anatomy codes are currently primitive, and therefore each
meaning is edited individually. Proper adoption and use of DL tools should permit many codes to be
sufficiently defined, which in turn should reduce the editing burden, increase quality assurance
checking capabilities, and improve overall consistency and reliability.
3 Background – what is the current model?
The anatomy concepts were merged from CTV3 and SNOMED RT. Both systems had in common the
use of codes to represent individual anatomical entities, organized in multi-parent hierarchies
according to logical subsumption criteria. The main difference was that SNOMED RT used a DL
object property called “Part Of”, but CTV3 instead used a hierarchical term that added the word
“structure” to each anatomy term to indicate all or part of the structure. For example, SNOMED RT
had a code for the liver, and a code for ‘liver part’. CTV3 instead had codes for ‘liver structure’ and
liver.
The adopted model brought the two systems together using ideas very similar to those subsequently
reported by Schulz & Hahn in a paper in 2005 called “Part-whole representation and reasoning in
formal biomedical ontologies.” This model is sometimes called the Structure-Entire-Part, or SEP
model. The application of the model to hand, finger and index finger is illustrated in the two diagrams
below (Figures 1 and 2):
SNOMED CT Anatomy Redesign Project Evaluation
Page 5 of 11
finger structure
hand structure
entire hand
part of hand
finger structure
entire finger
part of finger
entire finger
part of finger
structure of index finger
entire index finger
part of index finger
Figures 1 and 2: SEP model applied to hand, finger, and index finger.
The current situation is that all the codes are primitive, and each is-a link (black arrow in the diagram)
must be individually modeled.
Further description of the SEP model can be found in the SNOMED CT Editorial Guide.
4 Project Parts
4.1 SEP Assignment
This subproject assigns exactly one of the three types structure (S), entire (E), part (P), to each code
(concept) in the hierarchy under 91722005 | physical anatomical entity |. SNOMED CT relies on the
semantic differentiation of S, E, and P, but does not yet have an agreed assignment for each code,
and this creates problems in interpretation, naming and use.
4.2 Laterality Assignment
Each anatomy code is to be assigned a laterality (left, right, lateralizable, or not lateralizable), and
there must be a clear definition of the meaning of laterality. This is essential to delivering a key
requirement for SNOMED CT, which is the support of recording and retrieving data that includes
lateralized findings and procedures. The project also needs to propose a decision about whether to
pre-coordinate lateralized anatomy concepts, and provide a clear model for post-coordination of
laterality.
4.3 Assignment of Subtype and Subpart Relationships
For each “E” entity, this subproject assigns appropriate is-a (subtype-of) parents, and also assigns and
uses (via a capable DL classifier) semantically defining part-of relationships. This supports ease-ofuse requirements for reference set creation and maintenance; ease-of-curation requirements for
SNOMED CT Anatomy Redesign Project Evaluation
Page 6 of 11
quality assuring and maintaining the terminology itself; and requirements for integrating and
coordinating with external anatomical reference terminologies such as the Foundational Model of
Anatomy (FMA).
4.4 Creation of Sufficient DL Definitions for Entire (E) Codes
For ‘defined classes’ in the hierarchy of Entire (E) codes, this project works to create definitions that
are sufficient (defined instead of primitive) to allow the DL classifier to properly recognize all subtypes.
This greatly reduces the maintenance burden while at the same time greatly improves completeness
of the is-a hierarchy; and consequently supports confidence in the accuracy of the anatomy section
and all disease and procedure sections that are defined in terms of anatomical groupings.
4.5 Systematic Naming
This subproject proposes the adoption of a single, standard, predictable approach to naming the S, E
and P variations of an anatomical concept. Currently many concepts that are logically interpreted as
S-structure do not have a name that clearly identifies them as such, creating confusion.
4.6 Coordination with FMA
This project involves the identification of one-to-one correspondence between SNOMED CT codes
and FMA codes, along with any cases where names do not mean the same thing (e.g. finger), and
adoption of some of the FMA categories for the is-a hierarchy.
4.7 Revisions to SNOMED CT to Eliminate S Codes
This sub-project envisions the creation of a revised concept model that does not use “S” codes, and
permits their deprecation. There is considerable confusion among users of SNOMED CT regarding
“which code do I choose” when there are two codes (S and E) for every anatomical entity, with
inconsistent naming (See Systematic Naming), and synonyms that are sometimes identical for
different concepts. It is feasible to eliminate this confusion, but the changes would likely have an
unacceptably high cost to implementers who have already developed systems based on our current
model.
Figure 3 (below) illustrates the dependency relationships among the various subprojects:
SNOMED CT Anatomy Redesign Project Evaluation
Page 7 of 11
4.1
4.6
4.2
4.5
4.3
4.1: SEP Assignment
4.2: Laterality Assignment
4.3: is-a and part-of modeling
4.4: Sufficient Definitions
4.5: Systematic Naming
4.6: FMA Alignment
4.7: Options for eliminating “S”
Depends on
Facilitated by
4.4
4.7
Figure 3: Dependency Relationships Among Subprojects
5 Items to be evaluated, and some suggested criteria
5.1 SEP Assignment
The data to be evaluated is in the table called “sep-map.txt” posted as doc3132 on collabnet.
Evaluation should consider:
1. The need for assigning status of S, E, or P to every anatomy concept; harm/problems
encountered without it; impact of doing it (QA of hierarchies; implementer benefits)
2. Criteria for doing the assignment in (1), based on Read code, Name, Subtypes (S,E,P), and
usage. [See Appendix ]
3. The proposed assignments to S, E, P for accuracy, impact, consistency, correctness, and
compatibility with Read codes.
5.2 Laterality Assignment
The same table “sep-map.txt” contains assignments of midline laterality (Y, L, R, -) for each row.
Items to evaluate include:
1. Need for assigning a laterality to each SEP triple
2. Definitions of the meaning(s) of laterality
3. The proposed assignment of laterality to the SEP triples for correctness, consistency
SNOMED CT Anatomy Redesign Project Evaluation
Page 8 of 11
5.3 Is-a and part-of differentiation
The is-a and part-of relationships are provided in OWL format in file “SNOMED CT Anatomy Redesign
Alpha, OWL format” which is posted as doc2000 on Collabnet.
Items to be evaluated include:
1. Need for clear is-a hierarchy and separate part-of relationships, of the "E" concepts
2. Components of the proposed structure:
a. top-level of the is-a hierarchy, based on FMA
i. do we agree with the definitions (see revised text definitions in OWL file)
ii. are the assignments properly made, according to the definitions
iii. are the definitions URU (understandable, reproducible, useful)
b. is-a and part-of assignments of E concepts
i. are they properly made, according to the definitions
c. logic model (2 options) for assigning is-a to S and P automatically, based on the SEP
table and E stated rels
i. which model (OWL2 EL with reflexive rels, or OWL 2 DL with disjunction)
ii. technical criteria for the impact of adopting the model, for usability, release
format, extensibility, etc
5.4 Creating sufficient definitions for E concepts
This is an area of active development in the OWL version file (doc2000). Further development and
revision could occur after the model is adopted and brought into the main release of SNOMED CT.
See the accompanying slides in doc4529 Anatomy redesign background slides.
Evaluation should focus on:
1. Need/benefit of sufficient definitions, example from skin/subcut/surface concepts
2. The proposed sufficient definitions, according to:
a. expected curation benefit
b. required curation tooling/distribution format changes - requirements and costs [GCIs
required]
c. potential impact on implementers
5.5 Systematic naming
The field “basename” in file “sep-map.txt” contains a proposed name for each SEP triple.
Evaluation should examine:
1. The need for a 'base name' for each SEP triple
2. Criteria for (1), based on existing names.
3. The proposed base names: for correctness, absence of plurals, spelling, etc
4. Need for systematic naming of S, E, and P concepts
5. Criteria for (4) - and multiple options
6. Value of different naming options (would be different for options that keep SEP vs options that
eliminate S – see Part 4.7 and 5.7 below)
SNOMED CT Anatomy Redesign Project Evaluation
Page 9 of 11
5.6 Mapping to FMA
The proposed mapping is contained in field “FMAID” in file “sep-map.txt”.
Evaluation can review:
1. Benefits of one-to-one alignment with FMA
2. Criteria for accuracy and correctness of the mapping
3. The existing draft mapping itself: completeness (we know it is incomplete), and correctness of
existing maps
5.7 Revision of concept model to get rid of S nodes
No existing artifact contains the whole revised model(s). These would have to be built in order to
evaluate them. The evaluation should consider:
1. Benefits of having a simpler set of anatomy codes
2. Drawbacks of significantly more complicated disorder and procedure (and specimen) models
3. Possible classifier execution time impact (does the classifier take much longer to run with the
revised model?)
SNOMED CT Anatomy Redesign Project Evaluation
Page 10 of 11
6 Appendix: Assigning type S or E to concepts
1) Exclude concepts that have the word “part” (P), and also exclude concepts that refer to
a point, level, location, plane, “both”, “all” (A), or “branch”
2) Assess and code for each of these features:
a. Current name type: “U” means unassigned, (not S, E, P, or A)
b. Read code existed: R=Read code existed, N=no Read code). Codes starting in
“XU...” are assumed to be fake/pseudo-codes.
c. Existing dual (either S or E) exists: A=dual S exists, B=dual E exists, X=none
d. S-descendants: Y=has type “S” descendants, N=does not
e. Uses: 0=not used as a value, 1 = used at least once by finding/procedure/etc
3) Patterns:
Pattern Count Assignment
URXY1 1032
S
URXN0 2396
E
URXN1 1126
S
URA
15
E
UNXY1
129
S
UNXN0 1463
E
UNXN1
326
S
URB
2
S
UNB
1
S
Basic principle for the U-X patterns: if it has S-descendants and it is already in use,
then make it S. If it has no S-descendants and is not in use, make it E.
If it is used, but has no S-descendants, it should be reviewed, with the idea of
making URX become Es and UNX become Ss.
Review each of the URA, URB and UNB manually (there are only 18 of them).
URA -> Entire;
URB & UNB -> Structure.
If there is an S-descendant, it has to be S. (E’s are not allowed to have S
descendants).
If there is an E-ancestor, it has to be E. (S’s are not allowed to have E ancestors).
SNOMED CT Anatomy Redesign Project Evaluation
Page 11 of 11