ISO/IEC JTC 1/SC 32 N 0444

Transcription

1 ISO/IEC JTC 1/SC 32 N 0444 Date: REPLACES: -- ISO/IEC JTC 1/SC 32 Data Management and Interchange Secretariat: United States of America (ANSI) Administered by Pacific Northwest National Laboratory on behalf of ANSI DOCUMENT TYPE TITLE SOURCE PROJECT NUMBER Other Document (Open) Tutorial on Metadata Registries Bruce Bargmeyer STATUS Presented at the SC 32 Tutorial REFERENCES ACTION ID. REQUESTED ACTION DUE DATE FYI Number of Pages 26 LANGUAGE USED DISTRIBUTION English P & L Members SC Chair WG Conveners and Secretaries Douglas Mann, Secretariat, ISO/IEC JTC 1/SC 32 Pacific Northwest National Laboratory *, 901 D Street, SW., Suite 900, Washington, DC, , United States of America Telephone: ; Facsimile; ; MannD@battelle.org available from the JTC 1/SC 32 WebSite *Pacific Northwest National Laboratory (PNL) administers the ISO/IEC JTC 1/SC 32 Secretariat on behalf of ANSI

2 SC 32 Tutorial on Metadata Registries Bruce Bargmeyer Chair, SC 32 Data Management and Interchange U.S. Environmental Protection Agency Telephone: (202) WWW URL: January 19,

3 ISO 11179, Parts 1-6 Part 1: Framework for the Specification and Standardization of Data Elements Part 2: Classification for Data Elements Part 3: Basic Attributes of Data Elements Part 4: Rules and Guidelines for the Formulation of Data Definitions Part 5: Naming and Identification Principles for Data Elements Part 6: Registration of Data Elements DTR Specification of Data Value Domains 2

4 Part 4: Data Definitions Verification Method Code: The code that represents the process used to verify the latitude and longitude coordinates. Mailing Address Post Office Box: The number of the post office box where mail for the addressee is delivered. International Postal Code: The code that represents a postal zone specific to a country. 3

5 Data Element Concept Name: Country Identifiers Context: Definition: Unique ID: 5769 Conceptual Domain: Maintenance Org.: Steward: Classification: Registration Authority: Others Afghanistan Belgium China Denmark Egypt France Germany Data Elements Name: Context: Definition: Unique ID: 4572 Value Domain: Maintenance Org.: Steward: Classification: Registration Authority: Others Afghanistan Belgium China Denmark Egypt France Germany Name: Context: Definition: Unique ID: 3820 Value Domain: Maintenance Org.: Steward: Classification: Registration Authority: Others AFG BEL CHN DNK EGY FRA DEU Name: Context: Definition: Unique ID: 1047 Value Domain: Maintenance Org.: Steward: Classification: Registration Authority: Others ISO 3166 English Name ISO Alpha Code ISO Numeric Code In order to reduce costs associated with managing metadata, we want to enable interchange of metadata including terminology between metadata registries. Organizations that are responsible for particular terminology and data elements can propagate these changes to other metadata registries. 4

6 Data_Element_Concept <<Required>> administered_component : Administered_Component <<Optional>> object_class : Object_Class <<Optional>> object_class_qualifier <<Optional>> property : Property <<Optional>> property_qualifier 1..1 pression +represented_by Example <<Required>> item 1..* +representing exemplication +contained_in Data_Element_Concept_Relationship <<Required>> type_description Rule +having containing data_element_concept_relationship <<Optional>> administered_component : Administered_Component <<Required>> description Source_Data_Element 0..1 derivation_output derivation is_formula_for +used_by +is_input_to data_element_concept_conceptual_domain_relationship +containing derivation_input +specifing 1..1 value_domain_relationship +contained_in Non_enumerated_Domain <<Required>> description Conceptual_Domain <<Optional>> administered_component_information : Administered_Component <<Optional>> dimensionality Value_Domain_Relationship <<Required>> type_description +containing comceptual_domain_relationship 1..* +represented_by permissible_value_meaning +representing Permissible_Value <<Required>> item <<Required>> begin_date <<Conditional>> end_date 2..n +member_of allowed_value +specifing 1..* 1..* +containing value_meaning_set +contained_in Value_Meaning <<Required>> identifier <<Optional>> description <<Required>> begin_date <<Conditional>> end_date 2..n +contained_in +containing Enumerated_Domain permissible_value +containing +representing 0..1 presentation_to +represented_by +resulting_from +contained_in +contained_in Value_Domain 1..* * <<Optional>> administered_component : Administered_Component <<Optional>> name Data_Element <<Required>> datatype : Datatype <<Required>> administered_component : Administered_Component <<Optional>> maximum_character_quantity <<Required>> representation_class : Representation_Class <<Optional>> minimum_character_quantity <<Optional>> representation_class_qualifier representation <<Optional>> format <<Optional>> unit_of_quantity : Unit_of_Quantity providing_representation_for +represented_with specified_by specification Afghanistan Belgium China Denmark Egypt France Germany AFG BEL CHN DNK EGY FRA DEU

7 Elements of Terminology trout Salmo trutta brown trout truite Term Concept Definition any of several game fishes of the genus Salmo, related to the salmon... Object 6

8 Terminology any of several game fishes of the genus Salmo, related to the salmon... Concept UIN=6349 Terms trout Salmo trutta truite Context common name scientific name French name We capture a concept with a definition. We assign unique identifiers to uniquely identify concepts. There are potentially many terms associated with any concept, and many concepts associated with any one term. Each term has a context from which it is extracted. 7

9 Concept Terms Context UIN=6349 Brown trout common name Salmo trutta scientific name truite French name Printed On-line Dictionary/Glossary/Keywords It is common to alphabetize terms and demonstrate many senses of a term (e.g., dictionary, glossary, key word list). Terms within a specific context may also be stored for a particular subject area. We can alphabetize terms so people can look up and see all the concepts associated with a particular term. Specialized information, or subject matter specialties gather and store terms specific to a particular context (e.g., legal dictionary, medical glossaries, etc.). Deployment technologies: printed, on-line 8

10 Search Engine **1.00 fish <any> ***0.25 trout <or> ****0.10 Salmo trutta ****0.10 Brown trout Documents Data Search Example: Fish Trout Thesaurus (and Topic Trees) fish trout Concept UIN=6349 Terms Brown trout Salmo trutta truite Salmo trutta Brown Trout Context common name scientific name French name Another way to structure terminology is into a thesaurus. A thesaurus has a hierarchical realtionship (NT, BT, UF). We add value by buillding a structure which is more informative than a dictionary. Thesauri can be deployed in the form of published books, software, or used to feed search engine applications. 9

11 Data Elements Elements Data element concept: trout species name Definition: The names of species of trout Concept UIN=6349 Terms Context Brown trout common name Salmo trutta scientific name truite French name Data element 1, Common name: brook trout brown trout cutthroat trout Data element 2, Scientific name: Salvelinus fontinalis Salmo trutta Oncorhynchus clarkii We organize our terms into data element. Terms can be used in names, definitions, and values. The way to access all this data is by term. In our metadata registry we want to be able to view this information by the term name. 10

12 Systems: STORET Envirofacts.. Web-enabled Forms EDI Messages Federal Register Regulations Reports Database Design Query Message Content Data Elements Documents Concept Terms Context UIN=6349 Brown trout common name Salmo trutta scientific name truite French name Data elements are organized into the design of data bases, and can be used to perform queries. Data elements can be assembled into message content (I.e., message sets, transaction sets, information bundles, flat files, etc.) and can be deployed using EDI messages and other forms of communication. Terms and data elements can be organized into documents and published as reports, regulations, included in legislation, etc. 11

13 Concept UIN=6349 Terms Brown trout Salmo trutta truite Context common name scientific name French name Central Mapping Ontology Intelligent Information Services (IIS): Query Agent Broker Mediator Resource Agent Local Mapping Example: fish Table common name brown trout Data element Data element value A fourth way to structure terminology is into ontologies. Ontologies have rich structures of relationships (generalization, specialization, inheritance). Terms can be used to drive IIS s that utilize query agents, wrapping agents, mediators, and similar technology to access data on geographically dispersed, disparate sources. Example: an ontology might be structured to include table, data elements, and data element values, so that queries could be constructed using these ontological terms and resources. Queries are mapped to this ontology, thus enabling data to be integrated without requiring all resources to use the exact same terms in each system. 12

14 Users Metadata Registry Terminology Thesaurus Themes Ontology Intelligent Systems Middle Ware InfoSleuth Companies Universities Structured Metadata Data Standards Agencies Others 13

15 Concept Terms Context UIN=6349 Brown trout common name Salmo trutta scientific name truite French name Thesauri: General European Multilingual Environmental Thesaurus (GEMET) and Universal Medical Language System (UMLS) Data Elements Practitioners in Field Terminology Sources Documents There are many sources to obtain semantic content for our terminology (thesauri like GEMET and UMLS, or other sources like data elements, documents, and practioners of the world. 14

16 Semantics Management DBMS/EDI/ Documents Data Elements Search Engine Thesaurus Ontology a category of vertebrate, cold-blooded craniate animals with permanent gills... IIS Dictionary/Glossary/ Keywords New Work Items define overlap of and relevant standards for managing, organizing, and structuring terminology. We want to include modifications needed in 11179, or any additions to it. Users may want to access terminology directly in a metadata registry. 15

17 Profiles of ISO/IEC x x 16

18 data_element_concept_conceptual_domain_relationship Data_Element_Concept +having <<Required>> administered_component : Administered_Component <<Optional>> object_class : Object_Class <<Optional>> object_class_qualifier <<Optional>> property : Property <<Optional>> property_qualifier containing +represented_by +contained_in +specifing Conceptual_Domain 1..1 <<Optional>> administered_component_information : Administered_Component <<Optional>> dimensionality +contained_in 1..* containing +containing +specified_by value_meaning_set comceptual_domain_relationship Data_Element_Concept_Relationship <<Required>> type_description data_element_concept_relationship +contained_in Value_Meaning <<Required>> identifier <<Optional>> description <<Required>> begin_date <<Conditional>> end_date 1..* +represented_by 2..n +contained_in pression permissible_value_meaning +representing Rule <<Optional>> administered_component : Administered_Component <<Required>> description Permissible_Value <<Required>> item permissible_value <<Required>> begin_date <<Conditional>> end_date specification is_formula_for 2..n +member_of allowed_value Example <<Required>> item derivation +specifing 1..* +containing 1..* +representing +used_by Source_Data_Element Non_enumerated_Domain <<Required>> description Enumerated_Domain exemplication is_input_to value_domain_relationship +containing Value_Domain_Relationship <<Required>> type_description derivation_output derivation_input +containing +representing 0..1 presentation_to +represented_by +resulting_from +contained_in +contained_in Value_Domain 1..* * <<Optional>> administered_component : Administered_Component <<Optional>> name Data_Element <<Required>> datatype : Datatype <<Required>> administered_component : Administered_Component <<Optional>> maximum_character_quantity <<Required>> representation_class : Representation_Class <<Optional>> minimum_character_quantity <<Optional>> representation_class_qualifier representation <<Optional>> format <<Optional>> unit_of_quantity : Unit_of_Quantity providing_representation_for +represented_with 17

19 Part 2 Classifications Part 4 Definitions Part 5 Names IDs 18

20 Part 25 4 Definitions Classifications Names IDs 19

21 Impacts of Data Change ANSI Industry Gov t Systematic Name ISO Vernacular Name Taxonomic Serial Number New species New classification Biological terms 20

22 Impacts of Data Change ISO ANSI Industry Gov t Systematic Name Synonym CAS Number New chemical Chemicals 21

23 Impacts of Data Change ISO ANSI Industry Gov t CZ Czech Republic** LO Slovakia** CZ Czechoslovakia* Country changes Country * FIPS PUB 10-3 ** FIPS PUB 10-4 Change 22

24 As changes in the world occur, metadata changes will be recorded and effectively communicated between registries. Catalog of Data Sources Defense Data Dictionary System EDR Intelligent Transportation System Health Care Financing Administration S t ISO ANSI Industry Gov t Health Affairs HISB a Change Standard Data n d a r d 23

25 Profiles of ISO/IEC x x 24

26 Implementations Individual Parts of Profiles Extensions 25