UNCLASSIFIED UNCLASSIFIED. MITRE/DISA PEO-GES 25 Nov 2008

Transcription

1 UNCLASSIFIED DoD Enterprise Ontology Support Presentation to ASQ Software SIG/SSQ/IEEE Computer Society UNCLASSIFIED Dr Glenda Hayes MITRE/DISA PEO-GES 25 Nov 2008

2 Agenda Net-Centricity DoD Net-Centric Data Strategy Metadata s Role Types of Metadata Structural and Semantic Metadata Discovery Metadata Need for Controlled Vocabularies DoD Discovery Metadata Spec (DDMS) Ontology Spectrum DoD Metadata Registry and Clearinghouse (DoD MDR) UNCLASSIFIED 2

3 Net-Centric Tenets DoD Net-Centric Data Strategy Information Assurance Strategy Global Connectivity (Transformational Communications) Core Enterprise Services (NCES) UNCLASSIFIED Recipe for Agility 3

4 DoD Net-Centric Data Strategy The DoD Net-Centric Data Strategy, issued by the DoD CIO May 9, 2003, is the plan to make the Department s information resources: Visible Accessible Understandable Trusted Interoperable Responsive Is an information resource discoverable by most users? Is it available on the network, and are tools readily available to use it? Can it be intelligibly used? Are the semantics well documented? Are the source, security level and access controls of the data available to users? Can it be combined or compared with other information? Can it be mediated? Is the data what users need? Are robust user feedback mechanisms in place to improve it? 4 CC/S/As must institutionalize processes to accomplish these goals UNCLASSIFIED 4

5 Metadata s Role Visible Accessible Discover the existence of data (e.g., html, doc, ppt, jpeg, mpeg, data store, etc) Discover a web service To create, read, update, or delete data from a data store To transact business (order products or services to be rendered) Inform the machine of apps to process data (mime) Protect the data from improper access (national security & privacy) Understandable Inform the consumer of the data s reliability Inform the consumer, application, and developer of the data s organization & interpretation; the (web) service s operations, i/o structures, and endpoints Inform the consumer, application, and developer of data transforms and metadata mappings More And more info UNCLASSIFIED 5

6 Structural & Semantic Metadata Rules governing a chunk - Name, description, data constraints, and relationships of tags used in information resources to delimit one chunk of data from another chunk Artifacts where structural metadata is described: XML schemas, RDBMS structures, taxonomies Register in DoD Metadata Registry, use submission pkg Resource Metadata Advertisement - Terms to aid in the recall and retrieval of artifacts Artifacts that we collect resource metadata on: PPT, DOC, GIF, JPG, MPG, RDBMS Register in Data Catalog, use DoD Discovery Metadata Specification (DDMS) Differentiating Types of Metadata UNCLASSIFIED 6

7 Configuration managed by DoD Metadata WG Data Catalog (historical) DDMS endorsed by Executive Order Further Strengthening The Sharing Of Terrorism Information To Protect Americans DoD Discovery Metadata Specification (DDMS) * mandatory DDMS Attributes Security Title * Identifier * Creator * Publisher * Contributor Date Rights Language Type Source Subject * Geospatial Coverage Temporal Coverage Virtual Coverage Description Format IC: ISM W3C: Date & Time W3C: OWL OGC: GML W3C: Date & Time DDMS: Leverages Industry Standards UNCLASSIFIED 7

8 DoD Discovery Metadata Specification (DDMS) Make Data Configuration managed Accessible by DoD Metadata WG (responsibly) Data Catalog (historical) DDMS endorsed by Executive Order Further Strengthening The Sharing Of Terrorism Information To Enable Data to be Trusted Make Data Understandable Make Data Accessible (practically) Utility Beyond Make Data Visible * mandatory DDMS Attributes Security Title Identifier Creator Publisher Contributor Date Rights Language Type Source Subject Geospatial Coverage Temporal Coverage Virtual Coverage Description Format Protect Americans DDMS 8 is enabler to multiple Data Strategy Goals UNCLASSIFIED 8 * * * * * IC: ISM W3C: Date & Time W3C: OWL OGC: GML W3C: Date & Time

9 Scope & Scale comparable to DoD UNCLASSIFIED 9

10 MDR Support for Taxonomies PoliticalOrganization Organization DoD Core taxonomy TerroristOrganization MyCOI taxonomy ForeignTerroristOrganization equals UrCOI taxonomy Group TerroristGroup AlQaida equals al-qaeda Producer Consumer <ddms> : View View <Subject> /MyCOI.owl#AlQaida</Subject> </ddms> 10 UNCLASSIFIED 10

11 DoD Core Taxonomy v0.75c UNCLASSIFIED 11

12 UCore v2.0 Default Taxonomy UNCLASSIFIED 12

13 FEA-BRM as OWL-encoded Taxonomy UNCLASSIFIED 13

14 Taxonomies for Discovery UNCLASSIFIED 14

15 Example DDMS metacard References to controlled vocabularies More info UNCLASSIFIED 15

16 Ontology Spectrum: One View DB Schemas, XML Schema Conceptual Model RDF/S XTM Extended ER Thesaurus ER Modal Logic First Order Logic Logical Theory Description Logic DAML+OIL, OWL UML Is Subclass of Has Narrower Meaning Than strong semantics Is Disjoint Subclass of with transitivity property Semantic Interoperability Structural Interoperability Taxonomy Relational Model, XML Is Sub-Classification of Syntactic Interoperability weak semantics Copyright 2007, The MITRE Corporation, Leo Obrst 16

17 DoD Metadata Registry (MDR) Purpose Provide an on-line repository which enables developers to reuse, understand, integrate with, and share existing data assets (metadata) Targeting web services, databases, and vocabularies Mandated for the publishing of semantic and structural metadata DOD Directive Provides a portal for developer access and web services for machine-to-machine access Key Facts Over 8,000 users and 180,000 assets registered Over 900 Programs of Record supported Serving the DoD, DHS, IC, NASA and NATO Hosted on NIPR, SIPR, and JWICS (in progress) User driven via DoD Metadata Working Group and Feedback links Implements the ebxml standard for Metadata Registries (in DISR) User Name/Password or Single Sign-On through DKO Governance structure provided by Joint Enterprise Services ERB Primary Benefits Enables reuse and governance of data assets Foundation for other services; e.g. mediation Allows the COI data assets to exist after the COI disbands Primary Audience DoD Capability Developers, COIs UNCLASSIFIED 17

18 DoD MDR v7.0 Public areas UNCLASSIFIED 18

19 MDR Support for Mediation tacrep.xml schemalocation=.../tacrep.xsd ebxml Registry Query service tacrep.xsd (schema) HasXSLT tacrep-2-kml.xsl (stylesheet) tacrep.kml notional MDR Organizes Components for Mediation 19 Leverage Registered Components & Associations UNCLASSIFIED 19

20 MDR Governance Namespaces Distributed Configuration Management 7 Super Namespaces UNCLASSIFIED 20

21 MDR Users Developers Re-use and subscribe to registered data components, and/or register new ones they have created Community of Interest (COI) Metadata Governors Configuration Manage (CM) registered component (e.g., posting new metadata versions, version change notification etc.) Acquisition Policy Makers Use Metadata Registry metrics for acquisition oversight (e.g., reflecting program participation, specific data component reuse etc.) Applications Interface with registered components via Metadata Registry Web Service (ebxml) to exploit reference tables, transformations, and XML schemas at Run Time UNCLASSIFIED 21

22 Instances on 2 security enclaves Unclassified and Secret Users 10,360 Information Resources Submission Package 1,294 Schemas (e.g., DTD, XSD, etc) 5,036 Translations (i.e., XSL, XSLT) 181 MDR Size and Scope Services (i.e., WSDL) 567 XML samples 251 Taxonomies (i.e., OWL) 178 Reference Data Sets 5,709 Amplifying Documents (e.g., DOC, ER1, etc) 5,334 Unclassified MDR Inventory as of 24 Nov Programs of Record, 700 Organizations UNCLASSIFIED 22

23 DoD MDR History COE XML Registry v1.0 DoD Metadata Registry DoD XML Registration Memo MDR on SIPR v2.1 v3.1 v4.1 MDR Implements ebxml RIM & RS v5.0 v6.1 v More info UNCLASSIFIED 23

24 Net-Centric Publisher Service WSDL DDMS XSD Endpoint Simplifies Metadata Publishing UNCLASSIFIED 24

25 Inter-Registry Object References Framework for Registry Interoperability Federated Queries Enterprise Search Aggregator Service MDR Architecture Products Centralized Authority w/local Caching UDDI (U) MDR Unclassified MDR fully automated push Object Relocation MDR DDMS-based Query Service More attention needed (S) (U) MDR Secret Online Package Registration (TS) (S) (U) MDR Top Secret USTRANSCOM USMTF UNCLASSIFIED Adapted from OASIS Cooperating Registries 25

26 UNCLASSIFIED UNCLASSIFIED UNCLASSIFIED 26

27 PEO GES Data Services Office Mission Provide tools, techniques, and performance standards to enable the DoD Data Strategy Support DISA DoD Data Strategy compliance effort Products & Services Chair DoD Metadata Working Group Provide NCES Metadata Services support Oversee operation of the DoD Metadata Registry Develop and promote Data Strategy Enablers for Communities of Interest (COIs) Provide Data Strategy input to NCES Acquisition Milestone Documents Support NCES Product Branch, Testing & Evaluation, Operations, Sustainment, and NetOps activities Support DISA CIO in extending the Enterprise Information Environment (EIE) technical procedures and standards for DISA internal systems Additional questions, please use the Comments and Feedback link at UNCLASSIFIED 27

28 Advanced Search UNCLASSIFIED 28

29 Search Results ratings Add to Briefcase UNCLASSIFIED 29

30 Information Resource Details User-defined URLs UNCLASSIFIED 30

31 Navigate through Relationships UNCLASSIFIED 31

32 Practical Utility for Taxonomies Applicable for Content Services Structural Metadata Event Physical Area DoD Core Taxonomy Location Guidance Geographical Area Territorial Subdivision Geopolitical Organization Physical Community Country Country.sql ISO.xsd FIPS.xsd Aid precision search via DoD Discovery Metadata Specification (DDMS) <ddms> : <Subject> /DoDCore#Terrorist_Event</Subject> </ddms> UNCLASSIFIED 32

33 Federated Search Use Case Capabilities: DS Enterprise Services DECC Columbus External Applications, Services, and Data Sources Users Data Source NCES Enterprise Services Management FS NCES Security Service User Authorized by NCES Security Services Community of Interest DS FS NCES Service Discovery Fed Search Aggregator discovers data sources from Service Discovery COI, POR, C/S/A Data Sources populated from applications, databases, web content, etc. DS FS DS FS Aggregated results returned Results viewed by user FS FS NCES Fed Search Aggregator User Submits Search Query Program of Record DS DS FS FS Query is federated and results returned. DS DS FS EC NCES Enterprise Catalog User Logs DS into DOL (Web Enabled) Portal, DKO, or COI Application EC FS DECC Columbus & San Antonio Interfaces: Enterprise Catalog Federated Search For immediate discoverability users may post metadata to the Enterprise Catalog Enterprise Web Content is crawled and indexed DS (Web Enabled) Federated Search enables information sharing within and between PORs and UNCLASSIFIED COIs 33

34 Attribute-Based Access Control Releasability Rules classification="ts" ownerproducer="usa GBR" SCIcontrols="SI TK" FGIsourceProtected="ISR" disseminationcontrols="oc REL PR" releasableto="usa AUS CAN GBR" declassdate=" " derivedfrom="source Document" Notional Example Security Clearance: S Citizenship: US Rank: Major AOR: AF UNCLASSIFIED 34

35 Metadata Supports NCDS Goals book index card Analogy = Information Resource Structural & Semantic Resource Topical Assertions Title: ~~~~~~~~~~ Description: ~~~~ ~~~ ~~~ Author: ~~~ ~~ ~~~~~~ Subject: ~~~ ~~~ ~~~~ template, dictionary, thesaurus = = Resource Metadata Structural & Semantic Metadata Visible Accessible Understandable Trusted Interoperable Responsive UNCLASSIFIED 35

36 Useful Links DoD CIO Data Strategy Homepage DoD Metadata Registry DoD Discovery Metadata Specification NCES Techguide NCES Developer Community COI Toolkit Intellipedia UNCLASSIFIED 36