Energy Industry Profile An Update from the Metadata Work Group

Transcription

1 Energy Industry Profile An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas

2 Metadata Work Group Outline Metadata Initiative Background / EIP Overview 2012 Release of EIP V1.0 EIP Roadmap Energistics Geoportal Demonstration Esri Software Customizations to Support EIP V1.0 2

3 Background: Business Driver & Goal State Business Driver 40% of staff time devoted to finding, retrieving, and verifying information, while data volume is growing at 60-80%/yr and need for integrating distributed, diverse resources is increasing Goal State: Realize metadata standards and guidelines which enable stakeholders in the energy industry ( the community ) to effectively and efficiently discover, evaluate, and retrieve structured and unstructured information resources. Support both proprietary data management needs, and exchange of data between and within organizations. Leverage existing open standards to encourage adoption within the community and integration into the business, and exploit existing organizational resources needed for governance and long-term maintenance. 3

4 Background: Scope Facets 1. Application usage: Discovery, evaluation and retrieval of information resources distributed across the community 2. User community: Anyone cataloging, searching, evaluating or accessing information with value to members of the energy industry: Energy companies & consortia Data & Information providers Software vendors Government agencies & Academia 3. Resource types: Initial focus on structured and unstructured information resources which have associated spatial coordinates: Geospatial data sets & web services Mapping, Interpretation & Modeling project data sets Physical resources with associated location 4

5 Background: Vision for Industry Metadata Exchange & Use External Metadata Catalog Externally Harvested (Commercial,Gov t, & Academic) Application Managed EIP-compliant Catalog Partner & Subscription Delivered Legend : Metadata exchange via EIP standard Structured resources Internally Harvested Unstructured resources 5

6 Initiative Participants Steering Team Active Participants (SMEs) Dave Danko, ESRI Lisa Derenthal, Gimmal Alan Doniger, ACD Consulting Solutions 1 Scott Hills, Chevron 1 Hari Koduru, Energistics Steve Richard, USGIN, AZ Geol Survey 1 Energistics Asset/Data Management SIG Metadata Work Group AAPG Apache Boise State Univ. Carbon Lifecycle Technology ConocoPhillips DCP Midstream Deloitte Services LP Devon Energy ETL Solutions Exprodat ExxonMobil 1 First American Spatial Solutions Flare Solutions Fugro Robertson Geoscience Australia Geosoft Ies Brazil Consulting & Services 1 IHS Energy Maersk Oil 1 New Century Software North West Geomatics Oracle 1 ORNL P2 Energy Solutions PEMEX PennWell PetroWEB Pioneer Natural Resources 1 PPDM 1 Priemere Consulting Group SAS Global Oil & Gas Schlumberger 1 Shell 1 Univ. of Auckland, NZ Virginia Dept of MM&E Wood Mackenzie 1 Energistics member; Bold: Contributed initial EIP requirements, Feedback about v1.0 Release Candidate 6

7 Key External Engagements USGIN Project Joint project of U.S. Geological Survey and all 51 U.S. State Geological Surveys Steve Richard (AZ State Geol. Survey) on Work Group Steering Team, contributing significant technical input ISO/TC 211, Revision Project Energistics granted Class A Liaison status to ISO TC 211 Metadata Work Group on ISO Revision Project Team & Editing Committee Contributed several enhancements to ISO/DIS important to the Energy Industry Metadata Initiative vision ISO/TC 211, XML Encoding Project Energistics submitted New Work Item Proposal for XML encoding of ISO Invited Dr. Ted Habermann (NOAA) to fill Team Lead role Steve Richard representing Metadata Work Group on Project Team NOAA/National Geophysical Data Center Accepted key role in proposed EIP Prototype Project 7

8 EIP builds on established ISO standard Our approach leverages existing standards - ISO metadata standard for geographic information internationally accepted Existing profiles: North American Profile (NAP) European INSPIRE guidelines ANZLIC - Australia, New Zealand USGIN profile AASG/USGS Use same approach to deliver a Energy Industry Profile built on these 8

9 Overview of EIP Specification Leverage existing standards ISO (content model) and ISO (XML encoding) Existing profiles of ISO ANZLIC Profile (Australia, New Zealand) European Union INSPIRE guidelines USGIN Profile to Deliver Energy Industry Profile of ISO/DIS and ISO v1.0 ISO Conformance Level 1 Profile designed to enable community interoperability 125 pp. Specification Document includes: Normative Specifications Implementation Guidelines Selected XML Encoding Examples 9

10 EIP Design Basis Anticipating need for automated processing of large numbers of metadata records, - and to simplify development, implementation, and maintenance of supporting software EIP v1.0 identifies Three Classes of Information Resources, and decomposes them into Five Groups of Metadata Elements maps different combinations of Metadata Element Groups to MD_Scope codelist values, and thus the metadata config n - e.g., dataset value identifies a Geolocated Digital Product 10

11 Key Metadata Packages Portrayal Catalogue Constraint Content Citation & Responsible Party Distribution Maintenance Application Schema Metadata Entity Metadata Extension Data Quality Identification Reference System Key packages are highlighted Spatial Representation Units of Measure Extent Lines between packages are uses dependencies 11

12 EIP Roadmap EIP v1.0 Release Candidate Development Updates: ESRI UC PUG AGU OGC TC Mtg ISO Revision Drafts (WD0, WD1, CD, DIS) EIP v1.0 Release Candidate Stakeholder Webinars Community Review ISO/DIS Release ISO XML Encoding TS Initial Workable XML Encoding EIP v1.0 EIP Prototype EIP v1.1 Pilots 12

13 Recap: Vision for Industry Metadata Exchange & Use External Metadata Catalog Externally Harvested (Commercial,Gov t, & Academic) Application Managed EIP-compliant Catalog Partner & Subscription Delivered Legend : Metadata exchange via EIP standard Structured resources Internally Harvested Unstructured resources 13

14 EIP Prototype Project Search External Metadata Catalog Externally Harvested (Commercial, Gov t, & Academic) Service Interface EIP-compliant Catalog Harvesting Editing Project Focus 14

15 EIP Prototype Project Objectives Implement an Energistics-managed, EIP-compliant Catalog & Search System Based on Esri Geoportal Server Establish a Network of 3-4 Systems Demonstrating Discovery of Distributed Resources Contributors Energistics USGIN NOAA USGS Esri U. of Colorado/CIRES 15

16 EIP Prototype Project Deliverables Minimum 1. EIP-compliant Geoportal installation 2. XSLTs for harvesting FGDC, ISO 19115:2003 metadata 3. Compliance validation utility (Schematron) 4. Vocabulary web service for code lists 5. EIP-compliant metadata editor 6. Documented changes needed to EIP v Community workshops and webinars Optional (subject to Sponsor support) or Phase 2 Outline of design for non-geoportal implementations.net assembly for developers Tutorial documentation 16

17 EIP Geoportal - Search Feature Out of the box features, no customization

18 EIP Geoportal Metadata Details View

19 EIP Geoportal Metadata Details View (2) Task: update presentation of full metadata record Key content at the top of the listing: Title Abstract Access constraints Distribution

20 EIP Geoportal - Setup Harvest

21 EIP Geoportal - Creating Records Create records through UI Upload from files (single records) Harvest from network WAF CSW.

22 EIP Geoportal - Editor Configuration Can configure for various metadata profiles Task: Add EIP ISO profile to list Dataset Service Physical resource

23 EIP Geoportal - Editor Features Tabs for metadata sections Automatically calculated values Default values Pick lists

24 EIP Geoportal - Harvest from Variety of Sources Metadata has to be in known format EIP geoportal will harvest ISO19115 and FGDC XML

25 Geoportal - Catalog Service (CSW) Geoportal windows we ve been looking at are the canned, out of the box interface Important function of catalog is the service interface Allows queries from other clients using a variety of protocols (opensearch, OGC CSW, ESRI REST) Responses in various formats (csw:record, EIP ISO, atom ) Opportunity for others to build search interfaces Records in catalog may be harvested

26 Geoportal Output Formats Other output formats available via ESRI REST API

27 Geoportal - Atom Response in Web Browser

28 CSW request, XML response

29 Custom Search Client using CSW

30 Search from USGS National Map

31 EIP Prototype Contributors University of Colorado Role XSLT for FGDC to EIP ISO XSLT for ISO(2006) to EIP ISO Schematron rules for validation Esri Role ESRI Product Support for EIP Prototype Tasks 31

32 EIP Prototype Project Esri Custom Tools Esri Geoportal Server Identify, validate, and create EIP v1.0 metadata Implement U. of Colorado/CIRES Metadata Transform Capabilities Geoportal transforms ISO 19115/FGDC metadata to EIP v1.0 Search Prototype Project catalogs from ArcMap Use ArcCatalog 10 to view, create, and export EIP v1.0 metadata Assist Energistics making tools publically available 32

33 EIP Prototype Project Community Workshops and Tech Transfer Geoportal Technology Transfer to Energistics First Energy Community Workshop Second Energy Community Workshop Follow-on Training Webcast XML 33

34 34 EIP Prototype Project Online EIP v1.0 Geoportal Metadata Editor

35 EIP Prototype Prototype Transform existing metadata to EIP v1.0 & publish Transform ISO/FGDC Becomes EIP v1.0 Validate Transformed metadata validated against EIP v1.0 rules Passes or Fails validation Publish Valid, approved EIP 1.0 MD is published Invalid is saved as Draft 35

36 36 EIP Prototype Project Search Project Catalogs from ArcMap

37 37 Use ArcCatalog to view, create, & export EIP v1.0 metadata

38 Thank you Questions? 38