SCRREEN & the RMIS 2.0

Transcription

1 & the RMIS 2.0 Raw Materials Week Annual Critical Raw Material Event Daniel Cassard - BRGM 07 November 2017, Brussels

2 knowledge management manages both structured data (from database) and unstructured data (reports, stats, images ). is developing a CRM Knowledge Data Platform, the EU-CRMKDP. This is the DATA/DOCUMENT MANAGEMENT SYSTEM or DMS. This CRMKDP is connected to the MICA Expert System. This is the DECISION SUPPORT SYSTEM or DSS. builds on former and ongoing projects, taking advantage on the developments made in Minerals4EU, EURare, ProSUM and MICA, and implementing new techniques like Data Augmentation.

3 WP9: Knowledge Management The DMS: data / documents management system What is a distributed architecture? Pros & cons How to feed the Knowledge Base? How to retrieve information?

4 New knowledge produced by partners from other work packages General simplified architecture of the EU-CRMKDP Pertinent available layers from geological surveys and EU projects and other institutions (e.g., geographic, geological, geophysical, geochemical maps) Layers A system fully INSPIRE compliant, based on INSPIRE v.3 and ERML v.2. A Central Database to minimize the drawbacks of the distributed architecture: improves the performance, reduces the risk in case of server crash Based on OGC/ INSPIRE Implementing Rules for and Data X Y Structured data provided by geological surveys Information Factory data filtering, advanced search, statistics computing, report generation XX YY Non-, semi- & structured / standardized information related to MR & wastes: knowledge extraction, indexation Documents & Metadata Other agencies, institutes, professional associations, able to provide structured data REE Info MR Info A distributed architecture a sustainable system always kept up to date. Management of: - non-structured data, always accompanied by their metadata; - structured data.

5 EU-CRMKDP detailed architecture Based on a «production-diffusion schema» A professional architecture: A Central Harvesting Database synchronized with a Central Diffusion Database. The first one controls data quality and the second one is optimized for diffusion. Synchronization is made using SQL scripts. DB SYNCHRONIZATION Harvesting DB (+ quality control) MICKA Catalog (CS/W) (WMS/WFS) Diffusion DB (+ diffusion optimizations) (Stats, auto report, filtering ) Indexation (Search engine) EU level Country level Harvesting mechanism (ETL process) Deegree 3 INFORMATION FACTORY Documents & Metadata Project DB National DB National DB Standardized data models (INSPIRE MR, ERML) Mapping (ETL process and code lists) Provider DB Provider DB Provider DB Provider s own format

6 The dedicated application for feeding the Knowledge Base and retrieving information (1/5) A dedicated application to upload (or link) documents and their metadata (Dublin Core format 15 mandatory fields)

7

8 The dedicated application for feeding the Knowledge Base and retrieving information (3/5) The Data Search capabality allows searching like in Google (full text), using specific fields, geographycally (drawing a polygon), and also in structured data (Ore deposit database currently under development)

9 The dedicated application for feeding the Knowledge Base and retrieving information (4/5) Retrieve documents, see related metadata and get the document

10 The dedicated application for feeding the Knowledge Base and retrieving information (5/5) Get the info related to a deposit directly from the viewer

11 The DSS: decision support system Will use and improve the H2020 MICA ontology-based Dynamic Decision Graph (DDG). An ontology allows specifying in a formal language (machine understandable) the concepts of a domain of interest and their relationships. The DDG allows the end user to search for the most appropriate method(s) and tool(s) to use for resolving his problem. The first functionality of the DDG is not to be a pure search engine. However, data, information and knowledge being strongly and cleverly connected, the DDG and its side applications can play the role of an intelligent search engine in the Raw Materials domain, and also act as a powerful decisionaid tool.

12 RMICP Architecture MICASheetEditor RDF (Resource Description Framework) is a standard model for data interchange on the. RDF has features that facilitate data merging even if the underlying schemas differ. The MICA Main Ontology actually covers 7 thematic domains: Primary and Secondary Mineral Resources, Industrial Processing and Transformation, Raw Materials economics (including CRMs), Raw materials Policy & Legal Framework, Sustainability of Raw Materials and International Reporting, representing about 300 concepts and sub-concepts. A triplestore or RDF store is a purpose-built database for the storage and retrieval of triples through semantic queries. A triple is a data entity composed of subject-predicateobject, like "Bob is 35" or "Bob knows Fred".

13 The Dynamic Decision Graph

14 IKMS Portal EU-MKDP Portal EU-UMKDP Portal EU-CRMKDP Portal Filter r Filter r Filter r Filter r Applications e-minerals Yearbook e-prosum Stat Module e- applications MICKA Catalog (CS/W) (Search engine) The MICA Expert System Methods & Tools descriptions (WMS/WFS) (Stats, auto report, filtering ) Knowledge bases EURare Minerals4EU DB synchronization (SQL scripts) Diffusion DB (+ diffusion optimization) Indexation Minerals4EU Harvesting DB (+ quality control) Harvesting National DB National DB National DB National Provider National Provider National Provider ProSUM Harvesting DB (+ quality control) - REE - Continental primary and secondary resources - Continental resources at depth - Marine/offshore resources - CRM Standardized data models (INSPIRE MR, ERML) Mapping (ETL process and code lists) European provider (e.g., Eurostat) HARVESTING FTP Portrayal Direct extraction Portrayal ProSUM unified data model Scattered data ProSUM Urban mine: - WEEE - ELV - Spent batteries Documents & Metadata Toward the EURMKB: A unified vision of Knowledge Management

15 Toward end users RMIS 2.0 SELECTED ROLES & TASKS Connected to the MICA Expert System Roles Tasks PRESERVE & SERVE Create a JRC RMIS Safeguard DB MAKE MORE VISIBLE EXISTING APPS Build a thematic interface for end users HELP END USERS DISCOVERING DATA & KNOWLEDGE SEARCH capability MSA CRM PROVIDE END USERS WITH KEY INDICATORS TRADE SCOREBOARD ORGANIZE NEW KNOWLEDGE PUSH STANDARDS interface JRC RMIS Working DB Spatial portal Applications EURMKB Data & Knowledge JRC RMIS Safeguard DB D Ancient projects (FP5, 6, 7) APPs e-min. Yearbook Maps e-stats D K SEARCH PORTRAYAL APPs APPs API Download Recent/current /forthcoming projects, incl. Eurostat D K WEB SERVICES USGS BGS TNO EGS EEA OECD ESTAT External providers

16 I m a satisfied End User Can also directly call a dedicated system Ask a question Search for an information Answer with a smart response Urban mine Deposit & wastes Answer retrieved from the dedicated system A Q Q Q Q Q CRM REE RMIS Thematic interface Query dispatched to the dedicated system Q Expert system Other? EU-MKDP IKMS EU-UMKDP EU-CRMKDP EU-RMICP OTHER ORAMA recommendations ( SC5-15c-2017) GeoERA ProMine NGS Other possible databases Eurostat?? EuroGeo 07 Source November 2017, NGS? Brussels NGS

17 ORAMA DATASETS OPTIMISATION. Continental geology. Marine geology. Mineral resources. Geophysics The European Geological Data Infrastructure and the RMIS 2.0 Common governance Common architecture Based on standards Harmonised datasets Optimized for diffusion Extending the EGDI WMS, WFS RMIS 2.0 Other projects RMIS 2.0 Thematic Interface Other datasets NGS NGSNGS Other databases

18 Thank you for your attention! Contact: Coordinator: