Putting the Archives to Work: Workflow and Metadata-driven Analysis in LTER Science

Size: px
Start display at page:

Download "Putting the Archives to Work: Workflow and Metadata-driven Analysis in LTER Science"

Transcription

1 Putting the Archives to Work: Workflow and Metadata-driven Analysis in LTER Science Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia Acknowledgements: John Porter (Virginia Coast Reserve LTER) Duane Costa (LTER Network Office) Corinna Gries (North Temperate Lakes LTER) Inigo San Gil (LTER Network Office, McMurdo Dry Valleys LTER)

2 Background Ecological science in the LTER Network is a dataintensive effort covering vast temporal and spatial scales The practice of Informatics is critical for Managing LTER data for analysis Curating LTER data for accuracy and accessibility Archiving LTER data for interpretation and use by future scientists LTER sites have adopted many informatics standards and practices to meet these goals, including EML metadata and PASTA LTER EML implementation targets data integration, not just resource description

3 EML Metadata in LTER Integration-level EML is comprehensive Data discovery metadata Title, abstract, keywords, personnel Research context metadata Study description, methods, protocols, project description Data set coverage metadata Temporal, spatial, taxonomic Physical metadata for entities (e.g. tables) File format, delimiters, terminators, header format Download URL Attribute metadata Data types, names, descriptions, units, codes, Q/C limits Supports software-mediated discovery, download, parsing of entities and integration with other data

4 EML Generation LTER sites have developed many approaches for generating EML from site catalogs Morpho editor XML editors (oxygen, XML Spy) Custom application frameworks/databases Two software systems are emerging as community tools used at multiple sites and outside LTER Metabase Metadata Management System (Metabase) Drupal Ecological Information Management System (DEIMS)

5 Metabase MMS Generalized RDBMS for managing environmental metadata (GCE 2002) Personnel Site geography (study area polygons, point locations) Instrumentation Research Projects Data sets (studies, methods, entities, attributes, files) Linked to Bibliographic and Taxonomic DBs Supports automatic cross-links between people/research/pubs and data RESTful web services for mapping, personnel, data set descriptions Automated metadata generation for data sets, cross-links between all related information Used by GCE, CWT, MCR, SBC, SREL (HBR adopting)

6 DEIMS IMS built on the popular Drupal CMS framework (LNO 2010) A Drupal installation profile for storing, editing, and sharing data and information about biological and ecological research Provides user-friendly forms to describe all contextual information about your data Produces EML metadata to register data with metadata clearinghouses (LTER PASTA, ORNL-DAAC, KNB) Allows you to query external databases using the Data Explorer feature Used by MCM, SEV, JRN, LUQ, U. Michigan Biological Station and others (

7 Metadata-driven Analysis PASTA has simplified using EML-described data for metadata-driven analysis and workflows Unified repository for LTER data Quality checks ensure data-metadata conformity API for versioned metadata, data retrieval Trigger mechanism for running workflows on changes Variety of workflow tools in use Kepler R, SAS, SPSS statistical software MATLAB technical computing software GCE Data Toolbox (MATLAB-based framework) Web services (VCR) enabled on LTER Data Portal for generating data loaders for R, SAS, SPSS, MATLAB PASTA/EML support included in GCE Data Toolbox for interactive and programmatic data mining and workflows

8 Kepler Kepler supports data downloading via REST URLs EML metadata actor loads entities, configures ports for attributes Demo workflows for downloading PASTA data, ClimDB export Demo:

9 R, SAS, SPSS and MATLAB EML transformed via XSLT to generate native data acquisition programs for target platform (documented source code) Based on R stat program generator from TERN (I-LTER) Programs download compatible entities, load data into appropriate structures from within analysis environment Attribution and research origin metadata included as code comments (R, SAS, SPSS) or in data structure itself (MATLAB) Flexible can be run locally or via RESTful web services Many benefits to users: EML, source code and entities (e.g. CSV files) can be saved, re-used User can debug code using native IDE if incompatible data features Generated code can be modified and extended as part of a custom workflow Leverages tools researchers use every day!

10 R, SAS, SPSS, MATLAB

11 R, SAS, SPSS, MATLAB

12 R, SAS, SPSS, MATLAB Running code downloads files, loads data

13 LTER Data Portal Web Services Links to code generator services on summary page for every LTER data set in PASTA

14 LTER Data Portal Web Services Provides code (copy/paste or download) and instructions

15 GCE Data Toolbox MATLAB framework for metadata-based processing, quality control and analysis of environmental data (see ESIP poster) Imports EML-described data from local file system, PASTA, KNB, site catalogs,... Leverages generic EML-to-MATLAB XSLT Complete metadata imported along with entities into data model Supports authentication, entity selection (GUI or workflow)

16 GCE Data Toolbox Wide range of data visualization, transformation, integration tools for developing workflows Derived data contain complete metadata, QA/QC information, processing history Export results to text files, MATLAB arrays, RDBMS, CUAHSI ODM, KML, HTML EML and text files can be uploaded to PASTA Open source software library for MATLAB:

17 GCE Data Toolbox

18 Conclusion Currently just scratching the surface of what EML and PASTA can do Vision of machine-readable data and metadataenabled analysis and integration now a reality Use cases and collaborations inside and outside LTER welcome

Generating EML from a Relational Database Management System (RDBMS)

Generating EML from a Relational Database Management System (RDBMS) Page 13 of 34 Generating EML from a Relational Database Management System (RDBMS) - Zhiqiang Yang and Don Henshaw (AND) The Ecological Metadata Language (EML) is an open metadata specification and provides

More information

Wade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia CUAHSI Virtual Workshop Field Data Management Solutions

Wade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia   CUAHSI Virtual Workshop Field Data Management Solutions Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia email: sheldon@uga.edu CUAHSI Virtual Workshop Field Data Management Solutions 01-Oct-2014 Georgia Coastal Ecosystems LTER started in

More information

Georgia Coastal Ecosystems LTER Information Management

Georgia Coastal Ecosystems LTER Information Management Georgia Coastal Ecosystems LTER Information Management Wade Sheldon, Information Manager Adam Sapp, Assistant Information Manager University of Georgia Athens, Georgia GCE IM Overview Information Management

More information

GCE Data Toolbox for MATLAB An Introduction. Wade Sheldon Georgia Coastal Ecosystems LTER

GCE Data Toolbox for MATLAB An Introduction. Wade Sheldon Georgia Coastal Ecosystems LTER GCE Data Toolbox for MATLAB An Introduction Wade Sheldon Georgia Coastal Ecosystems LTER Background & Motivation Georgia Coastal Ecosystems LTER project started in May 2000 Major data collection effort

More information

Wade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia

Wade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia email: sheldon@uga.edu Regardless of Q/A procedures, data quality issues guaranteed with environmental sensor data Without good Q/C data

More information

Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data

Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia Introduction Quality Control of high volume, real-time data from

More information

Florida Coastal Everglades LTER Program

Florida Coastal Everglades LTER Program Florida Coastal Everglades LTER Program Metadata Workshop April 13, 2007 Linda Powell, FCE Information Manager Workshop Objectives I. Short Introduction to the FCE Metadata Policy What needs to be submitted

More information

Report to the IMC EML Data Package Checks and the PASTA Quality Engine July 2012

Report to the IMC EML Data Package Checks and the PASTA Quality Engine July 2012 Report to the IMC EML Data Package Checks and the PASTA Quality Engine July 2012 IMC EML Metrics and Congruency Checker Working Group Sven Bohm (KBS), Emery Boose (HFR), Duane Costa (LNO), Jason Downing

More information

International Multidisciplinary Metadata Workshop 18 January Rebecca Koskela Arctic Region Supercomputing Center

International Multidisciplinary Metadata Workshop 18 January Rebecca Koskela Arctic Region Supercomputing Center Metadata: A Means to Manage Ecological Data International Multidisciplinary Metadata Workshop 18 January 2007 Rebecca Koskela Arctic Region Supercomputing Center Why Should You Create Metadata? Data Entropy

More information

Managing Ecological and Biodiversity Data Using Ecoinformatics: Taiwan Experience. Chau Chin Lin Taiwan Forestry Research Institute

Managing Ecological and Biodiversity Data Using Ecoinformatics: Taiwan Experience. Chau Chin Lin Taiwan Forestry Research Institute Managing Ecological and Biodiversity Data Using Ecoinformatics: Taiwan Experience Chau Chin Lin Taiwan Forestry Research Institute Persons to Thank First for The Following Presentation Dr. Hen-biau King

More information

Using XML-encoded Metadata as a Basis for Advanced Information Systems for Ecological Research

Using XML-encoded Metadata as a Basis for Advanced Information Systems for Ecological Research Using XML-encoded Metadata as a Basis for Advanced Information Systems for Ecological Research Peter H. MCCARTNEY Center for Environmental Studies Arizona State University Tempe, AZ 85282, USA And Matthew

More information

THE VOEIS HIS GATEWAY. A REST Interface for HydroServer using ODM 1.1

THE VOEIS HIS GATEWAY. A REST Interface for HydroServer using ODM 1.1 THE VOEIS HIS GATEWAY A REST Interface for HydroServer using ODM 1.1 WHO AM I? Pol Llovet Research Software Engineer Research Computing Group Montana State University HIS IS ESSENTIAL Data publishing Data

More information

Site# Date H20 Temperature Conductance Turbidity KRS Sep KRS Aug KRS Aug

Site# Date H20 Temperature Conductance Turbidity KRS Sep KRS Aug KRS Aug ID ASR_Number Sample_Number QC_Code Analysis_Request_No External_Sample_Number Start_Date 1 1383 892 1 08-Aug-2002 2 1383 902 1 08-Aug-2002 3 1383 912 1 08-Aug-2002 Site# Date H20 Temperature Conductance

More information

2006 LNO Annual Report to the Executive Board

2006 LNO Annual Report to the Executive Board University of New Mexico UNM Digital Repository Long Term Ecological Research - Reports Long Term Ecological Research (LTER) 5-23-2014 2006 LNO Annual Report to the Executive Board Long Term Ecological

More information

A COASTAL WATER QUALITY METADATA DATABASE FOR THE SOUTHEAST U.S.A.

A COASTAL WATER QUALITY METADATA DATABASE FOR THE SOUTHEAST U.S.A. A COASTAL WATER QUALITY METADATA DATABASE FOR THE SOUTHEAST U.S.A. Wade M. Sheldon, Christine Laporte, Travis Douce, and Merryl Alber 4 AUTHORS: Department of Marine Sciences, University of Georgia, Athens,

More information

Annotation in EML 2.2. knb. EML Dev Committee 2018

Annotation in EML 2.2. knb. EML Dev Committee 2018 Annotation in EML 2.2 knb EML Dev Committee 2018 EML 2.2 New Features Backward compatible EML you create now (2.1, 2.0) is fine as is or re-label as EML 2.2 EML 2.2 New Features Choice of TextType or markdown

More information

When using this architecture for accessing distributed services, however, query broker and/or caches are recommendable for performance reasons.

When using this architecture for accessing distributed services, however, query broker and/or caches are recommendable for performance reasons. Integration of semantics, data and geospatial information for LTER Abstract The long term ecological monitoring and research network (LTER) in Europe[1] provides a vast amount of data with regard to drivers

More information

Network Information System. NESCent Dryad Subcontract (Year 1) Metacat OAI-PMH Project Plan 25 February Mark Servilla

Network Information System. NESCent Dryad Subcontract (Year 1) Metacat OAI-PMH Project Plan 25 February Mark Servilla Network Information System NESCent Dryad Subcontract (Year 1) Metacat OAI-PMH Project Plan 25 February 2009 Mark Servilla servilla@lternet.edu LTER Network Office Department of Biology, MSC03 2020 1 University

More information

Title: Interactive data entry and validation tool: A collaboration between librarians and researchers

Title: Interactive data entry and validation tool: A collaboration between librarians and researchers Proposed venue: Library Hi Tech News Title: Interactive data entry and validation tool: A collaboration between librarians and researchers Author: Abstract Purpose To share a case study process of collaboration

More information

DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences

DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences DataONE Enabling Cyberinfrastructure for the Biological, Environmental and Earth Sciences William K. Michener 1,2, Rebecca Koskela 1,2, Matthew B. Jones 2,3, Robert B. Cook 2,4, Mike Frame 2,5, Bruce Wilson

More information

A USER S GUIDE TO REGISTERING AND MAINTAINING DATA SERVICES IN HIS CENTRAL 2.0

A USER S GUIDE TO REGISTERING AND MAINTAINING DATA SERVICES IN HIS CENTRAL 2.0 A USER S GUIDE TO REGISTERING AND MAINTAINING DATA SERVICES IN HIS CENTRAL 2.0 Prepared by Jon Pollak, CUAHSI Water Data Center User Support Specialist September 2014 1 DISCLAIMERS The HIS Central application

More information

Curation module in action - its preliminary findings on VLO metadata quality

Curation module in action - its preliminary findings on VLO metadata quality Curation module in action - its preliminary findings on VLO metadata quality Davor Ostojić, Go Sugimoto, Matej Ďurčo (Austrian Centre for Digital Humanities) CLARIN Annual Conference 2016, Aix-en-Provence,

More information

West Coast Observation Project. West Coast Observing System Project Brief

West Coast Observation Project. West Coast Observing System Project Brief West Coast Observation Project Click to edit Master text styles Second level Third level Fourth level» Fifth level West Coast Observing System Project Brief Prepared by NCDDC August 2007 1 Outline West

More information

Jeffery S. Horsburgh. Utah Water Research Laboratory Utah State University

Jeffery S. Horsburgh. Utah Water Research Laboratory Utah State University Advancing a Services Oriented Architecture for Sharing Hydrologic Data Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University D.G. Tarboton, D.R. Maidment, I. Zaslavsky, D.P. Ames, J.L.

More information

A Data Management Plan Template for Ecological Restoration and Monitoring

A Data Management Plan Template for Ecological Restoration and Monitoring A Data Management Plan Template for Ecological Restoration and Monitoring Brick M. Fevold Research Scientist Advisor, GDIT Judy Schofield 1, Rob Sutter 1, Craig Palmer 1, Elizabeth Benjamin 1, Molly M.

More information

LifeWatch/EnvEurope User Forum Use Case Ecology

LifeWatch/EnvEurope User Forum Use Case Ecology LifeWatch/EnvEurope User Forum Use Case Ecology User Forum Barcelona, March 2012 Michael Mirtl (EAA, Environment Agency Austria) Wouter Los (LifeWatch) Infrastructure for Biodiversity and Ecosystem Research

More information

The Community Data Portal and the WMO WIS

The Community Data Portal and the WMO WIS he Community Data Portal and the WIS Presented by: Michael Burek Progress, metadata architecture, and collaboration in the future Acknowledgments NCAR - Luca Cinquini, Rob Markel, Nathan Willhelmi, Don

More information

How to use Water Data to Produce Knowledge: Data Sharing with the CUAHSI Water Data Center

How to use Water Data to Produce Knowledge: Data Sharing with the CUAHSI Water Data Center How to use Water Data to Produce Knowledge: Data Sharing with the CUAHSI Water Data Center Jon Pollak The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) August 20,

More information

Data Curation Practices at the Oak Ridge National Laboratory Distributed Active Archive Center

Data Curation Practices at the Oak Ridge National Laboratory Distributed Active Archive Center Data Curation Practices at the Oak Ridge National Laboratory Distributed Active Archive Center Robert Cook, DAAC Scientist Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN cookrb@ornl.gov

More information

Title Vega: A Flexible Data Model for Environmental Time Series Data

Title Vega: A Flexible Data Model for Environmental Time Series Data Title Vega: A Flexible Data Model for Environmental Time Series Data Authors L. A. Winslow 1, B. J. Benson 1, K. E. Chiu 3, P. C. Hanson 1, T. K. Kratz 2 1 Center for Limnology, University of Wisconsin-Madison,

More information

Workflow Exchange and Archival: The KSW File and the Kepler Object Manager. Shawn Bowers (For Chad Berkley & Matt Jones)

Workflow Exchange and Archival: The KSW File and the Kepler Object Manager. Shawn Bowers (For Chad Berkley & Matt Jones) Workflow Exchange and Archival: The KSW File and the Shawn Bowers (For Chad Berkley & Matt Jones) University of California, Davis May, 2005 Outline 1. The 2. Archival and Exchange via KSW Files 3. Object

More information

EMC Documentum xdb. High-performance native XML database optimized for storing and querying large volumes of XML content

EMC Documentum xdb. High-performance native XML database optimized for storing and querying large volumes of XML content DATA SHEET EMC Documentum xdb High-performance native XML database optimized for storing and querying large volumes of XML content The Big Picture Ideal for content-oriented applications like dynamic publishing

More information

From Open Data to Data- Intensive Science through CERIF

From Open Data to Data- Intensive Science through CERIF From Open Data to Data- Intensive Science through CERIF Keith G Jeffery a, Anne Asserson b, Nikos Houssos c, Valerie Brasse d, Brigitte Jörg e a Keith G Jeffery Consultants, Shrivenham, SN6 8AH, U, b University

More information

Interoperability ~ An Introduction

Interoperability ~ An Introduction Interoperability ~ An Introduction Cyndy Chandler Biological and Chemical Oceanography Data Management Office (BCO-DMO) Woods Hole Oceanographic Institution 26 July 2008 MMI OOS Interoperability Planning

More information

A detailed comparison of EasyMorph vs Tableau Prep

A detailed comparison of EasyMorph vs Tableau Prep A detailed comparison of vs We at keep getting asked by our customers and partners: How is positioned versus?. Well, you asked, we answer! Short answer and are similar, but there are two important differences.

More information

Paraben s Network Examiner 7.0 Release Notes

Paraben s Network  Examiner 7.0 Release Notes Paraben s Network E-mail Examiner 7.0 Release Notes 1 Paraben Corporation Welcome to Paraben s Network E-mail Examiner 7.0! Paraben s Network E-mail Examiner-NEMX is an advanced network e-mail archive

More information

Data Entry, and Manipulation. DataONE Community Engagement & Outreach Working Group

Data Entry, and Manipulation. DataONE Community Engagement & Outreach Working Group Data Entry, and Manipulation DataONE Community Engagement & Outreach Working Group Lesson Topics Best Practices for Creating Data Files Data Entry Options Data Integration Best Practices Data Manipulation

More information

12/6/2012. Getting Started with Metadata. Presenter. Making Metadata Work. Overall Topics. Data Collection. Topics

12/6/2012. Getting Started with Metadata. Presenter. Making Metadata Work. Overall Topics. Data Collection. Topics Making Metadata Work Using metadata to document your science Presenter Viv Hutchison US Geological Survey NBII program Metadata Coordinator Location: USGS Western Fisheries Research Center Seattle, WA

More information

Talend Open Studio for MDM Web User Interface. User Guide 5.6.2

Talend Open Studio for MDM Web User Interface. User Guide 5.6.2 Talend Open Studio for MDM Web User Interface User Guide 5.6.2 Talend Open Studio for MDM Web User Interface Adapted for v5.6.2. Supersedes previous releases. Publication date: May 12, 2015 Copyleft This

More information

The key objectives for this session are:

The key objectives for this session are: 4 The key objectives for this session are: Being able to create sets, and manage sets in the event you need to modify an existing set Differentiate between the 2 types of sets that are available in Alma,

More information

Introduction to Geodatabase and Spatial Management in ArcGIS. Craig Gillgrass Esri

Introduction to Geodatabase and Spatial Management in ArcGIS. Craig Gillgrass Esri Introduction to Geodatabase and Spatial Management in ArcGIS Craig Gillgrass Esri Session Path The Geodatabase - What is it? - Why use it? - What types are there? - What can I do with it? Query Layers

More information

Making Metadata Work. Using metadata to document your science. August 1 st, 2010

Making Metadata Work. Using metadata to document your science. August 1 st, 2010 Making Metadata Work Using metadata to document your science August 1 st, 2010 Presenter Viv Hutchison US Geological Survey NBII program Metadata Coordinator Location: USGS Western Fisheries Research Center

More information

A High-Level Distributed Execution Framework for Scientific Workflows

A High-Level Distributed Execution Framework for Scientific Workflows A High-Level Distributed Execution Framework for Scientific Workflows Jianwu Wang 1, Ilkay Altintas 1, Chad Berkley 2, Lucas Gilbert 1, Matthew B. Jones 2 1 San Diego Supercomputer Center, UCSD, U.S.A.

More information

Axon Fixed Limitations... 1 Known Limitations... 3 Informatica Global Customer Support... 5

Axon Fixed Limitations... 1 Known Limitations... 3 Informatica Global Customer Support... 5 Axon Data Governance 5.4 Release Notes September 2018 Copyright Informatica LLC 2015, 2018 Contents Axon 5.4... 1 Fixed Limitations.... 1 Known Limitations.... 3 Informatica Global Customer Support...

More information

Medici for Digital Cultural Heritage Libraries. George Tsouloupas, PhD The LinkSCEEM Project

Medici for Digital Cultural Heritage Libraries. George Tsouloupas, PhD The LinkSCEEM Project Medici for Digital Cultural Heritage Libraries George Tsouloupas, PhD The LinkSCEEM Project Overview of Digital Libraries A Digital Library: "An informal definition of a digital library is a managed collection

More information

DataONE: Open Persistent Access to Earth Observational Data

DataONE: Open Persistent Access to Earth Observational Data Open Persistent Access to al Robert J. Sandusky, UIC University of Illinois at Chicago The Net Partners Update: ONE and the Conservancy December 14, 2009 Outline NSF s Net Program ONE Introduction Motivating

More information

Reproducible & Transparent Computational Science with Galaxy. Jeremy Goecks The Galaxy Team

Reproducible & Transparent Computational Science with Galaxy. Jeremy Goecks The Galaxy Team Reproducible & Transparent Computational Science with Galaxy Jeremy Goecks The Galaxy Team 1 Doing Good Science Previous talks: performing an analysis setting up and scaling Galaxy adding tools libraries

More information

University at Buffalo's NEES Equipment Site. Data Management. Jason P. Hanley IT Services Manager

University at Buffalo's NEES Equipment Site. Data Management. Jason P. Hanley IT Services Manager University at Buffalo's NEES Equipment Site Data Management Jason P. Hanley IT Services Manager Structural Engineering and Earthquake Simulation Laboratory, Department of Civil, Structural and Environmental

More information

Engaging and Connecting Faculty:

Engaging and Connecting Faculty: Engaging and Connecting Faculty: Research Discovery, Access, Re-use, and Archiving Janet McCue and Jon Corson-Rikert Albert R. Mann Library Cornell University CNI Spring 2007 Task Force Meeting April 16,

More information

The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017

The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017 The Portal Aspect of the LSST Science Platform Gregory Dubois-Felsmann Caltech/IPAC LSST2017 August 16, 2017 1 Purpose of the LSST Science Platform (LSP) Enable access to the LSST data products Enable

More information

Dryad Curation Manual, Summer 2009

Dryad Curation Manual, Summer 2009 Sarah Carrier July 30, 2009 Introduction Dryad Curation Manual, Summer 2009 Dryad is being designed as a "catch-all" repository for numerical tables and all other kinds of published data that do not currently

More information

Key cyberinfrastructure elements implemented as RESTful webservices

Key cyberinfrastructure elements implemented as RESTful webservices Key cyberinfrastructure elements implemented as RESTful webservices Investigator Toolkit Web Interface Analysis, Visualization Data Management Client Libraries Java Python Command Line Member Nodes Service

More information

Description of CORE Implementation in Java

Description of CORE Implementation in Java Partner s name: Istat WP number and name: WP6 Implementation library for generic interface and production chain for Java Deliverable number and name: 6.1 Description of Implementation in Java Description

More information

PYRAMID Headline Features. April 2018 Release

PYRAMID Headline Features. April 2018 Release PYRAMID 2018.03 April 2018 Release The April release of Pyramid brings a big list of over 40 new features and functional upgrades, designed to make Pyramid s OS the leading solution for customers wishing

More information

Building a Linked Open Data Knowledge Graph Henning Schoenenberger Michele Pasin. Frankfurt Book Fair 2017 October 11, 2017

Building a Linked Open Data Knowledge Graph Henning Schoenenberger Michele Pasin. Frankfurt Book Fair 2017 October 11, 2017 Building a Linked Open Data Knowledge Graph Henning Schoenenberger Michele Pasin Frankfurt Book Fair 2017 October 11, 2017 1 Springer Nature s Metadata Mission Statement We understand metadata as the gateway

More information

Oliver Engels & Tillmann Eitelberg. Big Data! Big Quality?

Oliver Engels & Tillmann Eitelberg. Big Data! Big Quality? Oliver Engels & Tillmann Eitelberg Big Data! Big Quality? Like to visit Germany? PASS Camp 2017 Main Camp 5.12 7.12.2017 (4.12 Kick Off Evening) Lufthansa Training & Conference Center, Seeheim SQL Konferenz

More information

The Butterfly Effect. A proposal for distribution and management for butterfly data programs. Dave Waetjen SESYNC Butterfly Workshop May 10, 2012

The Butterfly Effect. A proposal for distribution and management for butterfly data programs. Dave Waetjen SESYNC Butterfly Workshop May 10, 2012 The Butterfly Effect A proposal for distribution and management for butterfly data programs Dave Waetjen SESYNC Butterfly Workshop May 10, 2012 http://butterfly.ucdavis.edu Citizen Science based Observation

More information

Long-term preservation for INSPIRE: a metadata framework and geo-portal implementation

Long-term preservation for INSPIRE: a metadata framework and geo-portal implementation Long-term preservation for INSPIRE: a metadata framework and geo-portal implementation INSPIRE 2010, KRAKOW Dr. Arif Shaon, Dr. Andrew Woolf (e-science, Science and Technology Facilities Council, UK) 3

More information

Crossing the Archival Borders

Crossing the Archival Borders IST-Africa 2008 Conference Proceedings Paul Cunningham and Miriam Cunningham (Eds) IIMC International Information Management Corporation, 2008 ISBN: 978-1-905824-07-6 Crossing the Archival Borders Fredrik

More information

Groovy in Jenkins. Ioannis K. Moutsatsos. Repurposing Jenkins for Life Sciences Data Pipelining

Groovy in Jenkins. Ioannis K. Moutsatsos. Repurposing Jenkins for Life Sciences Data Pipelining Groovy in Jenkins Ioannis K. Moutsatsos Repurposing Jenkins for Life Sciences Data Pipelining Who Am I? Research scientist at local pharmaceutical company Software engineer Open Source advocate and contributor

More information

The Now Platform Reference Guide

The Now Platform Reference Guide The Now Platform Reference Guide A tour of key features and functionality START Introducing the Now Platform Digitize your business with intelligent apps The Now Platform is an application Platform-as-a-Service

More information

The Curator s Approach to Data Management and Sustainability

The Curator s Approach to Data Management and Sustainability The Curator s Approach to Data Management and Sustainability Nic Weber & Megan Senseney Center for Informatics Research in Science & Scholarship Graduate School of Library & Information Science University

More information

Growing Variety and Volume of Remote Sensing and In Situ Data

Growing Variety and Volume of Remote Sensing and In Situ Data The Potential Role of the World Data Centers in the Global Earth Observing System of Systems and the International Polar Year: CIESIN Experience to Date Dr. Robert S. Chen Director and Senior Research

More information

Overview. Scientific workflows and Grids. Kepler revisited Data Grids. Taxonomy Example systems. Chimera GridDB

Overview. Scientific workflows and Grids. Kepler revisited Data Grids. Taxonomy Example systems. Chimera GridDB Grids and Workflows Overview Scientific workflows and Grids Taxonomy Example systems Kepler revisited Data Grids Chimera GridDB 2 Workflows and Grids Given a set of workflow tasks and a set of resources,

More information

Oracle Big Data Science IOUG Collaborate 16

Oracle Big Data Science IOUG Collaborate 16 Oracle Big Data Science IOUG Collaborate 16 Session 4762 Tim and Dan Vlamis Tuesday, April 12, 2016 Vlamis Software Solutions Vlamis Software founded in 1992 in Kansas City, Missouri Developed 200+ Oracle

More information

Instant Messaging Interface for Data Distribution Service

Instant Messaging Interface for Data Distribution Service Instant Messaging Interface for Data Distribution Service Javier Povedano-Molina 1, Jose M. Lopez-Vega 1, Javier Sanchez-Monedero 2, and Juan M. Lopez-Soler 1 1 {jpovedano,jmlv,juanma}@ugr.es Dpto. Teoría

More information

Data Governance for the Connected Enterprise

Data Governance for the Connected Enterprise Data Governance for the Connected Enterprise Irene Polikoff and Jack Spivak, TopQuadrant Inc. November 3, 2016 Copyright 2016 TopQuadrant Inc. Slide 1 Data Governance for the Connected Enterprise Today

More information

Oracle Big Data Cloud Service, Oracle Storage Cloud Service, Oracle Database Cloud Service

Oracle Big Data Cloud Service, Oracle Storage Cloud Service, Oracle Database Cloud Service Demo Introduction Keywords: Oracle Big Data Cloud Service, Oracle Storage Cloud Service, Oracle Database Cloud Service Goal of Demo: Oracle Big Data Preparation Cloud Services can ingest data from various

More information

Sessions 3/4: Member Node Breakouts. John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group

Sessions 3/4: Member Node Breakouts. John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group Sessions 3/4: Member Node Breakouts John Cobb Matt Jones Laura Moyers 7 July 2013 DataONE Users Group Schedule 1:00-2:20 and 2:40-4:00 Member Node Breakouts Member Node Overview and Process Overview Documentation

More information

Discovery Net : A UK e-science Pilot Project for Grid-based Knowledge Discovery Services. Patrick Wendel Imperial College, London

Discovery Net : A UK e-science Pilot Project for Grid-based Knowledge Discovery Services. Patrick Wendel Imperial College, London Discovery Net : A UK e-science Pilot Project for Grid-based Knowledge Discovery Services Patrick Wendel Imperial College, London Data Mining and Exploration Middleware for Distributed and Grid Computing,

More information

Welcome to the Gathering Intelligence from your Applications and Data: The case for Oracle BI eseminar

Welcome to the Gathering Intelligence from your Applications and Data: The case for Oracle BI eseminar Welcome to the Gathering Intelligence from your Applications and Data: The case for Oracle BI eseminar Agenda 1. PTS Organization 2. The case for Oracle BI by Matt Elumba 3. Additional Resources Milan

More information

Semantic Web: Core Concepts and Mechanisms. MMI ORR Ontology Registry and Repository

Semantic Web: Core Concepts and Mechanisms. MMI ORR Ontology Registry and Repository Semantic Web: Core Concepts and Mechanisms MMI ORR Ontology Registry and Repository Carlos A. Rueda Monterey Bay Aquarium Research Institute Moss Landing, CA ESIP 2016 Summer meeting What s all this about?!

More information

Windsor Essex Environmental Metadata System (WEEMS)

Windsor Essex Environmental Metadata System (WEEMS) Windsor Essex Environmental Metadata System (WEEMS) Utilizing Open Source Geospatial Metadata Technologies For Making g Research Based Data Available for Collaboration Grgicak-Mannion, A 1., Ciborowski,

More information

Database Systems: Design, Implementation, and Management Tenth Edition. Chapter 14 Database Connectivity and Web Technologies

Database Systems: Design, Implementation, and Management Tenth Edition. Chapter 14 Database Connectivity and Web Technologies Database Systems: Design, Implementation, and Management Tenth Edition Chapter 14 Database Connectivity and Web Technologies Database Connectivity Mechanisms by which application programs connect and communicate

More information

SAS 9.2 Foundation Services. Administrator s Guide

SAS 9.2 Foundation Services. Administrator s Guide SAS 9.2 Foundation Services Administrator s Guide The correct bibliographic citation for this manual is as follows: SAS Institute Inc. 2009. SAS 9.2 Foundation Services: Administrator s Guide. Cary, NC:

More information

Framework for Building Collaborative Research Environment

Framework for Building Collaborative Research Environment Framework for Building Collaborative Research Environment http://dx.doi.org/10.3991/ijes.v2i4.4017 Ranjeet Devarakonda 1, Giriprakash Palanisamy 1 and Inigo San Gil 2 1 Oak Ridge National Laboratory 2

More information

Towards Semantically-enabled Exploration and Analysis of Environmental Ecosystems

Towards Semantically-enabled Exploration and Analysis of Environmental Ecosystems Towards Semantically-enabled Exploration and Analysis of Environmental Ecosystems Deborah L. McGuinness 1 Tetherless World Senior Constellation Chair Rensselaer Polytechnic Institute In conjunction with

More information

Future Trends of ILS

Future Trends of ILS Held at The Hong Kong Institute of Education 24 April 2015 Future Trends of ILS K.T. Lam The Hong Kong University of Science and Technology Library lblkt@ust.hk, orcid.org/0000-0003-2625-9419 Last revised:

More information

Know Your Customer. c360 Microsoft Dynamics CRM 4.0 Product Catalog

Know Your Customer. c360 Microsoft Dynamics CRM 4.0 Product Catalog c360 Microsoft Dynamics CRM 4.0 Product Catalog Know Your Customer c360 products extend the functionality and industry focus of Microsoft Dynamics CRM c360 Core Productivity Pack Explorer (CRM Search Engine)

More information

IBM TRIRIGA Application Platform Version 3 Release 4.0. Connector User Guide

IBM TRIRIGA Application Platform Version 3 Release 4.0. Connector User Guide IBM TRIRIGA Application Platform Version 3 Release 4.0 Connector User Guide Note Before using this information and the product it supports, read the information in Notices on page 64. This edition applies

More information

Metadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan

Metadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan Metadata for Data Discovery: The NERC Data Catalogue Service Steve Donegan Introduction NERC, Science and Data Centres NERC Discovery Metadata The Data Catalogue Service NERC Data Services Case study:

More information

Paraben Examiner 9.0 Release Notes

Paraben  Examiner 9.0 Release Notes Paraben E-mail Examiner 9.0 Release Notes 1 Paraben Corporation Welcome to Paraben s E-mail Examiner 9.0! Paraben s Email Examiner-EMX allows for the forensic examination of the most popular local e-mail

More information

Smart Federated Search for Egyptian Knowledge Bank

Smart Federated Search for Egyptian Knowledge Bank Smart Federated Search for Egyptian Knowledge Bank MuseGlobal, Inc. 421 Fayetteville Street Suite 1100 Raleigh, NC 27601 U.S.A. www.museglobal.com MuseGlobal S.A Calea Bucuresti Bl. 27B, Sc. 1, Ap. 10

More information

Fusion Registry 9 SDMX Data and Metadata Management System

Fusion Registry 9 SDMX Data and Metadata Management System Registry 9 Data and Management System Registry 9 is a complete and fully integrated statistical data and metadata management system using. Whether you require a metadata repository supporting a highperformance

More information

EarthCube and Cyberinfrastructure for the Earth Sciences: Lessons and Perspective from OpenTopography

EarthCube and Cyberinfrastructure for the Earth Sciences: Lessons and Perspective from OpenTopography EarthCube and Cyberinfrastructure for the Earth Sciences: Lessons and Perspective from OpenTopography Christopher Crosby, San Diego Supercomputer Center J Ramon Arrowsmith, Arizona State University Chaitan

More information

Software + Services for Data Storage, Management, Discovery, and Re-Use

Software + Services for Data Storage, Management, Discovery, and Re-Use Software + Services for Data Storage, Management, Discovery, and Re-Use CODATA 22 Conference Stellenbosch, South Africa 25 October 2010 Alex D. Wade Director Scholarly Communication Microsoft External

More information

Copyright 2008, Paul Conway.

Copyright 2008, Paul Conway. Unless otherwise noted, the content of this course material is licensed under a Creative Commons Attribution - Non-Commercial - Share Alike 3.0 License.. http://creativecommons.org/licenses/by-nc-sa/3.0/

More information

SEXTANT 1. Purpose of the Application

SEXTANT 1. Purpose of the Application SEXTANT 1. Purpose of the Application Sextant has been used in the domains of Earth Observation and Environment by presenting its browsing and visualization capabilities using a number of link geospatial

More information

Standards, GML and AIXM. Dr. David Burggraf Vice President Galdos Systems Inc

Standards, GML and AIXM. Dr. David Burggraf Vice President Galdos Systems Inc Standards, and AIXM Dr. David Burggraf Vice President Galdos Systems Inc Copyright Galdos Systems Inc. May 6, 2010 Geography Markup Language: What is it? A modeling language for geographic features A set

More information

Metadata Models for Experimental Science Data Management

Metadata Models for Experimental Science Data Management Metadata Models for Experimental Science Data Management Brian Matthews Facilities Programme Manager Scientific Computing Department, STFC Co-Chair RDA Photon and Neutron Science Interest Group Task lead,

More information

Improving Data Discovery in Metadata Repositories through Semantic Search

Improving Data Discovery in Metadata Repositories through Semantic Search International Conference on Complex, Intelligent and Software Intensive Systems Improving Data Discovery in Metadata Repositories through Semantic Search Chad Berkley 1, Shawn Bowers 2, Matthew B. Jones

More information

The Model-Driven Semantic Web Emerging Standards & Technologies

The Model-Driven Semantic Web Emerging Standards & Technologies The Model-Driven Semantic Web Emerging Standards & Technologies Elisa Kendall Sandpiper Software March 24, 2005 1 Model Driven Architecture (MDA ) Insulates business applications from technology evolution,

More information

Provenance-aware Faceted Search in Drupal

Provenance-aware Faceted Search in Drupal Provenance-aware Faceted Search in Drupal Zhenning Shangguan, Jinguang Zheng, and Deborah L. McGuinness Tetherless World Constellation, Computer Science Department, Rensselaer Polytechnic Institute, 110

More information

ACCELERATE YOUR SHAREPOINT ADOPTION AND ROI WITH CONTENT INTELLIGENCE

ACCELERATE YOUR SHAREPOINT ADOPTION AND ROI WITH CONTENT INTELLIGENCE June 30, 2012 San Diego Convention Center ACCELERATE YOUR SHAREPOINT ADOPTION AND ROI WITH CONTENT INTELLIGENCE Stuart Laurie, Senior Consultant #SPSSAN Agenda 1. Challenges 2. What comes out of the box

More information

Techno Expert Solutions An institute for specialized studies! Introduction to Advance QTP course Content

Techno Expert Solutions An institute for specialized studies! Introduction to Advance QTP course Content Introduction to Advance QTP course Content NTRODUCTION TO AUTOMATION Automation Testing Benefits of Automation Testing Automation Testing Vs Manual Testing Automation Test Tools Tool selection criteria

More information

Hawaii Energy and Environmental Technologies (HEET) Initiative

Hawaii Energy and Environmental Technologies (HEET) Initiative Hawaii Energy and Environmental Technologies (HEET) Initiative Office of Naval Research Grant Award Number N0014-11-1-0391 Task 8. ENERGY-NEUTRAL ENERGY TEST PLATFORMS 8.3 Advanced Database Research, Development

More information

ArcGIS for Server Michele Lundeen

ArcGIS for Server Michele Lundeen ArcGIS for Server 10.1 Michele Lundeen Summary Vision Installation and Configuration Architecture Publishing Functional Enhancements Cloud Migration and Best Practices Powerful GIS capabilities Delivered

More information

The Logical Data Store

The Logical Data Store Tenth ECMWF Workshop on Meteorological Operational Systems 14-18 November 2005, Reading The Logical Data Store Bruce Wright, John Ward & Malcolm Field Crown copyright 2005 Page 1 Contents The presentation

More information

INSPIRE roadmap and architecture: lessons learned INSPIRE 2017

INSPIRE roadmap and architecture: lessons learned INSPIRE 2017 INSPIRE roadmap and architecture: lessons learned INSPIRE 2017 Stijn Goedertier GIM Thierry Meessen GIM Jeff Konnen ACT Luxembourg Patrick Weber ACT Luxembourg 1 Administration du cadastre et de la topographie

More information

Integrated Map Tool. Overview, Current Status, and Things to Come

Integrated Map Tool. Overview, Current Status, and Things to Come Integrated Map Tool Overview, Current Status, and Things to Come Integrated Mapping and Analysis Tool (IMAT) map widget Integrated Mapping Tool IMAT Reusable components for portrayal, query, analysis,

More information