Wade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia
|
|
- Victor Henderson
- 5 years ago
- Views:
Transcription
1 Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia
2 Regardless of Q/A procedures, data quality issues guaranteed with environmental sensor data Without good Q/C data users can draw invalid conclusions (untrustworthy data) Q/C analysis is a critical part of any monitoring program See: Campbell et al Quantity is Nothing without Quality: Automated QA/QC for Streaming Environmental Sensor Data. BioScience. 63(7):
3 Wide variety of software can be used to perform Q/C analysis Spreadsheets (conditional colors) Statistical software (outlier tests, consistency checks, models) Plotting software (visual checks) Assigning and managing qualifiers (flags) and revising data often a manual process Traditional Q/C techniques don t scale well for streaming sensor data Data volume too high to plot and look at every value before posting Tedious to document Q/C steps (provenance) Poor scope for automation Need for different approaches and tools for streaming sensor data that support automation, provenance-tracking
4 Requirements Algorithmic Q/C analysis (automation) Visual Q/C analysis (review/revision) Ability to repeat analysis with new data (scalability) Method to assign and manage qualifiers (flagging) Support for data correction and revision (cleaning) Documentation of Q/C steps (provenance) Example frameworks GCE Data Toolbox (MATLAB) CUAHSI ODM Tools (Python)
5 GCE Data Toolbox is a lightweight, portable, file-based data management system implemented in MATLAB Key components Generalized tabular data model for metadata, data and Q/C rules and flags Command-line function library (API) Graphical user interface (GUI) Data import support Delimited text (csv, tab, space) Logger files (CSI, SBE, YSI,...) SQL RDBMS Web services (NWIS, NOAA HADS, CHORDS,...) Data export Delimited text, SQL, XML/HTML Metadata export Plain text, EML/XML,...
6
7
8 Algorithmic Q/C Analysis Rules (i.e. criteria) define conditions in which values should be flagged Unlimited Q/C rules for each variable Rules evaluated when data loaded and when data or rules change Rules predefined in metadata templates to automate Q/C on import Interactive Q/C Analysis and Revision Qualifiers can be assigned/cleared visually on data plots with the mouse Qualifiers can be propagated to dependent columns Qualifiers can be removed or edited (search/replace) if standards change Automatic Documentation of Q/C Steps Q/C operations (including revisions) logged to processing lineage Data anomalies reports can be auto-generated and annotated Data correction, analysis, synthesis tools Q/C-aware Qualified values can be filtered, summarized, visualized during analysis Statistics about missing/qualified values tabulated, used to qualify derived data
9
10 flag_novaluechange(col_salinity,0.3,0.3,3)= F col_depth<0.2= Q col_depth<0= I
11
12 Visual Q/C tool can be invoked from interactive data plots Actions variable-specific to prevent inadvertent flagging of wrong values Left-click/drag to assign, right-click/drag to clear Anomaly reports can be auto-generated on demand and annotated to explain rationale for revision
13 Composite flags can be manually propagated to derived variables Flags can be meshed with or overwrite existing flags Often easier to propagate flags than compose multi-column rule sets Whenever flags interactively edited, automatic Q/C rules locked to prevent over-riding edits
14 Q/C flags can be visualized in data editor grid and plots Flagged values can be excluded from analyses and summarized Flagged values can be selectively removed from data sets and filled Replace flagged/missing values using constants, equations, models Fill values from replicate sensors (coalesce) Interpolated using linear regression, splines, shape-preserving cubic hermite
15 Interactive tools for sensor drift correction
16 Harvest Manager Data processing and Q/C workflows can be run on a timed basis Harvest management tools for defining, starting, stopping workflows and viewing logs Demo workflows provided with toolbox Workflow Raw Data Import Data Add / Import Metadat a QA/QC Analysi s Post- Process Synthes is Archive / Publish Products Reports
17 Finalized data can be published to a DataONE member node (EDI, KNB, etc) as an EML-described data package Can also export data/metadata in wide variety of formats for other repositories or local archiving
18 Python application for working with time series data in a CUAHSI Observations Data Model (ODM) database Multi-platform support (Windows, Linux, Mac) Multi-database support (Microsoft SQL Server, MySQL, and PostgreSQL) Implements a scripting interface to save the provenance of data edits in QC process Modern the Graphical User Interface (GUI) Horsburgh, Jeffery S.; Reeder, Stephanie; and Spackman Jones, Amber, "ODM Tools Python: Open Source Software For Managing Continuous Sensor Data" (2014). CUNY Academic Works.
19 Data querying and visualization Horsburgh, Jeffery S.; Reeder, Stephanie; and Spackman Jones, Amber, "ODM Tools Python: Open Source Software For Managing Continuous Sensor Data" (2014). CUNY Academic Works.
20 Data editing and visualization Horsburgh, Jeffery S.; Reeder, Stephanie; and Spackman Jones, Amber, "ODM Tools Python: Open Source Software For Managing Continuous Sensor Data" (2014). CUNY Academic Works.
21 Data Q/C analysis and visualization Horsburgh, Jeffery S.; Reeder, Stephanie; and Spackman Jones, Amber, "ODM Tools Python: Open Source Software For Managing Continuous Sensor Data" (2014). CUNY Academic Works.
22 Scriptable quality control editing Automatically generated Python code with each editing step Horsburgh, Jeffery S.; Reeder, Stephanie; and Spackman Jones, Amber, "ODM Tools Python: Open Source Software For Managing Continuous Sensor Data" (2014). CUNY Academic Works.
23 Revised data can be saved to the ODM database as a new time series processing level for the station Generated scripts can be saved and re-run to reproduce the edited time series or used for similar data Scripts document provenance of the data flagging and revision Finalized data can be published to a CUAHSI Hydroserver and accessed via web services and CUAHSI tools (HydroDesktop) Important Note: ODM Tools requires local installation of a legacy ODM database and does not connect to the latest CUAHSI Cloud Hydroserver platform
24 GCE Data Toolbox Website: Ref: Sheldon Jr., W.M., Dynamic, rule-based quality control framework for realtime sensor data. In: Gries, C., Jones, M.B. (Eds.), Proceedings of the Environmental Information Management Conference 2008: Sensor Networks, September 2008, pp nal.pdf ODM Tools Python Website: Ref: Horsburgh, J. et al Open source software for visualization and quality control of continuous hydrologic and water quality sensor data. Environmental Modelling & Software, 70:32-44 (doi.org/ /j.envsoft )
25 Website:
Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data
Dynamic, Rule-based Quality Control Framework for Real-time Sensor Data Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia Introduction Quality Control of high volume, real-time data from
More informationWade Sheldon. Georgia Coastal Ecosystems LTER University of Georgia CUAHSI Virtual Workshop Field Data Management Solutions
Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia email: sheldon@uga.edu CUAHSI Virtual Workshop Field Data Management Solutions 01-Oct-2014 Georgia Coastal Ecosystems LTER started in
More informationPutting the Archives to Work: Workflow and Metadata-driven Analysis in LTER Science
Putting the Archives to Work: Workflow and Metadata-driven Analysis in LTER Science Wade Sheldon Georgia Coastal Ecosystems LTER University of Georgia Acknowledgements: John Porter (Virginia Coast Reserve
More informationGCE Data Toolbox for MATLAB An Introduction. Wade Sheldon Georgia Coastal Ecosystems LTER
GCE Data Toolbox for MATLAB An Introduction Wade Sheldon Georgia Coastal Ecosystems LTER Background & Motivation Georgia Coastal Ecosystems LTER project started in May 2000 Major data collection effort
More informationExercise 3: Query, Visualize, and Edit Data Using ODM Tools
Exercise 3: Query, Visualize, and Edit Data Using ODM Tools Jeffery S. Horsburgh 1 4-25-2012 Objectives In this exercise you will learn how Query, Visualize, and Edit data in an ODM database using the
More informationJeffery S. Horsburgh. Utah Water Research Laboratory Utah State University
Advancing a Services Oriented Architecture for Sharing Hydrologic Data Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University D.G. Tarboton, D.R. Maidment, I. Zaslavsky, D.P. Ames, J.L.
More informationData Entry, and Manipulation. DataONE Community Engagement & Outreach Working Group
Data Entry, and Manipulation DataONE Community Engagement & Outreach Working Group Lesson Topics Best Practices for Creating Data Files Data Entry Options Data Integration Best Practices Data Manipulation
More informationHow to use Water Data to Produce Knowledge: Data Sharing with the CUAHSI Water Data Center
How to use Water Data to Produce Knowledge: Data Sharing with the CUAHSI Water Data Center Jon Pollak The Consortium of Universities for the Advancement of Hydrologic Science, Inc. (CUAHSI) August 20,
More informationGeorgia Coastal Ecosystems LTER Information Management
Georgia Coastal Ecosystems LTER Information Management Wade Sheldon, Information Manager Adam Sapp, Assistant Information Manager University of Georgia Athens, Georgia GCE IM Overview Information Management
More informationHYDRODESKTOP VERSION 1.4 QUICK START GUIDE
HYDRODESKTOP VERSION 1.4 QUICK START GUIDE A guide to using this free and open source application for discovering, accessing, and using hydrologic data February 8, 2012 by: Tim Whiteaker Center for Research
More informationHd Hydrologic Information System
Sharing Hydrologic Data with the CUAHSI Hd Hydrologic Information System David Tarboton, David Maidment, Ilya Zaslavsky, Dan Ames, Jon Goodall, Jeffery Horsburgh, Tim Whiteaker, Michael Piasecki, David
More informationA USER S GUIDE TO REGISTERING AND MAINTAINING DATA SERVICES IN HIS CENTRAL 2.0
A USER S GUIDE TO REGISTERING AND MAINTAINING DATA SERVICES IN HIS CENTRAL 2.0 Prepared by Jon Pollak, CUAHSI Water Data Center User Support Specialist September 2014 1 DISCLAIMERS The HIS Central application
More informationQueries give database managers its real power. Their most common function is to filter and consolidate data from tables to retrieve it.
1 2 Queries give database managers its real power. Their most common function is to filter and consolidate data from tables to retrieve it. The data you want to see is usually spread across several tables
More informationODM TOOLS. An application for interfacing with the CUAHSI Hydrologic Information System Observations Data Model. August 2011.
ODM TOOLS An application for interfacing with the CUAHSI Hydrologic Information System Observations Data Model August 2011 Prepared by: Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University
More informationOliver Engels & Tillmann Eitelberg. Big Data! Big Quality?
Oliver Engels & Tillmann Eitelberg Big Data! Big Quality? Like to visit Germany? PASS Camp 2017 Main Camp 5.12 7.12.2017 (4.12 Kick Off Evening) Lufthansa Training & Conference Center, Seeheim SQL Konferenz
More informationCUAHSI ODM Tools Version 1.0 Design Specifications October 27, 2006
CUAHSI ODM Tools Version 1.0 Design Specifications October 27, 2006 Jeffery S. Horsburgh 1 Abstract The CUAHSI Hydrologic Information System (HIS) Project is developing information technology infrastructure
More informationODM Tools Version 1.2
ODM Tools Version 1.2 An application for interfacing with the CUAHSI Hydrologic Information System Observations Data Model October 2007 Prepared by: Jeffery S. Horsburgh Environmental Management Research
More informationODM STREAMING DATA LOADER
ODM STREAMING DATA LOADER An application for loading streaming sensor data into the CUAHSI Hydrologic Information System Observations Data Model March 2012 Prepared by: Jeffery S. Horsburgh Utah Water
More informationData Archival and Dissemination Tools to Support Your Research, Management, and Education
Data Archival and Dissemination Tools to Support Your Research, Management, and Education LIZA BRAZIL CUAHSI PRODUCT MANAGER Shout Out: Upcoming Cyberseminars April 13: Liza Brazil, CUAHSI: Data Archiving
More informationExport out report results in multiple formats like PDF, Excel, Print, , etc.
Edition Comparison DOCSVAULT Docsvault is full of features that can help small businesses and large enterprises go paperless. The feature matrix below displays Docsvault s abilities for its Enterprise
More informationCUAHSI. Conservation Authority Hydrologic Information System
Conservation Authority Hydrologic Information System Data Management Application Groundwater Surface Water Quality Water Level / Low Flow Baseflow Neil MacFarlane, David T. Krupicz CUAHSI 1 Introduction
More informationEffective Team Collaboration with Simulink
Effective Team Collaboration with Simulink A MathWorks Master Class: 15:45 16:45 Gavin Walker, Development Manager, Simulink Model Management 2012 The MathWorks, Inc. 1 Overview Focus: New features of
More informationOvation Process Historian
Ovation Process Historian Features Designed to meet the needs of precision, performance, scalability and historical data management for the Ovation control system Collects historical data of Ovation process
More informationLifeWatch/EnvEurope User Forum Use Case Ecology
LifeWatch/EnvEurope User Forum Use Case Ecology User Forum Barcelona, March 2012 Michael Mirtl (EAA, Environment Agency Austria) Wouter Los (LifeWatch) Infrastructure for Biodiversity and Ecosystem Research
More informationIntroduction to BEST Viewpoints
Introduction to BEST Viewpoints This is not all but just one of the documentation files included in BEST Viewpoints. Introduction BEST Viewpoints is a user friendly data manipulation and analysis application
More informationirods for Data Management and Archiving UGM 2018 Masilamani Subramanyam
irods for Data Management and Archiving UGM 2018 Masilamani Subramanyam Agenda Introduction Challenges Data Transfer Solution irods use in Data Transfer Solution irods Proof-of-Concept Q&A Introduction
More informationAEMLog Users Guide. Version 1.01
AEMLog Users Guide Version 1.01 INTRODUCTION...2 DOCUMENTATION...2 INSTALLING AEMLOG...4 AEMLOG QUICK REFERENCE...5 THE MAIN GRAPH SCREEN...5 MENU COMMANDS...6 File Menu...6 Graph Menu...7 Analysis Menu...8
More informationObservatory Control System Test Plan Steve Wampler High-Level Software
Project Documentation Document PROC-0029 Rev A Observatory Control System Test Plan Steve Wampler High-Level Software June 6, 2016 REVISION SUMMARY: 1. Date: 6 June 2016 Revision: Rev A Changes: Initial
More informationArcGIS Online: Managing Data. Jeremy Bartley Sentha Sivabalan
ArcGIS Online: Managing Data Jeremy Bartley (jbartley@esri.com) Sentha Sivabalan (ssivabalan@esri.com) Agenda Creating and managing content like Apps, Maps, Scenes and Layers in ArcGIS Today s Topics:
More informationProduct Release Notes Alderstone cmt 2.0
Alderstone cmt product release notes Product Release Notes Alderstone cmt 2.0 Alderstone Consulting is a technology company headquartered in the UK and established in 2008. A BMC Technology Alliance Premier
More informationTitle Vega: A Flexible Data Model for Environmental Time Series Data
Title Vega: A Flexible Data Model for Environmental Time Series Data Authors L. A. Winslow 1, B. J. Benson 1, K. E. Chiu 3, P. C. Hanson 1, T. K. Kratz 2 1 Center for Limnology, University of Wisconsin-Madison,
More informationHeiðrun. Building DPLA s New Metadata Ingestion System. Mark A. Matienzo Digital Public Library of America
Heiðrun Building DPLA s New Metadata Ingestion System Mark A. Matienzo Digital Public Library of America Metropolitan New York Library Council Annual Conference January 15, 2015 Outline 1.
More informationB3 data QAQC software User s guide. Getting started
B3 data QAQC software User s guide B3 is software intended to enable comprehensive and traceable quality assurance and quality control for large environmental datasets collected at regular time intervals,
More informationAxon Fixed Limitations... 1 Known Limitations... 3 Informatica Global Customer Support... 5
Axon Data Governance 5.4 Release Notes September 2018 Copyright Informatica LLC 2015, 2018 Contents Axon 5.4... 1 Fixed Limitations.... 1 Known Limitations.... 3 Informatica Global Customer Support...
More informationHYDRODESKTOP VERSION 1.1 BETA QUICK START GUIDE
HYDRODESKTOP VERSION 1.1 BETA QUICK START GUIDE A guide to help you get started using this free and open source desktop application for discovering, accessing, and using hydrologic data. September 15,
More informationWhen using this architecture for accessing distributed services, however, query broker and/or caches are recommendable for performance reasons.
Integration of semantics, data and geospatial information for LTER Abstract The long term ecological monitoring and research network (LTER) in Europe[1] provides a vast amount of data with regard to drivers
More informationIng. José A. Mejía Villar M.Sc. Computing Center of the Alfred Wegener Institute for Polar and Marine Research
Ing. José A. Mejía Villar M.Sc. jmejia@awi.de Computing Center of the Alfred Wegener Institute for Polar and Marine Research 29. November 2011 Contents 1. Fedora Commons Repository 2. Federico 3. Federico's
More informationXfmea Version 10 First Steps Example
Xfmea Version 10 First Steps Example This example provides a quick introduction to the Xfmea software by allowing you to experiment with the application s data management, analysis and reporting features.
More informationIntroduction to Geodatabase and Spatial Management in ArcGIS. Craig Gillgrass Esri
Introduction to Geodatabase and Spatial Management in ArcGIS Craig Gillgrass Esri Session Path The Geodatabase - What is it? - Why use it? - What types are there? - What can I do with it? Query Layers
More informationODM 1.1. An application Hydrologic. June Prepared by: Jeffery S. Horsburgh Justin Berger Utah Water
ODM M STREAMING VERSION DATAA LOADER 1.1 An application for loading streaming sensor data into the CUAHSI Hydrologic Information System Observations Data Model June 2008 Prepared by: Jeffery S. Horsburgh
More informationECO375 Tutorial 1 Introduction to Stata
ECO375 Tutorial 1 Introduction to Stata Matt Tudball University of Toronto Mississauga September 14, 2017 Matt Tudball (University of Toronto) ECO375H5 September 14, 2017 1 / 25 What Is Stata? Stata is
More information2/12/11. Addendum (different syntax, similar ideas): XML, JSON, Motivation: Why Scientific Workflows? Scientific Workflows
Addendum (different syntax, similar ideas): XML, JSON, Python (a) Python (b) w/ dickonaries XML (a): "meta schema" JSON syntax LISP Source: h:p://en.wikipedia.org/wiki/json XML (b): "direct" schema Source:
More informationBW C SILWOOD TECHNOLOGY LTD. Safyr Metadata Discovery Software. Safyr User Guide
BW C SILWOOD TECHNOLOGY LTD Safyr Metadata Discovery Software Safyr User Guide S I L W O O D T E C H N O L O G Y L I M I T E D Safyr User Guide Safyr 7.1 This product is subject to the license agreement
More informationSage Estimating (SQL) v17.12
Sage Estimating (SQL) v17.12 Release Notes October 2017 This is a publication of Sage Software, Inc. 2017 The Sage Group plc or its licensors. All rights reserved. Sage, Sage logos, and Sage product and
More informationHawaii Energy and Environmental Technologies (HEET) Initiative
Hawaii Energy and Environmental Technologies (HEET) Initiative Office of Naval Research Grant Award Number N0014-11-1-0391 Task 8. ENERGY-NEUTRAL ENERGY TEST PLATFORMS 8.3 Advanced Database Research, Development
More informationManage your environmental monitoring data with power, depth and ease
EQWin Software Inc. PO Box 75106 RPO White Rock Surrey BC V4A 0B1 Canada Tel: +1 (604) 669-5554 Fax: +1 (888) 620-7140 E-mail: support@eqwinsoftware.com www.eqwinsoftware.com EQWin 7 Manage your environmental
More informationFusion Registry 9 SDMX Data and Metadata Management System
Registry 9 Data and Management System Registry 9 is a complete and fully integrated statistical data and metadata management system using. Whether you require a metadata repository supporting a highperformance
More informationRequirements (QASR) - Chapter 6. HYDRO-METEOROLOGIC and HYDRAULIC MONITORING
CERP Quality Assurance Systems Requirements (QASR) - Chapter 6 HYDRO-METEOROLOGIC and HYDRAULIC MONITORING Purpose and Scope Purpose is to provide guidelines for efficient and effective production of hydrologic
More informationData Interoperability in the Hydrologic Sciences
Data Interoperability in the Hydrologic Sciences The CUAHSI Hydrologic Information System David G Tarboton 1, David Maidment 2, Ilya Zaslavsky 3, Dan Ames 4, Jon Goodall 5, Richard P Hooper 6, Jeff Horsburgh
More informationRelease Notes. Agilent CytoGenomics 2.7. Product Number. Key new features. Overview
Release Notes Agilent CytoGenomics 2.7 Product Number G1662AA CytoGenomics Client 1 year named license (including Feature Extraction). This license supports installation of one client and server (to host
More informationData Analyst Nanodegree Syllabus
Data Analyst Nanodegree Syllabus Discover Insights from Data with Python, R, SQL, and Tableau Before You Start Prerequisites : In order to succeed in this program, we recommend having experience working
More informationA Data Management Plan Template for Ecological Restoration and Monitoring
A Data Management Plan Template for Ecological Restoration and Monitoring Brick M. Fevold Research Scientist Advisor, GDIT Judy Schofield 1, Rob Sutter 1, Craig Palmer 1, Elizabeth Benjamin 1, Molly M.
More informationAnalytics and Visualization
GU I DE NO. 4 Analytics and Visualization AWS IoT Analytics Mini-User Guide Introduction As IoT applications scale, so does the data generated from these various IoT devices. This data is raw, unstructured,
More informationProduct Documentation. ER/Studio Portal. User Guide. Version Published February 21, 2012
Product Documentation ER/Studio Portal User Guide Version 1.6.3 Published February 21, 2012 2012 Embarcadero Technologies, Inc. Embarcadero, the Embarcadero Technologies logos, and all other Embarcadero
More informationTempest Hydro-Met Analysis System
Tempest Hydro-Met Analysis System A suite of tools for retrieving, storing, validating, analyzing, & displaying hydrometeorological data The HydroMet Analysis System stores your decoded data in an SQL
More informationUtility Network Management in ArcGIS: Migrating Your Data to the Utility Network. John Alsup & John Long
Utility Network Management in ArcGIS: Migrating Your Data to the Utility Network John Alsup & John Long Presentation Outline Utility Network Preparation - Migration Patterns - Understanding the Asset Package
More informationCreating Workflows. What is Prime Network Workflow? CHAPTER
CHAPTER 12 The following topics describe how to use the Prime Network Workflow GUI client to create workflow templates that allow you to deploy and executed in runtime. What is Prime Network Workflow?,
More informationUnifying Hydrological Time Series Data for a Global Water Portal
Unifying Hydrological Time Series Data for a Global Water Portal Pathai Suwannawiwat Chayakorn Netramai The Sirindhorn International Thai-German Graduate School of Engineering King Mongkut s University
More informationInstruction Decode In Oracle Sql Loader Control File Example Tab Delimited
Instruction Decode In Oracle Sql Loader Control File Example Tab Delimited The text files are in an industry-standard format such as tab-delimited or comma-delimited ( CSV ). or in any of the formats that
More information18.1 user guide No Magic, Inc. 2015
18.1 user guide No Magic, Inc. 2015 All material contained herein is considered proprietary information owned by No Magic, Inc. and is not to be shared, copied, or reproduced by any means. All information
More information1. What is Excel? Page 2 of 17
Data Analysis & Business Intelligence Made Easy with Excel Power Tools Excel Data Analysis Basics = E-DAB Notes for Video: E-DAB-02: Data, Proper Data Sets, Excel Tables, Sort, Filter, Logical Tests Objectives
More informationLecture 3. Essential skills for bioinformatics: Unix/Linux
Lecture 3 Essential skills for bioinformatics: Unix/Linux RETRIEVING DATA Overview Whether downloading large sequencing datasets or accessing a web application hundreds of times to download specific files,
More informationUnity and Interoperability Among Decentralized Systems. Chris Gebhardt. The InfoCentral Project
Unity and Interoperability Among Decentralized Systems Chris Gebhardt The InfoCentral Project https://infocentral.org Users, Devices, I/O Software Layer (dynamic, largely declarative) software components
More informationRevision 1, September 29, 2011 Page 1
CloudTest version... 2 Overview of the CloudTest environment... 2 Overview of Track play locations for Compositions... 2 Play location for the Composition as a whole... 3 Overview of loading a Composition...
More informationAmbient Vibration H/V Spectral Ratio (HVSR) Method Data Analysis and Archival Guidelines
Ambient Vibration H/V Spectral Ratio (HVSR) Method Data Analysis and Archival Guidelines QuakeCoRE Technology Platform 2 Written by: Dr. Andrew Stolte Dr. Seokho Jeong Dr. Liam Wotherspoon Version 1.0
More informationTime Series Data Management in Air Quality Monitoring. AQE 2013, Telford/UK. Edgar Wetzel, 14 March 2013
Time Series Data Management in Air Quality Monitoring AQE 2013, Telford/UK Edgar Wetzel, 14 March 2013 Brief company presentation KISTERS AG software company with core competence: RDBMS-based time-series
More informationWhat s New MATLAB and Simulink
What s New MATLAB and Simulink Ascension Vizinho-Coutry Application Engineer Manager MathWorks Ascension.Vizinho-Coutry@mathworks.fr Daniel Martins Application Engineer MathWorks Daniel.Martins@mathworks.fr
More informationBig data for big river science: data intensive tools, techniques, and projects at the USGS/Columbia Environmental Research Center
Big data for big river science: data intensive tools, techniques, and projects at the USGS/Columbia Environmental Research Center Ed Bulliner U.S. Geological Survey, Columbia Environmental Research Center
More informationUSING THE MATLAB TOOLSET TO IMPROVE EFFICIENCY IN THE EOBD CALIBRATION PROCESS
1 USING THE MATLAB TOOLSET TO IMPROVE EFFICIENCY IN THE EOBD CALIBRATION PROCESS and Ford Motor Company Limited, UK Agenda 2 Introductions and Agenda Background Historical Calibration Process New Calibration
More informationReproducible & Transparent Computational Science with Galaxy. Jeremy Goecks The Galaxy Team
Reproducible & Transparent Computational Science with Galaxy Jeremy Goecks The Galaxy Team 1 Doing Good Science Previous talks: performing an analysis setting up and scaling Galaxy adding tools libraries
More informationA generic approach to manage metadata standards
A generic approach to manage metadata standards Barde Julien 1, Edgington Duane 1, Desconnets Jean-Christophe 2 1 Monterey Bay Aquarium Research Institute (MBARI) 2 IRD, US ESPACE, Maison de la télédétection
More informationBall Aerospace s Open Source Command and Control System. Ryan Melton Ball Aerospace & Technologies Corp. Boulder, CO
Ball Aerospace s Open Source Command and Control System Ryan Melton Ball Aerospace & Technologies Corp. Boulder, CO 8/5/2016 VISION To enable small satellite developers to easily and cost effectively command
More informationIntegrated Modeling Overview: OpenMI and EMIT. Anthony Castronova Utah State University
Integrated Modeling Overview: OpenMI and EMIT Anthony Castronova Utah State University OpenMI Overview and Applications Model Integration 9/1/2015 3 Tight Integration Bound by source code Enables complete
More informationForensic and Log Analysis GUI
Forensic and Log Analysis GUI David Collett I am not representing my Employer April 2005 1 Introduction motivations and goals For sysadmins Agenda log analysis basic investigations, data recovery For forensics
More informationAEMLog users guide V User Guide - Advanced Engine Management 2205 West 126 th st Hawthorne CA,
AEMLog users guide V 1.00 User Guide - Advanced Engine Management 2205 West 126 th st Hawthorne CA, 90250 310-484-2322 INTRODUCTION...2 DOCUMENTATION...2 INSTALLING AEMLOG...4 TRANSFERRING DATA TO AND
More informationArcGIS Server Architecture Considerations. Andrew Sakowicz
ArcGIS Server Architecture Considerations Andrew Sakowicz Introduction Andrew Sakowicz - Esri Professional Services - asakowicz@esri.com 2 Audience Audience - System Architects - Project Managers - Developers
More informationFlorida Coastal Everglades LTER Program
Florida Coastal Everglades LTER Program Metadata Workshop April 13, 2007 Linda Powell, FCE Information Manager Workshop Objectives I. Short Introduction to the FCE Metadata Policy What needs to be submitted
More informationSuspensionSim 2016 Release Notes
Mechanical Simulation 755 Phoenix Drive, Ann Arbor MI, 48108, USA Phone: 734 668-2930 Fax: 734 668-2877 Email: info@carsim.com Technical Memo carsim.com SuspensionSim 2016 Release Notes VehicleSim Architecture...1
More informationASG WHITE PAPER DATA INTELLIGENCE. ASG s Enterprise Data Intelligence Solutions: Data Lineage Diving Deeper
THE NEED Knowing where data came from, how it moves through systems, and how it changes, is the most critical and most difficult task in any data management project. If that process known as tracing data
More informationTexas Water Data Services
Texas Water Data Services David R. Maidment Center for Research in Water Resources University of Texas at Austin SSpeed Conference Houston Tx, Oct 30, 2008 Communicating Water Data During Flood Emergencies
More informationEssential Skills for Bioinformatics: Unix/Linux
Essential Skills for Bioinformatics: Unix/Linux WORKING WITH COMPRESSED DATA Overview Data compression, the process of condensing data so that it takes up less space (on disk drives, in memory, or across
More informationPowerCenter Repository Maintenance
PowerCenter Repository Maintenance 2012 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without
More informationTHE VOEIS HIS GATEWAY. A REST Interface for HydroServer using ODM 1.1
THE VOEIS HIS GATEWAY A REST Interface for HydroServer using ODM 1.1 WHO AM I? Pol Llovet Research Software Engineer Research Computing Group Montana State University HIS IS ESSENTIAL Data publishing Data
More informationData Modeling Diagram Open Source Tool Oracle
Data Modeling Diagram Open Source Tool Oracle Data Model Diagram Visualizer. in the original source tool. Figure 3 of SPARC International, Inc. UNIX is a registered trademark licensed through X/Open. Navicat
More informationOliver Engels & Tillmann Eitelberg. Big Data! Big Quality?
Oliver Engels & Tillmann Eitelberg Big Data! Big Quality? Sponsors help us to run this event! THX! You Rock! Sponsor Gold Sponsor Silver Sponsor Bronze Sponsor You Rock! Sponsor Session 13:45 Track 1 Das
More informationHow to use WISKI for CCRN data. Kevin Shook Centre for Hydrology, University of Saskatchewan
How to use WISKI for CCRN data Kevin Shook Centre for Hydrology, University of Saskatchewan What is WISKI? Water Information System KIsters http://www.kisters.net Commercial environmental time series database
More informationModule Customization Options
Module 15 Customization Options Customization Options Reference material Custom scripting Export connectors Custom elements Custom extensions Custom modules Batch workflow Workflow agents Customization
More informationMcAfee Security Management Center
Data Sheet McAfee Security Management Center Unified management for next-generation devices Key advantages: Single pane of glass across the management lifecycle for McAfee next generation devices. Scalability
More informationA Provenance Model for Quantified Self Data
DLR.de Chart 1 A Provenance Model for Quantified Self Data Andreas Schreiber Department for Intelligent and Distributed Systems German Aerospace Center (DLR), Cologne/Berlin DLR.de Chart 2 Motivation Use
More informationContinuous Monitoring Data in AWQMS. A Comprehensive Review as of 8/20/2018
Continuous Monitoring Data in AWQMS A Comprehensive Review as of 8/20/2018 The newer versions of AWQMS have significant enhancements both in terms of data storage and user interface; and there are more
More informationVendor: IBM. Exam Code: P Exam Name: IBM InfoSphere Information Server Technical Mastery Test v2. Version: Demo
Vendor: IBM Exam Code: P2090-010 Exam Name: IBM InfoSphere Information Server Technical Mastery Test v2 Version: Demo Question No : 1 Which tool would you recommend to obtain a clear roadmap of the tasks
More informationTalend Open Studio for Data Quality. User Guide 5.5.2
Talend Open Studio for Data Quality User Guide 5.5.2 Talend Open Studio for Data Quality Adapted for v5.5. Supersedes previous releases. Publication date: January 29, 2015 Copyleft This documentation is
More informationPYRAMID Headline Features. April 2018 Release
PYRAMID 2018.03 April 2018 Release The April release of Pyramid brings a big list of over 40 new features and functional upgrades, designed to make Pyramid s OS the leading solution for customers wishing
More informationTX DWA Contents RELEASE DOCUMENTATION
TX DWA 16.7 RELEASE DOCUMENTATION Contents Introduction... 2 New Features... 2 Differential Deployment... 3 Deployment Status Report... 3 Managed Deployment... 4 Data Export... 4 Dynamic Project Variables...
More informationWorking with Feature Layers. Russell Brennan Gary MacDougall
Working with Feature Layers Russell Brennan Gary MacDougall Working with Feature Layers Session will focus on feature access and editing Highlight new features added over the last few releases Agenda Introduction
More informationGoedelWorks Press release
Linden, 1 st September 2015 GoedelWorks Press release Altreonic is proud to announce the release of the version 3.0 of GoedelWorks, its unique end- to- end portal solution for trustworthy systems development.
More informationArcGIS for Server Michele Lundeen
ArcGIS for Server 10.1 Michele Lundeen Summary Vision Installation and Configuration Architecture Publishing Functional Enhancements Cloud Migration and Best Practices Powerful GIS capabilities Delivered
More informationDetects Potential Problems. Customizable Data Columns. Support for International Characters
Home Buy Download Support Company Blog Features Home Features HttpWatch Home Overview Features Compare Editions New in Version 9.x Awards and Reviews Download Pricing Our Customers Who is using it? What
More informationMicroStation. FDO Reader USER S MANUAL. [Företagets adress]
MicroStation FDO Reader USER S MANUAL [Företagets adress] MicroStation FDO Reader - User s Manual, 2018-10-27 copyright, 2018 ringduvevägen 13, 132 47 saltsjö-boo e-mail: consulting@surell.se, web: www.surell.se
More informationMatrex Table of Contents
Matrex Table of Contents Matrex...1 What is the equivalent of a spreadsheet in Matrex?...2 Why I should use Matrex instead of a spreadsheet application?...3 Concepts...4 System architecture in the future
More information