Cross-mission Analysis Through Space Physics Data Facility (SPDF) Services

Size: px
Start display at page:

Download "Cross-mission Analysis Through Space Physics Data Facility (SPDF) Services"

Transcription

1 Presented at the Fall 2012 AGU meeting Paper SM43A-2231 Cross-mission Analysis Through Space Physics Data Facility (SPDF) Services R.M. Candey, D. Bilitza, R. Chimiak, J.F. Cooper, L.N. Garcia, B. Harris, R. Johnson, J. King, T. Kovalick, H. Leckner, M. Liu, R.E. McGuire, N. Papitashvili and A. Roberts Heliospheric Physics Laboratory, Code 672 NASA Goddard Space Flight Center Page 1; Paper SM43A-2231

2 Abstract The Space Physics Data Facility (SPDF) project at NASA Goddard Space Flight Center provides widely-used heliophysics science-enabling information services and access to heliophysics science data and orbits from NASA s solarheliospheric satellite missions. Data services include the Coordinated Data Analysis Web (CDAWeb), OMNIweb compilation of interplanetary parameters and related indices, and their large underlying collection of datasets. Orbit information and display services include the Satellite Situation Center (SSCweb) and the 4D Orbit Viewer interactive Java client. Software includes the IDL CDAWlib library underlying CDAWeb and the Common Data Format (CDF) software library and file format and science file format translation suite. Page 2; Paper SM43A-2231

3 Data Resources at SPDF Current data with plots/listings/downloads from most instruments on most heliophysics missions Heliospheric: Ulysses, Voyager fields and plasmas Interplanetary Near 1AU: ACE, OMNI and OMNI High-Resolution, Wind, and STEREO Earth s Magnetosphere: Cluster, FAST, Geotail, IMAGE, Polar, NOAA and THEMIS Geosynchronous: NOAA GOES, LANL series ITM: TIMED plus older SNOE and ISIS/Alouette Topside Sounder (and THEMIS ground-based data) Soon RBSP and others >2000 datasets, 12M files over 30TB Current spacecraft orbits for these missions and others including DMSP, SOHO, AIM, Alouette, ISIS, NOAA, Chandra, DME-A, Explorer-45, STEREO, ISS Page 3; Paper SM43A-2231

4 CDAWeb and CDAWlib Data and other information available via many services < CDAWeb HTTP access to plots (GIF, PS, PDF), listings, CDFs < HTTP and FTP access to underlying data files < <ftp://spdf.gsfc.nasa.gov/pub/> Web Services < REST < SOAP < SPASEQL < CDAWeb driven by open source IDL library, CDAWlib < Easy to use one-line IDL interface to SPDF data in CDFs < Page 4; Paper SM43A-2231

5 SSCweb Orbits and Regions < List and plot positions of multiple spacecraft for time spans both past and near future in many coordinate systems in Cartesian or polar coordinates, projected to the Earth and along magnetic field lines Queries include magnetic conjunctions and when spacecraft are in selected regions of space Web Services REST < SOAP < Page 5; Paper SM43A-2231

6 4D Interactive Orbit Viewer (TIPSOD) < View multiple spacecraft orbit information supported by SPDF s SSCweb 3D zoom and pan (see demo) Spacecraft motion (save as animated GIFs) Display THEMIS ground stations (animated) Neutral sheet display in GSM coordinates Zoom and follow a lead spacecraft Mapping of spacecraft tracks to Earth Animated footpoint traces with ground station overlays Display of heliocentric missions under consideration Page 6; Paper SM43A-2231

7 Common Data Format (CDF) and Tools Version of CDF released Supports finer time resolution and larger files Major rewrite of the internal interface Reads older CDF versions and optionally writes in CDF 2.7 Includes internal checksums, better read performance Much improved IDL and Matlab performance, also interfaces for C, Fortran, C#, PERL, Java, Python Precise TT2000 time variables including leap seconds CDF used by THEMIS, STEREO, IBEX, RBSP, CCMC, and many others CDF Tools make creating CDFs easy SKTeditor for CDF form and ISTP/IACG compliant metadata MakeCDF and IDL-based ReadMyCDF/WriteMyCDF to import ASCII, various binaries, IDL savesets Translation among multiple self-describing data formats (HDF, netcdf, ASCII, CDF, FITS) Page 7; Paper SM43A-2231

8 CDF Creation Define and create the CDF structure to receive the data Create skeleton CDF with metadata (by text editing or using the SKTeditor tool < SPDF/ISTP/IACG Metadata Guidelines < Open empty CDF and add data In IDL, use IDLmakeCDF procedures Use read_master_cdf to read skeleton and create a structure within IDL, Load that structure using standard IDL calls as necessary, Use write_data_to_cdf to create a CDF with data Use makecdf tool to import ASCII or binary files skeleton CDF + input file + file format description Direct writes to CDF using CDF library CDF tools to translate (HDF, netcdf, FITS, XML, ASCII) Page 8; Paper SM43A-2231

9 Heliophysics Data Portal and GIF_walk Heliophysics Data Portal Solar & Space Physics Product Finder (formerly VSPO) Service to find and access distributed heliophysics data resources Leverages capabilities of services like CDAWeb and SSCweb < GIF_walk bitmap plot browser < Page 9; Paper SM43A-2231

10 OMNIweb and COHOweb < < OMNIweb: 1-minute and 5-minute resolution inferred interplanetary fields and plasmas at the nose of Earth s bow shock Multi-source compilation of near-earth hourly solar wind, magnetic field and plasma, energetic particle fluxes and solar/ geomagnetic activity indices extending from 1963 to near present COHOweb: serves uniformized hourly resolution IMF, plasma and trajectory data from most heliospheric spacecraft with coordinate system transforms Both feature scatter plots, linear regression fits and cross correlations Page 10; Paper SM43A-2231

11 Standards enable powerful and extendible services Standard file format (CDF, perhaps HDF, netcdf, FITS) Standardized metadata for datasets and parameters Standard dataset and file naming schemes Metadata-driven IDL software Metadata from Master (no data) CDFs over-rides metadata (or lack of) in data CDFs REST, SOAP and OPeNDAP standard web services interfaces CDAWeb and Heliophysics Data Portal are able to offer many advanced services in this way CDAWeb and SSCweb web services are queryable (users/apps can get lists of valid values) Page 11; Paper SM43A-2231

12 SPDF Priorities Provide unique correlative multi-mission and cross-disciplinary value-added heliophysics data services and special products Provide all data services robustly, with high performance and functionality while taking advantage of automation and distributed capabilities Provide web services APIs for metadata, data access, plotting and listing of large collection of heliophysics datasets and orbit information Work with projects, VxOs and the community to reduce project effort in serving data through SPDF while adding valuable community data services Page 12; Paper SM43A-2231

13 All SPDF Services can be reached at Page 13; Paper SM43A-2231

The Heliophysics Data Policy: Status and Plans. Aaron Roberts NASA GSFC 27 February 2012 Heliophysics Subcommittee Meeting

The Heliophysics Data Policy: Status and Plans. Aaron Roberts NASA GSFC 27 February 2012 Heliophysics Subcommittee Meeting The Heliophysics Data Policy: Status and Plans Aaron Roberts NASA GSFC 27 February 2012 Heliophysics Subcommittee Meeting The Data Policy states various functions for the HP Data Environment Produce and

More information

ESPAS: How it fits and benefits

ESPAS: How it fits and benefits ESPAS: How it fits and benefits Dieter Bilitza Department of Physics and Astronomy, George Mason University, Fairfax, Virginia, USA and Heliospheric Laboratory, NASA Goddard Space Flight Center, Greenbelt,

More information

NASA and International Open Standards and the Future of Space Weather Studies

NASA and International Open Standards and the Future of Space Weather Studies NASA and International Open Standards and the Future of Space Weather Studies D. Aaron Roberts NASA Goddard Space Flight Center ISWI2017, 4 August 2107 Virtual Observatory A virtual observatory is

More information

An Overview and Tutorial in the Use and Creation of CDF Files

An Overview and Tutorial in the Use and Creation of CDF Files An Overview and Tutorial in the Use and Creation of CDF Files Bob McGuire, Tami Kovalick, Bernie Harris and Bobby Candey Space Physics Data Facility Heliophysics Science Division (Code 670) NASA Goddard

More information

Mission Archive Plan for the Advanced Composition Explorer 2017 February 13 Andrew Davis and the ACE Science Team

Mission Archive Plan for the Advanced Composition Explorer 2017 February 13 Andrew Davis and the ACE Science Team Mission Archive Plan for the Advanced Composition Explorer 2017 February 13 Andrew Davis and the ACE Science Team 1. Introduction This document describes the Mission Archive Plan (MAP) for the Advanced

More information

Data Retrieval Issues

Data Retrieval Issues ESA Space Weather Programme Study Final Presentation R1. Overview R2. Detailed Rationale R3. Benefits R4. Market Analysis R5. System Requirements R6. Space Segment Definition R7. Ground Segment R8. Prototype

More information

Heliospheric Physics Data and Computing Working Group

Heliospheric Physics Data and Computing Working Group Heliospheric Physics Data and Computing Working Group Report to the Heliospheric Physics Subcommittee of the NASA Advisory Council Raymond J. Walker July 7, 2006 HPDCWG Andrew Davis Cal Tech Chuck Goodrich

More information

Published by IUGONET Project Team, Sep

Published by IUGONET Project Team, Sep Instructions for data analysis software: - Preparation - The IUGONET project and its products for space weather study - Installation - How to Use SPEDAS, part1 - How to Use SPEDAS, part2 Published by IUGONET

More information

Heliophysics Python Plan

Heliophysics Python Plan Heliophysics Python Plan Russell A. Stoneback Center for Space Sciences Photon Audio Lab The University of Texas at Dallas 27 July 2018 Snakes on a Spaceship: The Return of the Python Motivation Developing

More information

Advanced Topics in Python

Advanced Topics in Python Advanced Topics in Python Russell A. Stoneback Center for Space Sciences, University of Texas at Dallas 25 June 2018 Snakes on a Spaceship: The Return of the Python CEDAR Workshop 1 Who am I to tell you

More information

DATA PROCESSING, DATA BASES AND TOOLS AVAILABLE: PRESENT AND FUTURE D. Heynderickx, B. Quaghebeur Belgian Institute for Space Aeronomy, Brussels, Belg

DATA PROCESSING, DATA BASES AND TOOLS AVAILABLE: PRESENT AND FUTURE D. Heynderickx, B. Quaghebeur Belgian Institute for Space Aeronomy, Brussels, Belg DATA PROCESSING, DATA BASES AND TOOLS AVAILABLE: PRESENT AND FUTURE D. Heynderickx, B. Quaghebeur Belgian Institute for Space Aeronomy, Brussels, Belgium ABSTRACT By their nature, space weather applications

More information

New Datasets, Functionality and Future Development. Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL) Major contributors: Jon Callahan (Mazama(

New Datasets, Functionality and Future Development. Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL) Major contributors: Jon Callahan (Mazama( HYCOM Data Service New Datasets, Functionality and Future Development Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL) Major contributors: Jon Callahan (Mazama( Consulting) Roland Schweitzer (Weathertop

More information

HDF Product Designer: A tool for building HDF5 containers with granule metadata

HDF Product Designer: A tool for building HDF5 containers with granule metadata The HDF Group HDF Product Designer: A tool for building HDF5 containers with granule metadata Lindsay Powers Aleksandar Jelenak, Joe Lee, Ted Habermann The HDF Group Data Producer s Conundrum 2 HDF Features

More information

Introduction to NetCDF

Introduction to NetCDF Introduction to NetCDF NetCDF is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. First released in 1989.

More information

ESS 261 Spring Quarter Time Series Analysis, Access to Datasets

ESS 261 Spring Quarter Time Series Analysis, Access to Datasets ESS 261 Spring Quarter 2009 Time Series Analysis, Access to Datasets Access to datasets and models: PDS, SPDF, NSSDC, Distributed datasets Reprocessing, Calculating Quantities Time formats, Spike and Gap

More information

Heliophysics Division Overview Heliophysics Subcommittee Meeting 01 March 2016 Steven W. Clarke, Director

Heliophysics Division Overview Heliophysics Subcommittee Meeting 01 March 2016 Steven W. Clarke, Director Heliophysics Division Overview Heliophysics Subcommittee Meeting 01 March 2016 Steven W. Clarke, Director Overview Topics Welcome and Opening Remarks Budget Update Division Assignment Changes National

More information

WDC ACTIVITIES IN JAPAN, 2008

WDC ACTIVITIES IN JAPAN, 2008 WDC ACTIVITIES IN JAPAN, 2008 Takashi Watanabe Solar-Terrestrial Environment Laboratory, Nagoya University Nagoya, Japan Email: c62d51ef58@yahoo.co.jp ABSTRACT This paper briefly reviews the activities

More information

Building Software Architecture using Architectural Design Patterns

Building Software Architecture using Architectural Design Patterns Building Software Architecture using Architectural Design s U.V.R. Sarma Department of CSE CVR College of Engg. Ibrahimpatan(M), R.R. District, A.P., India Neelakantam Pavani Department of IT CVR College

More information

The SSA Programme and SWE Segment status + view towards Period 3. SWWT Steering Board meeting 15 th November, 2016

The SSA Programme and SWE Segment status + view towards Period 3. SWWT Steering Board meeting 15 th November, 2016 The SSA Programme and SWE Segment status + view towards Period 3 SWWT Steering Board meeting 15 th November, 2016 ESA SSA Programme Objective: Protection of space and ground assets against adverse effects

More information

FedGeoDay Interactive Visualization of Satellite (and Other) Data Online Using Cesium. October 13, 2016

FedGeoDay Interactive Visualization of Satellite (and Other) Data Online Using Cesium. October 13, 2016 FedGeoDay 2016 Interactive Visualization of Satellite (and Other) Data Online Using Cesium October 13, 2016 Matthew Lammers (matthew.r.lammers@nasa.gov) Web Analyst/Developer NASA Goddard Space Flight

More information

A software library for space science data analysis, modelling and space weather forecasting

A software library for space science data analysis, modelling and space weather forecasting A software library for space science data analysis, modelling and space weather forecasting SpacePy team: Steve Morley 1 ; Dan Welling 2 ; Jon Niehof 3 ; Brian Larsen! 1 Los Alamos National Laboratory

More information

McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008

McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008 McIDAS-V: An open source data analysis and visualization tool for multiand hyperspectral satellite data ITSC-XVI, Angra do Reis, Brazil, 7 May 2008 Tom Achtor, Tom Rink, Tom Whittaker, Dave Parker, Gail

More information

Analysis and visualization of space science model output and data with CISM-DX

Analysis and visualization of space science model output and data with CISM-DX JOURNAL OF GEOPHYSICAL RESEARCH, VOL. 110,, doi:10.1029/2004ja010956, 2005 Analysis and visualization of space science model output and data with CISM-DX M. Wiltberger Hight Altitude Observatory, National

More information

Tom Achtor, Tom Rink, Tom Whittaker. Space Science & Engineering Center (SSEC) at the University of Wisconsin - Madison

Tom Achtor, Tom Rink, Tom Whittaker. Space Science & Engineering Center (SSEC) at the University of Wisconsin - Madison Interactive Processing of Multi- and Hyper-spectral Environmental Satellite Data: The Next Generation of McIDAS EUMETSAT-AMS Conf. Amsterdam, NL 27 September 2007 Tom Achtor, Tom Rink, Tom Whittaker Space

More information

OPeNDAP: Accessing HYCOM (and other data) remotely

OPeNDAP: Accessing HYCOM (and other data) remotely OPeNDAP: Accessing HYCOM (and other data) remotely Presented at The HYCOM NOPP GODAE Meeting By Peter Cornillon OPeNDAP Inc., Narragansett, RI 02882 7 December 2005 8/25/05 HYCOM NOPP GODAE 1 Acknowledgements

More information

Analysis Methods in Atmospheric and Oceanic Science

Analysis Methods in Atmospheric and Oceanic Science Analysis Methods in Atmospheric and Oceanic Science AOSC 652 HDF & NetCDF files; Regression; File Compression & Data Access Week 11, Day 1 Today: Data Access for Projects; HDF & NetCDF Wed: Multiple Linear

More information

EGSO An Introduction to Solar Soft

EGSO An Introduction to Solar Soft 310/1749-27 ICTP-COST-USNSWP-CAWSES-INAF-INFN International Advanced School on Space Weather 2-19 May 2006 EGSO An Introduction to Solar Soft Robert BENTLEY UCL Department of Space and Climate Physics

More information

NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences

NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences Russ Rew, Ed Hartnett, and John Caron UCAR Unidata Program, Boulder 2006-01-31 Acknowledgments This work was supported by the

More information

Introduction to CISM_DX and Overview of OpenDX. Michael Gehmeyr

Introduction to CISM_DX and Overview of OpenDX. Michael Gehmeyr Introduction to CISM_DX and Overview of OpenDX Michael Gehmeyr Heliophysics The CISM Knowledge Summer School Transfer Short Course NCAR AFWA, August Omaha, 2, November 2007 2-3, 2005 Examples Outline Novice

More information

Google Earth Visualization of Magnetometer Data

Google Earth Visualization of Magnetometer Data Google Earth Visualization of Magnetometer Data Brian Love Computer Science Department Augsburg College Minneapolis, MN 55454 loveb@augsburg.edu Noel Petit Computer Science Department Augsburg College

More information

UCD discussion from SSIG. B. Cecconi, S. Erard, P. Le Sidaner Observatoire de Paris

UCD discussion from SSIG. B. Cecconi, S. Erard, P. Le Sidaner Observatoire de Paris UCD discussion from SSIG B. Cecconi, S. Erard, P. Le Sidaner Observatoire de Paris Previous proposal (1) Plasma environment modeling magnetic potential vector. phys.magfield;phys.potential OR phys.magfield.potentialvector

More information

Using MMS Data with SPEDAS

Using MMS Data with SPEDAS 2000 MMS 1 FPI Ion (xy) 2015-10-16/13:06:59.985 -> 13:07:00.135 (1) 1x10-20 1x10-21 1000 1x10-22 Vy (km/s) 0 1x10-23 1x10-24 f (s 3 /cm 6 ) -1000 1x10-25 -2000 1x10-26 -2000-1000 0 1000 2000 Vx (km/s)

More information

SPACE WEATHER PRODUCT GENERATION TRANSITION FROM SWPC to NESDIS. Arthur T McClinton Jr* Noblis, Inc., Falls Church, Virginia. 1.

SPACE WEATHER PRODUCT GENERATION TRANSITION FROM SWPC to NESDIS. Arthur T McClinton Jr* Noblis, Inc., Falls Church, Virginia. 1. Session 7.8 SPACE WEATHER PRODUCT GENERATION TRANSITION FROM SWPC to NESDIS Arthur T McClinton Jr* Noblis, Inc., Falls Church, Virginia K. Mckenzie 1, S. Hill 2, C. Ortiz 2, A. Booth 3, and P. Yu 4 1 NOAA/NESDIS/OSD,

More information

Accessing and Exploiting Solar Dynamics Observatory (SDO) Data in Europe. Veronique Delouille

Accessing and Exploiting Solar Dynamics Observatory (SDO) Data in Europe. Veronique Delouille Accessing and Exploiting Solar Dynamics Observatory (SDO) Data in Europe Veronique Delouille SWWT plenary meeting, 28 June 2011 Introduction As from NASA policy: Data from SDO mission are freely available

More information

CRaTER Scence Operation Center Requirements Document. Dwg. No

CRaTER Scence Operation Center Requirements Document. Dwg. No Rev. ECO Description Author Approved Date 01 32-157 Initial Release for comment RFGoeke 7/27/06 CRaTER Scence Operation Center Requirements Document Dwg. No. 32-01209 Revision 01 July 26, 2006 32-01209

More information

Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview

Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview November 12, 2015 TSIS-1 Project Overview 1 Total and Spectral solar Irradiance Sensor (TSIS-1) Project Overview 2015 Sun-Climate Symposium Project Manager: Candace Carlisle Deputy Project Manager / Resources:

More information

HDF Update. Elena Pourmal The HDF Group. October 16, 2008 IDL User Group Meeting 1

HDF Update. Elena Pourmal The HDF Group. October 16, 2008 IDL User Group Meeting 1 HDF Update Elena Pourmal The HDF Group October 16, 2008 IDL User Group Meeting 1 The HDF Group The HDF Group is a not-for-profit company with its mission focused on the support and growth of the HDF technologies

More information

Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison

Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison Glossary API Application Programming Interface AR5 IPCC Assessment Report 4 ASCII American Standard Code for Information Interchange BUFR Binary Universal Form for the Representation of meteorological

More information

Making data access easier with OPeNDAP. James Gallapher (OPeNDAP TM ) Duan Beckett (BoM) Kate Snow (NCI) Robert Davy (CSIRO) Adrian Burton (ARDC)

Making data access easier with OPeNDAP. James Gallapher (OPeNDAP TM ) Duan Beckett (BoM) Kate Snow (NCI) Robert Davy (CSIRO) Adrian Burton (ARDC) Making data access easier with OPeNDAP James Gallapher (OPeNDAP TM ) Duan Beckett (BoM) Kate Snow (NCI) Robert Davy (CSIRO) Adrian Burton (ARDC) Outline Introduction and trajectory (James Gallapher) OPeNDAP

More information

by Virtual Reality System

by Virtual Reality System Particle Simulation Analysis by Virtual Reality System Hiroaki Ohtani 12) 1,2), Nobuaki Ohno 3), Ritoku Horiuchi 12) 1,2) 1 National Institute for Fusion Science (NIFS), Japan 2 The Graduate University

More information

escience and Archiving for Space Science

escience and Archiving for Space Science escience and Archiving for Space Science Data Science Journal (submitted 1-5-05) Timothy E. Eastman 1, James L. Green 2, Edwin J. Grayzeck 3, Robert McGuire 4, and Donald M. Sawyer 3 1 QSS Group, Inc.,

More information

BIG DATA CHALLENGES A NOAA PERSPECTIVE

BIG DATA CHALLENGES A NOAA PERSPECTIVE BIG DATA CHALLENGES A NOAA PERSPECTIVE Dr. Edward J. Kearns NASA Examiner, Science and Space Branch, OMB/EOP and Chief (acting), Remote Sensing and Applications Division National Climatic Data Center National

More information

High Performance Data Efficient Interoperability for Scientific Data

High Performance Data Efficient Interoperability for Scientific Data High Performance Data Efficient Interoperability for Scientific Data Alex Ip 1, Andrew Turner 1, Dr. David Lescinsky 1 1 Geoscience Australia, Canberra, Australia Problem: Legacy Data Formats holding us

More information

Getting Started Processing DSN Data with ODTK

Getting Started Processing DSN Data with ODTK Getting Started Processing DSN Data with ODTK 1 Introduction ODTK can process several types of tracking data produced by JPL s deep space network (DSN): two-way sequential range, two- and three-way Doppler,

More information

Planetary Science Research with the IMPEx Infrastructure

Planetary Science Research with the IMPEx Infrastructure Planetary Science Research with the IMPEx Infrastructure From science cases to an interoperable VO architecture F. Topf 1, M. Khodachenko 1, E. Kallio 2, V. Génot 3, T. Al-Ubaidi 1, M. Gangloff 3, W. Schmidt

More information

8/16/12. Computer Organization. Architecture. Computer Organization. Computer Basics

8/16/12. Computer Organization. Architecture. Computer Organization. Computer Basics Computer Organization Computer Basics TOPICS Computer Organization Data Representation Program Execution Computer Languages 1 2 Architecture Computer Organization n central-processing unit n performs the

More information

Python: Working with Multidimensional Scientific Data. Nawajish Noman Deng Ding

Python: Working with Multidimensional Scientific Data. Nawajish Noman Deng Ding Python: Working with Multidimensional Scientific Data Nawajish Noman Deng Ding Outline Scientific Multidimensional Data Ingest and Data Management Analysis and Visualization Extending Analytical Capabilities

More information

ODF Programmability What we need & What we have Robert Weir Software Architect IBM Software Group

ODF Programmability What we need & What we have Robert Weir Software Architect IBM Software Group ODF Programmability What we need & What we have Robert Weir Software Architect IBM Software Group robert_weir@us.ibm.com http://www.robweir.com/blog 2007 IBM Corporation What we had before DOC/XLS/PPT

More information

Aleksandar Jelenak NOAA Satellite and Information Service

Aleksandar Jelenak NOAA Satellite and Information Service Aleksandar Jelenak NOAA Satellite and Information Service 2012-06-19 GSICS Web Meeting 1 Agenda EUMETSAT Bias Plotting Application NetCDF template for the GEO-LEO-IR products THREDDS configuration for

More information

CelestLabX: CelestLab s extension module

CelestLabX: CelestLab s extension module ScilabTEC CelestLabX: CelestLab s extension module Alain Lamy, CNES Alain.Lamy@cnes.fr 16 May 2014 Space Flight Dynamics mission design at CNES Agenda What tools for mission design? -> What makes Scilab

More information

IDL DISCOVER WHAT S IN YOUR DATA

IDL DISCOVER WHAT S IN YOUR DATA IDL DISCOVER WHAT S IN YOUR DATA IDL Discover What s In Your Data. A key foundation of scientific discovery is complex numerical data. If making discoveries is a fundamental part of your work, you need

More information

CCSDS and NASA Standards for Satellite Control Network Interoperability

CCSDS and NASA Standards for Satellite Control Network Interoperability InterPlanetary Network & Information Systems Directorate CCSDS and NASA Standards for Satellite Network Interoperability Peter Shames Jet Propulsion Laboratory California Institute of Technology The Fundamental

More information

Steve Ansari *, Stephen Del Greco, Neal Lott NOAA National Climatic Data Center, Asheville, North Carolina 2. DATA

Steve Ansari *, Stephen Del Greco, Neal Lott NOAA National Climatic Data Center, Asheville, North Carolina 2. DATA 5A.1 THE WEATHER AND CLIMATE TOOLKIT Steve Ansari *, Stephen Del Greco, Neal Lott NOAA National Climatic Data Center, Asheville, North Carolina ABSTRACT The Weather and Climate Toolkit (WCT) is free, platform

More information

National Research Council Space Studies Board

National Research Council Space Studies Board National Research Council Space Studies Board Mary E. Kicza Assistant Administrator for Satellite and Information Services National Oceanic and Atmospheric Administration March 9, 2010 National Oceanic

More information

Background mission of the HESSI satellite solar flares purpose of the HEDC. Challenges data volume / data flow derived data types research topics

Background mission of the HESSI satellite solar flares purpose of the HEDC. Challenges data volume / data flow derived data types research topics Background mission of the HESSI satellite solar flares purpose of the HEDC Etzard Stolte IKS Group stolte@inf.ethz.ch Challenges data volume / data flow derived data types research topics Solutions system

More information

Standards-based Access to Satellite Atmospheric Composition Data

Standards-based Access to Satellite Atmospheric Composition Data www.dlr.de Chart 1 Working Group on Information Systems and Services Standards-based Access to Satellite Atmospheric Composition Data S. Falke, C. Lynnes, J. Meyer-Arnek, O. Goussev, M. Bittner et al.

More information

Incorporating 3D Modeling System with HDF (Hierarchical Data Format) for the Enhancement of Modeling

Incorporating 3D Modeling System with HDF (Hierarchical Data Format) for the Enhancement of Modeling 2012 4th International Conference on Computer Modeling and Simulation (ICCMS 2012) IPCSIT vol.22 (2012) (2012) IACSIT Press, Singapore Incorporating 3D Modeling System with HDF (Hierarchical Data Format)

More information

CCSDS Space Link Extension (SLE)

CCSDS Space Link Extension (SLE) CCSDS Space Link Extension (SLE) Proposal for a NASA Wide Ground Data Service Standard Nascom Block Phase Out Work Group Team Prepared by Larry Muzny Lockheed Martin Space Operations Consolidated Space

More information

Time series for European Space Agency Solar Orbiter Archive with TimescaleDB

Time series for European Space Agency Solar Orbiter Archive with TimescaleDB Time series for European Space Agency Solar Orbiter Archive with TimescaleDB Hector Perez, European Space Astronomy Centre, Madrid, Spain David Kohn, Timescale, NYC, US PGCONF.US 2018, 04/18/2018 ESA UNCLASSIFIED

More information

ILWS Report for Denmark. Torsten Neubert

ILWS Report for Denmark. Torsten Neubert ILWS Report for Denmark Torsten Neubert Update of re-organization in Denmark Denmark has no space agency Danish National Space Center has been merged with the Technical University of Denmark (DTU) Official

More information

PERSPECTIVE ON REMOTE ACCESS TO SPACE ENVIRONMENT MODELS AND DATABASES

PERSPECTIVE ON REMOTE ACCESS TO SPACE ENVIRONMENT MODELS AND DATABASES PERSPECTIVE ON REMOTE ACCESS TO SPACE ENVIRONMENT MODELS AND DATABASES M. Kruglanski (1), E. Speelman (1), B. Quaghebeur (1), D. Heynderickx (1) (1) Belgian Institute for Space Aeronomy, Ringlaan 3, B-1180

More information

SCSODC: Integrating Ocean Data for Visualization Sharing and Application

SCSODC: Integrating Ocean Data for Visualization Sharing and Application IOP Conference Series: Earth and Environmental Science OPEN ACCESS SCSODC: Integrating Ocean Data for Visualization Sharing and Application To cite this article: C Xu et al 2014 IOP Conf. Ser.: Earth Environ.

More information

OGC at KNMI: Current use and plans

OGC at KNMI: Current use and plans OGC at KNMI: Current use and plans 4th Workshop on the use of GIS/OGC standards in meteorology 4 th of March 2013, Reading 1. Ernst de Vreede 2. Maarten Plieger Contents 1. ADAGUC 2. Internal applications

More information

NetCDF and HDF5. NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans. Ed Hartnett, Unidata/UCAR, 2010

NetCDF and HDF5. NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans. Ed Hartnett, Unidata/UCAR, 2010 NetCDF and HDF5 NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans Ed Hartnett, Unidata/UCAR, 2010 Unidata Mission: To provide the data services, tools, and cyberinfrastructure

More information

Java Applets, etc. Instructor: Dmitri A. Gusev. Fall Lecture 25, December 5, CS 502: Computers and Communications Technology

Java Applets, etc. Instructor: Dmitri A. Gusev. Fall Lecture 25, December 5, CS 502: Computers and Communications Technology Java Applets, etc. Instructor: Dmitri A. Gusev Fall 2007 CS 502: Computers and Communications Technology Lecture 25, December 5, 2007 CGI (Common Gateway Interface) CGI is a standard for handling forms'

More information

Yuechen Chi *, Ruixin Yang, and Menas Kafatos George Mason University, Fairfax, Virginia

Yuechen Chi *, Ruixin Yang, and Menas Kafatos George Mason University, Fairfax, Virginia P1.31 A SOFTWARE SYSTEM TO SUPPORT EARTH SCIENCE DATA SERVICES Yuechen Chi *, Ruixin Yang, and Menas Kafatos George Mason University, Fairfax, Virginia Abstract In Earth science applications, data services,

More information

Toward the Development of a Comprehensive Data & Information Management System for THORPEX

Toward the Development of a Comprehensive Data & Information Management System for THORPEX Toward the Development of a Comprehensive Data & Information Management System for THORPEX Mohan Ramamurthy, Unidata Steve Williams, JOSS Jose Meitin, JOSS Karyn Sawyer, JOSS UCAR Office of Programs Boulder,

More information

Catalog-driven, Reproducible Workflows for Ocean Science

Catalog-driven, Reproducible Workflows for Ocean Science Catalog-driven, Reproducible Workflows for Ocean Science Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, Centro Universidade Monte Serrat, Santos, Brazil. 2015 Boston Light Swim, Aug 15, 7:00am

More information

APPLYING INTERACTIVE WEB PAGES

APPLYING INTERACTIVE WEB PAGES APPLYING INTERACTIVE WEB PAGES Item Type text; Proceedings Authors Self, Lance Publisher International Foundation for Telemetering Journal International Telemetering Conference Proceedings Rights Copyright

More information

SmartSSR DTN Router. Alan Mick David Edell Workshop on Spacecraft Flight Software FSW-10, 12/8/2010 NOT SUBJECT TO EXPORT (ITAR) CONTROL

SmartSSR DTN Router. Alan Mick David Edell Workshop on Spacecraft Flight Software FSW-10, 12/8/2010 NOT SUBJECT TO EXPORT (ITAR) CONTROL SmartSSR DTN Router 2010 Workshop on Spacecraft Flight Software FSW-10, 12/8/2010 NOT SUBJECT TO EXPORT (ITAR) CONTROL Alan Mick David Edell Alan.Mick@jhuapl.edu David.Edell@jhuapl.edu V02, 11/29/2010

More information

ENHANCING ACCESS AND USE OF NASA SATELLITE DATA VIA TERRAFLY

ENHANCING ACCESS AND USE OF NASA SATELLITE DATA VIA TERRAFLY ENHANCING ACCESS AND USE OF NASA SATELLITE DATA VIA TERRAFLY William Teng NASA Goddard Earth Sciences Data and Information Services Center Distributed Active Archive Center (GES DISC DAAC) Code 610.2,

More information

Basic Concepts of the Energy Lab 2.0 Co-Simulation Platform

Basic Concepts of the Energy Lab 2.0 Co-Simulation Platform Basic Concepts of the Energy Lab 2.0 Co-Simulation Platform Jianlei Liu KIT Institute for Applied Computer Science (Prof. Dr. Veit Hagenmeyer) KIT University of the State of Baden-Wuerttemberg and National

More information

Goddard Mission Services Evolution Center. GSAW Demo

Goddard Mission Services Evolution Center. GSAW Demo National Aeronautics and Space Administration Goddard Mission Services Evolution Center GSAW Demo February 29, 2012 Dan Smith and Matt Handy NASA Goddard Space Flight Center Software Engineering Division

More information

Scientific and Multidimensional Raster Support in ArcGIS

Scientific and Multidimensional Raster Support in ArcGIS Scientific and Multidimensional Raster Support in ArcGIS Sudhir Raj Shrestha sshrestha@esri.com Brief breakdown Scientific Multidimensional data Ingesting Scientific MultiDim Data in ArcGIS Ingesting and

More information

McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data *

McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data * McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data * Thomas Achtor, Thomas Rink, Thomas Whittaker, David Parker and David Santek Space Science

More information

ORIGAMI AND GIPS: RUNNING A HYPERSPECTRAL SOUNDER PROCESSING SYSTEM ON A LIGHTWEIGHT ON-DEMAND DISTRIBUTED COMPUTING FRAMEWORK

ORIGAMI AND GIPS: RUNNING A HYPERSPECTRAL SOUNDER PROCESSING SYSTEM ON A LIGHTWEIGHT ON-DEMAND DISTRIBUTED COMPUTING FRAMEWORK ORIGAMI AND GIPS: RUNNING A HYPERSPECTRAL SOUNDER PROCESSING SYSTEM ON A LIGHTWEIGHT ON-DEMAND DISTRIBUTED COMPUTING FRAMEWORK Maciej Smuga-Otto, Raymond Garcia, Graeme Martin, Bruce Flynn, Robert Knuteson

More information

Using VIVO at the Laboratory for Atmospheric and Space Physics (LASP)

Using VIVO at the Laboratory for Atmospheric and Space Physics (LASP) Using VIVO at the Laboratory for Atmospheric and Space Physics (LASP) Anne Wilson and the LASP Web Development Team VIVO 2016 Panel on Using VIVO for Scientific Applications Friday, 08.19.16 Laboratory

More information

Next Generation SPENVIS: Current status - 3rd party developments - Release. M. Kruglanski BIRA-IASB

Next Generation SPENVIS: Current status - 3rd party developments - Release. M. Kruglanski BIRA-IASB Next Generation SPENVIS: Current status - 3rd party developments - Release M. Kruglanski BIRA-IASB Next Generation SPENVIS Context: ESA General Support Technology Programme (be, es, de) ESA Technical officer:

More information

Tutorial Example - Connection of Helio Tools, AMDA/IMPEx & 3DView/IMPEx: CME impact on Venus and Earth

Tutorial Example - Connection of Helio Tools, AMDA/IMPEx & 3DView/IMPEx: CME impact on Venus and Earth Tutorial Example - Connection of Helio Tools, AMDA/IMPEx & 3DView/IMPEx: CME impact on Venus and Earth This tutorial gives an example of the interconnected use of HELIO Tools, AMDA/IMPEx functionality

More information

ECLAT In Situ data products: Event finding and Visualization tool (D230.1)

ECLAT In Situ data products: Event finding and Visualization tool (D230.1) ECLAT Event finding and Visualization tool report (D230.1) ECLAT In Situ data products: Event finding and Visualization tool (D230.1) Peter Boakes, Rumi Nakamura, Martin Volwerk and Wolfgang Baumjohann

More information

Can Harmonization be Achieved via Standardization?: New Concrete Opportunities from the CCSDS Mission Operations Services

Can Harmonization be Achieved via Standardization?: New Concrete Opportunities from the CCSDS Mission Operations Services Can Harmonization be Achieved via Standardization?: New Concrete Opportunities from the CCSDS Mission Operations Services CCSDS Spacecraft (SM&C) Mario Merri (ESA), Chair GSAW, Los Angeles, USA - 1 Mar

More information

LRO MPS. Mission Planning and Scheduling System for NASA s Lunar Reconnaissance Mission GSAW 2009

LRO MPS. Mission Planning and Scheduling System for NASA s Lunar Reconnaissance Mission GSAW 2009 LRO MPS Mission Planning and Scheduling System for NASA s Lunar Reconnaissance Mission GSAW 2009 GMV - Gonzalo Garcia: LRO MPS Project Controller - Assaf Barnoy: LRO MPS Project Manager - Theresa Beech:

More information

ACCESS 07 Phil Callahan (334), PI Brian Wilson (335), Co-I Rob Raskin (388), Co-I. October 2008

ACCESS 07 Phil Callahan (334), PI Brian Wilson (335), Co-I Rob Raskin (388), Co-I. October 2008 ACCESS 07 Phil Callahan (334), PI Brian Wilson (335), Co-I Rob Raskin (388), Co-I October 2008 Advancing Collaborative Connections for Earth System Science Phil Callahan, JPL Objective Develop a web-based

More information

Development of an information service system based on GOOGLE graphical interfaces. Instruction for the use of the MOON-VOS portal Interface

Development of an information service system based on GOOGLE graphical interfaces. Instruction for the use of the MOON-VOS portal Interface Development of an information service system based on GOOGLE graphical interfaces Instruction for the use of the MOON-VOS portal Interface Giuseppe M.R. Manzella ENEA Operational Oceanography, p.o. box

More information

ECLAT In Situ data products: Event finding and Visualization tool (D230.1)

ECLAT In Situ data products: Event finding and Visualization tool (D230.1) ECLAT Event finding and Visualization tool report (D230.1) ECLAT In Situ data products: Event finding and Visualization tool (D230.1) Peter Boakes, Rumi Nakamura, Martin Volwerk and Wolfgang Baumjohann

More information

Space Physics Interactive Data Resource SPIDR. Web-Services Guide

Space Physics Interactive Data Resource SPIDR. Web-Services Guide Space Physics Interactive Data Resource SPIDR Web-Services Guide Version 2.10 March 2010 Contents Contents...2 Introduction...3 Architectural Overview...4 SOAP-based API Specifics...5 FileService...5 SpidrService...6

More information

Contents. Introduction. CDI V3 Help Quick Search

Contents. Introduction. CDI V3 Help Quick Search Contents Introduction... 1 A The interface... 2 A-1 Introduction... 2 A-2. Results list... 2 A-3: Additional menu options... 3 B. Searching the CDI entries metadata... 4 B-1 Narrowing down your result

More information

VirES for Swarm v2.0. Swarm Science Meeting, Banff, 20-24/03/2017. Page 1

VirES for Swarm v2.0. Swarm Science Meeting, Banff, 20-24/03/2017. Page 1 VirES for Swarm v2.0 Page 1 Table of Content Layers page 3 Views page 4 View Projections page 5 Product parameters and settings page 6 Spatial and Temporal Data Selection page 7 Time Slider: date selection

More information

CLAS data format (HDF5) G.Gavalian (ODU)

CLAS data format (HDF5) G.Gavalian (ODU) CLAS data format (HDF5) G.Gavalian (ODU) Motivation For higher level physics analysis more complicated DST structure is needed. Current DST structures do not provide tools for storing Physics Analysis

More information

The Common Framework for Earth Observation Data. US Group on Earth Observations Data Management Working Group

The Common Framework for Earth Observation Data. US Group on Earth Observations Data Management Working Group The Common Framework for Earth Observation Data US Group on Earth Observations Data Management Working Group Agenda USGEO and BEDI background Concise summary of recommended CFEOD standards today Full document

More information

Simulation and Optimization

Simulation and Optimization A Major Step to Efficient Trajectory Simulation and Optimization Astrodynamics Workshop 200 Dipl.-Ing. Sven Weike ASTOS GmbH i.g Content 1. What is ASTOS? 2. History of ASTOS 3. What is new in ASTOS V6

More information

IRISpy: Expanding IRIS Data Analysis into Python and Upgrading the Solar Physics Software Paradigm for a New Generation

IRISpy: Expanding IRIS Data Analysis into Python and Upgrading the Solar Physics Software Paradigm for a New Generation Docs: http://docs.sunpy.org/projects/irispy/en/latest/ Code: github.com/sunpy/irispy Live Demo: https://github.com/danryanirish/irispy_tutorials IRISpy: Expanding IRIS Data Analysis into Python and Upgrading

More information

Telemetry Processing and Display Ground System

Telemetry Processing and Display Ground System The MPCS Multimission Telemetry Processing and Display Ground System Its Use in the Mars Science Laboratory Mission and Beyond Josh Choi, Lloyd Deforrest, Marti DeMore Jet Propulsion Laboratory California

More information

Development of Formation Flight and Docking Algorithms Using the SPHERES Testbed

Development of Formation Flight and Docking Algorithms Using the SPHERES Testbed Development of Formation Flight and Docking Algorithms Using the Testbed Prof. David W. Miller MIT Allen Chen, Alvar Saenz-Otero, Mark Hilstad, David W. Miller Introduction : Synchronized Position Hold

More information

Science Data Processing and Data Products

Science Data Processing and Data Products and Data Products Chris Pankratz LASP/CU (303)492-0696 chris.pankratz@lasp.colorado.edu Page 1 Abstract The SORCE Science Data System will produce assigned EOS Standard Products using data acquired from

More information

Ocean Color Data Formats and Conventions:

Ocean Color Data Formats and Conventions: Ocean Color Data Formats and Conventions: NASA's perspective Sean Bailey NASA Goddard Space Flight Center 07 May 2013 International Ocean Color Science Meeting Darmstadt, Germany 1 The Big Picture The

More information

Design and Implementation of Data Models & Instrument Scheduling of Satellites in a Space Based Internet Emulation System

Design and Implementation of Data Models & Instrument Scheduling of Satellites in a Space Based Internet Emulation System Design and Implementation of Data Models & Instrument Scheduling of Satellites in a Space Based Internet Emulation System Karthik N Thyagarajan Masters Thesis Defense December 20, 2001 Defense Committee:

More information

P2.1 Accessing HDF5 data via OPeNDAP. MuQun Yang* 1, Hyo-Kyung Lee 1, James Gallagher 2. I. Introduction

P2.1 Accessing HDF5 data via OPeNDAP. MuQun Yang* 1, Hyo-Kyung Lee 1, James Gallagher 2. I. Introduction P2.1 Accessing HDF5 data via OPeNDAP MuQun Yang* 1, Hyo-Kyung Lee 1, James Gallagher 2 1 The HDF Group, 2 OPeNDAP, Inc. I. Introduction HDF[1] is a set of data formats and software libraries for storing

More information

HDF Product Designer Documentation

HDF Product Designer Documentation HDF Product Designer Documentation Release 1.0.2 The HDF Group May 29, 2015 Contents 1 Introduction 3 2 What s New 5 3 Known Issues 7 4 Getting Started 9 4.1 Download.................................................

More information

Remote Data Access with OPeNDAP. Dr. Dennis Heimbigner Unidata netcdf Workshop October 25, 2012

Remote Data Access with OPeNDAP. Dr. Dennis Heimbigner Unidata netcdf Workshop October 25, 2012 Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netcdf Workshop October 25, 2012 Overview What are OPeNDAP and DAP? What is a Client-Server Architecture Why is Remote Data Access Useful?

More information