The HDF-EOS5 Tutorial. Ray Milburn L3 Communciations, EER Systems Inc McCormick Drive, 170 Largo, MD USA
|
|
|
- Dinah O’Connor’
- 5 years ago
- Views:
Transcription
1 The HDF-EOS5 Tutorial Ray Milburn L3 Communciations, EER Systems Inc McCormick Drive, 170 Largo, MD USA
2 What is HDF-EOS? HDF (Hierarchical Data Format) is a disk-based format chosen by NASA as a standard for EOS program HDF-EOS is an extension to HDF which standardizes common Earth Sciences data structures HDF-EOS2 based on HDF4 is used operationally by EOS TERRA and AQUA instrument teams HDF-EOS5, based on HDF5 is newer and will be used by EOS AURA instruments Contains Geolocation Information: Structural metadata links Geolocation and science data 2
3 HDF-EOS 5 Library Provides Grid/Point/Swath/ZA interfaces Allows to create/access Grid/Point/Swath/ZA and manipulate their objects (data sets, attributes, etc.) Written in C with FORTRAN-77 wrappers C-function names prefixed with HE5_ FORTRAN-77 calls have similar naming convention 3
4 Grid Structure Data organized by regular geographic spacing, specified by projection parameters. Structure Multidimensional data arrays Geolocation information is given implicitly by projection parameters contained in structural metadata 4
5 Grid Data Example 5
6 Swath Structure Data is organized by time or track parameter Data spacing can be irregular Structure Geolocation information stored explicitly in Geolocation Field (2-D array) Data stored in multidimensional arrays Time stored in 1-D or 2-D array SM links Geolocation and science data 6
7 Swath Data Example 7
8 Point Structure Data is specified temporally and/or spatially, but with no particular organization Structure Tables used to store science data at a particular Lat/Long/Height Up to eight levels of data allowed. Structural metadata specifies relationship between levels. 8
9 Point Data Example Lat Lon Temp(C) Dewpt(C)
10 Zonal Average (ZA) Structure Generalized array structure with no geolocation linkage Data can be organized by time or track parameter Data spacing can be irregular Structure Data stored in multidimensional arrays Time stored in 1-D or 2-D array SM links science data 10
11 HDF-EOS Grid Structure Usage - Data which is organized by regular geographic spacing, specified by projection parameters. Structure Any number of 2-D to 8-D data arrays per structure, one per data type (e.g. temperature) Geolocation information contained in projection formula, coupled by structural metadata. Any number of Grid structures per file allowed. 11
12 HDF-EOS Swath Structure Usage - Data which is organized by time, monotonic geolocation, track parameter. Spacing can be irregular. Structure Geolocation information stored explicitly in Geolocation Field (2-D array) Data stored in 2-D or 3-D arrays Time stored in 1-D or 2-D array, TAI is standard. Geolocation/science data connected by structural 12 metadata
13 HDF-EOS Point Structure Usage - Data which is specified temporally and/or spatially, but with no particular organization. Structure Tables (Vdatas) used to store science data at a particular Lat/Long/Height. Up to eight levels of data allowed. Structural metadata specifies relationship between levels. 13
14 HDF-EOS ZA Structure Usage - Data which is organized by time, track parameter. Spacing can be irregular. Structure Data stored in 2-D or 3-D arrays Time stored in 1-D or 2-D array, TAI is standard. Science data connected by structural metadata 14
15 Basic HDF-EOS5 Functions Access - Open, create, close objects/files Definition - Set key parameters of data sets Input/Output - Read/Write data Inquiry - Return information about data Subset - Read data from specified region 15
16 File/Object Access GRID: HE5_GDopen/he5_gdopen HE5_GDcreate/he5_gdcreate HE5_GDattach/he5_gdattach HE5_GDdetach/he5_gddetach HE5_GDclose/he5_gdclose 16
17 File/Object Access POINT: HE5_PTopen/he5_ptopen HE5_PTcreate/he5_ptcreate HE5_PTattach/he5_ptattach HE5_PTdetach/he5_ptdetach HE5_PTclose/he5_ptclose 17
18 File/Object Access SWATH: HE5_SWopen/he5_swopen HE5_SWcreate/he5_swcreate HE5_SWattach/he5_swattach HE5_SWdetach/he5_swdetach HE5_SWclose/he5_swclose 18
19 File/Object Access ZA: HE5_ZAopen/he5_zaopen HE5_ZAcreate/he5_zacreate HE5_ZAattach/he5_zaattach HE5_ZAdetach/he5_zadetach HE5_ZAclose/he5_zaclose 19
20 Definition GRID: HE5_GDdefdim/he5_gddefdim HE5_GDdefproj/he5_gddefproj HE5_GDdeforigin/he5_gddeforigin HE5_GDdefpixreg/he5_gd_defpreg 20
21 Definition POINT: HE5_PTdeflevel/he5_ptdeflevel HE5_PTdeflinkage/he5_ptdeflinkage 21
22 Definition SWATH: HE5_SWdefdim/he5_swdefdim HE5_SWdefdimmap/he5_swdefmap HE5_SWdefidxmap/he5_swdefimap HE5_SWdefgeofield/he5_swdefgfld HE5_SWdefdatafield/he5_swdefdfld 22
23 Definition ZA: HE5_ZAdefdim/he5_zadefdim HE5_ZAdefine/he5_zadefine HE5_ZAdefcomp/he5_zadefcomp HE5_ZAdefchunk/he5_zadefchunk 23
24 Input/Output GRID: HE5_GDwritefield/he5_gdwrfld HE5_GDreadfield/he5_gdrdfld HE5_GDwriteattr/he5_gdwrattr HE5_GDreadattr/he5_gdrdattr 24
25 Input/Output POINT: HE5_PTwritelevel/he5_ptwritelevel HE5_PTreadlevel/he5_ptreadlevel HE5_PTwriteattr/he5_ptwrattr HE5_PTreadattr/he5_ptrdattr 25
26 Input/Output SWATH: HE5_SWwritefield/he5_swwrfld HE5_SWreadfield/he5_swrdfld HE5_SWwriteattr/he5_swwrattr HE5_SWreadattr/he5_swrdattr 26
27 Input/Output ZA: HE5_ZAwrite/he5_zawrite HE5_ZAread/he5_zaread HE5_ZAwriteattr/he5_zawrattr HE5_ZAreadattr/he5_zardattr 27
28 Inquiry GRID: HE5_GDinqdims/he5_gdinqdims HE5_GDdiminfo/he5_gddiminfo HE5_GDprojinfo/he5_gdprojinfo HE5_GDorigininfo/he5_gdorigininfo HE5_GDpixreginfo/he5_gdpreginfo 28
29 Inquiry POINT: HE5_PTlevelinfo/he5_ptlevelinfo HE5_PTinqattrs/he5_ptinqattrs HE5_PTattrinfo/he5_ptattrinfo 29
30 Inquiry SWATH: HE5_SWinqdatafields/he5_swinwdflds HE5_SWinqgeofields/he5_swinqgflds HE5_SWinqattrs/he5_swinqattrs HE5_SWattrinfo/he5_swattrinfo 30
31 Inquiry ZA: HE5_ZAinquire/he5_zainquire HE5_ZAinfo/he5_zainfo HE5_ZAinqattrs/he5_zainqattrs HE5_ZAattrinfo/he5_zaattrinfo 31
32 Programming Model Open the HDF-EOS5 file Create or Attach to a specified Grid/Swath/Point/ZA object Define key object features and/or perform necessary operations (with the data sets, attributes, etc) Detach from the Grid/Swath/Point/ZA object Close the HDF-EOS5 file 32
33 HDF-EOS Tools and Utilities heconvert - command-line utility to convert HDF-EOS2 objects to HDF-EOS5 objects HE5View - X-Motif based tool which displays all parts of the HDF-EOS5 objects JEB - Java EOS Browser - Java based tool to display HDF4, HDF-EOS2 and HDF- EOS5 objects 33
The Web Hierarchical Ordering Mechanism (WHOM) a tool for ordering HDF and HDF-EOS Data
The Goddard Earth Sciences Distributed Active Archive Center http://daac.gsfc.nasa.gov The Web Hierarchical Ordering Mechanism (WHOM) a tool for ordering HDF and HDF-EOS Data Presented by: James E. Johnson
SciSpark 201. Searching for MCCs
SciSpark 201 Searching for MCCs Agenda for 201: Access your SciSpark & Notebook VM (personal sandbox) Quick recap. of SciSpark Project What is Spark? SciSpark Extensions scitensor: N-dimensional arrays
An HDF-EOS and Data Formatting Primer for the ECS Project
175-WP-001-002 An HDF-EOS and Data Formatting Primer for the ECS Project White Paper March 2001 Prepared Under Contract NAS5-60000 RESPONSIBLE ENGINEER E. M. Taaheri /s/ 3-1-2001 David Wynne, Abe Taaheri
HDF Update. Elena Pourmal The HDF Group. October 16, 2008 IDL User Group Meeting 1
HDF Update Elena Pourmal The HDF Group October 16, 2008 IDL User Group Meeting 1 The HDF Group The HDF Group is a not-for-profit company with its mission focused on the support and growth of the HDF technologies
Definition of Level 1B Radiance product for OMI
Definition of Level 1B Radiance product for OMI document: RS-OMIE-KNMI-206 version: 1.0 date: 31 July 2000 authors: J.P. Veefkind KNMI veefkind@knmi.nl A. Mälkki FMI anssi.malkki@fmi.fi R.D. McPeters NASA
HDF-EOS Subsetting: HEW and other tools
HDF-EOS Subsetting: HEW and other tools HDF and San Francisco, CA Dr. Sara Graves, Bruce Beaumont, Helen Conover, Matt Smith Presented by Steve Tanner University of Alabama in Huntsville, Information Technology
HDF- A Suitable Scientific Data Format for Satellite Data Products
HDF- A Suitable Scientific Data Format for Satellite Data Products Sk. Sazid Mahammad, Debajyoti Dhar and R. Ramakrishnan Data Products Software Division Space Applications Centre, ISRO, Ahmedabad 380
Exercises with Level-2 satellite data
Exercises with Level-2 satellite data Mati Kahru WimSoft, http://www.wimsoft.com Email: wim@wimsoft.com also at Scripps Institution of Oceanography UCSD, La Jolla, CA 92093-0218, USA mkahru@ucsd.edu 10/25/2008
DIAS_Satellite_MODIS_SurfaceReflectance dataset
DIAS_Satellite_MODIS_SurfaceReflectance dataset 1. IDENTIFICATION INFORMATION DOI Metadata Identifier DIAS_Satellite_MODIS_SurfaceReflectance dataset doi:10.20783/dias.273 [http://doi.org/10.20783/dias.273]
Analysis Methods in Atmospheric and Oceanic Science
Analysis Methods in Atmospheric and Oceanic Science AOSC 652 HDF & NetCDF files; Regression; File Compression & Data Access Week 11, Day 1 Today: Data Access for Projects; HDF & NetCDF Wed: Multiple Linear
Addressing the Variety Challenge to Ease the Systemization of Machine Learning in Earth Science
Addressing the Variety Challenge to Ease the Systemization of Machine Learning in Earth Science K-S Kuo 1,2,3, M L Rilee 1,4, A O Oloso 1,5, K Doan 1,3, T L Clune 1, and H-F Yu 6 1 NASA Goddard Space Flight
11A.3 INVESTIGATION OF USING HDF5 ARCHIVAL INFORMATION PACKAGES (AIP) TO STORE NASA ECS DATA
11A.3 INVESTIGATION OF USING HDF5 ARCHIVAL INFORMATION PACKAGES (AIP) TO STORE NASA ECS DATA MuQun Yang* 1, Ruth Duerr 2, Choonghwan Lee 1 1 The HDF Group, 2 National Snow and Ice Data Center (NSIDC),
Satellite Science Data Processing with
Satellite Science Data Processing with PostgreSQL Curt Tilmes Curt.Tilmes@nasa.gov PGCon 2008 May 22, 2008 Outline Background MODIS and Ozone Processing Science Data Processing Architecture Evolution Metadata
Dataset Interoperability Recommendations for Earth Science
Status of this RFC Dataset Interoperability Recommendations for Earth Science This RFC provides information to the NASA Earth Science community. This RFC does not specify an Earth Science Data Systems
Goddard Atmospheric Composition Data Center: Aura Data and Services in One Place
Goddard Atmospheric Composition Data Center: Aura Data and Services in One Place G. Leptoukh, S. Kempler, I. Gerasimov, S. Ahmad, J. Johnson Goddard Earth Sciences Data and Information Services Center,
The netcdf- 4 data model and format. Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012
The netcdf- 4 data model and format Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012 NetCDF data models, formats, APIs Data models for scienbfic data and metadata - classic: simplest model - - dimensions,
Python: Working with Multidimensional Scientific Data. Nawajish Noman Deng Ding
Python: Working with Multidimensional Scientific Data Nawajish Noman Deng Ding Outline Scientific Multidimensional Data Ingest and Data Management Analysis and Visualization Extending Analytical Capabilities
NetCDF and Scientific Data Durability. Russ Rew, UCAR Unidata ESIP Federation Summer Meeting
NetCDF and Scientific Data Durability Russ Rew, UCAR Unidata ESIP Federation Summer Meeting 2009-07-08 For preserving data, is format obsolescence a non-issue? Why do formats (and their access software)
HDF Product Designer: A tool for building HDF5 containers with granule metadata
The HDF Group HDF Product Designer: A tool for building HDF5 containers with granule metadata Lindsay Powers Aleksandar Jelenak, Joe Lee, Ted Habermann The HDF Group Data Producer s Conundrum 2 HDF Features
Improving Access to Multi-dimensional Self-describing Scientific Datasets Λ
Improving Access to Multi-dimensional Self-describing Scientific Datasets Λ Beomseok Nam and Alan Sussman UMIACS and Dept. of Computer Science University of Maryland College Park, MD fbsnam,alsg@cs.umd.edu
Level 2 Radar-Lidar GEOPROF Product VERSION 1.0 Process Description and Interface Control Document
Recommendation JPL Document No. D-xxxx CloudSat Project A NASA Earth System Science Pathfinder Mission Level 2 Radar-Lidar GEOPROF Product VERSION 1.0 Process Description and Interface Control Document
PyNGL & PyNIO Geoscience Visualization & Data IO Modules
PyNGL & PyNIO Geoscience Visualization & Data IO Modules SciPy 08 Dave Brown National Center for Atmospheric Research Boulder, CO Topics What are PyNGL and PyNIO? Quick summary of PyNGL graphics PyNIO
Western U.S. TEMPO Early Adopters
Western U.S. TEMPO Early Adopters NASA Langley Atmospheric Science Data Center (ASDC) Distributed Active Archive Center (DAAC) Services April 10-11, 2018 NASA Langley s ASDC is part of NASA s EOSDIS NASA
Adapting Software to NetCDF's Enhanced Data Model
Adapting Software to NetCDF's Enhanced Data Model Russ Rew UCAR Unidata EGU, May 2010 Overview Background What is netcdf? What is the netcdf classic data model? What is the netcdf enhanced data model?
Search, Order and Customize NASA SMAP Data with NASA Earthdata Search
Search, Order and Customize NASA SMAP Data with NASA Earthdata Search In this step-by-step tutorial, we will demonstrate how to search, order, and customize NASA Soil Moisture Active Passive, or SMAP data
Writing NetCDF Files: Formats, Models, Conventions, and Best Practices. Overview
Writing NetCDF Files: Formats, Models, Conventions, and Best Practices Russ Rew, UCAR Unidata June 28, 2007 1 Overview Formats, conventions, and models NetCDF-3 limitations NetCDF-4 features: examples
Exercises with Level-2 satellite data
Exercises with Level-2 satellite data Mati Kahru WimSoft, http://www.wimsoft.com Email: wim@wimsoft.com & Scripps Institution of Oceanography UCSD, La Jolla, CA 92093-0218, USA mkahru@ucsd.edu 24-Jan-15
ENHANCING ACCESS AND USE OF NASA SATELLITE DATA VIA TERRAFLY
ENHANCING ACCESS AND USE OF NASA SATELLITE DATA VIA TERRAFLY William Teng NASA Goddard Earth Sciences Data and Information Services Center Distributed Active Archive Center (GES DISC DAAC) Code 610.2,
MODIS Atmosphere: MOD35_L2: Format & Content
Page 1 of 9 File Format Basics MOD35_L2 product files are stored in Hierarchical Data Format (HDF). HDF is a multi-object file format for sharing scientific data in multi-platform distributed environments.
SciSpark Tutorial 101
SciSpark Tutorial 101 Introduction to Spark Super Cool Parallel Computing In-Memory Map-Reduce It Slices, It Dices, It Minces,... So Fast, You Won t Believe It!!! ORDER NOW!!! Agenda for 101: Intro. to
NOAA CLASS Demo. Jorel Torres JPSS Satellite Liaison, CIRA/CSU 21 January 2017 AMS Short Course: Experiencing JPSS Capabilities, Seattle, WA
NOAA CLASS Demo Jorel Torres JPSS Satellite Liaison, CIRA/CSU 21 January 2017 AMS Short Course: Experiencing JPSS Capabilities, Seattle, WA www.class.noaa.gov Step 1: Go to www.class.noaa.gov and click
Encoding of Swath Data in CF
Encoding of Swath Data in CF 2017 EarthCube netcdf-cf Workshop Aleksandar Jelenak, The HDF Group Daid Santek, Uniersity of Wisconsin/SSEC Kent Yang, The HDF Group Robert Carp, Uniersity of Wisconsin/SSEC
NetCDF and HDF5. NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans. Ed Hartnett, Unidata/UCAR, 2010
NetCDF and HDF5 NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans Ed Hartnett, Unidata/UCAR, 2010 Unidata Mission: To provide the data services, tools, and cyberinfrastructure
Development of an information service system based on GOOGLE graphical interfaces. Instruction for the use of the MOON-VOS portal Interface
Development of an information service system based on GOOGLE graphical interfaces Instruction for the use of the MOON-VOS portal Interface Giuseppe M.R. Manzella ENEA Operational Oceanography, p.o. box
Ocean Color Data Formats and Conventions:
Ocean Color Data Formats and Conventions: NASA's perspective Sean Bailey NASA Goddard Space Flight Center 07 May 2013 International Ocean Color Science Meeting Darmstadt, Germany 1 The Big Picture The
Provenance Tracking in an Earth Science Data Processing System
Provenance Tracking in an Earth Science Data Processing System Curt Tilmes 1 and Albert J. Fleig 2 1 NASA Goddard Space Flight Center, Greenbelt, MD 20771,USA, Curt.Tilmes@nasa.gov 2 PITA Analytic Sciences,
Agent Framework For Intelligent Data Processing
Agent Framework For Intelligent Data Processing Rahul Ramachandran, Sara Graves, Sunil Movva and Xiang Li Information Technology and Systems Center University of Alabama in Huntsville rramachandran@itsc.uah.edu
NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences
NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences Russ Rew, Ed Hartnett, and John Caron UCAR Unidata Program, Boulder 2006-01-31 Acknowledgments This work was supported by the
Terms and definitions * keep definitions of processes and terms that may be useful for tests, assignments
Lecture 1 Core of GIS Thematic layers Terms and definitions * keep definitions of processes and terms that may be useful for tests, assignments Lecture 2 What is GIS? Info: value added data Data to solve
Preprocessed Input Data. Description MODIS
Preprocessed Input Data Description MODIS The Moderate Resolution Imaging Spectroradiometer (MODIS) Surface Reflectance products provide an estimate of the surface spectral reflectance as it would be measured
Using ESML in a Semantic Web Approach for Improved Earth Science Data Usability
Using in a Semantic Web Approach for Improved Earth Science Data Usability Rahul Ramachandran, Helen Conover, Sunil Movva and Sara Graves Information Technology and Systems Center University of Alabama
HDF Product Designer Documentation
HDF Product Designer Documentation Release 1.6.0 The HDF Group Dec 01, 2017 Contents 1 Contents: 3 1.1 Getting Started.............................................. 3 1.2 Usage...................................................
The Logical Data Store
Tenth ECMWF Workshop on Meteorological Operational Systems 14-18 November 2005, Reading The Logical Data Store Bruce Wright, John Ward & Malcolm Field Crown copyright 2005 Page 1 Contents The presentation
GREASE Grid Aware End-to-end Analysis and Simulation Environment
GREASE Grid Aware End-to-end Analysis and Simulation Environment Mark ter Linden 25 October 2002 Project! Started July 2002, ends June 2003 URD ready SSD, SVVP in progress Prototyping in progress Setup
7C.2 EXPERIENCE WITH AN ENHANCED NETCDF DATA MODEL AND INTERFACE FOR SCIENTIFIC DATA ACCESS. Edward Hartnett*, and R. K. Rew UCAR, Boulder, CO
7C.2 EXPERIENCE WITH AN ENHANCED NETCDF DATA MODEL AND INTERFACE FOR SCIENTIFIC DATA ACCESS Edward Hartnett*, and R. K. Rew UCAR, Boulder, CO 1 INTRODUCTION TO NETCDF AND THE NETCDF-4 PROJECT The purpose
ECSS Project: Prof. Bodony: CFD, Aeroacoustics
ECSS Project: Prof. Bodony: CFD, Aeroacoustics Robert McLay The Texas Advanced Computing Center June 19, 2012 ECSS Project: Bodony Aeroacoustics Program Program s name is RocfloCM It is mixture of Fortran
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data Liping Di, Aijun Chen, Wenli Yang and Peisheng Zhao achen6@gmu.edu; achen@laits.gmu.edu Lab for Advanced Information
Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom
The Met Office s Logical Store Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom Background are the lifeblood of the Met Office. However, over time, the organic, un-governed growth of
Geographic Information Systems. using QGIS
Geographic Information Systems using QGIS 1 - INTRODUCTION Generalities A GIS (Geographic Information System) consists of: -Computer hardware -Computer software - Digital Data Generalities GIS softwares
DATA FUSION, DE-NOISING, AND FILTERING TO PRODUCE CLOUD-FREE TEMPORAL COMPOSITES USING PARALLEL TEMPORAL MAP ALGEBRA
DATA FUSION, DE-NOISING, AND FILTERING TO PRODUCE CLOUD-FREE TEMPORAL COMPOSITES USING PARALLEL TEMPORAL MAP ALGEBRA Bijay Shrestha Dr. Charles O Hara Preeti Mali GeoResources Institute Mississippi State
HDF Product Designer Documentation
HDF Product Designer Documentation Release 1.0.2 The HDF Group May 29, 2015 Contents 1 Introduction 3 2 What s New 5 3 Known Issues 7 4 Getting Started 9 4.1 Download.................................................
Tom Achtor, Tom Rink, Tom Whittaker. Space Science & Engineering Center (SSEC) at the University of Wisconsin - Madison
Interactive Processing of Multi- and Hyper-spectral Environmental Satellite Data: The Next Generation of McIDAS EUMETSAT-AMS Conf. Amsterdam, NL 27 September 2007 Tom Achtor, Tom Rink, Tom Whittaker Space
THREDDS and the THREDDS Data Server (TDS) Don Murray CU/CIRES Slides by Ethan Davis - Unidata
THREDDS and the THREDDS Data Server (TDS) Don Murray CU/CIRES Slides by Ethan Davis - Unidata THREDDS Data Server (TDS) Web server for scienmfic data (wripen in 100% Java) Can serve any dataset the netcdf-
Download and Use of the GIS JMARS
Download and Use of the GIS JMARS Guide Dr Marlene Bamberg March 2015 JMARS is an acronym and stands for Java Mission- planning and Analysis for Remote Sensing. It was developed by the Mars Space Flight
In this exercise, you ll create a netcdf raster layer using the variable tmin. You will change the display by selecting a different time step.
Learning to Work with Temporal Data in ArcGIS Working with a netcdf File in ArcGIS Objective NetCDF (network Common Data Form) is a file format for storing multidimensional scientific data (variables)
Kenneth A. Hawick P. D. Coddington H. A. James
Student: Vidar Tulinius Email: vidarot@brandeis.edu Distributed frameworks and parallel algorithms for processing large-scale geographic data Kenneth A. Hawick P. D. Coddington H. A. James Overview Increasing
Dataset Interoperability Working Group
Dataset Interoperability Working Group Co-Chairs: Charlie Zender and Peter Leonard Ed Armstrong, Mary Jo Brodzik, Joe Glassy, Aleksander Jelenak, Siri Jodha Khalsa, Wenli Yang; Steve Berrick, Chris Lynnes,
SME1013 PROGRAMMING FOR ENGINEERS
SME1013 PROGRAMMING FOR ENGINEERS Ainullotfi bin Abdul Latif Faculty of Mechanical Engineering UTM Problem Solving Recognise and understand the problem (what is it that needed to be solved?) List the parameters
Assessments of MODIS On-orbit Spatial and Spectral Characterization
EOS Assessments of MODIS On-orbit Spatial and Spectral Characterization Jack Xiong, Dan Link, Kevin Twedt, and Ben Wang NASA GSFC, Greenbelt, MD 0, USA SSAI, 00 Greenbelt Road, Lanham, MD 00, USA Acknowledgements
CF-netCDF and CDM. Ethan Davis, John Caron, Ben Domenico, Stefano Nativi* UCAR Unidata Univ of Florence*
CF-netCDF and CDM Ethan Davis, John Caron, Ben Domenico, Stefano Nativi* UCAR Unidata Univ of Florence* OGC in MetOcean, Toulouse, France, November 2009 CF-netCDF and CDM CF-netCDF CDM/netCDF-java TDS
Projections for use in the Merced River basin
Instructions to download Downscaled CMIP3 and CMIP5 Climate and Hydrology Projections for use in the Merced River basin Go to the Downscaled CMIP3 and CMIP5 Climate and Hydrology Projections website. 1.
Introduction to NetCDF
Introduction to NetCDF NetCDF is a set of software libraries and machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. First released in 1989.
Ocean, Atmosphere & Climate Model Assessment for Everyone
Ocean, Atmosphere & Climate Model Assessment for Everyone Rich Signell USGS Woods Hole, MA Unidata 2014 DeSouza Award Presentation Boulder, CO : Sep 15, 2014 2 US Integrated Ocean Observing System (IOOS
Introduction to ArcCatalog
Introduction to ArcCatalog Introduction To Arc Catalog ArcCatalog is a data- centric GUI tool used for managing spatial data With ArcCatalog you can. Inspect properties and attributes of data Preview and
McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data *
McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data * Thomas Achtor, Thomas Rink, Thomas Whittaker, David Parker and David Santek Space Science
17/07/2013 RASTER DATA STRUCTURE GIS LECTURE 4 GIS DATA MODELS AND STRUCTURES RASTER DATA MODEL& STRUCTURE TIN- TRIANGULAR IRREGULAR NETWORK
RASTER DATA STRUCTURE GIS LECTURE 4 GIS DATA MODELS AND STRUCTURES Space is subdivided into regular grids of square grid cells or other forms of polygonal meshes known as picture elements (pixels) the
3.Data Abstraction. Prof. Tulasi Prasad Sariki SCSE, VIT, Chennai 1 / 26
3.Data Abstraction Prof. Tulasi Prasad Sariki SCSE, VIT, Chennai www.learnersdesk.weebly.com 1 / 26 Outline What can be visualized? Why Do Data Semantics and Types Matter? Data Types Items, Attributes,
Alexander Lyuty 29, Staromonetny per., Moscow, , Russia Institute of Geography, Russian Academy of Sciences
SEARCHING INTERNET SERVER FOR THE ELECTRONIC LIBRARIES OF MAPS AND GEOSPATIAL INFORMATION METADATA AS A SCIENTIFIC AND PRACTICAL PROBLEM OF THE GLOBAL GEOINFORMATIC MAPPING Alexander Martynenko a_martynenko@mail.ru
LARGE SCALE SATELLITE IMAGE PROCESSING USING HADOOP FRAMEWORK
LARGE SCALE SATELLITE IMAGE PROCESSING USING HADOOP FRAMEWORK Bhagyashri Kamble 1, Namrata Harishchandre 2, Vrushali Kunjir 3 1 Student,Department of Computer Engineering, Sinhgad Academy of Engineering,
Data Mining Support for Aerosol Retrieval and Analysis:
Data Mining Support for Aerosol Retrieval and Analysis: Our Approach and Preliminary Results Zoran Obradovic 1 joint work with Amy Braverman 2, Bo Han 1, Zhanqing Li 3, Yong Li 1, Kang Peng 1, Yilian Qin
Outline Overview of Spatiotemporal data Storage and management of temporal data Feature Raster Array (netcdf) Visualization of temporal data Analysis
Working with Temporal Data in ArcGIS Nawajish Noman Jeff Bigos Workshop on Spatial-Temporal Modeling Center for Geographic Analysis, Harvard University, April 10 th 2009 Outline Overview of Spatiotemporal
Welcome! Virtual tutorial starts at 15:00 BST
Welcome! Virtual tutorial starts at 15:00 BST Parallel IO and the ARCHER Filesystem ARCHER Virtual Tutorial, Wed 8 th Oct 2014 David Henty Reusing this material This work is licensed
EGI Programmatic Access User Documentation
EGI Programmatic Access User Documentation Programmatic Access of EOSDIS DAAC Hosted Services User Documentation Updated 02/14/2017 Overview What is Programmatic Access? What Does It Look Like? Using curl
MySQL for Developers with Developer Techniques Accelerated
Oracle University Contact Us: 02 696 8000 MySQL for Developers with Developer Techniques Accelerated Duration: 5 Days What you will learn This MySQL for Developers with Developer Techniques Accelerated
CERA GUI Usage. Revision History. Contents
CERA GUI Usage Revision History Revision Author Scope February-2017 DKRZ Data management Public release Contents Introduction...2 Intended Audience...2 Revision History...2 Interface...2 Browse...4 Search...6
(Towards) A metadata model for atmospheric data resources
(Towards) A metadata model for atmospheric data resources Anne De Rudder and Jean-Christopher Lambert Belgian Institute for Space Aeronomy (IASB-BIRA), Brussels The context EU FP7 Ground-based atmospheric
Co-existence: Can Big Data and Big Computation Co-exist on the Same Systems?
Co-existence: Can Big Data and Big Computation Co-exist on the Same Systems? Dr. William Kramer National Center for Supercomputing Applications, University of Illinois Where these views come from Large
Example use of TES data Susan Kulawik, California Institute of Technology Government sponsorship acknowledged
Example use of TES data Susan Kulawik, 2009 2009 California Institute of Technology Government sponsorship acknowledged The following shows how to find, browse plots of, download, plot, and compare TES
The ncvar Package. October 8, 2004
The ncvar Package October 8, 2004 Version 1.0-3 Date 2004-10-08 Title High-level R Interface to NetCDF Datasets Author Maintainer Depends R (>= 1.7), RNetCDF This package provides
Oracle Spatial Users Conference
April 27, 2006 Tampa Convention Center Tampa, Florida, USA Stephen Smith GIS Solutions Manager Large Image Archive Management Solutions Using Oracle 10g Spatial & IONIC RedSpider Image Archive Outline
PH5: AN INTRODUCTION. A Look at the PH5 Format and a Hands-On Demonstration to Build Your Own Archive
PH5: AN INTRODUCTION A Look at the PH5 Format and a Hands-On Demonstration to Build Your Own Archive Agenda Introduction to PH5 Hands-on building a PH5 archive Validating and viewing a PH5 archive Sending
John Caron Unidata October 2012
John Caron Unidata October 2012 NetCDF is a File format Store data model objects Persistence layer NetCDF- 3, netcdf- 4 SoDware library Implements the API C, Java, others API An API is the interface to
Data Discovery Tools and Services Part A
Data Discovery Tools and Services Part A A Panel Presentation: Pat Liggett, Ron Weaver, Sean Hardman, Ben Holt (with help from Dave Gallaher, SIDC) October 15, 16 2008 Burbank Airport Marriott User Scenario:
McIDAS-V Tutorial Displaying Polar Satellite Imagery updated July 2016 (software version 1.6)
McIDAS-V Tutorial Displaying Polar Satellite Imagery updated July 2016 (software version 1.6) McIDAS-V is a free, open source, visualization and data analysis software package that is the next generation
Hierarchical Data Format 5:
Hierarchical Data Format 5: Giusy Muscianisi g.muscianisi@cineca.it SuperComputing Applications and Innovation Department May 17th, 2013 Outline What is HDF5? Overview to HDF5 Data Model and File Structure
ASTER User s Guide. ERSDAC Earth Remote Sensing Data Analysis Center. 3D Ortho Product (L3A01) Part III. (Ver.1.1) July, 2004
ASTER User s Guide Part III 3D Ortho Product (L3A01) (Ver.1.1) July, 2004 ERSDAC Earth Remote Sensing Data Analysis Center ASTER User s Guide Part III 3D Ortho Product (L3A01) (Ver.1.1) TABLE OF CONTENTS
GrADS for Beginners. Laura Mariotti
GrADS for Beginners Laura Mariotti mariotti@ictp.it Outline n What is GrADS and how do I get it? n GrADS essentials n Getting started n Gridded data sets n Displaying data n Script language n Saving your
NetCDF- Java Overview. John Caron Oct 29, 2010
NetCDF- Java Overview John Caron Oct 29, 2010 Contents Data Models / Shared Dimensions Coordinate Systems Feature Types NetCDF Markup Language (NcML) THREDDS Data Server (TDS) NetCDF- 3 data model MulMdimensional
GSAW The Earth Observing System (EOS) Ground System: Leveraging an Existing Operational Ground System Infrastructure to Support New Missions
GSAW 2016 The Earth Observing System (EOS) Ground System: Leveraging an Existing Operational Ground System Infrastructure to Support New Missions David Hardison NASA Goddard Space Flight Center Johnny
NCL variable based on a netcdf variable model
NCL variable based on a netcdf variable model netcdf files self describing (ideally) all info contained within file no external information needed to determine file contents portable [machine independent]
SES 123 Global and Regional Energy Lab Worksheet
SES 123 Global and Regional Energy Lab Worksheet Introduction An important aspect to understand about our planet is global temperatures, including spatial variations, such as between oceans and continents
Configuring ThingWorx Manufacturing Apps. Easy Guide
Configuring ThingWorx Manufacturing Apps Easy Guide Introduction EASY GUIDE ThingWorx Manufacturing Apps include ThingWorx Controls Advisor, ThingWorx Asset Advisor, and ThingWorx Production Advisor (coming
COMPARISON OF LOCAL CSPP VIIRS SDRS WITH GLOBAL NOAA PRODUCTS FOR VALIDATION AND MONITORING OF THE EARS-VIIRS SERVICE STEPHAN ZINKE
1 EUM/TSS/DOC/15/798085, v1, 2015-04-15 COMPARISON OF LOCAL CSPP VIIRS SDRS WITH GLOBAL NOAA PRODUCTS FOR VALIDATION AND MONITORING OF THE EARS-VIIRS SERVICE STEPHAN ZINKE TOC Product Validation Introduction
PyTables. An on- disk binary data container, query engine and computa:onal kernel. Francesc Alted
PyTables An on- disk binary data container, query engine and computa:onal kernel Francesc Alted Tutorial for the PyData Conference, October 2012, New York City 10 th anniversary of PyTables Hi!, PyTables
Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison
Glossary API Application Programming Interface AR5 IPCC Assessment Report 4 ASCII American Standard Code for Information Interchange BUFR Binary Universal Form for the Representation of meteorological
STRATEGIES FOR ALTERNATE APPROACHES FOR VEGETATION INDICES COMPOSITING USING PARALLEL TEMPORAL MAP ALGEBRA
STRATEGIES FOR ALTERNATE APPROACHES FOR VEGETATION INDICES COMPOSITING USING PARALLEL TEMPORAL MAP ALGEBRA Bijay Shrestha, Dr. Charles O Hara Dr. Nicholas H. Younan Mississippi State University OUTLINE
Large Irregular Datasets and the Computational Grid
Large Irregular Datasets and the Computational Grid Joel Saltz University of Maryland College Park Computer Science Department Johns Hopkins Medical Institutions Pathology Department Computational grids
OpenSearch GeoSpatial-Time and! Earth Observation Extensions!
OpenSearch GeoSpatial-Time and! Earth Observation Extensions! Heterogeneous Mission Accessibility for Science HMA-S Kick-Off Meeting Thursday, January 24, 2013 Fabrice Brito (on behalf of P. Gonçalves)
presented by: Tim Haithcoat University of Missouri Columbia
12 presented by: Tim Haithcoat University of Missouri Columbia Introduction Very early attempts to build GIS began from scratch, using limited tools like operating systems & compilers More recently, GIS