NCL variable based on a netcdf variable model

Similar documents
Workshop Overview Objective comfortable with NCL; minimize learning curve workshop will not make you an expert access, process and visualize data

Workshop Overview Objective comfortable with NCL minimize learning curve access, process and visualize your data workshop will not make you an expert

Data Processing. Dennis Shea National Center for Atmospheric Research. NCAR is sponsored by the National Science Foundation

File IO. Shapefiles Vis5D. Dennis Shea National Center for Atmospheric Research. NCAR is sponsored by the National Science Foundation

Introduction to NCL File I/O

Lab: Scientific Computing Tsunami-Simulation

Adapting Software to NetCDF's Enhanced Data Model

fixnc Documentation Release Nikolay Koldunov

Interpreting JULES output

The ncvar Package. October 8, 2004

PyNGL & PyNIO Geoscience Visualization & Data IO Modules

GEOS-Chem for advanced users and introduction to HEMCO

03-Creating_NetCDF. Stephen Pascoe. 1 Creating NetCDF data in Python. 1.1 NetCDF Model Revision. 1.2 Creating/Opening/Closing a netcdf file

Open Geospatial Consortium Inc.

Day 3: Diagnostics and Output

Writing NetCDF Files: Formats, Models, Conventions, and Best Practices. Overview

Preparation. Login to yellowstone.ucar.edu with -X. my-machine> ssh X Run an X application to test your X forwarding

Preparation. Login to mirage[0,1,2].ucar.edu with X terminal. siliu% > ssh X

The Soil Database of China for Land Surface modeling

Exercise Overview. Customize your history output. Namelist + Code modification Add a new output field to the code. Change a tuning parameter

Introduction to NCL Graphics. Mark Branson steals from Mary Haley and Dennis Shea

An introduction to netcdf diagnostics in GEOS-Chem. Bob Yantosca Senior Software Engineer 05 Oct 2017

Dataset Interoperability Recommendations for Earth Science

NetCDF-4: : Software Implementing an Enhanced Data Model for the Geosciences

netcdf-ld SKOS: demonstrating Linked Data vocabulary use within netcdf-compliant files

NetCDF = Network Common Data Form

Dynamical Downscaling Tutorial

IPSL Boot Camp Part 5:

netcdf Operators [NCO]

Parallel I/O and Portable Data Formats PnetCDF and NetCDF 4

Transition Guide NCL à PyNGL

netcdf- Java/CDM and THREDDS Data Server (TDS) Ethan Davis Unidata October 2010

Data Processing Steps Between Observation Data, Model Data, and Live Access Server in the AOSN Program

There is also a more in-depth GUI called the Curve Fitting Toolbox. To run this toolbox, type the command

Prac%cal Session 3: Atmospheric Model Configura%on Op%ons. Andrew Ge>elman

COM INTRO 2016: GRIB Decoding - Solutions to practicals. Solution to Practical 1: using grib_dump and grib_ls

NetCDF and Scientific Data Durability. Russ Rew, UCAR Unidata ESIP Federation Summer Meeting

04-Atmospheric_Data_Formats

The NetCDF Users Guide

Mini-Language Reference Manual

The netcdf- 4 data model and format. Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012

COM INTRO 2017: GRIB Decoding - Solutions to practicals. Solution to Practical 1: using grib_dump and grib_ls

MATLAB & Practical Application on Climate Variability Studies EXERCISES

In this exercise, you ll create a netcdf raster layer using the variable tmin. You will change the display by selecting a different time step.

GrADS for Beginners. Laura Mariotti

NCL Regridding using ESMF

Introduction to NetCDF

Online Trajectory Module in COSMO - A short user guide

NetCDF and HDF5. NASA Earth Science Data Systems Working Group October 20, 2010 New Orleans. Ed Hartnett, Unidata/UCAR, 2010

7C.2 EXPERIENCE WITH AN ENHANCED NETCDF DATA MODEL AND INTERFACE FOR SCIENTIFIC DATA ACCESS. Edward Hartnett*, and R. K. Rew UCAR, Boulder, CO

A data model of the Climate and Forecast metadata conventions (CF-1.6) with a software implementation (cf-python v2.1)

Documentation for csi2ncdf

cdo Data Processing (and Production) Luis Kornblueh, Uwe Schulzweida, Deike Kleberg, Thomas Jahns, Irina Fast

WRF-NMM Standard Initialization (SI) Matthew Pyle 8 August 2006

Open Geospatial Consortium

Remote Data Access with OPeNDAP. Dr. Dennis Heimbigner Unidata netcdf Workshop October 25, 2012

IDF Format and Content Specification

D2.4 EU-CIRCLE climate hazards metadata and standards

(A)ATSR Land Surface Temperature (LST) Product (UOL_LST_L2) Level 2 User Guide. v 1.0

IMOS NETCDF USER S MANUAL

Data Centre NetCDF Implementation Pilot

WRF Utilities. Cindy Bruyère

Encoding of Swath Data in CF

Start > All Programs > OpenGrADS 2.0 > Grads Prompt

Acquiring and Processing NREL Wind Prospector Data. Steven Wallace, Old Saw Consulting, 27 Sep 2016

How Can We Use NetCDF Extractor V.2.0?

Visualization of GRIB Files GrADS: Grid Analysis and Display System NCVIEW

Python: Working with Multidimensional Scientific Data. Nawajish Noman Deng Ding

Multi-disciplinary interoperability challenges

Dataset Interoperability (formerly HDF5 Conventions) Working Group

eccodes BUFR encoding

Olga Abramkina, Y. Meurdesoif, M.H Nguyen, Y. Wang, A. Caubel, R. Lacroix, J. Dérouillat. U 2 U. t XIOS XIOS TUTORIAL : CEA/LSCE - IPSL 3/7/17

NetCDF Metadata Guidelines for FY 2011 IOC NOAA Climate Data Records

A brief introduction 1 to retrieving ERA Interim via the web and webapi

Overview Trajectory Details

IMOS NETCDF CONVENTIONS

Towards Linked Data Conventions for Delivery of Environmental Data Using netcdf

EGI Programmatic Access User Documentation

Climate Data Management System

Version 3 Updated: 10 March Distributed Oceanographic Match-up Service (DOMS) User Interface Design

Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison

Package cmsaf. August 6, 2018

OPeNDAP Aggregation Server Guide Version 1.4

ECMWF Environment on the CRAY practical solutions

ceda-di Documentation

NCAR Insitu Turbulence EDR Software Requirements

Neil Berg October 18 th, The wonderful world of NCO

16 th Annual CESM Workshop s Software Engineering Working Group. Parallel Analysis of GeOscience Data Status and Future

NetCDF-4: A New Data Model, Programming Interface, and Format Using HDF5

Wind Site Assessment Dashboard API User Guide

DEPARTMENT OF INFORMATICS. Development of a tool for postprocessing of simulated earthquake data

GRIB API advanced tools

Writing an OPeNDAP Client Document version 1.1

University of Michigan Space Physics Research Laboratory

AMENDMENT RECORD AMENDMENT RECORD SHEET

The NetCDF Tutorial. NetCDF the Easy Way NetCDF Version Last Updated 19 February Ed Hartnett Unidata Program Center

grib_api.h File Reference

NetCDF- Java Overview. John Caron Oct 29, 2010

SES 123 Global and Regional Energy Lab Worksheet

netcdf4- python: A python interface to the netcdf C library Jeff Whitaker NOAA Earth System Research Lab

Transcription:

NCL variable based on a netcdf variable model netcdf files self describing (ideally) all info contained within file no external information needed to determine file contents portable [machine independent] software [source Unidata] designed for generality, not high performance parallel reads are possible; no parallel writes [version 3.6] variable model: simple array oriented (may) have descriptive info [meta data] limited data structures no ragged arrays; no record/nested structures only one unlimited (record) dimension [version 3.6] 1

Examining a netcdf file ncdump file_name less dumps the entire contents of a file ncdump -h file_name less dumps the header info NCL equivalent: print (f) ncdump -v U file_name less NCL equivalent: print (U) Note: ncdump is a Unidata utility not a netcdf Operator (NCO) not associated with NCL ncview to visualize file contents [COARDS] ncl_filedump file_name [ more general ] netcdf, GRIB, HDF, HDF-EOS Parts of netcdf file ncdump -h 1999.nc DIMENSIONS: dimensions: lat = 64 ; lon = 128 ; time = 12 ; FILE ATTRIBUTES: global attributes: :title = Temp: 1999" ; :source = NCAR ; :conventions = "None" ; VARIABLES: Names, Attributes, Coordinates variables: float lat(lat) ; lat:long_name = "latitude" ; lat:units = "degrees_north" ; float lon(lon) ; lon:long_name = "longitude" ; lon:units = "degrees_east" ; int time(time) ; time:long_name = "time" ; time:units = "Month of Year" ; float T(time, lat, lon) ; T:long_name = Temperature ; T:units = C" ; T:missing_value = 1.e+20f ; T:_FillValue = 1.e+20f exercise: ncdump h UV300.nc less 2

X Scalar or Array attributes long_name _FillValue units add_offset scale_factor netcdf [NCL] Variable model coordinates time lev lat lon f = addfile( foo.nc, r ) x = f->x NCL reads the scalar/array, attributes, and coordinate variables as an object accessed via @ values Scalar or Array X attributes long_name _FillValue units add_offset scale_factor ; grb/hdf accessed via & coord var time lev lat lon netcdf Version 3.6 current version 3.6 [released Feb 2005] Large File Support [LFS] available Files > 2GB, though any one variable can not > 2GB All 64-bit architectures have LFS Some 32-bit OS have LFS, including linux Portability can be issue if others do not have LFS 3

netcdf Version 4.0 [ Oct 2006?] netcdf API implemeneted on top of HDF5 will write HDF5 but use netcdf API many new capabilities backward compatible compression multiple unlimited dimensions parallel IO multi-dimensional coordinate variables [? V4.1] hierarchial grouping of data user data types NCL developers working with Unidata netcdf Info URLs http://www.unidata.ucar.edu/software/netcdf What s New http://www.unidata.ucar.edu/software/netcdf/docs/bestpractices.html Good info to know http://www.unidata.ucar.edu/software/netcdf/netcdf-4/ Learn about netcdf-4 4

The slides that follow are.. For NCL class. Detailed Look netcdf Variable (ncl) ncl <return> ncl 0 > f = addfile ("UV300.nc", "r") ncl 1 > u = f->u ncl 2 > printvarsummary (u) ; interactive mode ; open file ; import STRUCTURE ; overview of variable Variable: u Type: float Total Size: 65536 bytes 16384 values Number of Dimensions: 3 Dimensions and Sizes: [time 2] x [lat 64] x [lon 128] Coordinates: time: [ 1.. 7 ] lat: [ -87.8638.. 87.8638 ] lon: [ 0.. 357.185] Number of Attributes: 5 _FillValue : 1e36 units : m/s long_name : Zonal Wind Component short_name : U missing_value : 1e36 Classic netcdf Variable Model NCL syntax/funcs query use modify add any aspect of data object 5

Picture: 2D netcdf Variable Model Latitude coordinate variable (1D, &) coordinate variables attributes @: long_name units Longitude coordinate variable (1D, &) NCL is NOT LIMITED to netcdf conforming variables eg: 2D coordinate arrays (curvilinear coords) UNLIMITED dimension special dimension essentially a record dimension time dimension is most frequently unlimited used by the NCO to concatenate files no special meaning to NCL when creating output file in NCL (optional) filedimdef (outputfile, time, -1, True ) example: ncdump -h T2m_ud.nc netcdf T2m_ud { dimensions: time = UNLIMITED ; // (204 currently) lat = 94 ; lon = 192 ; lev = 18} 6