IMOS/AODN ocean portal: tools for data delivery. Roger Proctor, Peter Blain, Sebastien Mancini IMOS

IMOS/AODN ocean portal: tools for data delivery Roger Proctor, Peter Blain, Sebastien Mancini IMOS

Data from IMOS: The six Nodes Bluewater and Climate Node open ocean focus Five Regional Nodes continental shelf and coastal focus Western Australia Queensland WAIMOS QIMOS New South Wales Southern Australia Tasmania BwC SAIMOS NSW-IMOS TasIMOS

Elements of the information infrastructure Distributed Data Storage All IMOS data stored on ARCS/AERO Data Fabric ( RDSI) publicly accessible directories archive storage of raw data Data Delivery OPeNDAP servers/thredds catalog; Data Fabric Data subsetting and aggregation netcdf, flat ascii, csv IMOS > 2 million files, 30Tb data, ~2000 metadata records

IMOS Data Standards metadata standard: ISO 19115/19139 Marine Community Profile Metadata exchange: Catalog Services for the Web (CSW) Legal standard: Creative Commons data format: Climate and Forecast NetCDF Convention data download: Web Feature Service (WFS) OPeNDAP Sensor Observation Service (SOS) data visualisation: Web Map Service (WMS)

Portal screenshot (October 2012) IMOS measures > 250 parameters

IMOS observations in the coastal zone

IMOS Ocean Portal: imos.aodn.org.au

Integrated latest observations

Map view or search

HF Radar data in WA

Filtering datasets

Select mooring data by region

Argo Aggregations By year By region Atlantic N Pacific S Pacific Indian

SOOP XBT Aggregations by line, by year by region Australia (NE, NW, SE, SW) Southern Ocean Tasman Sea

an interoperable, online network of marine and coastal data resources Australia s interface to large amounts of otherwise undiscoverable marine data infrastructure & visualisation tools to establish free access to data and metadata neither generating, nor storing data! #1 challenge of publishing interoperable data from multiple disciplines! #2 the AODN can only work if people / researchers / institutes agree to share data! Australian Antarctic Division Australian Institute of Marine Science Bureau of Meteorology CSIRO Marine and Atmospheric Research Geoscience Australia Royal Australian Navy Hydrography and Metoc Branch Australian Ocean Data Centre Joint Facility (AODC JF)

IMOS and AODN distributed data and information network AAD RAN GA AIMS CSIRO BoM AODN portal NIWA Pacific Islands? ALA TERN

User discovers Datasets Through Metadata query AODN Portal User constructs Maps AODN Functional Diagram User Selects from map and plots or Downloads data User Downloads Data files Master Metadata Catalog (Geonetwork) Harvesting Geonetwork Metadata Catalog Geoserver Web Services (WMS, WFS) THREDDS Catalogs netcdf data files Harvesting Other Metadata Catalogs Imagery, Shapefiles Relational Databases AODN portal http://portal.aodn.org.au/webportal/

User discovers Datasets Through Metadata query AODN Portal User constructs Maps AODN Functional Diagram User Selects from map and plots or Downloads data User Downloads Data files A node of AODN Master Metadata Catalog (Geonetwork) Harvesting Geonetwork Metadata Catalog Geoserver Web Services (WMS, WFS) THREDDS Catalogs netcdf data files Harvesting Other Metadata Catalogs Imagery, Shapefiles Relational Databases AODN portal http://portal.aodn.org.au/webportal/

http://portal.aodn.org.au Map layers for contributors, includes IMOS

http://portal.aodn.org.au

CoastalWatch beach cameras

Shoreline photos in WA

AODN brings in additional datasets, e.g. XBT and CTD data from the Navy and the Research Vessels

And coastal observations for the GBR

http://www.bom.gov.au/oceanography/tides/

http://www.bom.gov.au/oceanography/projects/abslmp/data/index.shtml

Spatial/Temporal Search Search for data in a space time region. Combine with other search criteria such as parameter.

Faceted Search Faceted searching is due to be released in late October. Faceted searching became popular in online retailing, and is now a ubiquitous feature for searching lists on web sites. The portal s implementation will allow navigation of datasets using facets such as parameter, location, and organisation. Other facets will be added as the MCP schema is refined.

Machine interface for searching RAMADDA provides a web query service for searching IMOS & AODN datasets. This interface is used by external services such as the Marine Virtual Laboratory (MARVL). It is available at http://ramadda.aodn.org.au It is possible to query by date, time, parameter, and many other criteria. OPeNDAP URLs can be returned for further querying. Output types include JSON and XML.

Animation of Gridded Data Visualise your data before downloading Animations controls: Play, Pause, Fast Forward, etc Select a date range Select an individual time step Download animated gifs Share animations via a URL

Model animations e.g. Ribbon model

SETAS model

Aggregate Gridded Data Data split across multiple files can be subsetted, aggregated, and returned as a single 3D file covering a requested space/time region. The service is backed by the AODAAC aggregator and will soon be available through the portal s user interface.

Next steps

Next steps subset regions and along tracks

Australian National Environmental Information Infrastructure IMOS data as a demonstrator within prototype NEII NEII Services Pathfinder Architecture overview 1. Spatial Information Services Stack (SISS) 2. Production information model registry 3. SISS configured for NEII data services across: air, land, water, ocean 4. Linked-data demonstrator 5. User interface for menu-driven querying

Linking IMOS data to NEII IMOS/AODN

Linking IMOS data to NEII IMOS/AODN SOS

Linking IMOS data to NEII IMOS/AODN ncsos

http://www.csiro.au/tasman/portal/index.htm# Timeseries comparison of model ( ) and observation ( )

Scope of Models and Products Bluelink? OceanMaps, other ocean models Atmos forcing? ACCESS Climatologies? BRAN, CARS, NW shelf? BGC data bio-optical database + NRS + SOOP MARS database inclusion? Sedsim data and model? Bathy data? Wave data? Sea level data?

Publish Your Model Output! The AODN publishes model data The AODN cookbook describes how to contribute

The End