IMOS/AODN ocean portal: tools for data delivery. Roger Proctor, Peter Blain, Sebastien Mancini IMOS

Transcription

1 IMOS/AODN ocean portal: tools for data delivery Roger Proctor, Peter Blain, Sebastien Mancini IMOS

2 Data from IMOS: The six Nodes Bluewater and Climate Node open ocean focus Five Regional Nodes continental shelf and coastal focus Western Australia Queensland WAIMOS QIMOS New South Wales Southern Australia Tasmania BwC SAIMOS NSW-IMOS TasIMOS

3

4 Elements of the information infrastructure Distributed Data Storage All IMOS data stored on ARCS/AERO Data Fabric ( RDSI) publicly accessible directories archive storage of raw data Data Delivery OPeNDAP servers/thredds catalog; Data Fabric Data subsetting and aggregation netcdf, flat ascii, csv IMOS > 2 million files, 30Tb data, ~2000 metadata records

5 IMOS Data Standards metadata standard: ISO 19115/19139 Marine Community Profile Metadata exchange: Catalog Services for the Web (CSW) Legal standard: Creative Commons data format: Climate and Forecast NetCDF Convention data download: Web Feature Service (WFS) OPeNDAP Sensor Observation Service (SOS) data visualisation: Web Map Service (WMS)

6 IMOS Data Standards metadata standard: ISO 19115/19139 Marine Community Profile Metadata exchange: Catalog Services for the Web (CSW) Legal standard: Creative Commons data format: Climate and Forecast NetCDF Convention data download: Web Feature Service (WFS) OPeNDAP Sensor Observation Service (SOS) data visualisation: Web Map Service (WMS)

7 Portal screenshot (October 2012) IMOS measures > 250 parameters

8 IMOS observations in the coastal zone

9 IMOS Ocean Portal: imos.aodn.org.au

10 IMOS Ocean Portal: imos.aodn.org.au

11 Integrated latest observations

12 Map view or search

13 HF Radar data in WA

14 Filtering datasets

15 Filtering datasets

16 Filtering datasets

17 Select mooring data by region

18 Argo Aggregations By year By region Atlantic N Pacific S Pacific Indian

19 SOOP XBT Aggregations by line, by year by region Australia (NE, NW, SE, SW) Southern Ocean Tasman Sea

20 an interoperable, online network of marine and coastal data resources Australia s interface to large amounts of otherwise undiscoverable marine data infrastructure & visualisation tools to establish free access to data and metadata neither generating, nor storing data! #1 challenge of publishing interoperable data from multiple disciplines! #2 the AODN can only work if people / researchers / institutes agree to share data! Australian Antarctic Division Australian Institute of Marine Science Bureau of Meteorology CSIRO Marine and Atmospheric Research Geoscience Australia Royal Australian Navy Hydrography and Metoc Branch Australian Ocean Data Centre Joint Facility (AODC JF)

21 IMOS and AODN distributed data and information network AAD RAN GA AIMS CSIRO BoM AODN portal NIWA Pacific Islands? ALA TERN

22 User discovers Datasets Through Metadata query AODN Portal User constructs Maps AODN Functional Diagram User Selects from map and plots or Downloads data User Downloads Data files Master Metadata Catalog (Geonetwork) Harvesting Geonetwork Metadata Catalog Geoserver Web Services (WMS, WFS) THREDDS Catalogs netcdf data files Harvesting Other Metadata Catalogs Imagery, Shapefiles Relational Databases AODN portal

23 User discovers Datasets Through Metadata query AODN Portal User constructs Maps AODN Functional Diagram User Selects from map and plots or Downloads data User Downloads Data files A node of AODN Master Metadata Catalog (Geonetwork) Harvesting Geonetwork Metadata Catalog Geoserver Web Services (WMS, WFS) THREDDS Catalogs netcdf data files Harvesting Other Metadata Catalogs Imagery, Shapefiles Relational Databases AODN portal

24 User discovers Datasets Through Metadata query AODN Portal User constructs Maps AODN Functional Diagram User Selects from map and plots or Downloads data User Downloads Data files A node of AODN Master Metadata Catalog (Geonetwork) Harvesting Geonetwork Metadata Catalog Geoserver Web Services (WMS, WFS) THREDDS Catalogs netcdf data files Harvesting Other Metadata Catalogs Imagery, Shapefiles Relational Databases AODN portal

25 Map layers for contributors, includes IMOS

26

27 CoastalWatch beach cameras

28 CoastalWatch beach cameras

29 CoastalWatch beach cameras

30 Shoreline photos in WA

31 Shoreline photos in WA

32 Shoreline photos in WA

33 Shoreline photos in WA

34 AODN brings in additional datasets, e.g. XBT and CTD data from the Navy and the Research Vessels

35 And coastal observations for the GBR

36

37

38

39 Spatial/Temporal Search Search for data in a space time region. Combine with other search criteria such as parameter.

40 Faceted Search Faceted searching is due to be released in late October. Faceted searching became popular in online retailing, and is now a ubiquitous feature for searching lists on web sites. The portal s implementation will allow navigation of datasets using facets such as parameter, location, and organisation. Other facets will be added as the MCP schema is refined.

41 Machine interface for searching RAMADDA provides a web query service for searching IMOS & AODN datasets. This interface is used by external services such as the Marine Virtual Laboratory (MARVL). It is available at It is possible to query by date, time, parameter, and many other criteria. OPeNDAP URLs can be returned for further querying. Output types include JSON and XML.

42 Animation of Gridded Data Visualise your data before downloading Animations controls: Play, Pause, Fast Forward, etc Select a date range Select an individual time step Download animated gifs Share animations via a URL

43 Model animations e.g. Ribbon model

44 SETAS model

45 Aggregate Gridded Data Data split across multiple files can be subsetted, aggregated, and returned as a single 3D file covering a requested space/time region. The service is backed by the AODAAC aggregator and will soon be available through the portal s user interface.

46 Next steps

47 Next steps subset regions and along tracks

48 Australian National Environmental Information Infrastructure IMOS data as a demonstrator within prototype NEII NEII Services Pathfinder Architecture overview 1. Spatial Information Services Stack (SISS) 2. Production information model registry 3. SISS configured for NEII data services across: air, land, water, ocean 4. Linked-data demonstrator 5. User interface for menu-driven querying

49 Linking IMOS data to NEII IMOS/AODN

50 Linking IMOS data to NEII IMOS/AODN SOS

51 Linking IMOS data to NEII IMOS/AODN ncsos

52 Timeseries comparison of model ( ) and observation ( )

53 Scope of Models and Products Bluelink? OceanMaps, other ocean models Atmos forcing? ACCESS Climatologies? BRAN, CARS, NW shelf? BGC data bio-optical database + NRS + SOOP MARS database inclusion? Sedsim data and model? Bathy data? Wave data? Sea level data?

54 Publish Your Model Output! The AODN publishes model data The AODN cookbook describes how to contribute

55 The End