climate4impact.eu Christian Pagé, CERFACS

Similar documents
Existing Solutions. Operating data services: Climate Explorer ECA&D climate4impact.eu data.knmi.nl

CLIPC portal: driven by climate4impact.eu services

InfraStructure for the European Network for Earth System modelling. From «IS-ENES» to IS-ENES2

IS-ENES2 1 st General Assembly th June 2014 UPC Campus, Barcelona, Spain. ESGF Use, CORDEX, ongoing developments

IS- ENES2 Key Performance Indicators

European and international background

ExArch: Climate analytics on distributed exascale data archives Martin Juckes, V. Balaji, B.N. Lawrence, M. Lautenschlager, S. Denvil, G. Aloisio, P.

OGC at KNMI: Current use and plans

Index Introduction Setting up an account Searching and accessing Download Advanced features

CoG: The NEW ESGF WEB USER INTERFACE

ExArch, Edinburgh, March 2014

The CEDA Web Processing Service for rapid deployment of earth system data services

Data near processing support for climate data analysis. Stephan Kindermann, Carsten Ehbrecht Deutsches Klimarechenzentrum (DKRZ)

Climate Science s Globally Distributed Infrastructure

SEVENTH FRAMEWORK PROGRAMME Capacities Specific Programme Research Infrastructures

Updated ranking of GCM-RCM results for five Scandinavian locations

Meta4+CMIP5. Bryan Lawrence, Gerry Devine and many many others

Kepler Scientific Workflow and Climate Modeling

The statistical downscaling portal. An end-to-end tool for regional impact studies

The Future of ESGF. in the context of ENES Strategy

Data Reference Syntax Governing Standards within Climate Research Data archived in the ESGF

ESGF IdEA: Iden-ty, En-tlement and Access Management

RENKU - Reproduce, Reuse, Recycle Research. Rok Roškar and the SDSC Renku team

Update of the. ENES infrastructure strategy

International Big Science Coming to Your Campus Soon (Sooner Than You Think )

Data Access and Analysis with Distributed, Federated Data Servers in climateprediction.net

Modeling groups and Data Center Requirements. Session s Keynote. Sébastien Denvil, CNRS, Institut Pierre Simon Laplace (IPSL)

Joint DOE, NASA, NOAA, NSF, IS-ENES, and ANU/NCI Conference

Software Test Plan Version 1.0

Identifier Infrastructure Usage for Global Climate Reporting

Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners

Clare Richards, Benjamin Evans, Kate Snow, Chris Allen, Jingbo Wang, Kelsey A Druken, Sean Pringle, Jon Smillie and Matt Nethery. nci.org.

Introduction to the ESMValTool

ICAT Job Portal. a generic job submission system built on a scientific data catalog. IWSG 2013 ETH, Zurich, Switzerland 3-5 June 2013

Downscaling tools for adapting climate predictions to the user's needs: Challenges for their integration into climate services

The Regional Climate Model Evalua4on System (RCMES): Introduc4on and Demonstra4on

Reports on user support, training, and integration of NEMO and EC-Earth community models Milestone MS6

- C3Grid Stephan Kindermann, DKRZ. Martina Stockhause, MPI-M C3-Team

Managing Research Data for Diverse Scientific Experiments

The C3S Climate Data Store and its upcoming use by CAMS

This version is the same as NetCDF Extractor V.2.0, but it has an API for plotting contour and heat map graphs.

Release Notes March 2016

ECMWF Copernicus Procurement

Workload Management. Stefano Lacaprara. CMS Physics Week, FNAL, 12/16 April Department of Physics INFN and University of Padova

Deliverable D3.12. Contract number: OJEU 2010/S Deliverable: D3.12 Author: Igor Antolovic Date: Version: Final

NextData System of Systems Infrastructure (ND-SoS-Ina)

Earth System Sciences in the Times of Brilliant Technologies

Oracle Big Data Cloud Service, Oracle Storage Cloud Service, Oracle Database Cloud Service

EVOlution of EO Online Data Access Services (EVO-ODAS) ESA GSTP-6 Project by DLR, EOX and GeoSolutions (2015/ /04)

Open Data and its enemies

Microsoft Partner Day. Introduction to SharePoint for.net Developer

HDF Product Designer: A tool for building HDF5 containers with granule metadata

Python in the Copernicus Climate Change Service

Database Developers Forum APEX

Advanced Systems Engineering Methodologies and Tools for Gateway Selection and Configuration

Introduction to the Europeana SIP CREATOR

EUDAT & SeaDataCloud

Technical Capabilities of WMO and its Partners in Support of GFCS Implementation: the Climate Services Information System

The Now Platform Reference Guide

CORDEX DOMAINS (plus Arctic & Antarctica)

European Data Grant agreement number: RI Deliverable D Technology adaptation and development framework. in EUDAT WP7.

THE IMPORTANCE OF NICHE TECHNOLOGIES IN BUSINESS ANALYSIS. - Kat Okwera Jan 2019

Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow

Sentinel-1A Data Dissemination and Users Data Uptake. Jolyon Martin (ESA) Betlem Rosich Tell (ESA) Michael Foumelis (RSAC c/o ESA)

WebProtégé. Protégé going Web. Tania Tudorache, Jennifer Vendetti, Natasha Noy. Stanford Center for Biomedical Informatics

Core Technology Development Team Meeting

WHAT S NEW IN QLIKVIEW 11

Release Notes October 2016

NARCCAP: North American Regional Climate Change Assessment Program. Seth McGinnis, NCAR

Enabling High-Quality Printing in Web Applications. Tanu Hoque & Jeff Moulds

Big Data Analysis and Metadata Standards for Earth System Models

Prototype DIRAC portal for EISCAT data Short instruction

WP JRA1: Architectures for an integrated and interoperable AAI

The Portal Aspect of the LSST Science Platform. Gregory Dubois-Felsmann Caltech/IPAC. LSST2017 August 16, 2017

SAS Web Infrastructure Kit 1.0. Overview

The NextGEOSS Project

Liferay Digital Experience Platform. New Features Summary

Scientific Applications of the Regional Climate Model Evaluation System (RCMES)

Joachim Biercamp Deutsches Klimarechenzentrum (DKRZ) With input from Peter Bauer, Reinhard Budich, Sylvie Joussaume, Bryan Lawrence.

Interconnect EGEE and CNGRID e-infrastructures

Deliverable 7.3. Workflow Manager. Poznao Supercomputing and Networking Center

GIOTTO. Design and Architecture

Leveraging Tools and Components from OODT and Apache within Climate Science and the Earth System Grid Federa9on

Catalog-driven, Reproducible Workflows for Ocean Science

User manual E-Bike Connect.

CMPSC 24: Lecture 1 So4ware Development Process

How to expand the Galaxy from genes to Earth in six simple steps

Hue Application for Big Data Ingestion

Deliverable D3.5 Harmonised e-authentication architecture in collaboration with STORK platform (M40) ATTPS. Achieving The Trust Paradigm Shift

[MS10962]: Advanced Automated Administration With Windows PowerShell

Eclipse Technology Project: g-eclipse

Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison

The EU-funded BRIDGE project

ELIXIR Human Data Use Case

A Design of the Conceptual Architecture for a Multitenant SaaS Application Platform

Appendix R SYSTEMA THERMICA & THERMICALC Timothée Soriano Rose Nerriere (Astrium SAS, France)

The XVC Framework for In-Vehicle User Interfaces

RAD, Rules, and Compatibility: What's Coming in Kuali Rice 2.0

Fault Detection using Advanced Analytics at CERN's Large Hadron Collider

Using the Network Common Data Form for storage of atmospheric data

Transcription:

IS-ENES2 1 st General Assembly 11-13 th June 2014 UPC Campus, Barcelona, Spain Status of infrastructure climate4impact.eu Christian Pagé, CERFACS Working teams and institutions CERFACS: Christian Pagé WU: Ronald Hutjes, Erik van Slobbe KNMI: Wim Som de Cerff, Maarten Plieger CNRS-IPSL: Eric Guilyardi, Sébastien Denvil STFC/UREAD: Martin Juckes; Stephen Pascoe SMHI: Lars Bärring, Michael Kolax, Grigory Nikulin CMCC: Sandro Fiore, Giovanni Aloisio UC: Antonio S. Cofiño, Manuel Vega-Saldarriaga DKRZ: Torsten Rathmann, Frank Toussaint, Stephan Kindermann CSAG: Chris Jack, Bruce Hewitson, Chris Lennard DMI: Ole Bøssing Christensen INHGA: Marius Matreata Collaboration with CLIPC project 1

Status of infrastructure climate4impact Tasks in WPs dedicated to climate4impact NA4.3 Requirements for the impact user community (CERFACS, WUR, CSAG, CNRS- IPSL, KNMI, SMHI, UC, CMCC, MF- CNRM) SA2.3: Enhanced data and InformaIon access (KNMI, STFC, DKRZ) JRA3 JRA 3.3.1 Portal (CERFACS, KNMI, UC) JRA 3.3.2 Derived Data products (CERFACS, KNMI, CSAG, DMI, SMHI, INHGA, UC)

Status of infrastructure climate4impact Objectives (one of the 5 IS-ENES2 key objectives) Facilitate the applica4on of Earth system model simula4ons to be@er predict and understand climate change impacts on society By: Enhance the dissemina4on of model results from both global and regional model experiments Develop an interface dedicated to the climate impact community and improving the quality of informaion on simulaions through metadata developments and guidance to users Enhance interac4on between the climate modelling acivity and users from companies and the emerging climate services

Status of infrastructure climate4impact Deliverables related to climate4impact Month D/M Descrip4on WP 12 D11.2 Report on climate4impacts, version 1.0 JRA 3.3 24 M11.7 Report on integraion of services for indices and averaging 32 M32 JRA3 developed services deployed on climate4impact SA2 36 M11.8 Review climate4impact services and objecives (associated with D11.6) JRA 3.3 JRA 3.3 36 D5.2 Assessment of impact communiies requirements NA 4.3 44 D11.6 Report on derived products in climate4impact JRA3.3 46 M8.8 climate4impact components available for use in tailored impact portals SA2

Functionalities Prototype IS-ENES 1 " Extensive documentation for impact modelers " Guidelines, warnings, do s and don ts " Access to CMIP5 data " 30 data nodes, ~3 Petabyte of data " Search in a faceted way " Through models, variables, experiments, frequency, dates " Visualize and download any CMIP5 dataset " Visualize any gridded dataset offered via OPeNDAP! " Using ADAGUC WMS/WCS " Login with ESGF OpenID Identifier 5

Functionalities IS-ENES 2 " Improved search interface " Web Processing Service with ESGF security " esgf.py in PyDap, install_esgf_client (Stephen Pascoe) " Demonstrator online, create timeseries plot on any dataset in ESGF with 3 dimensions " Compose OpenID identifier based on username and gateway " Improved styling based on ENES VERC portal " Less clicking, improved error feedback and improved user friendliness " Still, a lot has to be done 1 st Operational Release April 2014 (October 2013 version) Announcement of the operational version (example on SMHI portal) " Simplified interface for search and download " Functionality organized in a simpler accessible way, streamlining the workflow and reducing amount of mouse clicks " Improved error interface 6

Improved search 7

ES-DOC integration 8

View file - WMS Generate timeseries plots for a certain location. Supported formats: HTML, JSON, XML and PNG 9

Web Processing Service " Uses PyWPS framework " Implement by creating standalone Python scripts as processes " Use OpenClimateGIS " Also providing access to ExArch and CDO WPS " Users have a personal place on climate4impact to store results " Keep settings for a process, rerun a process with same settings " Examples of processed visualization: " Make timeseries " Compare anomalies of precipitation against temperature for France " Scripts can be added easily to climate4impact for data analysis 10

WPS - Climate indices calculation Temperature indices Heat indices Cold indices ECA&D/ETCCDI indices Humidity indices Compound indices Rain indices Drought indices Snow indices " Python code library for in-memory calculations " Generic and modular approach, can be reused in other environments " C functions called for optimization " All calculations done in memory for very fast performance " Validation against CDO, ETCCDI " Now embedded into NCAR/NCPP OpenClimateGIS code " I/O interface is structured for optimal performance " Wrapper function " Dynamic Chunking to balance between OpenDAP access and available memory 11

WPS WPS jobs can be monitored 12

Status of infrastructure climate4impact Main achievements Working Progress Improved site entrance, documentaion and styling Improved login and security Simplified interface for search and download FuncIonality organized in a simpler accessible way, streamlining the workflow and reducing amount of mouse clicks Improved error interface Online processing climate indices (prototype) downscaling (prototype communicaion interface)

Main goals Status of infrastructure Climate4impact (C4I) Downscaling Portal (DP) integration Work status Develop an API into the DP in order to access to Downscaling services externally. Provide security access to this API. Develop a Downscaling UI for the C4I Main achievements First version of RESTFul API implemented with token based security. C4I portal can register its users to the DP through the API. A new Downscaling UI tab has been created. Allow users to subscribe to the Downscaling service and it will allow to use the services through UI components. UI prototype has been created (Pending of discussion) Ongoing work The ongoing work is focusing on modeling the en44es and improve the prototype which will allow users to create and save a downscaling configura4on

Status of infrastructure Climate4impact (C4I) Downscaling Portal (DP) integration Work status First version of the Downscaling UI tab in the C4I

Issues s4ll to be addressed Status of infrastructure climate4impact Next steps - climate4impact roadmap: what features to focus on? Need to prioriize given user needs and feedbacks. - Services reusable by other portals - IntegraIon with other projects - CLIPC reuse of services and documentaion - - - - SPECS data and s2d documentaion EUPORIAS data and use cases EURO4M/UERRA data and use cases -

Technical developments: Architectural design DocumentaIon Portal prototyping climate4impact work done, work planned OperaIonal portal (April 2014) Enhanced data and InformaIon access Derived Data products (indices) Services reusable by other portals 18

SMHI operational annoucement 19

20