Data Staging and Data Movement with EUDAT. Course Introduction Helsinki 10 th -12 th September, Course Timetable TODAY
|
|
- Doris Felicity Goodwin
- 6 years ago
- Views:
Transcription
1 Data Staging and Data Movement with EUDAT Course Introduction Helsinki 10 th -12 th September, Introduction Adam Carter Course Timetable TODAY 1430 The EUDAT Safe Replication Service Claudio Cacciari 1530 Coffee 1545 The EUDAT Data Staging Service Claudio Cacciari 1700 Close 1
2 Course Timetable TIMETABLES FOR DAY 2 & DAY 3 SUBJECT TO FINASATION Data Staging and Data Movement Data Staging is particularly important to PRACE users and future PRACE users, but in general it is one aspect of Data Movement in general What we mean by Data Staging Term is used to mean different things, even within our project. We ll use it generically to mean the movement of data between systems, but obviously in a PRACE context, one of these systems is usually an HPC resource 2
3 Speed Reliability Availability Integrity Security Ease Of Use Simplicity Familiarity Flexibility Data Movement: What End Users Care About Why isn t this easy? End points (where you re moving the data to and from are typically in different jurisdictions Security vs Performance tradeoffs Changing ecosystem: users want to be able to work in different ways. Consider, e.g., Dropbox Relationship between data location and data meaning Data is getting bigger faster than the pipes 3
4 Teach by example A combination of: Approach of this course A description of how we re doing things in EUDAT A demonstration of some of the tools and software that we re using to implement EUDAT and that can be used to interface with EUDAT and bridge the gap between EUDAT, PRACE and other infrastructures, services and software that you use or develop. EUDAT: Vision & Architecture EUDAT began with the concept of the Collaborative Data Infrastructure See Riding the Wave (High Level Expert Group on Scientific Data, Final Report, 2010 This identified a handful of core Service Cases See And the implementation of the Service Cases led to our current distributed Architecture 4
5 What is the EUDAT CDI? The EUDAT Collaborative Data Infrastructure is a pan-european, cross-disciplinary domain of research data for both big community researchers and long tail scientists where data are registered, preserved, accessible and made re-usable Pan-European What does this mean? Fundamentally, a wide-area distributed architecture Cross-disciplinary Five core stakeholder communities, many other interested; many sources of conflicting requirements! Including simplified services to encourage the long tail to participate All implies a significant systems integration challenge! 5
6 What does this mean? (2 Registered means EUDAT data are Globally identified and discoverable (the PID Service Preserved means EUDAT data are Stored at big European HPC and data centres Replicated for safety (the Safe Replication Service Governed by policy rules (the Policy Management Service What does this mean? (3 Accessible means EUDAT data are Identifiable and findable (the PID Service Retrievable efficiently (the Data Staging Service Governed by suitable access control (the AAI Service Re-usable means EUDAT data are Findable (the PID Service Comprehensible (the Joint Metadata Service Composable and combinable (future workflow and computational services 6
7 What does this mean? (4 For both big communities and long tail means Stable, web-service APIs for existing tool-stacks to use (the Common Service Layer Interface Low barriers to use (the Simple Store Service Hence the core EUDAT service cases Identifying solutions for these cases that work with our stakeholder communities existing solutions led us to the current CDI architecture The CDI network architecture The CDI is a connected network of European research institutions and data centres (collectively Nodes each offering one or more common EUDAT data services to both participating research communities and independent researchers Data centre Nodes have lots of connections Research community Nodes need only one Connections have both technical & policy agreement aspects 7
8 The CDI network architecture Generic data centres Community data sites CDI Node architecture Nodes run parts of the CDI Node software suite, depending on which services they want to offer All Nodes should offer Safe Replication and PID This is really what being in the CDI is all about Others are optional Depends on what a Node s expected user base requires (Some data centre Nodes also need to run the Operational Services suite 8
9 CDI service development timeline Year EUDAT Services CDI 2012 Safe Replication v1, Data Staging v1, PID v1, Operational Services v1; AAI (design V AAI v1, Joint Metadata v1, Simple Store Service v1, Safe Replication v2, Data Staging v2, Operational Services v2; Common Service Layer Interface (design, workflow and computation services (design 2014 AAI v2, Joint Metadata v2, Simple Store Service v2, Data Staging v3, Operational Services v3, v1, computational and workflow services v1 V 2 V PID v2, Safe Replication v3, computational and workflow services v2 V 4 Data Staging (DS v1 PID v1 Handle PID registration (PID v1 SR v1, OP v1 SR v1, OP v1 Community s/w SR v1 Operational services (OP v1 Safe Replication (SR v1 CDI V1 (2012 9
10 + Web (DS v2 AAI v1 JMD v1 (UI Simple Store ( v1 v1 (UI PID v1 JMD v1 v1 SR v2, OP v2 SR v2, OP v2 Community s/w SR v2 Joint Metadata (JMD v1 + Policy Management (SR v2 CDI V2 (2013 Data Staging (DS v3 + Federation AAI v2 Workflow, Compute v1 JMD v2 (UI Simple Store ( v2 v2 (UI PID v1 JMD v2 v2 SR v2, OPv3 SR v2, OPv3 Community s/w SR v2 Joint Metadata (JMD v2 CDI V3 (
11 Workflow Coordinatio n (WC v1 WC + Generalisation (computational v2 JMD v2 (UI v2 (UI PID v2 Enhanced Handle registration (PID v2 JMD v2 v2 SR v3 SR v3, OPv4 SR v3, OPv4 Community s/w + Real Time Data (SR v3 CDI V4 (2015+ Current Node software suite Safe Replication irods v3.x + EUDAT replication microservices + GSI (X.509 security PID EPIC/Handle system (external service + EUDAT EPIC client microservices for irods Data Staging Griffin gridftp irods client + EUDAT Data Staging client Joint Metadata CKAN + Apache Solr + OAI-PMH Simple Store Invenio + EUDAT faceted user interface layer 11
12 Communit y s/w Using the CDI Joining vs Using the CDI JMD (UI (UI PID JMD EUDAT core EUDAT core Community s/w EUDAT core Joining the CDI EUDAT CDI 12
EUDAT Training 2 nd EUDAT Conference, Rome October 28 th Introduction, Vision and Architecture. Giuseppe Fiameni CINECA Rob Baxter EPCC EUDAT members
EUDAT Training 2 nd EUDAT Conference, Rome October 28 th Introduction, Vision and Architecture Giuseppe Fiameni CINECA Rob Baxter EPCC EUDAT members Agenda Background information Services Common Data Infrastructure
More informationData Discovery - Introduction
Data Discovery - Introduction Why (benefits of reusing data) How EUDAT's services help with this (in general) Adam Carter In days gone by: Design an experiment Getting Your Data Conduct the experiment
More informationEUDAT. Towards a Collaborative Data Infrastructure. Ari Lukkarinen CSC-IT Center for Science, Finland NORDUnet 2012 Oslo, 18 August 2012
EUDAT Towards a Collaborative Data Infrastructure Ari Lukkarinen CSC-IT Center for Science, Finland NORDUnet 2012 Oslo, 18 August 2012 Big (Chaotic) Data DATA GENERATORS 1) Measurement technology. 2) Cheap
More informationEUDAT. A European Collaborative Data Infrastructure. Daan Broeder The Language Archive MPI for Psycholinguistics CLARIN, DASISH, EUDAT
EUDAT A European Collaborative Data Infrastructure Daan Broeder The Language Archive MPI for Psycholinguistics CLARIN, DASISH, EUDAT OpenAire Interoperability Workshop Braga, Feb. 8, 2013 EUDAT Key facts
More informationData Replication: Automated move and copy of data. PRACE Advanced Training Course on Data Staging and Data Movement Helsinki, September 10 th 2013
Data Replication: Automated move and copy of data PRACE Advanced Training Course on Data Staging and Data Movement Helsinki, September 10 th 2013 Claudio Cacciari c.cacciari@cineca.it Outline The issue
More informationUsing EUDAT services to replicate, store, share, and find cultural heritage data
Using EUDAT services to replicate, store, share, and find cultural heritage data in PSNC and beyond Maciej Brzeźniak, Norbert Meyer, PSNC Damien Lecarpentier, CSC 3 October 203 DIGITAL PRESERVATION OF
More informationEUDAT Data Services & Tools for Researchers and Communities. Dr. Per Öster Director, Research Infrastructures CSC IT Center for Science Ltd
EUDAT Data Services & Tools for Researchers and Communities Dr. Per Öster Director, Research Infrastructures CSC IT Center for Science Ltd CSC IT CENTER FOR SCIENCE! Founded in 1971 as a technical support
More informationData management and discovery
Data management and discovery using EUDAT services Hans van Piggelen SURFsara, The Netherlands EUDAT Mission offer common data services in CDI to all European researchers services will address the needs
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure. Damien Lecarpentier CSC-IT Center for Science, Finland EUDAT User Forum, Barcelona
EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland EUDAT User Forum, Barcelona Date: 7 March 2012 EUDAT Key facts Content Project Name
More informationirods workflows for the data management in the EUDAT pan-european infrastructure
irods workflows for the data management in the EUDAT pan-european infrastructure irods UGM 2017 Utrecht, 14-15.06.2017 Claudio Cacciari (c.cacciari@cineca.it) EUDAT receiv es funding from the European
More informationEUDAT- Towards a Global Collaborative Data Infrastructure
EUDAT- Towards a Global Collaborative Data Infrastructure FOT-Net Data Stakeholder Meeting Brussels, 8 March 2016 Yann Le Franc, PhD e-science Data Factory, France CEO and founder EUDAT receives funding
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Giuseppe Fiameni (g.fiameni@cineca.it) Claudio Cacciari SuperComputing, Application and Innovation CINECA Johannes Reatz RZG, Germany Damien
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure. KNMI Workshop, Utrecht, Netherlands
EUDAT Towards a pan-european Collaborative Data Infrastructure Giuseppe Fiameni, Claudio Cacciari SuperComputing Centre, CINECA, Italy Peter Wittenburg, Daan Broeder The Language Archive, Max Planck Institute,
More informationEUDAT Towards a Collaborative Data Infrastructure
EUDAT Towards a Collaborative Data Infrastructure Daan Broeder - MPI for Psycholinguistics - EUDAT - CLARIN - DASISH Bielefeld 10 th International Conference Data These days it is so very easy to create
More informationData Staging: Moving large amounts of data around, and moving it close to compute resources
Data Staging: Moving large amounts of data around, and moving it close to compute resources PRACE advanced training course on Data Staging and Data Movement Helsinki, September 10 th 2013 Claudio Cacciari
More informationThe EUDAT Collaborative Data Infrastructure
The EUDAT Collaborative Data Infrastructure CSCS, Lugano, 8-9 September 2 2016 (Plan-E workshop) Damien Lecarpentier Project Director, Research Infrastructures, CSC EUDAT Project Director EUDAT receives
More informationEUDAT Common data infrastructure
EUDAT Common data infrastructure Giuseppe Fiameni SuperComputing Applications and Innovation CINECA Italy Peter Wittenburg Max Planck Institute for Psycholinguistics Nijmegen, Netherlands some major characteristics
More informationEUDAT-B2FIND A FAIR and Interdisciplinary Discovery Portal for Research Data
EUDAT-B2FIND A FAIR and Interdisciplinary Discovery Portal for Research Data Heinrich Widmann, DKRZ Claudia Martens, DKRZ Open Science Days, Berlin, 17 October 2017 www.eudat.eu EUDAT receives funding
More informationI data set della ricerca ed il progetto EUDAT
I data set della ricerca ed il progetto EUDAT Casalecchio di Reno (BO) Via Magnanelli 6/3, 40033 Casalecchio di Reno 051 6171411 www.cineca.it 1 Digital as a Global Priority 2 Focus on research data Square
More informationEUDAT - Open Data Services for Research
EUDAT - Open Data Services for Research Johannes Reetz EUDAT operations Max Planck Computing & Data Centre Science Operations Workshop 2015 ESO, Garching 24-27th November 2015 EUDAT receives funding from
More informationEuropean Collaborative Data Infrastructure EUDAT - Training on EUDAT Principles -
European Collaborative Data Infrastructure EUDAT - Training on EUDAT Principles - Dr.-Ing. Morris Riedel Federated Systems and Data Juelich Supercomputing Centre (JSC) Adjunct Associate Professor School
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Martin Hellmich Slides adapted from Damien Lecarpentier DCH-RP workshop, Manchester, 10 April 2013 Research Infrastructures Research Infrastructure
More informationFundamentals of Data Infrastructures
Fundamentals of Data Infrastructures Dublin, March 2014 Welcome & Introduction Adam Carter EPCC, The University of Edinburgh Training Coordinator, EUDAT Timetable 09:00 Registration & Coffee 09:15 Welcome
More informationODC and future EIDA/ EPOS-S plans within EUDAT2020. Luca Trani and the EIDA Team Acknowledgements to SURFsara and the B2SAFE team
B2Safe @ ODC and future EIDA/ EPOS-S plans within EUDAT2020 Luca Trani and the EIDA Team Acknowledgements to SURFsara and the B2SAFE team 3rd Conference, Amsterdam, The Netherlands, 24-25 September 2014
More informationB2SAFE metadata management
B2SAFE metadata management version 1.2 by Claudio Cacciari, Robert Verkerk, Adil Hasan, Elena Erastova Introduction The B2SAFE service provides a set of functions for long term bit stream data preservation:
More informationUSE CASES IN SEISMOLOGY. Alberto Michelini INGV
USE CASES IN SEISMOLOGY Alberto Michelini INGV PROJECTS NERA (Network of European Research Infrastructures for Earthquake Risk Assessment and Mitigation) VERCE (Virtual Earthquake and seismology Research
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland CESSDA workshop Tampere, 5 October 2012 EUDAT Towards a pan-european Collaborative
More informationEUDAT & AAI. Daan Broeder MPI for Psycholinguistics
EUDAT & AAI Daan Broeder MPI for Psycholinguistics Initially six research communities on Board EPOS: European Plate Observatory System CLARIN: Common Language Resources and Technology Infrastructure ENES:
More informationEGI federated e-infrastructure, a building block for the Open Science Commons
EGI federated e-infrastructure, a building block for the Open Science Commons Yannick LEGRÉ Director, EGI.eu www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union
More informationInge Van Nieuwerburgh OpenAIRE NOAD Belgium. Tools&Services. OpenAIRE EUDAT. can be reused under the CC BY license
Inge Van Nieuwerburgh OpenAIRE NOAD Belgium Tools&Services OpenAIRE EUDAT can be reused under the CC BY license Open Access Infrastructure for Research in Europe www.openaire.eu Research Data Services,
More informationEUDAT and Cloud Services
EUDAT and Cloud Services Space Data & Cloud Computing Infrastructures: Policies and Regulations ESRIN, Frascati, 7 July 2017 Per Öster CSC-IT Center for Science Finland www.eudat.eu EUDAT receives funding
More informationEUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal Heinrich Widmann, DKRZ DI4R 2016, Krakow, 28 September 2016 www.eudat.eu EUDAT receives funding from the European Union's Horizon 2020
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure - A Nordic Perspective? -
EUDAT Towards a pan-european Collaborative Data Infrastructure - A Nordic Perspective? - Damien Lecarpentier CSC-IT Center for Science, Finland NeIC Conference Trondheim, 16 May 2013 Data trends Exponential
More informationTowards a joint service catalogue for e-infrastructure services
Towards a joint service catalogue for e-infrastructure services Dr British Library 1 DI4R 2016 Workshop Joint service catalogue for research 29 September 2016 15/09/15 Goal A framework for creating a Catalogue
More informationNorStore. a national infrastructure for scientific data. Andreas O Jaunsen UNINETT Sigma as
NorStore a national infrastructure for scientific data Andreas O Jaunsen UNINETT Sigma as About UNINETT Sigma UNINETT Sigma AS is a private company established by the Ministry of science and education
More informationData Staging: Moving large amounts of data around, and moving it close to compute resources
Data Staging: Moving large amounts of data around, and moving it close to compute resources Digital Preserva-on Advanced Prac--oner Course Glasgow, July 19 th 2013 c.cacciari@cineca.it Definition Starting
More informationDesigning an institutional research data management infrastructure for the life sciences
Designing an institutional research data management infrastructure for the life sciences Paul van Schayck PhD student, data steward Maastricht University Medical Center + p.vanschayck@maastrichtuniversity.nl
More informationCoupled Computing and Data Analytics to support Science EGI Viewpoint Yannick Legré, EGI.eu Director
Coupled Computing and Data Analytics to support Science EGI Viewpoint Yannick Legré, EGI.eu Director yannick.legre@egi.eu Credit slides: T. Ferrari www.egi.eu This work by EGI.eu is licensed under a Creative
More informationACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development
ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development Jeremy Fischer Indiana University 9 September 2014 Citation: Fischer, J.L. 2014. ACCI Recommendations on Long Term
More informationEuroHPC and the European HPC Strategy HPC User Forum September 4-6, 2018 Dearborn, Michigan, USA
EuroHPC and the European HPC Strategy HPC User Forum September 4-6, 2018 Dearborn, Michigan, USA Leonardo Flores Añover Senior Expert - HPC and Quantum technologies DG CONNECT European Commission Overall
More informationScience-as-a-Service
Science-as-a-Service The iplant Foundation Rion Dooley Edwin Skidmore Dan Stanzione Steve Terry Matthew Vaughn Outline Why, why, why! When duct tape isn t enough Building an API for the web Core services
More informationPoland - e-infrastructure ecosystem and relation to EOSC
Poland - e-infrastructure ecosystem and relation to EOSC Norbert Meyer meyer@man.poznan.pl Polish research infrastructure stakeholders Owners of the infrastructure MAN institutions + HPC centres Service
More informationEurope and its Open Science Cloud: the Italian perspective. Luciano Gaido Plan-E meeting, Poznan, April
Europe and its Open Science Cloud: the Italian perspective Luciano Gaido (gaido@to.infn.it) Plan-E meeting, Poznan, April 27 2017 Background Italy has a long-standing expertise and experience in the management
More informationIndiana University Research Technology and the Research Data Alliance
Indiana University Research Technology and the Research Data Alliance Rob Quick Manager High Throughput Computing Operations Officer - OSG and SWAMP Board Member - RDA Organizational Assembly RDA Mission
More informationOpen Smart City Open Social Innovation Infrastructure. Cezary Mazurek, Maciej Stroinski Poznan Supercomputing and Networking Center
Open Smart City Open Social Innovation Infrastructure Cezary Mazurek, Maciej Stroinski Poznan Supercomputing and Networking Center 25 years of PSNC Poznań Supercomputing and Networking Center (PSNC), established
More informationEuropean Open Science Cloud
European Open Science Cloud a common vision for accessing services for science and research. eage 04/12/2017 Enrique GOMEZ Programme Officcer e-infrastructure and Science Cloud EC DG CONNECT/C1 1 The EOSC
More informationWebinar Annotate data in the EUDAT CDI
Webinar Annotate data in the EUDAT CDI Yann Le Franc - e-science Data Factory, Paris, France March 16, 2017 This work is licensed under the Creative Commons CC-BY 4.0 licence. Attribution: Y. Le Franc
More informationTHE NATIONAL DATA SERVICE(S) & NDS CONSORTIUM A Call to Action for Accelerating Discovery Through Data Services we can Build Ed Seidel
THE NATIONAL DATA SERVICE(S) & NDS CONSORTIUM A Call to Action for Accelerating Discovery Through Data Services we can Build Ed Seidel National Center for Supercomputing Applications University of Illinois
More informationWP3: Policy and Best Practice Harmonisation
Authentication and Authorisation for Research and Collaboration WP3: Policy and Best Practice Harmonisation David Groep AARC2 2018 AL/TL meeting 12-13 September, 2018 Amsterdam 0.4 Policy and best practice
More informationA national approach for storage scale-out scenarios based on irods
A national approach for storage scale-out scenarios based on irods Christine Staiger Ton Smeele SURFsara Utrecht University Science Park 140, ITS/RDM Amsterdam, The Heidelberglaan 8, Netherlands Utrecht,
More informationThe DART-Europe E-theses Portal
The DART-Europe E-theses Portal Martin Moyle Digital Curation Manager UCL Library Services, UK m.moyle@ucl.ac.uk ETD 2009, University of Pittsburgh, June 10-13 2009 Contents DART-Europe: background The
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationEuropeana Core Service Platform
Europeana Core Service Platform DELIVERABLE D7.1: Strategic Development Plan, Architectural Planning Revision Final Date of submission 30 October 2015 Author(s) Marcin Werla, PSNC Pavel Kats, Europeana
More informationSharing Best Security Practices with your Peers - on an International Level
Public Sharing Best Security Practices with your Peers - on an International Level Urpo Kaila, Head of Security, csc.fi EUDAT Security Officer WISE Community SC member GÉANT SIG-ISMS
More informationFLAT: A CLARIN-compatible repository solution based on Fedora Commons
FLAT: A CLARIN-compatible repository solution based on Fedora Commons Paul Trilsbeek The Language Archive Max Planck Institute for Psycholinguistics Nijmegen, The Netherlands Paul.Trilsbeek@mpi.nl Menzo
More informationEuropean Cloud Initiative: implementation status. Augusto BURGUEÑO ARJONA European Commission DG CNECT Unit C1: e-infrastructure and Science Cloud
European Cloud Initiative: implementation status Augusto BURGUEÑO ARJONA European Commission DG CNECT Unit C1: e-infrastructure and Science Cloud Political drivers for action EC Communication "European
More informationSouth African Science Gateways
Co-ordination & Harmonisation of Advanced e-infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n. 306819 South African Science Gateways Bruce Becker, Coordinator,
More informationThe EuroHPC strategic initiative
Amsterdam, 12 December 2017 The EuroHPC strategic initiative Thomas Skordas Director, DG CONNECT-C, European Commission The European HPC strategy in Horizon 2020 Infrastructure Capacity of acquiring leadership-class
More informationKey Elements of Global Data Infrastructures
Key Elements of Global Data Infrastructures Peter Wittenburg CLARIN Research Infrastructure EUDAT Data Infrastructure The Language Archive Max Planck Institute for Psycholinguistics Nijmegen, The Netherlands
More informationContainerised Development of a Scientific Data Management System Ben Leighton, Andrew Freebairn, Ashley Sommer, Jonathan Yu, Simon Cox LAND AND WATER
Containerised elopment of a Scientific Data Management System Ben Leighton, Andrew Freebairn, Ashley Sommer, Jonathan Yu, Simon Cox LAND AND WATER Some context I m part of a team of developers in Land
More informationINSPIRE tools What's new?
INSPIRE tools What's new? Michael Lutz INSPIRE Conference, Antwerp 18 September 2018 Joint Research Centre The European Commission s science and knowledge service INSPIRE reference validator Why a reference
More informationIS4H TOOLKIT TOOL: Workshop on Developing a National ehealth Strategy (Workshop Template)
IS4H TOOLKIT TOOL: Workshop on Developing a National ehealth Strategy (Workshop Template) Department of Evidence and Intelligence for Action in Health PAHO/WHO Workshop on Developing a National ehealth
More information«Prompting an EOSC in Practice»
«Prompting an EOSC in Practice» EOSC HLEG II (2017-2018) Members George A. Komatsoulis (Observer, USA), Andreas Mortensen (Rapporteur), Silvana Muscella (Chair), Isabel Campos Plasencia, Toivo Räim, François
More informationirods 4.0 and Beyond Presented at the irods & DDN User Group Meeting 2014
irods 4.0 and Beyond Presented at the irods & DDN User Group Meeting 2014 September 8, 2014 irods 4.0 and Beyond -- irods & DDN User Group Meeting 2014 1 Motivation and Goals irods is open source middleware
More informationB2FIND: EUDAT Metadata Service. Daan Broeder, et al. EUDAT Metadata Task Force
B2FIND: EUDAT Metadata Service Daan Broeder, et al. EUDAT Metadata Task Force EUDAT Joint Metadata Domain of Research Data Deliver a service for searching and browsing metadata across communities Appropriate
More informationStriving for efficiency
Ron Dekker Director CESSDA Striving for efficiency Realise the social data part of EOSC How to Get the Maximum from Research Data Prerequisites and Outcomes University of Tartu, 29 May 2018 Trends 1.Growing
More informationGiovanni Lamanna LAPP - Laboratoire d'annecy-le-vieux de Physique des Particules, Université de Savoie, CNRS/IN2P3, Annecy-le-Vieux, France
Giovanni Lamanna LAPP - Laboratoire d'annecy-le-vieux de Physique des Particules, Université de Savoie, CNRS/IN2P3, Annecy-le-Vieux, France ERF, Big data & Open data Brussels, 7-8 May 2014 EU-T0, Data
More informationKubernetes made easy with Docker EE. Patrick van der Bleek Sr. Solutions Engineer NEMEA
Kubernetes made easy with Docker EE Patrick van der Bleek Sr. Solutions Engineer NEMEA Docker Enterprise Edition is More than Containers + Orchestration... DOCKER ENTERPRISE EDITION Kubernetes integration
More informationEuroHPC Bologna 23 Marzo Gabriella Scipione
EuroHPC Bologna 23 Marzo 2018 Gabriella Scipione g.scipione@cineca.it EuroHPC - Europe's journey to exascale HPC http://eurohpc.eu/ What EuroHPC is a joint collaboration between European countries and
More informatione-infrastructures in Horizon 2020 e-infrastructures for data and computing
e-infrastructures in Horizon 2020 e-infrastructures for data and computing Kostas Glinos Head of Unit, e-infrastructure European Commission DG CONNECT Research Infrastructures in Horizon 2020 Developing
More informationEUDAT & SeaDataCloud
EUDAT & SeaDataCloud SeaDataCloud Kick-off meeting Damien Lecarpentier CSC-IT Center for Science www.eudat.eu EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-infrastructures.
More informationINDIGO AAI An overview and status update!
RIA-653549 INDIGO DataCloud INDIGO AAI An overview and status update! Andrea Ceccanti (INFN) on behalf of the INDIGO AAI Task Force! indigo-aai-tf@lists.indigo-datacloud.org INDIGO Datacloud An H2020 project
More informationRemote Workflow Enactment using Docker and the Generic Execution Framework in EUDAT
Remote Workflow Enactment using Docker and the Generic Execution Framework in EUDAT Asela Rajapakse Max Planck Institute for Meteorology EUDAT receives funding from the European Union's Horizon 2020 programme
More informationEGI-InSPIRE. Cloud Services. Steven Newhouse, EGI.eu Director. 23/05/2011 Cloud Services - ASPIRE - May EGI-InSPIRE RI
EGI-InSPIRE Cloud Services Steven Newhouse, EGI.eu Director 23/05/2011 Cloud Services - ASPIRE - May 2011 1 Definition of the cloud Cloud computing is a model for enabling convenient, on-demand network
More informationPersistent Identifiers for Audiovisual Archives and Cultural Heritage
Persistent Identifiers for Audiovisual Archives and Cultural Heritage Hennie Brugman Technical coordinator CATCHPlus Max-Planck-Institute for Psycholinguistics Netherlands Institute for Sound and Vision
More informationESFRI WORKSHOP ON RIs AND EOSC
30 January 2019 Royal Geographical Society, London Jan Hrušák From VISION.. to ACTION.. EOSC will provide 1.7m EU researchers an environment with free, open services for data storage, management, analysis
More informationThe iplant Data Commons
The iplant Data Commons Using irods to Facilitate Data Dissemination, Discovery, and Reproducibility Jeremy DeBarry, jdebarry@iplantcollaborative.org Tony Edgin, tedgin@iplantcollaborative.org Nirav Merchant,
More informationSafe Replication and Data Staging
Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013 2 enrichment processing reduction analysis domain of registered data individual
More informationESFRI Strategic Roadmap & RI Long-term sustainability an EC overview
ESFRI Strategic Roadmap & RI Long-term sustainability an EC overview Margarida Ribeiro European Commission DG Research & B.4 - Research Infrastructure Research and What is ESFRI? An informal body composed
More informationThe Materials Data Facility
The Materials Data Facility Ben Blaiszik (blaiszik@uchicago.edu), Kyle Chard (chard@uchicago.edu) Ian Foster (foster@uchicago.edu) materialsdatafacility.org What is MDF? We aim to make it simple for materials
More informationAAI in EGI Current status
AAI in EGI Current status Peter Solagna EGI.eu Operations Manager www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number 654142 User authentication
More informationRichard Marciano Alexandra Chassanoff David Pcolar Bing Zhu Chien-Yi Hu. March 24, 2010
Richard Marciano Alexandra Chassanoff David Pcolar Bing Zhu Chien-Yi Hu March 24, 2010 What is the feasibility of repository interoperability at the policy level? Can a preservation environment be assembled
More informationOpen Science Commons: A Participatory Model for the Open Science Cloud
Open Science Commons: A Participatory Model for the Open Science Cloud Tiziana Ferrari EGI.eu Technical Director EGI-Engage Technical Coordinator www.egi.eu EGI-Engage is co-funded by the Horizon 2020
More informationGATE: Big Data for Smart Society Dessislava Petrova-Antonova Sofia University St. Kliment Ohridski Faculty of Mathematics and Informatics
GATE: Big Data for Smart Society Dessislava Petrova-Antonova Sofia University St. Kliment Ohridski Faculty of Mathematics and Informatics Johann Wolfgang von Goethe Big Data provides the pipes, and AI
More informationASPECT Adopting Standards and Specifications for. Final Project Presentation By David Massart, EUN April 2011
ASPECT Adopting Standards Final Project Presentation By David Massart, EUN April 2011 The ASPECT Best Practice Network was supported by the European Commission s econtentplus Programme. Outline of the
More informationFederated access to e-infrastructures worldwide
Federated access to e-infrastructures worldwide Marco Fargetta, INFN Catania - Italy (marco.fargetta@ct.infn.it) DCIs developed in the last decade 2 Evolution Research organisations are moving to cloud
More informationEuropean Network and ICOS
European Network and ICOS Dario Papale University of Tuscia Italy ICOS Ecosystem Thematic Centre Network size and trend The European network had a constant growth until 2009 and then stopped, increasing
More informationPID System for eresearch
the European Persistant Identifier Gesellschaft für wissenschaftliche Datenverarbeitung mbh Göttingen Am Fassberg, 37077 Göttingen ulrich.schwardmann@gwdg.de IZA/Gesis/RatSWD-WS Persistent Identifiers
More informationTrust and Certification: the case for Trustworthy Digital Repositories. RDA Europe webinar, 14 February 2017 Ingrid Dillo, DANS, The Netherlands
Trust and Certification: the case for Trustworthy Digital Repositories RDA Europe webinar, 14 February 2017 Ingrid Dillo, DANS, The Netherlands Perhaps the biggest challenge in sharing data is trust: how
More informationKepler and Grid Systems -- Early Efforts --
Distributed Computing in Kepler Lead, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, (Joint work with Matthew Jones) 6th Biennial Ptolemy Miniconference Berkeley,
More informationEuroHPC: the European HPC Strategy
HPC User Forum Campus Teratec, Bruyères-le-Châtel (F) 6-7 March 2018 EuroHPC: the European HPC Strategy Leonardo Flores Añover Senior Expert, HPC and Quantum Computing Unit DG CONNECT, European Commission
More informationEuropean Open Science Cloud Implementation roadmap: translating the vision into practice. September 2018
European Open Science Cloud Implementation roadmap: translating the vision into practice September 2018 European Commission, Directorate General Research & Innovation (DG RTD) Unit A2 Open Data Policy
More informationRENKU - Reproduce, Reuse, Recycle Research. Rok Roškar and the SDSC Renku team
RENKU - Reproduce, Reuse, Recycle Research Rok Roškar and the SDSC Renku team Renku-Reana workshop @ CERN 26.06.2018 Goals of Renku 1. Provide the means to create reproducible data science 2. Facilitate
More informationSAP Agile Data Preparation Simplify the Way You Shape Data PUBLIC
SAP Agile Data Preparation Simplify the Way You Shape Data Introduction SAP Agile Data Preparation Overview Video SAP Agile Data Preparation is a self-service data preparation application providing data
More informationFirst European Globus Community Forum Meeting
First European Globus Community Forum Meeting Florian Zrenner (zrenner@lrz.de) Slides from Dr. Helmut Heller (heller@lrz.de) Leibniz Supercomputing Centre (LRZ), Munich, Germany September 7 th, 2011 1
More informationHow to share research data
How to share research data University Library, UiT Fall 2018 Research data @ UiT Learning objectives Part 1 Why share data? What are the important criteria in choosing a data archive? Part 2 Learn about
More informationThe Need for a Terminology Bridge. May 2009
May 2009 Principal Author: Michael Peterson Supporting Authors: Bob Rogers Chief Strategy Advocate for the SNIA s Data Management Forum, CEO, Strategic Research Corporation and TechNexxus Chair of the
More informationGN4-1 SA8 Real Time Applications and Multimedia Management. Networks Services People 1
GN4-1 SA8 Real Time Applications and Multimedia Management 1 eduoer is an Open Education Resource (OER) metadata aggregation hub and portal service for the European research and education community 2 eduoer
More informationHelix Nebula The Science Cloud
Helix Nebula The Science Cloud CERN 14 May 2014 Bob Jones (CERN) This document produced by Members of the Helix Nebula consortium is licensed under a Creative Commons Attribution 3.0 Unported License.
More information2. HDF AAI Meeting -- Demo Slides
2. HDF AAI Meeting -- Demo Slides Steinbuch Centre for Computing Marcus Hardt KIT University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association www.kit.edu Introduction
More information