- C3Grid Stephan Kindermann, DKRZ. Martina Stockhause, MPI-M C3-Team
|
|
- Evan Townsend
- 5 years ago
- Views:
Transcription
1 A Collaborative Environment for Climate Data Handling - Stephan Kindermann, DKRZ Martina Stockhause, MPI-M C3-Team
2 Motivation Model Output Data + Observation Data + TeraByte Analysis Data Expected future rate: min. 10 PetaByte/year The mission for : Build up a collaborative environment to ease data discovery, data access and data processing Being part of a national Grid Infrastructure DFG Roundtable Tutzing 3
3 The Consortium Partners in information sciences Scientific Users MPI-M (Max Planck Institute for Meteorology) IFM-GEOMAR (Leibniz Institute of Marine Sciences) University of Cologne Freie Universität Berlin PIK (Potsdam Institute for Climate Impact Scientific Data provider University of Dortmund Zuse Institute Berlin (ZIB) DWD Research) DLR AWI World Data Centers WDC Climate WDC Mare WDC RSAT (German Meteorological Service) (German Aerospace Center) (Alfred Wegener Institute for Polar and Marine Research) GKSS DKRZ (German Climate Computing Center) PIK (Potsdam Institute for Climate Impact Associate Partners Research) AWI University of Hannover University of Bonn Forschungszentrum Karlsruhe (Alfred Wegener Institute for Polar and Marine Research) Sun Microsystems, Inc. NEC Corporation Brockmann Consult IFM-GEOMAR (Leibniz Institute of Marine Sciences) University of Cologne/ ZAIK/ FUB Further info:
4 in context Application Climate Community / Organizations GO-ESSP, CF, IPCC, Earth System Curator New FP7 projects Metafor, IS-ENES, Europs-Net.. Geosciences: INSPIRE ISO OGC Other Grids: EGEE, ESG, NDG D-Grid Security: Shibboleth, SAML Grid / Web Basics: OGF, Globus, WSRF, GSI, WSI,.. Infrastructure
5 Talk Overview ArchitectureKey Challenges / Problems Data discovery Automatic Metadata Generation Data access Bridging Heterogeneity Data processing Workflow Composition Access to resources Consistent Security Infrastructur
6 Discovery of data products: Open standards: Portal OAI-PMH harvesting Discovery Web Service DIS primary metadata ISO 19115/19139 Metadata Profile freely available discovery framework (see or sourceforge.net site) OAI-PMH Harvestin g ISO Profile: ISO Metadata Profile controlled vocabularies ( CF standard names, Coordinate Ref. Systems, ) hierarchical data organisation (parent child, aggregation info,..) data provenance (ISO lineage information) data access info ( specific)
7
8
9 Community Data Access: Bridging Heterogeneity geographical Generic Data Request Web Service Interface + vertical + temporal + content + file format selection Analysis Selection of preprocessing tools Metadata generation Provider specific data access interface Initial Implementation: WSDL Web Service next: WSRF Web Service base data preworkspace proc. metadata Compute Resource Grid based data management Implementation Examples: primary data - DB + Archive Wrapper (DKRZ, M&D) Data Warehouse (Pangaea) OGSA-DAI + DB (DWD)... netcdf, GRIB, HDF, XML,..
10 The SOA Portal Portal Distributed infrastructure grid DIS primary metadata DMS primary data local resources and interfaces Workflow Scheduler RIS base data preworkspace proc. metadata Compute Resource Data / Compute Providers World Data Centers Climat Mare RSAT e Research Institutes Universities IFMGeomarFU Berlin Uni Köln : Interface DWD DKRZ PIK GKSS AWI MPI-M
11 Problem: Automatic Metadata Life Cycle Management Problem A: Discovery of dynamically generated/inserted data products Portal Portal Distributed infrastructure Automatic (discovery) metadata generation as part of workflow, including grid DIS DMS automatic provenance info tracking security info aggregation info Automatic quality check Generic tool support primary metadata primary data local resources and interfaces base data?? preproc. Workspace / metadata C3 Repository Center Compute Resource
12 Metadata Handling Support Browser Interface: API: XML content visualisation workflow integration XML (template) generation e-science middleware integration Browser Browser Program interface XForms HTML + css Secure login API Property file interpreter OGSA-DAI Manipulation layer XSLT & XQuery + Checking Specification layer ISO XML template, Specification file, default XMLs Metadata basis ISO XMLs Technology: XML database (exist), XForms (Orbeon), python tools First reusable prototype, cooperation with EGEE
13 Discovery Metadata: Experiences, Problems For established data centers ISO discovery metadata generation was quickly done Substantial support necessary for generating or manipulating ISO discovery metadata for others Agreement on, maintainance of, controlled vocabularies very important USE / DISCOVERY metadata gap is an open issue (e.g. GRIB usage problem, )
14 Workflow Processing Portal Portal Distributed Problem infrastructure B: grid DIS DMS Flexibility of processing functionality?? RIS Workflow Scheduler predefined workflows (just parameterization) primary primary Compute base data workflow compositiondata based onpremodule metadata Resource library workspace proc. local resources and interfaces metadata user inserted programs
15 Workflow Processing: Status / Next steps Portal Initial set of fixed workflows integrated in portal JSDL based workflow description Scheduler controls execution (decision based e.g. on modules info + data avalability) modules info published to Grid Resource Information Service (MDS RIS Workflow Scheduler based) Compute Resource GT4 WS-GRAM Interfaces Preinstalled SW packages (use of modules system) workspace local resources and interfaces Open Issues: workflow composition support interdependency between processing and data user defined processing debugging, substantial user support needed; security!
16 Data access and security Portal AA single sign on support of users without grid certificates federated identity management Portal Distributed infrastructure grid DIS X509DMS grid certificates (EU-GridPMA CA) RIS Grid security infrastructure (GSI) Workflow Scheduler AA primary metadata primary data local resources and interfaces base data preworkspace proc. metadata Compute Resource Data / Compute Providers legacy AA infrastructure (LDAP, DB based,..) AA World Data Centers legacy data access infrastructure Research Institutes Climat Mare RSAT e Universities IFMGeomarFU Berlin Uni Köln : Interface DWD DKRZ PIK GKSS AWI MPI-M
17 Security Infrastructure Identity Provider Home Organisation SAML WAYF Identity Provider Virtual Organisation Home attributes + VO attributes SAML Portal Middleware Delegation Service GridShib SAML tools X509 Gridproxy wflow client <..SAML Assertions..> Grid Service Grid Resource SAML Grid Service SAML GridShib for GT policy GRAM / DataRAM SLCS (CA) MyProxy Personal / Group Account
18 Security Infrastructure Approach: 2. Shibboleth (WEB2.0) federated identity management, Home + VO attrib. 3. X509 Grid certificates + GSI in Grid Infrastructure 1 + 2: SAML assertions short lived certificate from SLCS CA Problem: Initial Idea was: Take and adapt existing technology Status is: ambitious, risky security infrastructure establishment new technology, often partly documented no working security infrastructure - no real added value services for users
19 Summary / Next steps Prototype running; first project phase ends Sept Next phase: transfer to production environment Establishment of a multi-petabyte distributed climate repository center (C3RC) for data storage Core Group has responsibility to keep this running contribution to IPCC AR5 data management Application for funds in context of next D-Grid Call
20 Thank you! further info:
21
22 Data provenance
23 Subject Issuer Public Key Validity Signature IdP entityid SAML Subject <Assertion> </Assertion >
24 Shibboleth & VO Steps: (3)IdP at Institutes (4)Initial SP s (5)GridShib tests
Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationC3Grid ISO Metadata Profile
Collaborative Climate Community Data and Processing Grid (C3-Grid) C3Grid ISO 19115 Metadata Profile Work package: WP3 Metadata Authors: C3Grid Metadata Working Group Editors: S.Kindermann, M.Stockhause
More informationGrid Computing Middleware. Definitions & functions Middleware components Globus glite
Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid
More informationINITIATIVE FOR GLOBUS IN EUROPE. Dr. Helmut Heller Leibniz Supercomputing Centre (LRZ) Munich, Germany IGE Project Coordinator
Dr. Helmut Heller (heller@lrz.de) Leibniz Supercomputing Centre (LRZ) Munich, Germany IGE Project Coordinator Argonne, March 2 nd, 2010 Overview The European Grid Ecosystem Initiative for Globus in Europe
More informationHow to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework
How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework Piotr Dziubecki, Piotr Grabowski, Michał Krysiński, Tomasz Kuczyński, Dawid Szejnfeld, Dominik Tarnawczyk, Gosia Wolniewicz
More informationGrid Scheduling Architectures with Globus
Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents
More informationGlobus GTK and Grid Services
Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature
More informationLong-term preservation for INSPIRE: a metadata framework and geo-portal implementation
Long-term preservation for INSPIRE: a metadata framework and geo-portal implementation INSPIRE 2010, KRAKOW Dr. Arif Shaon, Dr. Andrew Woolf (e-science, Science and Technology Facilities Council, UK) 3
More informationEasy Access to Grid Infrastructures
Easy Access to Grid Infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) On behalf of the g-eclipse consortium WP11 Grid Workshop Grenoble, France 09 th of December 2008 Background in astro particle
More informationNew trends in Identity Management
New trends in Identity Management Peter Gietz, DAASI International GmbH peter.gietz@daasi.de Track on Research and Education Networking in South East Europe, Yu Info 2007, Kopaionik, Serbia 14 March 2007
More informationEGI-InSPIRE. GridCertLib Shibboleth authentication for X.509 certificates and Grid proxies. Sergio Maffioletti
EGI-InSPIRE GridCertLib Shibboleth authentication for X.509 certificates and Grid proxies Sergio Maffioletti Grid Computing Competence Centre, University of Zurich http://www.gc3.uzh.ch/
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationCMIP5 Datenmanagement erste Erfahrungen
CMIP5 Datenmanagement erste Erfahrungen Dr. Michael Lautenschlager Deutsches Klimarechenzentrum Helmholtz Open Access Webinare zu Forschungsdaten Webinar 18-17.01./28.01.14 CMIP5 Protocol +Timeline Taylor
More information2. HDF AAI Meeting -- Demo Slides
2. HDF AAI Meeting -- Demo Slides Steinbuch Centre for Computing Marcus Hardt KIT University of the State of Baden-Wuerttemberg and National Research Center of the Helmholtz Association www.kit.edu Introduction
More informationMetadata for Data Discovery: The NERC Data Catalogue Service. Steve Donegan
Metadata for Data Discovery: The NERC Data Catalogue Service Steve Donegan Introduction NERC, Science and Data Centres NERC Discovery Metadata The Data Catalogue Service NERC Data Services Case study:
More informationGlobal Cryosphere Watch. GCW web portal Structure and demonstration
Global Cryosphere Watch GCW web portal Structure and demonstration Øystein Godøy The high level purpose The GCW web portal will make GCW data and information available to WMO Members, their partners, and
More informationAuthentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA.
Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. November 3th, 2005 Von Welch vwelch@ncsa.uiuc.edu Outline
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Martin Hellmich Slides adapted from Damien Lecarpentier DCH-RP workshop, Manchester, 10 April 2013 Research Infrastructures Research Infrastructure
More informationEUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal Heinrich Widmann, DKRZ DI4R 2016, Krakow, 28 September 2016 www.eudat.eu EUDAT receives funding from the European Union's Horizon 2020
More informationGoal. TeraGrid. Challenges. Federated Login to TeraGrid
Goal Federated Login to Jim Basney Terry Fleury Von Welch Enable researchers to use the authentication method of their home organization for access to Researchers don t need to use -specific credentials
More informationJuliusz Pukacki OGF25 - Grid technologies in e-health Catania, 2-6 March 2009
Grid Technologies for Cancer Research in the ACGT Project Juliusz Pukacki (pukacki@man.poznan.pl) OGF25 - Grid technologies in e-health Catania, 2-6 March 2009 Outline ACGT project ACGT architecture Layers
More informationEuropean Grid Infrastructure
EGI-InSPIRE European Grid Infrastructure A pan-european Research Infrastructure supporting the digital European Research Area Michel Drescher Technical Manager, EGI.eu Michel.Drescher@egi.eu TPDL 2013
More informationImplementation of Geospatial Product Virtualization in Grid Environment
Implementation of Geospatial Product Virtualization in Grid Environment Liping Di, Aijun Chen, Yuqi Bai, and Yaxing Wei Dr. Aijun Chen () George Mason University (GMU) Page 1 Outline Introduction Open
More informationIntroduction of NAREGI-PSE implementation of ACS and Replication feature
Introduction of NAREGI-PSE implementation of ACS and Replication feature January. 2007 NAREGI-PSE Group National Institute of Informatics Fujitsu Limited Utsunomiya University National Research Grid Initiative
More informationVisual Core Description
Visual Core Description and Information Structure Hans-Joachim Wallrabe-Adams, MARUM Ronald Conze, OSG/ICDP Colin Graham, ESO 8.5.2006 Expeditions - Information Structure Drilling Information System DIS/XDIS
More informationBruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom
The Met Office s Logical Store Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom Background are the lifeblood of the Met Office. However, over time, the organic, un-governed growth of
More informationDesign of Distributed Data Mining Applications on the KNOWLEDGE GRID
Design of Distributed Data Mining Applications on the KNOWLEDGE GRID Mario Cannataro ICAR-CNR cannataro@acm.org Domenico Talia DEIS University of Calabria talia@deis.unical.it Paolo Trunfio DEIS University
More informationNetworking European Digital Repositories
Networking European Digital Repositories What to Network? Researchers generate knowledge This is going to become an amazing paper I only hope I will be able to access it Knowledge is wrapped in publications
More informationEUDAT - Open Data Services for Research
EUDAT - Open Data Services for Research Johannes Reetz EUDAT operations Max Planck Computing & Data Centre Science Operations Workshop 2015 ESO, Garching 24-27th November 2015 EUDAT receives funding from
More informationCERA: Database System and Data Model
CERA: Database System and Data Model Michael Lautenschlager Frank Toussaint World Data Center for Climate (M&D/MPIMET, Hamburg) NINTH WORKSHOP ON METEOROLOGICAL OPERATIONAL SYSTEMS ECMWF, Reading/Berks.,
More informationThe Community Data Portal and the WMO WIS
he Community Data Portal and the WIS Presented by: Michael Burek Progress, metadata architecture, and collaboration in the future Acknowledgments NCAR - Luca Cinquini, Rob Markel, Nathan Willhelmi, Don
More informationNetworking European Digital Repositories
Networking European Digital Repositories What to Network? Researchers generate knowledge This is going to become an amazing paper I only hope I will be able to access it Knowledge is wrapped in publications
More informationPilot Implementation: Publication and Citation of Scientific Primary Data
Pilot Implementation: Publication and Citation of Scientific Primary Data Result of CODATA WG, supported by DFG Jan Brase Learning Lab Lower Saxony, Uni. Hannover Michael Lautenschlager WDC for Climate
More informationEUDAT. A European Collaborative Data Infrastructure. Daan Broeder The Language Archive MPI for Psycholinguistics CLARIN, DASISH, EUDAT
EUDAT A European Collaborative Data Infrastructure Daan Broeder The Language Archive MPI for Psycholinguistics CLARIN, DASISH, EUDAT OpenAire Interoperability Workshop Braga, Feb. 8, 2013 EUDAT Key facts
More informationEuropean and international background
IS-ENES2 General Assembly 11-13th June 2014 Barcelona European and international background Metadata and ES-DOC (including statistical downscaling) Sébastien Denvil, Mark Greenslade, Allyn Treshansky,
More informatione-infrastructure: objectives and strategy in FP7
"The views expressed in this presentation are those of the author and do not necessarily reflect the views of the European Commission" e-infrastructure: objectives and strategy in FP7 National information
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland CESSDA workshop Tampere, 5 October 2012 EUDAT Towards a pan-european Collaborative
More informationEvery Bit Counts. Publication and Citation of Data in the Earth Sciences MG&G Data Systems Advisory Committee Meeting 2009 Jens Klump et al.
Every Bit Counts Publication and Citation of Data in the Earth Sciences MG&G Data Systems Advisory Committee Meeting 2009 Jens Klump et al. Autors Jens Klump 1, Robert Huber 2, Jan Brase 3, Michael Diepenbroek
More informationCopyright 2008, Paul Conway.
Unless otherwise noted, the content of this course material is licensed under a Creative Commons Attribution - Non-Commercial - Share Alike 3.0 License.. http://creativecommons.org/licenses/by-nc-sa/3.0/
More informationUniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison
Glossary API Application Programming Interface AR5 IPCC Assessment Report 4 ASCII American Standard Code for Information Interchange BUFR Binary Universal Form for the Representation of meteorological
More informationEUDAT & SeaDataCloud
EUDAT & SeaDataCloud SeaDataCloud Kick-off meeting Damien Lecarpentier CSC-IT Center for Science www.eudat.eu EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-infrastructures.
More informationEclipse Technology Project: g-eclipse
(Incubation) Document classification: Made available under the Eclipse Public License v1.0. Date: September 11, 2007 Abstract: This document contains the Release Review Documentation for the Eclipse Technology
More informationRADAR. Establishing a generic Research Data Repository: RESEARCH DATA REPOSITORY. Dr. Angelina Kraft
RESEARCH DATA REPOSITORY http://www.radar-projekt.org http://www.radar-service.eu Establishing a generic Research Data Repository: RADAR Digital Infrastructures for Research 2016 Conference 28 th - 30
More informationIndex Introduction Setting up an account Searching and accessing Download Advanced features
ESGF Earth System Grid Federation Tutorial Index Introduction Setting up an account Searching and accessing Download Advanced features Index Introduction IT Challenges of Climate Change Research ESGF Introduction
More informationResearch and Design Application Platform of Service Grid Based on WSRF
DOI: 10.7763/IPEDR. 2012. V49. 27 Research and Design Application Platform of Service Grid Based on WSRF Jianmei Ge a, Shying Zhang a College of Computer Science and Technology, Beihua University, No.1
More informationAFRI AND CERA: A FLEXIBLE STORAGE AND RETRIEVAL SYSTEM FOR SPATIAL DATA
Frank Toussaint, Markus Wrobel AFRI AND CERA: A FLEXIBLE STORAGE AND RETRIEVAL SYSTEM FOR SPATIAL DATA 1. Introduction The exploration of the earth has lead to a worldwide exponential increase of geo-referenced
More informationDigital Curation and Preservation: Defining the Research Agenda for the Next Decade
Storage Resource Broker Digital Curation and Preservation: Defining the Research Agenda for the Next Decade Reagan W. Moore moore@sdsc.edu http://www.sdsc.edu/srb Background NARA research prototype persistent
More informationData Replication: Automated move and copy of data. PRACE Advanced Training Course on Data Staging and Data Movement Helsinki, September 10 th 2013
Data Replication: Automated move and copy of data PRACE Advanced Training Course on Data Staging and Data Movement Helsinki, September 10 th 2013 Claudio Cacciari c.cacciari@cineca.it Outline The issue
More informationGrid Computing Security
Anirban Chakrabarti Grid Computing Security With 87 Figures and 12 Tables Sprin g er Contents Preface Organization Acknowledgments v vi vii 1 Introduction 1 1.1 Background 1 1.2 Grid Computing Overview
More informationGrid Middleware and Globus Toolkit Architecture
Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities
More informationBuilding a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners 24th Forum ORAP Cite Scientifique; Lille, France March 26, 2009 Don Middleton National
More informationBy Ian Foster. Zhifeng Yun
By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance
More informationEUDAT-B2FIND A FAIR and Interdisciplinary Discovery Portal for Research Data
EUDAT-B2FIND A FAIR and Interdisciplinary Discovery Portal for Research Data Heinrich Widmann, DKRZ Claudia Martens, DKRZ Open Science Days, Berlin, 17 October 2017 www.eudat.eu EUDAT receives funding
More informationDesign The way components fit together
Introduction to Grid Architecture What is Architecture? Design The way components fit together 9-Mar-10 MCC/MIERSI Grid Computing 1 Introduction to Grid Architecture Why Discuss Architecture? Descriptive
More informationDURAARK. Ex Libris conference April th, 2013 Berlin. Long-term Preservation of 3D Architectural Data
DURAARK Long-term Preservation of 3D Architectural Data Ex Libris conference April 29-30 th, 2013 Berlin Dr Helmi Ben Hmida (Leibniz University Hanover, DE) 1 / 33 30 / 04 / 13 Dr Helmi Ben Hmida (Leibniz
More informationIng. José A. Mejía Villar M.Sc. Computing Center of the Alfred Wegener Institute for Polar and Marine Research
Ing. José A. Mejía Villar M.Sc. jmejia@awi.de Computing Center of the Alfred Wegener Institute for Polar and Marine Research 29. November 2011 Contents 1. Fedora Commons Repository 2. Federico 3. Federico's
More informationDSpace Fedora. Eprints Greenstone. Handle System
Enabling Inter-repository repository Access Management between irods and Fedora Bing Zhu, Uni. of California: San Diego Richard Marciano Reagan Moore University of North Carolina at Chapel Hill May 18,
More informationComputational Web Portals. Tomasz Haupt Mississippi State University
Computational Web Portals Tomasz Haupt Mississippi State University What is a portal? Is it a web page? There is something going on behind the scene! Synopsis URL TCP/IP SSL HTTP HTTPS PKI Kerberos HTML
More informationKepler Scientific Workflow and Climate Modeling
Kepler Scientific Workflow and Climate Modeling Ufuk Turuncoglu Istanbul Technical University Informatics Institute Cecelia DeLuca Sylvia Murphy NOAA/ESRL Computational Science and Engineering Dept. NESII
More informationTHEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap
THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap Arnie Miles Georgetown University adm35@georgetown.edu http://thebes.arc.georgetown.edu The Thebes middleware project was
More informationFederated access to Grid resources
Federated access to Grid resources http://tinyurl.com/loubf Keith Hazelton (hazelton@wisc.edu) Internet2 Middleware Architecture Comm. for Ed. APAN, Singapore, 19-July-06 Topics http://tinyurl.com/loubf
More informationGrid-Based Data Mining and the KNOWLEDGE GRID Framework
Grid-Based Data Mining and the KNOWLEDGE GRID Framework DOMENICO TALIA (joint work with M. Cannataro, A. Congiusta, P. Trunfio) DEIS University of Calabria ITALY talia@deis.unical.it Minneapolis, September
More informationShibVomGSite: A Framework for Providing Username and Password Support to GridSite with Attribute based Authorization using Shibboleth and VOMS
ShibVomGSite: A Framework for Providing Username and Password Support to GridSite with Attribute based Authorization using Shibboleth and VOMS Joseph Olufemi Dada & Andrew McNab School of Physics and Astronomy,
More informationEUDAT. Towards a Collaborative Data Infrastructure. Ari Lukkarinen CSC-IT Center for Science, Finland NORDUnet 2012 Oslo, 18 August 2012
EUDAT Towards a Collaborative Data Infrastructure Ari Lukkarinen CSC-IT Center for Science, Finland NORDUnet 2012 Oslo, 18 August 2012 Big (Chaotic) Data DATA GENERATORS 1) Measurement technology. 2) Cheap
More informationDataFinder A Scientific Data Management Solution ABSTRACT
DataFinder A Scientific Data Management Solution Tobias Schlauch (1), Andreas Schreiber (2) (1) German Aerospace Center (DLR) Simulation and Software Technology Lilienthalplatz 7, D-38108 Braunschweig,
More informationData discovery and access via the SeaDataNet CDI system
Data discovery and access via the SeaDataNet CDI system Central dataproducts and data services on distributed data. Peter Thijsse MARIS CLIPC IS-ENES workshop, KNMI, November 2014 Outline 1. Introduction
More informationDagmar Triebel, Peter Grobe, Anton Güntsch, Gregor Hagedorn, Joachim Holstein, Carola Söhngen, Claus Weiland, Tanja Weibulat.
How to organize, process and archive collection and occurrence data using GFBio services provided by Germany s major natural history and culture collection data repositories, Peter Grobe, Anton Güntsch,
More informationThe NASA/GSFC Advanced Data Grid: A Prototype for Future Earth Science Ground System Architectures
The NASA/GSFC Advanced Data Grid: A Prototype for Future Earth Science Ground System Architectures Samuel D. Gasster, Craig A. Lee, Brooks Davis, Matt Clark, Mike AuYeung, John R. Wilson Computer Systems
More informationEnabling Grids for E-sciencE. EGEE security pitch. Olle Mulmo. EGEE Chief Security Architect KTH, Sweden. INFSO-RI
EGEE security pitch Olle Mulmo EGEE Chief Security Architect KTH, Sweden www.eu-egee.org Project PR www.eu-egee.org EGEE EGEE is the largest Grid infrastructure project in the World? : 70 leading institutions
More informationThe NCAR Community Data Portal
The NCAR Community Data Portal http://cdp.ucar.edu/ QuickTime and a TIFF (Uncompressed) decompressor are needed to see this picture. QuickTime and a TIFF (Uncompressed) decompressor are needed to see this
More informationIntroduction to Grid Security
Introduction to Grid Security Mika Silander Helsinki Institute of Physics www.hip.fi T-106.5820 Grid Technologies and Applications TKK, Outline Background Functionality overview Virtual Organisations Certification
More informationGrid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management
More informationA VO-friendly, Community-based Authorization Framework
A VO-friendly, Community-based Authorization Framework Part 1: Use Cases, Requirements, and Approach Ray Plante and Bruce Loftis NCSA Version 0.1 (February 11, 2005) Abstract The era of massive surveys
More informationResearch on the Key Technologies of Geospatial Information Grid Service Workflow System
Research on the Key Technologies of Geospatial Information Grid Service Workflow System Lin Wan *, Zhong Xie, Liang Wu Faculty of Information Engineering China University of Geosciences Wuhan, China *
More informationImplementing a Data Quality Strategy to simplify access to data
IN43D-07 AGU Fall Meeting 2016 Implementing a Quality Strategy to simplify access to data Kelsey Druken, Claire Trenham, Ben Evans, Clare Richards, Jingbo Wang, & Lesley Wyborn National Computational Infrastructure,
More informationXML Applications. Introduction Jaana Holvikivi 1
XML Applications Introduction 1.4.2009 Jaana Holvikivi 1 Outline XML standards Application areas 1.4.2009 Jaana Holvikivi 2 Basic XML standards XML a meta language for the creation of languages to define
More informationEUDAT. Towards a pan-european Collaborative Data Infrastructure
EUDAT Towards a pan-european Collaborative Data Infrastructure Giuseppe Fiameni (g.fiameni@cineca.it) Claudio Cacciari SuperComputing, Application and Innovation CINECA Johannes Reatz RZG, Germany Damien
More informationGENeric European Sustainable Information Space for Environment.
GENeric European Sustainable Information Space for Environment http://www.genesis-fp7.eu/ Outline Introduction The GENESIS FP7 project The GENESIS solution s architecture GENESIS experience with INSPIRE
More informationEUDAT & AAI. Daan Broeder MPI for Psycholinguistics
EUDAT & AAI Daan Broeder MPI for Psycholinguistics Initially six research communities on Board EPOS: European Plate Observatory System CLARIN: Common Language Resources and Technology Infrastructure ENES:
More informationeresearch Collaboration across the Pacific:
eresearch Collaboration across the Pacific: Marine Systems and Australian Marine Science Craig Johnson University of Tasmania Outline Introduce the Australian Ocean Network Possibilities for trans-pacific
More informationMediGRID Grid Computing for Medicine and Life Sciences
MediGRID Grid Computing for Medicine and Life Sciences Anette Weisbecker, Fraunhofer IAO, Stuttgart Otto Rienhoff, Georg-August-Universität, Göttingen International Symposium on Grid Computing Taipei,
More informationKnowledge Discovery Services and Tools on Grids
Knowledge Discovery Services and Tools on Grids DOMENICO TALIA DEIS University of Calabria ITALY talia@deis.unical.it Symposium ISMIS 2003, Maebashi City, Japan, Oct. 29, 2003 OUTLINE Introduction Grid
More informationMajor SAML 2.0 Changes. Nate Klingenstein Internet2 EuroCAMP 2007 Helsinki April 17, 2007
Major SAML 2.0 Changes Nate Klingenstein Internet2 EuroCAMP 2007 Helsinki April 17, 2007 Tokens, Protocols, Bindings, and Profiles Tokens are requests and assertions Protocols bindings are communication
More informationA Concept for Attribute-Based Authorization on D-Grid Resources
A Concept for Attribute-Based Authorization on D-Grid Resources Ralf Groeper a, Christian Grimm a, Siegfried Makedanz b, Hans Pfeiffenberger b, Wolfgang Ziegler c, Peter Gietz d, Michael Schiffers e a
More informationGrids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan
Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security
More informationg-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.
g-eclipse A Framework for Accessing Grid Infrastructures Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.cy) EGEE Training the Trainers May 6 th, 2009 Outline Grid Reality The Problem g-eclipse
More informationDHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI
DHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI Department of Computer Science and Engineering CS6703 Grid and Cloud Computing Anna University 2 & 16 Mark Questions & Answers Year / Semester: IV / VII Regulation:
More informationMetadata Models for Experimental Science Data Management
Metadata Models for Experimental Science Data Management Brian Matthews Facilities Programme Manager Scientific Computing Department, STFC Co-Chair RDA Photon and Neutron Science Interest Group Task lead,
More informationTHE WIDE AREA GRID. Architecture
THE WIDE AREA GRID Architecture Context The Wide Area Grid concept was discussed during several WGISS meetings The idea was to imagine and experiment an infrastructure that could be used by agencies to
More informationManaging very large Multimedia Archives and their Integration into Federations
Managing very large Multimedia Archives and their Integration into Federations Daan Broeder, Eric Auer, Marc Kemps-Snijders, Han Sloetjes, Peter Wittenburg, Claus Zinn 1 1 Max-Planck-Institute for Psycholinguistics,
More informationWeb Interface to Materials Simulations
Web Interface to Materials Simulations Web Interface Generator and Legacy Application Façade Portal Development Team Funding Akos J. Czikmantory (JPL - Wiglaf) DARPA-PROM Hook Hua (JPL - Wiglaf ) JPL SRRF
More informationReducing Consumer Uncertainty
Spatial Analytics Reducing Consumer Uncertainty Towards an Ontology for Geospatial User-centric Metadata Introduction Cooperative Research Centre for Spatial Information (CRCSI) in Australia Communicate
More informationGrid technologies, solutions and concepts in the synchrotron Elettra
Grid technologies, solutions and concepts in the synchrotron Elettra Roberto Pugliese, George Kourousias, Alessio Curri, Milan Prica, Andrea Del Linz Scientific Computing Group, Elettra Sincrotrone, Trieste,
More informationDOIs for Research Data
DOIs for Research Data Open Science Days 2017, 16.-17. Oktober 2017, Berlin Britta Dreyer, Technische Informationsbibliothek (TIB) http://orcid.org/0000-0002-0687-5460 Scope 1. DataCite Services 2. Data
More informationRelation between Geospatial information projects related to GBIF
Relation between Geospatial information projects related to GBIF Synthesys 3.6-Synthesys 3.7-GBIF.DE- BioGeomancer The most up to date work can always be found at: http://www.biogeografia.com/synthesys
More informationA Guanxi Shibboleth based Security Infrastructure for e-social Science
A Guanxi Shibboleth based Security Infrastructure for e-social Science Wei Jie 1 Alistair Young 2 Junaid Arshad 3 June Finch 1 Rob Procter 1 Andy Turner 3 1 University of Manchester, UK 2 UHI Millennium
More informationObservations and Measurements as a basis for semantic reconciliation between GRIB and netcdf... and some other ideas.
Observations and Measurements as a basis for semantic reconciliation between GRIB and netcdf... and some other ideas. Jeremy Tandy 24 th September 2014 Problem statement: interoperability interoperable
More information30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
More informationInfraStructure for the European Network for Earth System modelling. From «IS-ENES» to IS-ENES2
InfraStructure for the European Network for Earth System modelling From «IS-ENES» to IS-ENES2 Sylvie JOUSSAUME, CNRS, Institut Pierre Simon Laplace, Coordinator ENES European Network for Earth System modelling
More informationIdentity Management in ESA Grid on-demand Infrastructure
Identity Management in ESA Grid on-demand Infrastructure OGC TC - Europe Forum 4 December 2008, Valencia Pedro Pereira Gonçalves http://www.terradue.com Slide 1 ESA G-POD Infrastructure! Computing and
More information