The Earth System Grid: A Visualisation Solution. Gary Strand
|
|
|
- Patrick Robertson
- 6 years ago
- Views:
Transcription
1 The Earth System Grid: A Visualisation Solution Gary Strand
2 Introduction
3 Acknowledgments PI s Ian Foster (ANL) Don Middleton (NCAR) Dean Williams (LLNL) ESG Development Team Veronika Nefedova (ANL) Ann Chervenak (ISI/USC) Carl Kesselman (ISI/USC) David Bernholdt (ORNL) Kasidit Chanchio (ORNL) Line Pouchard (ORNL) Alex Sim (LBNL) Arie Shoshani (LBNL) Bob Drach (LLNL) Dave Brown (NCAR) Gary Strand (NCAR) Jose Garcia (NCAR) Luca Cinquini (NCAR) Peter Fox (NCAR)
4 Current Practices o Scientist (or others) wants a visualisation o Visualisation person gets appropriate data after verifying with data manager as to the name, location, total size, etc. o Data moved to local machine that has visualisation tools o Visualization created on local machine o Hopefully, someone remembers to archive the visualisation
5 Simple Vis Example
6 Problems in the process o What if the data cannot be found (e.g. we have 1.2 million files, 73 TB of data), or the data manager is unavailable? o What if there isn t enough disk space or sufficient other resources? o What if a better visualisation tool is located elsewhere? o What if the visualisation should be shared? o What if the visualisation is lost? o ESG is part of the answers to these questions
7 What is ESG? LBNL: Climate storage facility ANL: Computational grids, & grid-based applications LLNL: Model diagnostics & inter-comparison USC/ISI: Computational grids, & grid-based applications NCAR: Climate change predication and scenarios LANL: Next generation coupled models & computing ORNL: Climate storage & computational resources
8 ESG Architecture LBNL HPSS! High Performance! Storage System! disk! ANL SRM! Storage Resource! Management! gridftp! server! NCAR opendapg! server! gridftp! Striped! server! CAS! Community Authorization Services! Tomcat servlet engine! MyProxy! server! disk! LLNL MCS client! RLS client! MyProxy client! CAS client! SRM! Storage Resource! Management! gridftp! server! GRAM! gatekeeper! gridftp! gridftp! server! ORNL ISI MCS! Metadata Cataloguing Services! SOAP" SRM! Storage Resource! Management! gridftp! gridftp! server! SRM! Storage Resource! Management! RLS! Replica Location Services! RMI" disk! MSS! Mass Storage System! disk! HPSS! High Performance! Storage System!
9 Solutions o What happens when data cannot be found, or the data manager is unavailable? Metadata catalogue service (MCS) Replica location service (RLS)
10 MCS and RLS and Metadata Services ESG CLIENTS API! & USER INTERFACES! PUBLISHING! ANALYSIS & VISUALIZATION! SEARCH & DISCOVERY! ADMINISTRATION! BROWSING & DISPLAY! METADATA! EXTRACTION! METADATA! ANNOTATION! HIGH LEVEL METADATA SERVICES! METADATA & DATA! REGISTRATION! METADATA! BROWSING! METADATA! QUERY! METADATA! AGGREGATION! METADATA! VALIDATION! METADATA! DISPLAY! METADATA! DISCOVERY! METADATA ACCESS! (update, insert, delete, query)! CORE METADATA SERVICES! SERVICE TRANSLATION! LIBRARY! METADATA HOLDINGS! Data &! Metadata! Catalog! Dublin Core! Database! mirror! Dublin Core! XML Files! COARDS! Database! COMMENTS! XML Files!
11 Solutions (contd.) o What if there isn t enough disk space or sufficient other resources? Hierarchical Resource Manager (HRM)
12 HRM
13 Solutions (contd.) o What What if a better visualization tool is located elsewhere? Distributed visualization
14 CDAT Example of an ESG Script Access The next-generation language, Python, is used to access the Earth System Grid (ESG) at LLNL Import cdms, vcs db = cdms.open( ldap://localhost:389/database=demo,ou=pcmdi,o=llnl,c=us ) f = db.open( ncep_reanalysis_mo ) ds = f( ts ) x=vcs.init( ) x.plot(ds)
15 CDAT: Example of an ESG GUI Client Access
16 Solutions (contd.) o What if the visualization should be shared? Access Grid plus Visualisation Tool
17 Collaborative Environments Science Portals + AccessGrid: University of Michigan (Knoop, Hardin) Vegetation & Ecosystem Mapping Program (VEMAP) NCAR/SCD VETS/KEG Argonne National Labs
18 Conclusions " Visualisation can require as many services and resources as the initial computation " Many sites do not offer sufficient resources for the visualisations earth sciences require " ESG provides, and will provide, the tools that enable visualisation on a grander scale
19 Conclusions (contd.) " ESG tools enable better data access, better data knowledge, and the processes of collaboration for the needs of investigating, visualising, and learning
The Earth System Grid Discovery and Semantic Web Technologies
The Earth System Grid Discovery and Semantic Web Technologies Line Pouchard (Oak Ridge National Laboratory, Oak Ridge, TN 37831-6367, pouchardlc@ornl.gov) Luca Cinquini, Gary Strand (National Center for
The Earth System Grid: Supporting the Next Generation of Climate Modeling Research
The Earth System Grid: Supporting the Next Generation of Climate Modeling Research DAVID BERNHOLDT, SHISHIR BHARATHI, DAVID BROWN, KASIDIT CHANCHIO, MEILI CHEN, ANN CHERVENAK, LUCA CINQUINI, BOB DRACH,
The Virtual Observatory
The Virtual Observatory Peter Fox HAO/ESSL/NCAR November 28, 2005 Outline Virtual Observatories - history and definition(s), I*Ys Some examples - within disciplines When is a VO, not a VO? Beyond disciplines,
Monitoring the Earth System Grid with MDS4
Monitoring the Earth System Grid with MDS4 Ann Chervenak 1, Jennifer M. Schopf 2,3,4, Laura Pearlman 1, Mei-Hui Su 1, Shishir Bharathi 1, Luca Cinquini 5, Mike D Arcy 1, Neill Miller 2,3, David Bernholdt
Ontologies and The Earth System Grid
Ontologies and The Earth System Grid Line Pouchard (ORNL) PI s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams (LLNL) http://www.earthsystemgrid.org The NIEeS Workshop Cambridge, UK Overview:
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners 24th Forum ORAP Cite Scientifique; Lille, France March 26, 2009 Don Middleton National
The NCAR Community Data Portal
The NCAR Community Data Portal http://cdp.ucar.edu/ QuickTime and a TIFF (Uncompressed) decompressor are needed to see this picture. QuickTime and a TIFF (Uncompressed) decompressor are needed to see this
The Virtual Solar-Terrestrial Observatory ++
The Virtual Solar-Terrestrial Observatory ++ Peter Fox* Deborah McGuinness$#, Luca Cinquini%, Patrick West*, Jose Garcia*, Tony Darnell*, James Benedict$, Don Middleton%, Stan Solomon* *HAO/ESSL/NCAR $
Introduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
Data Management Components for a Research Data Archive
Data Management Components for a Research Data Archive Steven Worley and Bob Dattore Scientific Computing Division Computational and Information Systems Laboratory National Center for Atmospheric Research
By Ian Foster. Zhifeng Yun
By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance
Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.
Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies
SciDAC's Earth System Grid Center for Enabling Technologies Semiannual Progress Report October 1, 2010 through March 31, 2011
LLNL-TR-478393 SciDAC's Earth System Grid Center for Enabling Technologies Semiannual Progress Report October 1, 2010 through March 31, 2011 D. N. Williams April 4, 2011 Disclaimer This document was prepared
Climate Data Management using Globus
Climate Data Management using Globus Computation Institute Rachana Ananthakrishnan (ranantha@uchicago.edu) Data Management Challenges Transfers often take longer than expected based on available network
A Distributed Media Service System Based on Globus Data-Management Technologies1
A Distributed Media Service System Based on Globus Data-Management Technologies1 Xiang Yu, Shoubao Yang, and Yu Hong Dept. of Computer Science, University of Science and Technology of China, Hefei 230026,
The Community Data Portal and the WMO WIS
he Community Data Portal and the WIS Presented by: Michael Burek Progress, metadata architecture, and collaboration in the future Acknowledgments NCAR - Luca Cinquini, Rob Markel, Nathan Willhelmi, Don
Knowledge-based Grids
Knowledge-based Grids Reagan Moore San Diego Supercomputer Center (http://www.npaci.edu/dice/) Data Intensive Computing Environment Chaitan Baru Walter Crescenzi Amarnath Gupta Bertram Ludaescher Richard
THE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid
THE GLOBUS PROJECT White Paper GridFTP Universal Data Transfer for the Grid WHITE PAPER GridFTP Universal Data Transfer for the Grid September 5, 2000 Copyright 2000, The University of Chicago and The
A Simple Mass Storage System for the SRB Data Grid
A Simple Mass Storage System for the SRB Data Grid Michael Wan, Arcot Rajasekar, Reagan Moore, Phil Andrews San Diego Supercomputer Center SDSC/UCSD/NPACI Outline Motivations for implementing a Mass Storage
Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory
Lawrence Berkeley National Laboratory Lawrence Berkeley National Laboratory Title Scaling the Earth System Grid to 100Gbps Networks Permalink https://escholarship.org/uc/item/80n7w3tw Author Balman, Mehmet
Transitioning NCAR MSS to HPSS
Transitioning NCAR MSS to HPSS Oct 29, 2009 Erich Thanhardt Overview Transitioning to HPSS Explain rationale behind the move Introduce current HPSS system in house Present transition plans with timelines
Grid Technologies & Applications: Architecture & Achievements
Grid Technologies & Applications: Architecture & Achievements Ian Foster Mathematics & Computer Science Division, Argonne National Laboratory, Argonne, IL 60439, USA Department of Computer Science, The
LIGO Virtual Data. Realizing. UWM: Bruce Allen, Scott Koranda. Caltech: Kent Blackburn, Phil Ehrens, Albert. Lazzarini, Roy Williams
Realizing LIGO Virtual Data Caltech: Kent Blackburn, Phil Ehrens, Albert Lazzarini, Roy Williams ISI: Ewa Deelman, Carl Kesselman, Gaurang Mehta, Leila Meshkat, Laura Pearlman UWM: Bruce Allen, Scott Koranda
SDS: A Scalable Data Services System in Data Grid
SDS: A Scalable Data s System in Data Grid Xiaoning Peng School of Information Science & Engineering, Central South University Changsha 410083, China Department of Computer Science and Technology, Huaihua
Uniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison
Glossary API Application Programming Interface AR5 IPCC Assessment Report 4 ASCII American Standard Code for Information Interchange BUFR Binary Universal Form for the Representation of meteorological
Grid Data Management in Action: Experience in Running and Supporting Data Management Services in the EU DataGrid Project
Grid Data Management in Action: Experience in Running and Supporting Data Management Services in the EU DataGrid Project Heinz Stockinger, Flavia Donno, Erwin Laure, Shahzad Muzaffar, Peter Kunszt CERN,
The EC Presenting a multi-terabyte dataset MWF via ER the web
The EC Presenting a multi-terabyte dataset MWF via ER the web Data Management at the BADC Ag Stephens BADC Data Scientist 11 November 2003 Presentation outline An introduction to the BADC. The project
Index Introduction Setting up an account Searching and accessing Download Advanced features
ESGF Earth System Grid Federation Tutorial Index Introduction Setting up an account Searching and accessing Download Advanced features Index Introduction IT Challenges of Climate Change Research ESGF Introduction
Introduction to The Storage Resource Broker
http://www.nesc.ac.uk/training http://www.ngs.ac.uk Introduction to The Storage Resource Broker http://www.pparc.ac.uk/ http://www.eu-egee.org/ Policy for re-use This presentation can be re-used for academic
Zhengyang Liu University of Virginia. Oct 29, 2012
SDCI Net: Collaborative Research: An integrated study of datacenter networking and 100 GigE wide-area networking in support of distributed scientific computing Zhengyang Liu University of Virginia Oct
Web Enabled Collaborative Climate Visualization in the Earth System Grid
Web Enabled Collaborative Climate Visualization in the Earth System Grid Wesley Kendall, Markus Glatter, Jian Huang University of Tennessee, Knoxville E-mail: {kendall, glatter, huangj}@cs.utk.edu Forrest
ESGF IdEA: Iden-ty, En-tlement and Access Management
ESGF IdEA: Iden-ty, En-tlement and Access Management ESGF UV- CDAT Conference 09-11 December 2014 Philip Kershaw, Centre for Environmental Data Archival, RAL Space, STFC Rachana Ananthakrishnan, Argonne
ALICE Grid Activities in US
ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions
Engagement With Scientific Facilities
Engagement With Scientific Facilities Eli Dart, Network Engineer ESnet Science Engagement Lawrence Berkeley National Laboratory Global Science Engagement Panel Internet2 Technology Exchange San Francisco,
Lawrence Berkeley National Laboratory Recent Work
Lawrence Berkeley National Laboratory Recent Work Title Storage resource managers: Essential components for the grid Permalink https://escholarship.org/uc/item/3qk459bb Journal Grid Resource Management:
Pegasus Workflow Management System. Gideon Juve. USC Informa3on Sciences Ins3tute
Pegasus Workflow Management System Gideon Juve USC Informa3on Sciences Ins3tute Scientific Workflows Orchestrate complex, multi-stage scientific computations Often expressed as directed acyclic graphs
Data Grid Services: The Storage Resource Broker. Andrew A. Chien CSE 225, Spring 2004 May 26, Administrivia
Data Grid Services: The Storage Resource Broker Andrew A. Chien CSE 225, Spring 2004 May 26, 2004 Administrivia This week:» 5/28 meet ½ hour early (430pm) Project Reports Due, 6/10, to Andrew s Office
Database Assessment for PDMS
Database Assessment for PDMS Abhishek Gaurav, Nayden Markatchev, Philip Rizk and Rob Simmonds Grid Research Centre, University of Calgary. http://grid.ucalgary.ca 1 Introduction This document describes
The Materials Data Facility
The Materials Data Facility Ben Blaiszik (blaiszik@uchicago.edu), Kyle Chard (chard@uchicago.edu) Ian Foster (foster@uchicago.edu) materialsdatafacility.org What is MDF? We aim to make it simple for materials
The Grid Architecture
U.S. Department of Energy Office of Science The Grid Architecture William E. Johnston Distributed Systems Department Computational Research Division Lawrence Berkeley National Laboratory dsd.lbl.gov What
Astrophysics and the Grid: Experience with EGEE
Astrophysics and the Grid: Experience with EGEE Fabio Pasian INAF & VObs.it IVOA 2007 Interoperability Meeting Astro-RG session INAF experience with the grid (from the IVOA 2006 Interop): In INAF there
Introduction to Grid Computing
Introduction to Grid Computing Jennifer M. Schopf UK National escience Centre Argonne National Lab Overview and Outline What is a Grid And what is not a Grid History Globus Toolkit and Standards Grid 2003
Grid-BGC: A Grid-Enabled Terrestrial Carbon Cycle Modeling System
Grid-BGC: A Grid-Enabled Terrestrial Carbon Cycle Modeling System Jason Cope*, Craig Hartsough, Peter Thornton, Henry M. Tufo*, Nathan Wilhelmi and Matthew Woitaszek* * University of Colorado, Boulder
Data Access and Analysis with Distributed, Federated Data Servers in climateprediction.net
Data Access and Analysis with Distributed, Federated Data Servers in climateprediction.net Neil Massey 1 neil.massey@comlab.ox.ac.uk Tolu Aina 2, Myles Allen 2, Carl Christensen 1, David Frame 2, Daniel
A Replica Location Grid Service Implementation
A Replica Location Grid Service Implementation Mary Manohar, Ann Chervenak, Ben Clifford, Carl Kesselman Information Sciences Institute, University of Southern California Marina Del Rey, CA 90292 {mmanohar,
The NOAA Operational Model Archive and Distribution System (NOMADS)
The NOAA Operational Model Archive and Distribution System (NOMADS) Glenn Rutledge Principle Investigator January 2003 Overview Retrospective analysis and model inter-comparison are necessary to verify
Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
NCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017
NCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017 Overview The Globally Accessible Data Environment (GLADE) provides centralized file storage for HPC computational, data-analysis,
HEP Grid Activities in China
HEP Grid Activities in China Sun Gongxing Institute of High Energy Physics, Chinese Academy of Sciences CANS Nov. 1-2, 2005, Shen Zhen, China History of IHEP Computing Center Found in 1974 Computing Platform
Cloud Computing. Up until now
Cloud Computing Lecture 4 and 5 Grid: 2012-2013 Introduction. Up until now Definition of Cloud Computing. Grid Computing: Schedulers: Condor SGE 1 Summary Core Grid: Toolkit Condor-G Grid: Conceptual Architecture
SC17 - Overview
HPSS @ SC17 - Overview High Performance Storage System The value and benefits of the HPSS service offering http://www.hpss-collaboration.org 1 We are storage industry thought leaders HPSS is a development
and the GridKa mass storage system Jos van Wezel / GridKa
and the GridKa mass storage system / GridKa [Tape TSM] staging server 2 Introduction Grid storage and storage middleware dcache h and TSS TSS internals Conclusion and further work 3 FZK/GridKa The GridKa
Coordinating Parallel HSM in Object-based Cluster Filesystems
Coordinating Parallel HSM in Object-based Cluster Filesystems Dingshan He, Xianbo Zhang, David Du University of Minnesota Gary Grider Los Alamos National Lab Agenda Motivations Parallel archiving/retrieving
Kepler Scientific Workflow and Climate Modeling
Kepler Scientific Workflow and Climate Modeling Ufuk Turuncoglu Istanbul Technical University Informatics Institute Cecelia DeLuca Sylvia Murphy NOAA/ESRL Computational Science and Engineering Dept. NESII
Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management
glite Grid Services Overview
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,
GPFS Experiences from the Argonne Leadership Computing Facility (ALCF) William (Bill) E. Allcock ALCF Director of Operations
GPFS Experiences from the Argonne Leadership Computing Facility (ALCF) William (Bill) E. Allcock ALCF Director of Operations Argonne National Laboratory Argonne National Laboratory is located on 1,500
A Metadata Catalog Service for Data Intensive Applications
Metadata Catalog Service Draft August 5, 2002 A Metadata Catalog Service for Data Intensive Applications Ann Chervenak, Ewa Deelman, Carl Kesselman, Laura Pearlman, Gurmeet Singh Version 1.0 1 Introduction
Based on: Grid Intro and Fundamentals Review Talk by Gabrielle Allen Talk by Laura Bright / Bill Howe
Introduction to Grid Computing 1 Based on: Grid Intro and Fundamentals Review Talk by Gabrielle Allen Talk by Laura Bright / Bill Howe 2 Overview Background: What is the Grid? Related technologies Grid
Introduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill
Introduction to FREE National Resources for Scientific Computing Dana Brunson Oklahoma State University High Performance Computing Center Jeff Pummill University of Arkansas High Peformance Computing Center
Web Services for Visualization
Web Services for Visualization Gordon Erlebacher (Florida State University) Collaborators: S. Pallickara, G. Fox (Indiana U.) Dave Yuen (U. Minnesota) State of affairs Size of datasets is growing exponentially
DIRAC data management: consistency, integrity and coherence of data
Journal of Physics: Conference Series DIRAC data management: consistency, integrity and coherence of data To cite this article: M Bargiotti and A C Smith 2008 J. Phys.: Conf. Ser. 119 062013 Related content
Combining Virtual Organization and Local Policies for Automated Configuration of Grid Services
Combining Virtual Organization and Local Policies for Automated Configuration of Grid Services Shishir Bharathi, Beom Kun Kim, Ann Chervenak, Robert Schuler USC Information Sciences Institute Abstract.
Globus GTK and Grid Services
Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature
Indiana University s Lustre WAN: The TeraGrid and Beyond
Indiana University s Lustre WAN: The TeraGrid and Beyond Stephen C. Simms Manager, Data Capacitor Project TeraGrid Site Lead, Indiana University ssimms@indiana.edu Lustre User Group Meeting April 17, 2009
Implementation of Geospatial Product Virtualization in Grid Environment
Implementation of Geospatial Product Virtualization in Grid Environment Liping Di, Aijun Chen, Yuqi Bai, and Yaxing Wei Dr. Aijun Chen () George Mason University (GMU) Page 1 Outline Introduction Open
The National Fusion Collaboratory
The National Fusion Collaboratory A DOE National Collaboratory Pilot Project Presented by David P. Schissel at ICC 2004 Workshop May 27, 2004 Madison, WI PRESENTATION S KEY POINTS Collaborative technology
Metadata Models for Experimental Science Data Management
Metadata Models for Experimental Science Data Management Brian Matthews Facilities Programme Manager Scientific Computing Department, STFC Co-Chair RDA Photon and Neutron Science Interest Group Task lead,
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data Liping Di, Aijun Chen, Wenli Yang and Peisheng Zhao achen6@gmu.edu; achen@laits.gmu.edu Lab for Advanced Information
- C3Grid Stephan Kindermann, DKRZ. Martina Stockhause, MPI-M C3-Team
A Collaborative Environment for Climate Data Handling - Stephan Kindermann, DKRZ Martina Stockhause, MPI-M C3-Team 10.06. 2008 Motivation Model Output Data + Observation Data + TeraByte Analysis Data Expected
Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow
Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow ORNL: Brian Smith, John Harney, Brian Jewell LLNL: Jeffrey Painter, James McEnerney, ORNL is managed by UT-Battelle for the US Department
Globus Platform Services for Data Publication. Greg Nawrocki University of Chicago & Argonne National Lab GeoDaRRS August 7, 2018
Globus Platform Services for Data Publication Greg Nawrocki greg@globus.org University of Chicago & Argonne National Lab GeoDaRRS August 7, 2018 Outline Globus Overview Globus Data Publication v1 Lessons
Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
HPSS Treefrog Summary MARCH 1, 2018
HPSS Treefrog Summary MARCH 1, 2018 Disclaimer Forward looking information including schedules and future software reflect current planning that may change and should not be taken as commitments by IBM
APIs - what are they, really? Web API, Programming libraries, third party APIs etc
APIs - what are they, really? Web API, Programming libraries, third party APIs etc Different kinds of APIs Let s consider a Java application. It uses Java interfaces and classes. Classes and interfaces
Grid Portal Architectures for Scientific Applications
Grid Portal Architectures for Scientific Applications M. P. Thomas 1, J. Burruss 2, L. Cinquini 3, G. Fox 4, D. Gannon 5, L. Gilbert 6, G. von Laszewski 7, K. Jackson 8, D. Middleton 3, R. Moore 6, M.
Navigational Data Management. Joshua Stillerman, Martin Greenwald, John Wright MIT Plasma Science and Fusion Center
Navigational Data Management Joshua Stillerman, Martin Greenwald, John Wright MIT Plasma Science and Fusion Center Data Challenges Situation Collecting data has never been easier Making sense of data -
NARCCAP: North American Regional Climate Change Assessment Program. Seth McGinnis, NCAR
NARCCAP: North American Regional Climate Change Assessment Program Seth McGinnis, NCAR mcginnis@ucar.edu NARCCAP: North American Regional Climate Change Assessment Program Nest highresolution regional
Day 1 : August (Thursday) An overview of Globus Toolkit 2.4
An Overview of Grid Computing Workshop Day 1 : August 05 2004 (Thursday) An overview of Globus Toolkit 2.4 By CDAC Experts Contact :vcvrao@cdacindia.com; betatest@cdacindia.com URL : http://www.cs.umn.edu/~vcvrao
30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
Grid Computing Initiative at UI: A Preliminary Result
Grid Computing Initiative at UI: A Preliminary Result Riri Fitri Sari, Kalamullah Ramli, Bagio Budiardjo e-mail: {riri, k.ramli, bbudi@ee.ui.ac.id} Center for Information and Communication Engineering
Regular Forum of Lreis. Speechmaker: Gao Ang
Regular Forum of Lreis Speechmaker: Gao Ang Content: A. Overview of Eclipse Project B. Rich Client Platform C. The progress of ustudio Project D. The development of Grid technology and Grid GIS E. Future
Progress in building the International Lattice Data Grid
Progress in building the International Lattice Data Grid Jefferson Lab, Newport News, VA 23606, USA E-mail: bjoo@jlab.org C.M. Maynard EPCC, School of Physics, Univeristy of Edinburgh, Edinburgh EH9 3JZ,
Distributing BaBar Data using the Storage Resource Broker (SRB)
Distributing BaBar Data using the Storage Resource Broker (SRB) W. Kröger (SLAC), L. Martin (Univ. Paris VI et VII), D. Boutigny (LAPP - CNRS/IN2P3), A. Hanushevsky (SLAC), A. Hasan (SLAC) For the BaBar
Pangeo. A community-driven effort for Big Data geoscience
Pangeo A community-driven effort for Big Data geoscience !2 What would you like to have and why? Pangeo s vision for scientific computing in the big-data era Pangeo s Website pangeo-data.org !3 Hello!
Storage Virtualization. Eric Yen Academia Sinica Grid Computing Centre (ASGC) Taiwan
Storage Virtualization Eric Yen Academia Sinica Grid Computing Centre (ASGC) Taiwan Storage Virtualization In computer science, storage virtualization uses virtualization to enable better functionality
THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA
THE EUCLID ARCHIVE SYSTEM: A DATA-CENTRIC APPROACH TO BIG DATA Rees Williams on behalf of A.N.Belikov, D.Boxhoorn, B. Dröge, J.McFarland, A.Tsyganov, E.A. Valentijn University of Groningen, Groningen,
The EHRI GraphQL API IEEE Big Data Workshop on Computational Archival Science
The EHRI GraphQL API IEEE Big Data Workshop on Computational Archival Science 13/12/2017 Mike Bryant CONNECTING COLLECTIONS The EHRI Project The main objective of EHRI is to support the Holocaust research
Replica Selection in the Globus Data Grid
Replica Selection in the Globus Data Grid Sudharshan Vazhkudai 1, Steven Tuecke 2, and Ian Foster 2 1 Department of Computer and Information Science The University of Mississippi chucha@john.cs.olemiss.edu
Toward Scalable Monitoring on Large-Scale Storage for Software Defined Cyberinfrastructure
Toward Scalable Monitoring on Large-Scale Storage for Software Defined Cyberinfrastructure Arnab K. Paul, Ryan Chard, Kyle Chard, Steven Tuecke, Ali R. Butt, Ian Foster Virginia Tech, Argonne National
irods usage at CC-IN2P3: a long history
Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules irods usage at CC-IN2P3: a long history Jean-Yves Nief Yonny Cardenas Pascal Calvat What is CC-IN2P3? IN2P3:
The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets
Journal of Network and Computer Applications (2000) 23, 187 200 doi:10.1006/jnca.2000.0110, available online at http://www.idealibrary.com on The data grid: Towards an architecture for the distributed
Distributed Data Management on the Grid. Mario Lassnig
Distributed Data Management on the Grid Mario Lassnig Who am I? Mario Lassnig Computer scientist main field of study was theoretical (algorithm design) working on/with distributed and embedded systems
MONitoring Agents using a Large Integrated Services Architecture. Iosif Legrand California Institute of Technology
MONitoring Agents using a Large Integrated s Architecture California Institute of Technology Distributed Dynamic s Architecture Hierarchical structure of loosely coupled services which are independent
Managing HPC Active Archive Storage with HPSS RAIT at Oak Ridge National Laboratory
Managing HPC Active Archive Storage with HPSS RAIT at Oak Ridge National Laboratory Quinn Mitchell HPC UNIX/LINUX Storage Systems ORNL is managed by UT-Battelle for the US Department of Energy U.S. Department
Design patterns for data-driven research acceleration
Design patterns for data-driven research acceleration Rachana Ananthakrishnan, Kyle Chard, and Ian Foster The University of Chicago and Argonne National Laboratory Contact: rachana@globus.org Introduction
Mitigating Risk of Data Loss in Preservation Environments
Storage Resource Broker Mitigating Risk of Data Loss in Preservation Environments Reagan W. Moore San Diego Supercomputer Center Joseph JaJa University of Maryland Robert Chadduck National Archives and
Globus Online and HPSS. KEK, Tsukuba Japan October 16 20, 2017 Guangwei Che
Globus Online and HPSS KEK, Tsukuba Japan October 16 20, 2017 Guangwei Che Agenda (1) What is Globus and Globus Online? How Globus Online works? Globus DSI module for HPSS Globus Online setup DSI module
ACME Exploratory Analysis and Classic Diagnostics Viewer
ACME Exploratory Analysis and Classic Diagnostics Viewer Raymond Borges Marcia Branstetter Katherine Evans John Harney Brian Jewell Benjamin Mayer Jeff Painter Galen Shipman Brian Smith Chad Steed Dean
The ASCI/DOD Scalable I/O History and Strategy Run Time Systems and Scalable I/O Team Gary Grider CCN-8 Los Alamos National Laboratory LAUR
The ASCI/DOD Scalable I/O History and Strategy Run Time Systems and Scalable I/O Team Gary Grider CCN-8 Los Alamos National Laboratory LAUR 042787 05/2004 Parallel File Systems and Parallel I/O Why - From