NARCCAP: North American Regional Climate Change Assessment Program. Seth McGinnis, NCAR
|
|
- Clyde Wilkins
- 5 years ago
- Views:
Transcription
1 NARCCAP: North American Regional Climate Change Assessment Program Seth McGinnis, NCAR
2 NARCCAP: North American Regional Climate Change Assessment Program Nest highresolution regional climate models (RCMs) inside coarser global models (GCMs) over North America
3 Experimental Design 25 years Two 30-year runs, current & future NCEP GFDL CGCM3 HADCM CCSM 3 CRCM X -- X -- X ECP2 X X -- X -- HRM3 X X -- X -- MM5I X X X RCM3 X X X WRFG X -- X -- X Timeslices X X 6 RCMs x 4 GCMs + NCEP and Timeslices = 34 runs total
4 Data Publication Pipeline Transfer Backup QC Format Ancillary data Metadata Data validity Correct errors Archive Publish to portal (Update / Recall)
5 NARCCAP Program Goals Evaluate model performance and uncertainty Support further dynamical downscaling experiments Generate high-res climate change scenario data for impacts analysis
6 Supporting Further Downscaling 3-D boundary condition data High spatial & temporal resolution Large data volumes CO Target region WRF model domain TR
7 Supporting Impacts Users Ecology, biology, adaptation, water mgmt 2-D surface data for a few variables Regional / statistical / distilled Small data volumes Example: # days w/ T max 90 F for Austin, TX?
8 Data Services Analysis and transformation of data before transfer to end user Reduce the need for large data downloads Improve usability for applications, non-specialists Capture expertise as automated processing
9 Providing climate model simula2on data to the user community The CESM perspec2ve Gary Strand, NCAR
10 Earth System Grid (ESG) Ini5ally started as a research project to move data from DOE compu5ng centers in ca Evolved into a means to provide NCAR climate model data to the user community, star5ng in early 2002 Used by PCMDI for the CMIP3 archive onwards Upgraded and updated to the Earth System Grid Federa5on (ESG- F) for CMIP5 In use currently at NCAR for non- MIP- related data
11 NCAR ESG- CET portal downloads
12 NCAR flops and bytes,
13 Workflow model 5me 1 header field 1 field 2... field n 5me 2 header field 1 field 2... field n... TB scale disk 5me m header field 1 field 2... field n post- processing/analysis field 1 field 2 field n TB scale disk header 5me 1 5me me m header 5me 1 5me me m header 5me 1 5me me m tape archive tape archive publish publish data portal
14 Current workflow model 5me 1 header field 1 field 2... field n 5me 2 header field 1 field 2... field n... 5me m header field 1 field 2... field n post- processing/analysis field 1 field 2 field n header 5me 1 5me me m header 5me 1 5me me m header 5me 1 5me me m netcdf- 3 netcdf- 4 PB scale disk tape archive publish data portal
15 Workflow 2014/2015 model field 1 field 2 field n header time 1 time 2... time m header time 1 time 2... time m header time 1 time 2... time m analysis field 1 field 2 field n header time 1 time 2... time m header time 1 time 2... time m header time 1 time 2... time m 10s PB disk tape archive publish data portal
16 The perspec2ve from CESM Near- term big data projects CESM1- CAM5- BGC ensemble ~70 runs, total ~7,500 model years, ~200[*] TB Last millenium ensemble 26 runs, total ~26,000 model years, ~300[*] TB (Both using newest workflow) Longer- term big data CMIP6 ( ?) Poten5al addi5onal - MIPs Higher resolu5on (1/8 SE atm/lnd, 1/10 ocn/ice)
17 CESM and the nearish- future Issues Mee5ng user community needs/wants drives all! Modeling and analysis ~concurrently to avoid memory - > disk latency and all the other issues Ongoing updates of workflow Upda5ng CESM data management policy to reflect workflow and other changes Longer- term viability of ESG/ESGF model - downloading PB isn t sustainable - or is it? Must have serious server- side analysis Possibility of rerunning model for addi5onal data
18 NCAR s Data Archives: The Bigger Picture Eric Nienhouse, NCAR ejn@ucar.edu
19 Sample of NCAR Data Archives We build data archives and curate data for diverse communi4es. 20K annual users, 300 data providers, 10K collec5ons, 3.5PB, 2PB yearly downloads. ACADIS Advanced Collabora5ve Arc5c Data Informa5on Service ESG- NCAR Earth System Grid at NCAR RDA Research Data Archive NSF Arc5c projects Self publishing tools Many disciplines Highly varied data Long term preserva5on Climate models (CESM) RCMs (NARCCAP) Large data volume Heavily accessed Reanalysis + obs products Subset and re- format svcs ECMWF, ICOADS, JRA- 55 Ac5vely curated
20 Community Use and Access Data products are growing in popularity among non tradi4onal disciplines Over 2000 users monthly Diverse and growing user base 10X download volume by 2016 Data reduc5on increasingly u5lized Seeking more ways to access data TB/Month ESG- NCAR and RDA Data Volume Delivered (Average TB / Month) RDA ESG- NCAR Total (est)
21 Removing Barriers to Scien5fic Data Use Common Problems: Finding and preparing data for analysis is expensive. Search, download, evaluate, repeat is slow. Scien5fically related data is hard to find. Tools for data evalua5on are lacking in workflows. Human experts cannot scale to meet growing needs.
22 Removing Barriers to Scien5fic Data Use Impar4ng knowledge to inform data consumers is a growing need. Published Data Analysis Knowledge
23 Challenges of obtaining data for analysis Big data challenges include increasing efficiency of obtaining data and informa4on Evaluate Published Data Discover Access Analysis Discovery is improving Metadata federa5on Search engines Schema.org Evalua5on & Access is Challenging Download open required Lirle guidance in workflow Human experts fill in gaps
24 How do we improve the path to analysis? Open services, user experience driven with tools for enabling innova4on Open data helps (services, ease of access) Connect informa5on to data workflows (wikis, experts) Focus on usability with user centered, itera5ve design Increase access to informa5on throughout access workflow Enable services for data reduc5on and server side analysis Enable third party innova5on with open service access Build in metrics to measure and guide improvements
25 What the future holds Collabora4on, focus on data use and new communi4es of users Recogni5on that significant barriers to use s5ll exist. Expand collabora5on and technology sharing. User centered design which includes emerging user classes. Workflows suppor5ng efficient path to analysis. More access to expert informa5on and guidance.
Distilling Regional Climate Model Data from NARCCAP for Use in Impacts Analysis
Distilling Regional Climate Model Data from NARCCAP for Use in Impacts Analysis Seth McGinnis IMAGe CISL NCAR mcginnis@ucar.edu 2013-09-09 v.5 Outline Introduction Overview of NARCCAP Supporting impacts
More informationVariability in Annual Temperature Profiles
Variability in Annual Temperature Profiles A Multivariate Spatial Analysis of Regional Climate Model Output Tamara Greasby, Stephan Sain Institute for Mathematics Applied to Geosciences, National Center
More informationBuilding a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners
Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners 24th Forum ORAP Cite Scientifique; Lille, France March 26, 2009 Don Middleton National
More informationThe Regional Climate Model Evalua4on System (RCMES): Introduc4on and Demonstra4on
The Regional Climate Model Evalua4on System (RCMES): Introduc4on and Demonstra4on Paul C. Loikith, Duane E. Waliser, Chris MaEmann, Jinwon Kim, Huikyo Lee, Paul M. Ramirez, Andrew F. Hart, Cameron E. Goodale,
More informationChallenges and Solutions for Future Modeling Data Analysis Systems
Challenges and Solutions for Future Modeling Data Analysis Systems Tsengdar Lee tsengdar.j.lee@nasa.gov NASA Headquarters Dan Duffy, NASA GSFC Seungwon Lee, JPL Rama Nemani, NASA ARC Duane Waliser, JPL
More informationExArch, Edinburgh, March 2014
ExArch: Climate analytics on distributed exascale data archives Martin Juckes, V. Balaji, B.N. Lawrence, M. Lautenschlager, S. Denvil, G. Aloisio, P. Kushner, D. Waliser, S. Pascoe, A. Stephens, P. Kershaw,
More informationExArch: Climate analytics on distributed exascale data archives Martin Juckes, V. Balaji, B.N. Lawrence, M. Lautenschlager, S. Denvil, G. Aloisio, P.
ExArch: Climate analytics on distributed exascale data archives Martin Juckes, V. Balaji, B.N. Lawrence, M. Lautenschlager, S. Denvil, G. Aloisio, P. Kushner, D. Waliser, S. Pascoe, A. Stephens, P. Kershaw,
More informationData Management Components for a Research Data Archive
Data Management Components for a Research Data Archive Steven Worley and Bob Dattore Scientific Computing Division Computational and Information Systems Laboratory National Center for Atmospheric Research
More informationDataONE Cyberinfrastructure. Ma# Jones Dave Vieglais Bruce Wilson
DataONE Cyberinfrastructure Ma# Jones Dave Vieglais Bruce Wilson Foremost a Federa9on Member Nodes (MNs) Heart of the federa9on Harness the power of local cura9on Coordina9ng Nodes (CNs) Services to link
More informationTowards a Strategy for Data Sciences at UW
Towards a Strategy for Data Sciences at UW Albrecht Karle Department of Physics June 2017 High performance compu0ng infrastructure: Perspec0ves from Physics Exis0ng infrastructure and projected future
More informationCESM Workflow Refactor Project Land Model and Biogeochemistry Working Groups 2015 Winter Meeting CSEG & ASAP/CISL
CESM Workflow Refactor Project Land Model and Biogeochemistry Working Groups 2015 Winter Meeting Alice Bertini Sheri Mickelson CSEG & ASAP/CISL CESM Workflow Refactor Project Who s involved? Joint project
More informationThe CEDA Archive: Data, Services and Infrastructure
The CEDA Archive: Data, Services and Infrastructure Kevin Marsh Centre for Environmental Data Archival (CEDA) www.ceda.ac.uk with thanks to V. Bennett, P. Kershaw, S. Donegan and the rest of the CEDA Team
More informationWhen the Need for an Ins/tu/onal Repository Gives Rise to a Federa/on
When the Need for an Ins/tu/onal Repository Gives Rise to a Federa/on Lisa Schmidt lschmidt@msu.edu Michigan Academic Library Council March 18, 2011 Overview Ins?tu?onal Background Why an Ins?tu?onal Repository?
More informationThe Future of ESGF. in the context of ENES Strategy
The Future of ESGF in the context of ENES Strategy With a subtext of the important role of IS-ENES2 In addressing solutions to the following question: Two thirds of data written is never read! WHY NOT?
More informationEOSC Services & Architecture: the EOSC-hub approach Tiziana Ferrari, Project Coordinator, EGI Founda?on
EOSC Services & Architecture: the EOSC-hub approach Tiziana Ferrari, Project Coordinator, EGI Founda?on eosc-hub.eu @EOSC_eu EOSC-hub receives funding from the European Union s Horizon 2020 research and
More informationMetadata Zoo Dataset Metadata Rebecca Koskela Execu4ve Director, DataONE
Metadata Zoo Dataset Metadata Rebecca Koskela Execu4ve Director, DataONE eurocris September 9, 2013 Outline Data Challenges Metadata Solu=on DataONE addressing the Data Challenge Enabling Scien=fic Discovery
More informationCORDEX DOMAINS (plus Arctic & Antarctica)
CORDEX DOMAINS (plus Arctic & Antarctica) 12 domains with a resolution of 0.44 (approx. 50x50km²) Focus on Africa High resolution ~0.11 x0.11 for Europe (by some institutions) The TFRCD mandate was extended
More informationOrientation to NCAR, CISL and the Outreach Services Group
Orientation to NCAR, CISL and the Outreach Services Group Dr. Richard Loft Director, SIParCS Program Director, Technology Development Div. Computational and Information Systems Laboratory loft@ucar.edu
More informationDecentralized K-Means Clustering with Emergent Computing
Decentralized K-Means Clustering with Emergent Computing Ryan McCune & Greg Madey University of Notre Dame, Computer Science & Engineering Spring Simula?on Mul?- Conference 2014, Tampa, FL Student Colloquium
More informationCMIP5 Update. Karl E. Taylor. Program for Climate Model Diagnosis and Intercomparison (PCMDI) Lawrence Livermore National Laboratory
CMIP5 Update Karl E. Taylor Program for Climate Model Diagnosis and Intercomparison () Lawrence Livermore National Laboratory Presented to the WCRP Working Group on Coupled Modelling Hamburg, Germany 24
More informationIntro to CMIP, the WHOI CMIP5 community server, and planning for CMIP6
Intro to CMIP, the WHOI CMIP5 community server, and planning for CMIP6 Caroline Ummenhofer, PO Overview - Background on IPCC & CMIP - WHOI CMIP5 server - Available model output - How to access files -
More informationIndex Introduction Setting up an account Searching and accessing Download Advanced features
ESGF Earth System Grid Federation Tutorial Index Introduction Setting up an account Searching and accessing Download Advanced features Index Introduction IT Challenges of Climate Change Research ESGF Introduction
More informationDistributed Online Data Access and Analysis
Distributed Online Data Access and Analysis Ruixin Yang George Mason University Slides from SIESIP Partners and from NOMADS PI, Glenn K. Rutledge of US NCDC on NOMADS SIESIP: Seasonal-to-Interannual Earth
More informationIntroduction to PRECIS
Introduction to PRECIS Joseph D. Intsiful CGE Hands-on training Workshop on V & A, Asuncion, Paraguay, 14 th 18 th August 2006 Crown copyright Page 1 Contents What, why, who The components of PRECIS Hardware
More informationScientific Applications of the Regional Climate Model Evaluation System (RCMES)
Scientific Applications of the Regional Climate Model Evaluation System (RCMES) Paul C. Loikith, Duane E. Waliser, Chris Mattmann, Jinwon Kim, Huikyo Lee, Paul M. Ramirez, Andrew F. Hart, Cameron E. Goodale,
More informationTop Trends in DBMS & DW
Oracle Top Trends in DBMS & DW Noel Yuhanna Principal Analyst Forrester Research Trend #1: Proliferation of data Data doubles every 18-24 months for critical Apps, for some its every 6 months Terabyte
More informationInfraStructure for the European Network for Earth System modelling. From «IS-ENES» to IS-ENES2
InfraStructure for the European Network for Earth System modelling From «IS-ENES» to IS-ENES2 Sylvie JOUSSAUME, CNRS, Institut Pierre Simon Laplace, Coordinator ENES European Network for Earth System modelling
More informationEarthCube and Cyberinfrastructure for the Earth Sciences: Lessons and Perspective from OpenTopography
EarthCube and Cyberinfrastructure for the Earth Sciences: Lessons and Perspective from OpenTopography Christopher Crosby, San Diego Supercomputer Center J Ramon Arrowsmith, Arizona State University Chaitan
More informationThe Blue Water s File/Archive System. Data Management Challenges Michelle Butler
The Blue Water s File/Archive System Data Management Challenges Michelle Butler (mbutler@ncsa.illinois.edu) NCSA is a World leader in deploying supercomputers and providing scientists with the software
More informationData Reference Syntax Governing Standards within Climate Research Data archived in the ESGF
Data Reference Syntax Governing Standards within Climate Research Data archived in the ESGF Michael Kolax Swedish Meteorological and Hydrological Institute Motivation for a DRS within CMIP5 In CMIP5 the
More informationICOADS: Update Status and Data Distribution
ICOADS: Update Status and Data Distribution Steven J. Worley Scott D. Woodruff Sandra J. Lubker Ziahua Ji J. Eric Freeman NCAR, NOAA/ESRL, NOAA/NCDC CLIMAR-III, 6-9 May 2008, Gdynia, Poland Topic Outline
More informationCombinatorial Mathema/cs and Algorithms at Exascale: Challenges and Promising Direc/ons
Combinatorial Mathema/cs and Algorithms at Exascale: Challenges and Promising Direc/ons Assefaw Gebremedhin Purdue University (Star/ng August 2014, Washington State University School of Electrical Engineering
More informationWhy Spectrum Storage Suite and Flash Systems for storage makes perfect sense
Why Storage Suite and Flash Systems for storage makes perfect sense Nick Harris Steve Ward 1 Summary: Things we covered #1 Simplify today s traditional storage environment The challenge Storage is siloed
More informationThe Earth System Grid: A Visualisation Solution. Gary Strand
The Earth System Grid: A Visualisation Solution Gary Strand Introduction Acknowledgments PI s Ian Foster (ANL) Don Middleton (NCAR) Dean Williams (LLNL) ESG Development Team Veronika Nefedova (ANL) Ann
More informationNCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017
NCAR Globally Accessible Data Environment (GLADE) Updated: 15 Feb 2017 Overview The Globally Accessible Data Environment (GLADE) provides centralized file storage for HPC computational, data-analysis,
More informationThe Earth System Modeling Framework (and Beyond)
The Earth System Modeling Framework (and Beyond) Fei Liu NOAA Environmental Software Infrastructure and Interoperability http://www.esrl.noaa.gov/nesii/ March 27, 2013 GEOSS Community ESMF is an established
More informationCLOUD SERVICES. Cloud Value Assessment.
CLOUD SERVICES Cloud Value Assessment www.cloudcomrade.com Comrade a companion who shares one's ac8vi8es or is a fellow member of an organiza8on 2 Today s Agenda! Why Companies Should Consider Moving Business
More informationWelcome to the CyVerse Data Store. Manage and share your data across all CyVerse pla8orms
Welcome to the CyVerse Data Store Manage and share your data across all CyVerse pla8orms ü Follow Along ü Workshop Packet ü mcbios.readthedocs.org Logis;cs Working with Big Data What? Challenges: the scope
More informationNCEP HPC Transition. 15 th ECMWF Workshop on the Use of HPC in Meteorology. Allan Darling. Deputy Director, NCEP Central Operations
NCEP HPC Transition 15 th ECMWF Workshop on the Use of HPC Allan Darling Deputy Director, NCEP Central Operations WCOSS NOAA Weather and Climate Operational Supercomputing System CURRENT OPERATIONAL CHALLENGE
More informationData Issues for next generation HPC
Data Issues for next generation HPC Bryan Lawrence National Centre for Atmospheric Science National Centre for Earth Observation Rutherford Appleton Laboratory Caveats: Due to time, discussion is limited
More informationDigital Preservation at NARA
Digital Preservation at NARA Policy, Records, Technology Leslie Johnston Director of Digital Preservation US National Archives and Records Administration (NARA) ARMA, April 18, 2018 Policy Managing Government
More informationSpatial Distributions of Precipitation Events from Regional Climate Models
Spatial Distributions of Precipitation Events from Regional Climate Models N. Lenssen September 2, 2010 1 Scientific Reason The Institute of Mathematics Applied to Geosciences (IMAGe) and the National
More informationCumulus Services Working Group. Dan Pilone SE TIM / August 2017
Cumulus Services Working Group Dan Pilone dan@element84.com SE TIM / August 2017 2 Reminder: Why are we doing this? 3 Background: Motivation for Cloud Growth of Mission Data & Processing: Projected rapid
More informationReal- &me Archiving of Spontaneous Events (Use- Case : Hurricane Sandy)
Archive- it Partner Mee&ng, Annapolis, Maryland December 3, 2012 Real- &me Archiving of Spontaneous Events (Use- Case : Hurricane Sandy) Kiran ChiBuri, Digital Library Research Laboratory, Virginia Tech.
More informationWoodson Research Center Digital Preservation Policy
Primary Policy Aims Risk Assessment Needs Statement Project/Purpose Statement Goals and Objectives Projects to Undertake in 2016 Organizational Commitments Financial Commitments Personnel Preservation
More informationPetaSTAR A Real World Data Storage and Management Solution
PetaSTAR A Real World Data Storage and Management Solution James M. Johnson Ovation Data Services, Inc. 10650 Haddington Drive Houston TX 77043-3229 Phone: +1-713-464-1300 FAX: +1-713-464-1615 e-mail:
More informationNCAR Workload Analysis on Yellowstone. March 2015 V5.0
NCAR Workload Analysis on Yellowstone March 2015 V5.0 Purpose and Scope of the Analysis Understanding the NCAR application workload is a critical part of making efficient use of Yellowstone and in scoping
More informationOverview of XSEDE for HPC Users Victor Hazlewood XSEDE Deputy Director of Operations
October 29, 2014 Overview of XSEDE for HPC Users Victor Hazlewood XSEDE Deputy Director of Operations XSEDE for HPC Users What is XSEDE? XSEDE mo/va/on and goals XSEDE Resources XSEDE for HPC Users: Before
More informationVersion 3 Updated: 10 March Distributed Oceanographic Match-up Service (DOMS) User Interface Design
Distributed Oceanographic Match-up Service (DOMS) User Interface Design Shawn R. Smith 1, Jocelyn Elya 1, Adam Stallard 1, Thomas Huang 2, Vardis Tsontos 2, Benjamin Holt 2, Steven Worley 3, Zaihua Ji
More informationCMIP5 Datenmanagement erste Erfahrungen
CMIP5 Datenmanagement erste Erfahrungen Dr. Michael Lautenschlager Deutsches Klimarechenzentrum Helmholtz Open Access Webinare zu Forschungsdaten Webinar 18-17.01./28.01.14 CMIP5 Protocol +Timeline Taylor
More informationDesign patterns for data-driven research acceleration
Design patterns for data-driven research acceleration Rachana Ananthakrishnan, Kyle Chard, and Ian Foster The University of Chicago and Argonne National Laboratory Contact: rachana@globus.org Introduction
More informationFirst experiences of using WC(P)S at ECMWF
Earth Server-2 First experiences of using WC(P)S at ECMWF Julia Wagemann and Stephan Siemen European Centre for Medium-Range Weather Forecasts Workshop on Meteorological Operational Systems #OpenDataWeek
More informationCommi&ng to Data Quality
Commi&ng to Data Quality Ann Green Digital Lifecycle Research & Consul;ng NADDI Vancouver 2014 outline Data Quality Building the DDI ShiGs Crisis of Quality & Loss of Data Commi&ng to Data Quality Data
More informationA PSyclone perspec.ve of the big picture. Rupert Ford STFC Hartree Centre
A PSyclone perspec.ve of the big picture Rupert Ford STFC Hartree Centre Requirement I Maintainable so,ware maintain codes in a way that subject ma7er experts can s:ll modify the code Leslie Hart from
More informationClare Richards, Benjamin Evans, Kate Snow, Chris Allen, Jingbo Wang, Kelsey A Druken, Sean Pringle, Jon Smillie and Matt Nethery. nci.org.
The important role of HPC and data-intensive infrastructure facilities in supporting a diversity of Virtual Research Environments (VREs): working with Climate Clare Richards, Benjamin Evans, Kate Snow,
More informationCoG: The NEW ESGF WEB USER INTERFACE
CoG: The NEW ESGF WEB USER INTERFACE ESGF F2F Workshop, Livermore, CA, December 2014 Luca Cinquini [1], Cecelia DeLuca [2], Sylvia Murphy [2] [1] California Ins/tute of Technology & NASA Jet Propulsion
More informationDigital Cura+on Planning at Michigan State University
Digital Cura+on Planning at Michigan State University Lisa Schmidt, Electronic Records Archivist Michigan State University Archives & Historical Collec+ons January 17, 2010 Overview Michigan State University
More informationREsources linkage for E-scIence - RENKEI -
REsources linkage for E-scIence - - hlp://www.e- sciren.org/ REsources linkage for E- science () is a research and development project for new middleware technologies to enable e- science communi?es. ""
More informationBig Data, Big Compute, Big Interac3on Machines for Future Biology. Rick Stevens. Argonne Na3onal Laboratory The University of Chicago
Assembly Annota3on Modeling Design Big Data, Big Compute, Big Interac3on Machines for Future Biology Rick Stevens stevens@anl.gov Argonne Na3onal Laboratory The University of Chicago There are no solved
More informationOn the Road to 2020 Census Geographic Programs Update Oregon State Data Center Annual Meeting 11/29/2012
On the Road to 2020 Census Geographic Programs Update Oregon State Data Center Annual Meeting 11/29/2012 Rick Campbell Geographer L.A. Regional Office (Based in Seattle) richard.t.campbell@census.gov (206)
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationglobus online Software-as-a-Service for Research Data Management
globus online Software-as-a-Service for Research Data Management Steve Tuecke Deputy Director, Computation Institute University of Chicago & Argonne National Laboratory Big Science built on Globus Toolkit
More informationMachine Learning Crash Course: Part I
Machine Learning Crash Course: Part I Ariel Kleiner August 21, 2012 Machine learning exists at the intersec
More informationCESM2 Software Update. Mariana Vertenstein CESM Software Engineering Group
CESM2 Software Update Mariana Vertenstein CESM Software Engineering Group Outline CMIP6 Computational Performance Cheyenne Status CESM2 new user-friendly infrastructure features CIME New porting capabilities
More informationThe C3S Climate Data Store and its upcoming use by CAMS
Atmosphere The C3S Climate Data Store and its upcoming use by CAMS Miha Razinger, ECMWF thanks to Angel Alos, Baudouin Raoult, Cedric Bergeron and the CDS contractors Atmosphere What are C3S and CDS? The
More informationescience in the Cloud Dan Fay Director Earth, Energy and Environment
escience in the Cloud Dan Fay Director Earth, Energy and Environment dan.fay@microsoft.com New ways to analyze and communicate data EOS Article: Mountain Hydrology, Snow Color, and the Fourth Paradigm
More informationOutline. In Situ Data Triage and Visualiza8on
In Situ Data Triage and Visualiza8on Kwan- Liu Ma University of California at Davis Outline In situ data triage and visualiza8on: Issues and strategies Case study: An earthquake simula8on Case study: A
More informationData Analytics and Storage System (DASS) Mixing POSIX and Hadoop Architectures. 13 November 2016
National Aeronautics and Space Administration Data Analytics and Storage System (DASS) Mixing POSIX and Hadoop Architectures 13 November 2016 Carrie Spear (carrie.e.spear@nasa.gov) HPC Architect/Contractor
More informationTPP On The Cloud. Joe Slagel
TPP On The Cloud Joe Slagel Lecture topics Introduc5on to Cloud Compu5ng and Amazon Web Services Overview of TPP Cloud components Setup trial AWS and use of the new TPP Web Launcher for Amazon (TWA) Future
More informationLightweight Streaming-based Runtime for Cloud Computing. Shrideep Pallickara. Community Grids Lab, Indiana University
Lightweight Streaming-based Runtime for Cloud Computing granules Shrideep Pallickara Community Grids Lab, Indiana University A unique confluence of factors have driven the need for cloud computing DEMAND
More informationMetadata Models for Experimental Science Data Management
Metadata Models for Experimental Science Data Management Brian Matthews Facilities Programme Manager Scientific Computing Department, STFC Co-Chair RDA Photon and Neutron Science Interest Group Task lead,
More informationCollabora've Development
Collabora've Development Ricardo Todling NASA GMAO 2013 Joint DTC- EMC- JCSDA GSI Workshop 1 In the Beginning NCEP: SSI (late 1980 s) Spectral formula'on of background error cov Direct assimila'on of radiances
More informationPeraso Corporate Presenta5on CES 2017
Peraso Technologies, Inc. Peraso Corporate Presenta5on CES 2017 1 Peraso Confiden,al Peraso Highlights Consumer Electronics Wireless Broadband Peraso is World s Only Start-Up Shipping 60GHz WiGig Silicon
More informationOp#mizing MapReduce for Highly- Distributed Environments
Op#mizing MapReduce for Highly- Distributed Environments Abhishek Chandra Associate Professor Department of Computer Science and Engineering University of Minnesota hep://www.cs.umn.edu/~chandra 1 Big
More informationNCAR Workload Analysis on Yellowstone. September 2014 V4.1
NCAR Workload Analysis on Yellowstone September 2014 V4.1 Purpose and Scope of the Analysis Understanding the NCAR applica5on workload is a cri5cal part of making efficient use of Yellowstone and in scoping
More informationData Curation Practices at the Oak Ridge National Laboratory Distributed Active Archive Center
Data Curation Practices at the Oak Ridge National Laboratory Distributed Active Archive Center Robert Cook, DAAC Scientist Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN cookrb@ornl.gov
More informationData Curation Handbook Steps
Data Curation Handbook Steps By Lisa R. Johnston Preliminary Step 0: Establish Your Data Curation Service: Repository data curation services should be sustained through appropriate staffing and business
More informationNext Generation Backup: Better ways to deal with rapid data growth and aging tape infrastructures
Next Generation Backup: Better ways to deal with rapid data growth and aging tape infrastructures Next 1 What we see happening today. The amount of data businesses must cope with on a daily basis is getting
More informationDataONE: Open Persistent Access to Earth Observational Data
Open Persistent Access to al Robert J. Sandusky, UIC University of Illinois at Chicago The Net Partners Update: ONE and the Conservancy December 14, 2009 Outline NSF s Net Program ONE Introduction Motivating
More informationSystems 2020 Strategic Initiative Overview
Systems 2020 Strategic Initiative Overview Kristen Baldwin ODDR&E/Systems Engineering 13 th Annual NDIA Systems Engineering Conference San Diego, CA October 28, 2010 Oct 2010 Page-1 DISTRIBUTION STATEMENT
More informationMemory Hierarchy. Memory Flavors Principle of Locality Program Traces Memory Hierarchies Associativity. (Study Chapter 5)
Memory Hierarchy Why are you dressed like that? Halloween was weeks ago! It makes me look faster, don t you think? Memory Flavors Principle of Locality Program Traces Memory Hierarchies Associativity (Study
More informationNetSecOps: Policy-Driven, Knowledge-Centric, Holis<c Network Security Opera<ons
NetSecOps: Policy-Driven, Knowledge-Centric, Holis
More informationCMIP5 early assessment. WGCM Ron Stouffer with lots of help October 2012
CMIP5 early assessment WGCM Ron Stouffer with lots of help October 2012 CMIP Climate Science side Experiments runs Variables saved, QC ed, made public METAFOR Data serving (computer science) side Security
More informationUniform Resource Locator Wide Area Network World Climate Research Programme Coupled Model Intercomparison
Glossary API Application Programming Interface AR5 IPCC Assessment Report 4 ASCII American Standard Code for Information Interchange BUFR Binary Universal Form for the Representation of meteorological
More informationOPTIMIZATION MAXIMIZING TELECOM AND NETWORK. The current state of enterprise optimization, best practices and considerations for improvement
MAXIMIZING TELECOM AND NETWORK OPTIMIZATION The current state of enterprise optimization, best practices and considerations for improvement AOTMP.com The Next Evolution of Telecom Management OVERVIEW As
More informationECE468 Computer Organization and Architecture. Memory Hierarchy
ECE468 Computer Organization and Architecture Hierarchy ECE468 memory.1 The Big Picture: Where are We Now? The Five Classic Components of a Computer Processor Control Input Datapath Output Today s Topic:
More informationBradley J. Daigle, University of Virginia Sco9 Turnbull, University of Virginia
Bradley J. Daigle, University of Virginia Sco9 Turnbull, University of Virginia DLF Forum 2014 29 October 2014 Columbia University Indiana University North Carolina State University Johns Hopkins University
More informationData, Data, Everywhere. We are now in the Big Data Era.
Data, Data, Everywhere. We are now in the Big Data Era. CONTENTS Background Big Data What is Generating our Big Data Physical Management of Big Data Optimisation in Data Processing Techniques for Handling
More informationThe Common Framework for Earth Observation Data. US Group on Earth Observations Data Management Working Group
The Common Framework for Earth Observation Data US Group on Earth Observations Data Management Working Group Agenda USGEO and BEDI background Concise summary of recommended CFEOD standards today Full document
More informationCISL Update. 29 April Operations and Services Division
CISL Update Operations and Services CISL HPC Advisory Panel Meeting Anke Kamrath anke@ucar.edu Operations and Services Division Computational and Information Systems Laboratory 1 CHAP Meeting 14 May 2009
More informationLec 13: Linking and Memory. Kavita Bala CS 3410, Fall 2008 Computer Science Cornell University. Announcements
Lec 13: Linking and Memory Kavita Bala CS 3410, Fall 2008 Computer Science Cornell University PA 2 is out Due on Oct 22 nd Announcements Prelim Oct 23 rd, 7:30-9:30/10:00 All content up to Lecture on Oct
More informationCurrent Progress of Grid Project in KMA
Current Progress of Grid Project in KMA CUG 2006 Kim, Hee-Sik Cray Korea Inc. This Presentation May Contain Some Preliminary Information, Subject To Change Outline KMA s Cray X1E system Relationship between
More informationIntroduction to High Performance Parallel I/O
Introduction to High Performance Parallel I/O Richard Gerber Deputy Group Lead NERSC User Services August 30, 2013-1- Some slides from Katie Antypas I/O Needs Getting Bigger All the Time I/O needs growing
More informationAlgorithm Performance Factors. Memory Performance of Algorithms. Processor-Memory Performance Gap. Moore s Law. Program Model of Memory I
Memory Performance of Algorithms CSE 32 Data Structures Lecture Algorithm Performance Factors Algorithm choices (asymptotic running time) O(n 2 ) or O(n log n) Data structure choices List or Arrays Language
More informationCase Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy
Case Study: CyberSKA - A Collaborative Platform for Data Intensive Radio Astronomy Outline Motivation / Overview Participants / Industry Partners Documentation Architecture Current Status and Services
More informationThe NCAR Community Data Portal
The NCAR Community Data Portal http://cdp.ucar.edu/ QuickTime and a TIFF (Uncompressed) decompressor are needed to see this picture. QuickTime and a TIFF (Uncompressed) decompressor are needed to see this
More informationEGI: Linking digital resources across Eastern Europe for European science and innovation
EGI- InSPIRE EGI: Linking digital resources across Eastern Europe for European science and innovation Steven Newhouse EGI.eu Director 12/19/12 EPE 2012 1 EGI European Over 35 countries Grid Secure sharing
More informationBIG DATA CHALLENGES A NOAA PERSPECTIVE
BIG DATA CHALLENGES A NOAA PERSPECTIVE Dr. Edward J. Kearns NASA Examiner, Science and Space Branch, OMB/EOP and Chief (acting), Remote Sensing and Applications Division National Climatic Data Center National
More informationCERA: Database System and Data Model
CERA: Database System and Data Model Michael Lautenschlager Frank Toussaint World Data Center for Climate (M&D/MPIMET, Hamburg) NINTH WORKSHOP ON METEOROLOGICAL OPERATIONAL SYSTEMS ECMWF, Reading/Berks.,
More informationDiagnostics and Exploratory Analysis Infrastructure for ACME Workflow
Diagnostics and Exploratory Analysis Infrastructure for ACME Workflow ORNL: Brian Smith, John Harney, Brian Jewell LLNL: Jeffrey Painter, James McEnerney, ORNL is managed by UT-Battelle for the US Department
More information