SLATE. Services Layer at the Edge. First Meeting of the National Research Platform Montana State University August 7-8, 2017

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "SLATE. Services Layer at the Edge. First Meeting of the National Research Platform Montana State University August 7-8, 2017"

Transcription

1 SLATE Services Layer at the Edge Rob Gardner University of Chicago Shawn McKee University of Michigan Joe Breen University of Utah First Meeting of the National Research Platform Montana State University August 7-8, 2017

2 What is SLATE? New NSF DIBBs award, "SLATE and the Mobility of Capability" Equip the SciDMZ with a service orchestration platform, potentially federated to create scalable, multi-campus science platforms Underlayment-as-a-service (UaaS) for platform builders & science gateway developers 2

3 Ultimate goal: enabling collaborative science XENON Collaboration 3

4 How we got to SLATE lessons 4

5 Early 'platforms': ivdgl, grid3, open science grid, wlcg Deployments of globus software for gatekeepers and storage interfaces, condor for job submission and routing Since 2003 we've led deployments of integration testbeds and supported production services across ~100 institutions 5

6 CERN LHC computing: global grid of data centers ATLAS Tier2 centers led by UMich and UChicago Multi-site grid federations of distributed storage, job routing, software and data caches in production > 10 years Each supports workflows from >1k users from the international collaboration 6

7 perfsonar meshes & data federations Helping campuses deploy perfsonar instances to optimize data throughput (OSG and WLCG) Managed deployment of xrootd federation network of 66 LHC data centers xrootd data federation 7

8 Friction in deployment of distributed services A broken DevOps cycle! - Latency in updates across sites make it extremely difficult to rapidly innovate platform services VO (domain & application) centric - Requires distributed expertise in specialized software stacks across many institutions - Resource providers need to become experts in a range of VO software services 8

9 SLATE Vision

10 10

11 Services layer at the edge A ubiquitous "underlayment" -- the missing shim A generic CI substrate optimized for hosting edge services Programmable Easy & natural for HPC and IT professionals Tool for creating "hybrid" platforms Potentially federate Centralized deployment & operations possible DevOps friendly (for platform and science gateway developers) quick patches, release iterations, fast track new capabilities 11

12 Concepts & components Containerized services in managed clusters Standalone or federated Federated clusters support multi-site platform systems Widely used open source technologies for growth and sustainability 12

13 WP2: Node Specification & Deployment (SPN) API for local and (potentially) remote admin Monitoring & analytics SLATE SciDMZ node -- to be compatible with emerging national specs "Big", "Small", "Central" types 13

14 WP3: Federated Services Example command line interface to service meshes 14

15 Two important challenges (among many) Cybersecurity and policy On premise services, potentially managed by third parties, present additional risks that need to be understood Engagements with CISO from our campuses Engagement with Center for Trustworthy Scientific Cyberinfrastructure Scientific outreach Underlayment to Science Embedded with science collaborations with multi-institution cyberinfrastructure - distributed data services, software, job routing Developers associated with the Science Gateways Community Institute 15

16 SLATE and the NRP A service for science platform builders Easily compatible with FIONA box and current PRP setups We need partners & volunteers: to help inform technology choices to confront and solve policy & cybersecurity issues focus on usability & integration in HPC environments usability for science gateway developers & distributed service deployment teams align with emergent national SciDMZ patterns 16

17 Timeline - first year Testbed spec and deployment Service orchestration technology evaluations Early multi-site pilot demonstrator with: stateless services stateful services non-trivial HPC resource integration Early federated platform tools Recruit volunteers and build community 17

18 Summary SLIDES: Reduce barriers to supporting collaborative science Give science platform developers a ubiquitous "CI substrate" Change distributed cyberinfrastructure opertional practice by mobilizing capabilities in the edge Achieve scale through multi-site service meshes: ensembles of federated, orchestrated services 18

19 Thank you! contact 19

ALICE Grid Activities in US

ALICE Grid Activities in US ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions

More information

Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science

Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine,

More information

An NSF Cybersecurity Center of Excellence to Support Research

An NSF Cybersecurity Center of Excellence to Support Research An NSF Cybersecurity Center of Excellence to Support Research Jim Basney, Tom Barton, and Kim Milford Internet2 Global Summit May 18 2016 trustedci.org Agenda Overview of CTSC (Jim) Cybersecurity for Science:

More information

Network Analytics. Hendrik Borras, Marian Babik IT-CM-MM

Network Analytics. Hendrik Borras, Marian Babik IT-CM-MM Network Analytics Hendrik Borras, Marian Babik IT-CM-MM perfsonar Infrastructure perfsonar has been widely deployed in WLCG 249 active instances, deployed at 120 sites including major network hubs at ESNet,

More information

5 August 2010 Eric Boyd, Internet2 Deputy CTO

5 August 2010 Eric Boyd, Internet2 Deputy CTO 5 August 2010 Eric Boyd, Internet2 Deputy CTO Extending IDC based Dynamic Circuit Networking Services Internet2 and Dynamic Circuit Networking Internet2 has been working with partners on dynamic circuit

More information

WLCG Network Throughput WG

WLCG Network Throughput WG WLCG Network Throughput WG Shawn McKee, Marian Babik for the Working Group HEPiX Tsukuba 16-20 October 2017 Working Group WLCG Network Throughput WG formed in the fall of 2014 within the scope of WLCG

More information

Conference The Data Challenges of the LHC. Reda Tafirout, TRIUMF

Conference The Data Challenges of the LHC. Reda Tafirout, TRIUMF Conference 2017 The Data Challenges of the LHC Reda Tafirout, TRIUMF Outline LHC Science goals, tools and data Worldwide LHC Computing Grid Collaboration & Scale Key challenges Networking ATLAS experiment

More information

Georgia State University Cyberinfrastructure Plan

Georgia State University Cyberinfrastructure Plan Georgia State University Cyberinfrastructure Plan Summary Building relationships with a wide ecosystem of partners, technology, and researchers are important for GSU to expand its innovative improvements

More information

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi GRIDS INTRODUCTION TO GRID INFRASTRUCTURES Fabrizio Gagliardi Dr. Fabrizio Gagliardi is the leader of the EU DataGrid project and designated director of the proposed EGEE (Enabling Grids for E-science

More information

DiPerF: automated DIstributed PERformance testing Framework

DiPerF: automated DIstributed PERformance testing Framework DiPerF: automated DIstributed PERformance testing Framework Catalin Dumitrescu, Ioan Raicu, Matei Ripeanu, Ian Foster Distributed Systems Laboratory Computer Science Department University of Chicago Introduction

More information

MITATE: Mobile Internet Testbed for Application Traffic Experimentation

MITATE: Mobile Internet Testbed for Application Traffic Experimentation MITATE: Mobile Internet Testbed for Application Traffic Experimentation A new platform for mobile application prototyping in live mobile networks. Open to the public and being deployed on M-Lab. 1 Why

More information

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem

More information

Data Center and Cloud Automation

Data Center and Cloud Automation Data Center and Cloud Automation Tanja Hess Systems Engineer September, 2014 AGENDA Challenges and Opportunities Manual vs. Automated IT Operations What problem are we trying to solve and how do we solve

More information

Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # ) Klara Jelinkova Joseph Ghobrial

Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # ) Klara Jelinkova Joseph Ghobrial Improving Network Infrastructure to Enable Large Scale Scientific Data Flows and Collaboration (Award # 1659348) Klara Jelinkova Joseph Ghobrial NSF Campus Cyberinfrastructure PI and Cybersecurity Innovation

More information

HPE Strategy for VMware Cloud Foundation

HPE Strategy for VMware Cloud Foundation HPE Strategy for VMware Cloud Foundation September 12, 2017 Alexander Tschebanjuk Solution Architect EMEA HPE multi-cloud strategy Manage an open, mixed cloud environment HPE Integration and Professional

More information

The OSiRIS Project: Collaborative Access to Data CNSECCS Symposium May 18, 2017

The OSiRIS Project: Collaborative Access to Data CNSECCS Symposium May 18, 2017 The OSiRIS Project: Collaborative Access to Data CNSECCS Symposium May 18, 2017 Open Storage Research Infrastructure Project Outline rationale general goals Project Components technical goals science users

More information

Science-as-a-Service

Science-as-a-Service Science-as-a-Service The iplant Foundation Rion Dooley Edwin Skidmore Dan Stanzione Steve Terry Matthew Vaughn Outline Why, why, why! When duct tape isn t enough Building an API for the web Core services

More information

Overview of ATLAS PanDA Workload Management

Overview of ATLAS PanDA Workload Management Overview of ATLAS PanDA Workload Management T. Maeno 1, K. De 2, T. Wenaus 1, P. Nilsson 2, G. A. Stewart 3, R. Walker 4, A. Stradling 2, J. Caballero 1, M. Potekhin 1, D. Smith 5, for The ATLAS Collaboration

More information

RESEARCH DATA DEPOT AT PURDUE UNIVERSITY

RESEARCH DATA DEPOT AT PURDUE UNIVERSITY Preston Smith Director of Research Services RESEARCH DATA DEPOT AT PURDUE UNIVERSITY May 18, 2016 HTCONDOR WEEK 2016 Ran into Miron at a workshop recently.. Talked about data and the challenges of providing

More information

einfrastructures Concertation Event

einfrastructures Concertation Event einfrastructures Concertation Event Steve Crumb, Executive Director December 5, 2007 OGF Vision & Mission Our Vision: The Open Grid Forum accelerates grid adoption to enable scientific discovery and business

More information

EGI-InSPIRE. Security Drill Group: Security Service Challenges. Oscar Koeroo. Together with: 09/23/11 1 EGI-InSPIRE RI

EGI-InSPIRE. Security Drill Group: Security Service Challenges. Oscar Koeroo. Together with: 09/23/11 1 EGI-InSPIRE RI EGI-InSPIRE Security Drill Group: Security Service Challenges Oscar Koeroo Together with: 09/23/11 1 index Intro Why an SSC? SSC{1,2,3,4} SSC5 Future 2 acknowledgements NON INTRUSIVE DO NOT affect actual

More information

Fujitsu: Your Partner for SAP HANA Solutions

Fujitsu: Your Partner for SAP HANA Solutions Fujitsu: Your Partner for SAP HANA Solutions The In-memory Revolution Process vast amounts of data in real-time Run analytics dramatically faster than disk-based DB (10x to >1,000x) Big Data Challenge

More information

The LCG 3D Project. Maria Girone, CERN. The 23rd Open Grid Forum - OGF23 4th June 2008, Barcelona. CERN IT Department CH-1211 Genève 23 Switzerland

The LCG 3D Project. Maria Girone, CERN. The 23rd Open Grid Forum - OGF23 4th June 2008, Barcelona. CERN IT Department CH-1211 Genève 23 Switzerland The LCG 3D Project Maria Girone, CERN The rd Open Grid Forum - OGF 4th June 2008, Barcelona Outline Introduction The Distributed Database (3D) Project Streams Replication Technology and Performance Availability

More information

The Science DMZ: Evolution

The Science DMZ: Evolution The Science DMZ: Evolution Eli Dart, ESnet CC-NIE PI Meeting Washington, DC May 1, 2014 Why Are We Doing This? It s good to build high-quality infrastructure As network engineers, we like building networks

More information

ARC integration for CMS

ARC integration for CMS ARC integration for CMS ARC integration for CMS Erik Edelmann 2, Laurence Field 3, Jaime Frey 4, Michael Grønager 2, Kalle Happonen 1, Daniel Johansson 2, Josva Kleist 2, Jukka Klem 1, Jesper Koivumäki

More information

Clemson HPC and Cloud Computing

Clemson HPC and Cloud Computing Clemson HPC and Cloud Computing Jill Gemmill, Ph.D. Executive Director Cyberinfrastructure Technology Integration Computing & Information Technology CLEMSON UNIVERSITY 2 About Clemson University South

More information

High Throughput WAN Data Transfer with Hadoop-based Storage

High Throughput WAN Data Transfer with Hadoop-based Storage High Throughput WAN Data Transfer with Hadoop-based Storage A Amin 2, B Bockelman 4, J Letts 1, T Levshina 3, T Martin 1, H Pi 1, I Sfiligoi 1, M Thomas 2, F Wuerthwein 1 1 University of California, San

More information

The LHC Computing Grid

The LHC Computing Grid The LHC Computing Grid Visit of Finnish IT Centre for Science CSC Board Members Finland Tuesday 19 th May 2009 Frédéric Hemmer IT Department Head The LHC and Detectors Outline Computing Challenges Current

More information

EGEE and Interoperation

EGEE and Interoperation EGEE and Interoperation Laurence Field CERN-IT-GD ISGC 2008 www.eu-egee.org EGEE and glite are registered trademarks Overview The grid problem definition GLite and EGEE The interoperability problem The

More information

Cisco CloudCenter Solution with VMware

Cisco CloudCenter Solution with VMware Cisco CloudCenter Solution with Extend, any application, and any cloud The Cisco CloudCenter hybrid cloud management platform securely provisions infrastructure resources and deploys application components

More information

CouchDB-based system for data management in a Grid environment Implementation and Experience

CouchDB-based system for data management in a Grid environment Implementation and Experience CouchDB-based system for data management in a Grid environment Implementation and Experience Hassen Riahi IT/SDC, CERN Outline Context Problematic and strategy System architecture Integration and deployment

More information

Cisco Unified Data Center Strategy

Cisco Unified Data Center Strategy Cisco Unified Data Center Strategy How can IT enable new business? Holger Müller Technical Solutions Architect, Cisco September 2014 My business is rapidly changing and I need the IT and new technologies

More information

CHAMELEON: A LARGE-SCALE, RECONFIGURABLE EXPERIMENTAL ENVIRONMENT FOR CLOUD RESEARCH

CHAMELEON: A LARGE-SCALE, RECONFIGURABLE EXPERIMENTAL ENVIRONMENT FOR CLOUD RESEARCH CHAMELEON: A LARGE-SCALE, RECONFIGURABLE EXPERIMENTAL ENVIRONMENT FOR CLOUD RESEARCH Principal Investigator: Kate Keahey Co-PIs: J. Mambretti, D.K. Panda, P. Rad, W. Smith, D. Stanzione NB: With an Additional

More information

THE BENEFITS OF DOING THE SAME THING, THE SAME WAY, EVERYWHERE

THE BENEFITS OF DOING THE SAME THING, THE SAME WAY, EVERYWHERE Approved for Public Release THE BENEFITS OF DOING THE SAME THING, THE SAME WAY, EVERYWHERE Tim Swett, Lianne Poisson, Twila Pfieffer, Danny Poisson Raytheon Company GBS Information Technology liveworx.com

More information

Developing Networking and Human Expertise in Support of International Science

Developing Networking and Human Expertise in Support of International Science INTERNATIONAL NETWORKS Developing Networking and Human Expertise in Support of International Science Edward Moynihan, November 3, 2017 Indiana? INTERNATIONAL NETWORKS INTERNATIONAL NETWORKS The NEAAR Collaboration

More information

Operating the Distributed NDGF Tier-1

Operating the Distributed NDGF Tier-1 Operating the Distributed NDGF Tier-1 Michael Grønager Technical Coordinator, NDGF International Symposium on Grid Computing 08 Taipei, April 10th 2008 Talk Outline What is NDGF? Why a distributed Tier-1?

More information

XSEDE Campus Bridging Tools Jim Ferguson National Institute for Computational Sciences

XSEDE Campus Bridging Tools Jim Ferguson National Institute for Computational Sciences September 26, 2014 XSEDE Campus Bridging Tools Jim Ferguson National Institute for Computational Sciences jwf@utk.edu Quick Advertisement: Student Programs Research Experience 12-18 students per summer,

More information

#techsummitch

#techsummitch www.thomasmaurer.ch #techsummitch Justin Incarnato Justin Incarnato Microsoft Principal PM - Azure Stack Hyper-scale Hybrid Power of Azure in your datacenter Azure Stack Enterprise-proven On-premises

More information

Eucalyptus Overview The most widely deployed on-premise cloud computing platform

Eucalyptus Overview The most widely deployed on-premise cloud computing platform Eucalyptus Overview The most widely deployed on-premise cloud computing platform Vision Value Proposition Solution Highlights Ecosystem Background We bring the power of cloud to your business The world

More information

Next Generation Integrated Architecture SDN Ecosystem for LHC and Exascale Science. Harvey Newman, Caltech

Next Generation Integrated Architecture SDN Ecosystem for LHC and Exascale Science. Harvey Newman, Caltech Next Generation Integrated Architecture SDN Ecosystem for LHC and Exascale Science Joint Genome Institute LHC Beyond the Higgs Boson LSST SKA Harvey Newman, Caltech NSF CC*/CICI Workshop: Data Integration

More information

Data services for LHC computing

Data services for LHC computing Data services for LHC computing SLAC 1 Xavier Espinal on behalf of IT/ST DAQ to CC 8GB/s+4xReco Hot files Reliable Fast Processing DAQ Feedback loop WAN aware Tier-1/2 replica, multi-site High throughout

More information

How Cisco Deploys Video Conferencing for Employee Collaboration

How Cisco Deploys Video Conferencing for Employee Collaboration How Cisco Deploys Video Conferencing for Employee Collaboration Cisco Unified Video Advantage brings video telephony to Cisco Unified IP phones. Cisco IT Case Study / Video / : This case study describes

More information

The extension of optical networks into the campus

The extension of optical networks into the campus The extension of optical networks into the campus Wade Hong Office of the Dean of Science Carleton University Outline Motivation CA*net 4 IGT From the Carleton U Perspective Issues Lessons learned Motivation

More information

Virtustream Managed Services Drive value from technology investments through IT management solutions. Tim Calahan, Manager Managed Services

Virtustream Managed Services Drive value from technology investments through IT management solutions. Tim Calahan, Manager Managed Services Virtustream Managed Services Drive value from technology investments through IT management solutions Tim Calahan, Manager Managed Services Virtustream Managed Services Your partner in delivering IT as

More information

NET+ INFRASTRUCTURE AND PLATFORM SERVICES PORTFOLIO STATUS & UPDATE

NET+ INFRASTRUCTURE AND PLATFORM SERVICES PORTFOLIO STATUS & UPDATE NET+ INFRASTRUCTURE AND PLATFORM SERVICES PORTFOLIO STATUS & UPDATE Andrew Keating, Sean O'Brien, and Sara Jeanes NET+ Cloud Services 2014 Internet2 NET+ IPS Portfolio Update CONTENTS Goals and Updates

More information

Grid Interoperation and Regional Collaboration

Grid Interoperation and Regional Collaboration Grid Interoperation and Regional Collaboration Eric Yen ASGC Academia Sinica Taiwan 23 Jan. 2006 Dreams of Grid Computing Global collaboration across administrative domains by sharing of people, resources,

More information

Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA.

Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. November 3th, 2005 Von Welch vwelch@ncsa.uiuc.edu Outline

More information

Singularity tests at CC-IN2P3 for Atlas

Singularity tests at CC-IN2P3 for Atlas Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules Singularity tests at CC-IN2P3 for Atlas Vamvakopoulos Emmanouil Journées LCG-France, 22-24 Novembre 2017, LPC

More information

Low Friction Data Warehousing WITH PERSPECTIVE ILM DATA GOVERNOR

Low Friction Data Warehousing WITH PERSPECTIVE ILM DATA GOVERNOR Low Friction Data Warehousing WITH PERSPECTIVE ILM DATA GOVERNOR Table of Contents Foreword... 2 New Era of Rapid Data Warehousing... 3 Eliminating Slow Reporting and Analytics Pains... 3 Applying 20 Years

More information

Using Digital Rebar to Create Composable Infrastructure Operations for Site Reliability Engineers

Using Digital Rebar to Create Composable Infrastructure Operations for Site Reliability Engineers WHITE PAPER Using Digital Rebar to Create Composable Infrastructure Operations for Site Reliability Engineers Authored by Rob Hirschfeld, Greg Althaus, and Victor Lowther Executive Summary Enterprises

More information

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE Aleksandar Belić Scientific Computing Laboratory Institute of Physics EGEE Introduction EGEE = Enabling Grids for

More information

Workload Management. Stefano Lacaprara. CMS Physics Week, FNAL, 12/16 April Department of Physics INFN and University of Padova

Workload Management. Stefano Lacaprara. CMS Physics Week, FNAL, 12/16 April Department of Physics INFN and University of Padova Workload Management Stefano Lacaprara Department of Physics INFN and University of Padova CMS Physics Week, FNAL, 12/16 April 2005 Outline 1 Workload Management: the CMS way General Architecture Present

More information

Federated data storage system prototype for LHC experiments and data intensive science

Federated data storage system prototype for LHC experiments and data intensive science Federated data storage system prototype for LHC experiments and data intensive science A. Kiryanov 1,2,a, A. Klimentov 1,3,b, D. Krasnopevtsev 1,4,c, E. Ryabinkin 1,d, A. Zarochentsev 1,5,e 1 National

More information

Data Virtualization Implementation Methodology and Best Practices

Data Virtualization Implementation Methodology and Best Practices White Paper Data Virtualization Implementation Methodology and Best Practices INTRODUCTION Cisco s proven Data Virtualization Implementation Methodology and Best Practices is compiled from our successful

More information

Towards Network Awareness in LHC Computing

Towards Network Awareness in LHC Computing Towards Network Awareness in LHC Computing CMS ALICE CERN Atlas LHCb LHC Run1: Discovery of a New Boson LHC Run2: Beyond the Standard Model Gateway to a New Era Artur Barczyk / Caltech Internet2 Technology

More information

Journey Towards Science DMZ. Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia

Journey Towards Science DMZ. Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia Malaysia's Computational Journey Towards Science DMZ Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia suhaimi@upm.my In the Beginning... Research on parallel/distributed

More information

The Latest EMC s announcements

The Latest EMC s announcements The Latest EMC s announcements Copyright 2014 EMC Corporation. All rights reserved. 1 TODAY S BUSINESS CHALLENGES Cut Operational Costs & Legacy More Than Ever React Faster To Find New Growth Balance Risk

More information

Aruba Networks. Now is the time to build your Aruba practice

Aruba Networks. Now is the time to build your Aruba practice Aruba Networks Now is the time to build your Aruba practice HPE s Vision for Aruba Ecosystem of innovation partners Flexible consumption Driven by agile DevOps Mobile users, apps and devices Beacons, sensors

More information

The iplant Data Commons

The iplant Data Commons The iplant Data Commons Using irods to Facilitate Data Dissemination, Discovery, and Reproducibility Jeremy DeBarry, jdebarry@iplantcollaborative.org Tony Edgin, tedgin@iplantcollaborative.org Nirav Merchant,

More information

IT TRENDS REPORT 2016:

IT TRENDS REPORT 2016: IT TRENDS REPORT 2016: THE HYBRID IT EVOLUTION NORTH AMERICA WHAT WE COVER IN THE REPORT IT TRENDS REPORT 2016: THE HYBRID IT EVOLUTION Introduction Key Findings Recommendations Full Survey Results INTRODUCTION

More information

Accelerate your Azure Hybrid Cloud Business with HPE. Ken Won, HPE Director, Cloud Product Marketing

Accelerate your Azure Hybrid Cloud Business with HPE. Ken Won, HPE Director, Cloud Product Marketing Accelerate your Azure Hybrid Cloud Business with HPE Ken Won, HPE Director, Cloud Product Marketing Mega trend: Customers are increasingly buying cloud services from external service providers Speed of

More information

To Compete You Must Compute

To Compete You Must Compute To Compete You Must Compute Presentation to Society of High Performance Computing Professionals November 3, 2010 Susan Baldwin Executive Director Compute Canada susan.baldwin@computecanada.org Vision To

More information

DDN Annual High Performance Computing Trends Survey Reveals Rising Deployment of Flash Tiers & Private/Hybrid Clouds vs.

DDN Annual High Performance Computing Trends Survey Reveals Rising Deployment of Flash Tiers & Private/Hybrid Clouds vs. DDN Annual High Performance Computing Trends Survey Reveals Rising Deployment of Flash Tiers & Private/Hybrid Clouds vs. Public for HPC HPC End Users Cite Mixed I/O as the Most Difficult Performance Challenge

More information

SUSE s vision for agile software development and deployment in the Software Defined Datacenter

SUSE s vision for agile software development and deployment in the Software Defined Datacenter From Git to Cloud SUSE s vision for agile software development and deployment in the Software Defined Datacenter Joachim Werner Senior Product Manager joe@suse.com Peter Chadwick Director Product Management

More information

Modelos de Negócio na Era das Clouds. André Rodrigues, Cloud Systems Engineer

Modelos de Negócio na Era das Clouds. André Rodrigues, Cloud Systems Engineer Modelos de Negócio na Era das Clouds André Rodrigues, Cloud Systems Engineer Agenda Software and Cloud Changed the World Cisco s Cloud Vision&Strategy 5 Phase Cloud Plan Before Now From idea to production:

More information

Outline. ASP 2012 Grid School

Outline. ASP 2012 Grid School Distributed Storage Rob Quick Indiana University Slides courtesy of Derek Weitzel University of Nebraska Lincoln Outline Storage Patterns in Grid Applications Storage

More information

DataON and Intel Select Hyper-Converged Infrastructure (HCI) Maximizes IOPS Performance for Windows Server Software-Defined Storage

DataON and Intel Select Hyper-Converged Infrastructure (HCI) Maximizes IOPS Performance for Windows Server Software-Defined Storage Solution Brief DataON and Intel Select Hyper-Converged Infrastructure (HCI) Maximizes IOPS Performance for Windows Server Software-Defined Storage DataON Next-Generation All NVMe SSD Flash-Based Hyper-Converged

More information

IT Town Hall Meeting

IT Town Hall Meeting IT Town Hall Meeting Scott F. Midkiff Vice President for Information Technology and CIO Professor of Electrical and Computer Engineering Virginia Tech midkiff@vt.edu October 20, 2015 10/20/2015 IT Town

More information

The Data Exacell (DXC): Data Infrastructure Building Blocks for Integrating Analytics with Data Management

The Data Exacell (DXC): Data Infrastructure Building Blocks for Integrating Analytics with Data Management The Data Exacell (DXC): Data Infrastructure Building Blocks for Integrating Analytics with Data Management Nick Nystrom, Michael J. Levine, Ralph Roskies, and J Ray Scott Pittsburgh Supercomputing Center

More information

How to Leverage Containers to Bolster Security and Performance While Moving to Google Cloud

How to Leverage Containers to Bolster Security and Performance While Moving to Google Cloud PRESENTED BY How to Leverage Containers to Bolster Security and Performance While Moving to Google Cloud BIG-IP enables the enterprise to efficiently address security and performance when migrating to

More information

Enabling Smart Energy as a Service via 5G Mobile Network advances

Enabling Smart Energy as a Service via 5G Mobile Network advances NR 5 Enabling Smart Energy as a Service via 5G Mobile Network advances 5G-PPP Phase 2 at EuCNC Oulu Fiorentino Giampaolo giampaolo.fiorentino@eng.it SCOPE MOTIVATION NR 5 Insights behind... The state of

More information

Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc.

Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc. Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc. Who s speaking? Mark Galpin Solution Architect @jfrog magalpin Microservices

More information

The Future of Galaxy. Nate Coraor galaxyproject.org

The Future of Galaxy. Nate Coraor galaxyproject.org The Future of Galaxy Nate Coraor galaxyproject.org Galaxy is... A framework for scientists Enables usage of complicated command line tools Deals with file formats as transparently as possible Provides

More information

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or

More information

The LHC Computing Grid

The LHC Computing Grid The LHC Computing Grid Gergely Debreczeni (CERN IT/Grid Deployment Group) The data factory of LHC 40 million collisions in each second After on-line triggers and selections, only 100 3-4 MB/event requires

More information

Decommissioning Plan. Jenni Evans

Decommissioning Plan. Jenni Evans Decommissioning Plan Jenni Evans Background Power Issues in the Computer Building/Data Center New Data Center Power Usage Effectiveness ~1.17 National average for data centers =1.7 EC Recommendation on

More information

3D in the ArcGIS Platform. Chris Andrews

3D in the ArcGIS Platform. Chris Andrews 3D in the ArcGIS Platform Chris Andrews Geospatial 3D is already all around us 3D is expanding the GIS community s opportunity to provide value 3D City & Infrastructure Models Generated 3D features Photogrammetrc

More information

DIGITAL INNOVATION HYBRID CLOUD COSTS AGILITY PRODUCTIVITY

DIGITAL INNOVATION HYBRID CLOUD COSTS AGILITY PRODUCTIVITY Hybrid Cloud Automation Framework (HCAF): How to Accelerate and De-risk the Path to Hybrid Cloud CDI LLC Advanced Services Group Contents 02 03 03 04 04 04 05 05 05 06 06 07 07 08 08 09 09 10 10 12 Executive

More information

Virtual Appliances and Education in FutureGrid. Dr. Renato Figueiredo ACIS Lab - University of Florida

Virtual Appliances and Education in FutureGrid. Dr. Renato Figueiredo ACIS Lab - University of Florida Virtual Appliances and Education in FutureGrid Dr. Renato Figueiredo ACIS Lab - University of Florida Background l Traditional ways of delivering hands-on training and education in parallel/distributed

More information

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Chicago, October 2008 Kate Keahey, Renato Figueiredo, Jose Fortes, Tim Freeman, Mauricio Tsugawa University of Chicago University

More information

Data Transfers Between LHC Grid Sites Dorian Kcira

Data Transfers Between LHC Grid Sites Dorian Kcira Data Transfers Between LHC Grid Sites Dorian Kcira dkcira@caltech.edu Caltech High Energy Physics Group hep.caltech.edu/cms CERN Site: LHC and the Experiments Large Hadron Collider 27 km circumference

More information

European Grid Infrastructure

European Grid Infrastructure EGI-InSPIRE European Grid Infrastructure A pan-european Research Infrastructure supporting the digital European Research Area Michel Drescher Technical Manager, EGI.eu Michel.Drescher@egi.eu TPDL 2013

More information

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of

More information

Home to the cloud e-shelter Innovation Lab. Toan Nguyen - Frankfurt am Main, September 29 th, 2016

Home to the cloud e-shelter Innovation Lab. Toan Nguyen - Frankfurt am Main, September 29 th, 2016 e-shelter Innovation Lab Toan Nguyen - Frankfurt am Main, September 29 th, 2016 1 Quick recap Market is solid and growing Stable historic growth and positive outlook (10-12% revenue CAGR) for DC space/power

More information

INDIGO AAI An overview and status update!

INDIGO AAI An overview and status update! RIA-653549 INDIGO DataCloud INDIGO AAI An overview and status update! Andrea Ceccanti (INFN) on behalf of the INDIGO AAI Task Force! indigo-aai-tf@lists.indigo-datacloud.org INDIGO Datacloud An H2020 project

More information

Identifying the right kind of hybrid cloud for your business. Danny Elmarji ANZ Solution

Identifying the right kind of hybrid cloud for your business. Danny Elmarji ANZ Solution Identifying the right kind of hybrid cloud for your business Danny Elmarji ANZ Solution Manager @elmarji 1 SOFTWARE IS REDEFINING EVERY BUSINESS 2 BUSINESS IS MOVING MUCH FASTER TRADITIONAL IT TEAM ENTREPRENEURIAL

More information

F5 Synthesis Information Session. April, 2014

F5 Synthesis Information Session. April, 2014 F5 Synthesis Information Session April, 2014 Agenda Welcome and Introduction to Customer Technology Challenges Software Defined Application Services Reference Architectures for Today s Customer Challenges

More information

Advanced Research Compu2ng Informa2on Technology Virginia Tech

Advanced Research Compu2ng Informa2on Technology Virginia Tech Advanced Research Compu2ng Informa2on Technology Virginia Tech www.arc.vt.edu Personnel Associate VP for Research Compu6ng: Terry Herdman (herd88@vt.edu) Director, HPC: Vijay Agarwala (vijaykag@vt.edu)

More information

CLOUD WORKLOAD SECURITY

CLOUD WORKLOAD SECURITY SOLUTION OVERVIEW CLOUD WORKLOAD SECURITY Bottom line: If you re in IT today, you re already in the cloud. As technology becomes an increasingly important element of business success, the adoption of highly

More information

Distributed Monte Carlo Production for

Distributed Monte Carlo Production for Distributed Monte Carlo Production for Joel Snow Langston University DOE Review March 2011 Outline Introduction FNAL SAM SAMGrid Interoperability with OSG and LCG Production System Production Results LUHEP

More information

FTS3 a file transfer service for Grids, HPCs and Clouds

FTS3 a file transfer service for Grids, HPCs and Clouds FTS3 a file transfer service for Grids, HPCs and Clouds PNPI, NRC KI, CERN Gatchina, Russia E-mail: Andrey.Kiryanov@cern.ch Alejandro Alvarez Ayllon CERN Geneva, Switzerland E-mail: Alejandro.Alvarez.Ayllon@cern.ch

More information

Digital Renewable Ecosystem on Predix Platform from GE Renewable Energy

Digital Renewable Ecosystem on Predix Platform from GE Renewable Energy Digital Renewable Ecosystem on Predix Platform from GE Renewable Energy Business Challenges Investment in the Industrial Internet of Things (IIoT) is expected to top $60 trillion during the next 15 years.

More information

Paving the Rocky Road Toward Open and FAIR in the Field Sciences

Paving the Rocky Road Toward Open and FAIR in the Field Sciences Paving the Rocky Road Toward Open and FAIR Kerstin Lehnert Lamont-Doherty Earth Observatory, Columbia University IEDA (Interdisciplinary Earth Data Alliance), www.iedadata.org IGSN e.v., www.igsn.org Field

More information

Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine

Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine Journal of Physics: Conference Series OPEN ACCESS Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine To cite this article: Henrik Öhman et al 2014 J. Phys.: Conf.

More information

Federated Services for Scientists Thursday, December 9, p.m. EST

Federated Services for Scientists Thursday, December 9, p.m. EST IAM Online Federated Services for Scientists Thursday, December 9, 2010 1 p.m. EST Rachana Ananthakrishnan Argonne National Laboratory & University of Chicago Jim Basney National Center for Supercomputing

More information

FlexPod. The Journey to the Cloud. Technical Presentation. Presented Jointly by NetApp and Cisco

FlexPod. The Journey to the Cloud. Technical Presentation. Presented Jointly by NetApp and Cisco FlexPod The Journey to the Cloud Technical Presentation Presented Jointly by NetApp and Cisco Agenda Alliance Highlights Introducing FlexPod One Shared Vision and Journey FlexPod for the Oracle base base

More information

STREAMLINED CERTIFICATION PATHS

STREAMLINED CERTIFICATION PATHS STREAMLINED CERTIFICATION PATHS MOBILITY Windows 10 Mobility CLOUD PLATFORM & INFRASTRUCTURE Cloud Platform Cloud Platform & Infrastructure Linux on Azure PRODUCTIVITY Productivity Office 365 APP BUILDER

More information

Connecting the e-infrastructure chain

Connecting the e-infrastructure chain Connecting the e-infrastructure chain Internet2 Spring Meeting, Arlington, April 23 rd, 2012 Peter Hinrich & Migiel de Vos Topics - About SURFnet - Motivation: Big data & collaboration - Collaboration

More information

API Best Practices. Managing APIs holistically across the enterprise

API Best Practices. Managing APIs holistically across the enterprise API Best Practices Managing APIs holistically across the enterprise APIs are critical to evolving application architectures Public clouds Microservices Distributed apps μservice μservice μservice μservice

More information

Cisco Cloud Strategy. Uwe Müller. Leader PreSales Cloud & Datacenter Germany

Cisco Cloud Strategy. Uwe Müller. Leader PreSales Cloud & Datacenter Germany Cisco Cloud Strategy Uwe Müller Leader PreSales Cloud & Datacenter Germany 277X Data created by IoE devices v. end-user 30M New devices connected every week 180B Mobile apps downloaded in 2015 78% Workloads

More information