Campus Bridging in XSEDE, OSG, and Beyond
|
|
- Janel Maxwell
- 6 years ago
- Views:
Transcription
1 Campus Bridging in XSEDE, OSG, and Beyond Dan Fraser, OSG Jim Ferguson, NICS Andrew Grimshaw, UVA Rich Knepper, IU David Lifka, Cornell Internet2 Spring Members Meeting, Arlington, VA
2 April 23, 2012 Overview Campus Bridging introduction Open Science Grid and software deployment XSEDE Campus Bridging Program Global Federated File System Campus Initiatives RedCloud POD at IU
3 April 23, 2012 Campus Bridging: Formation NSF Advisory Committee for CyberInfrastructure Community input at multiple workshops Surveys ACCI Campus Bridging Task Force Report
4 April 23, 2012 Campus Bridging: Concepts Making it easier for users to transition from their laptop to large-scale resources Gathering best practices to deploy resources in a way that makes them familiar to users Providing training and documentation that covers research computation at multiple scales
5 OSG Campus Bridging (Campus High Throughput Computing Infrastructures) Dan Fraser OSG Production Coordinator Campus Infrastructure Lead Internet2 Spring Members Meeting Arlington, VA Sept 24, 2012
6 The Open Science Grid The Open Science Grid (OSG) has focused on campuses from its inception. All OSG computing power comes from campuses. OSG has a footprint on over 100 campuses in the US and abroad.
7 OSG Campus Bridging Focus Focus on the Researcher ( or Artist) One step at a time
8 Simple interfaces are good
9 Engaging with the Campus Campuses each have their own culture Terminology Access patterns Security Operational styles Processes (autn, autz, monitoring, accounting, data management, ) The most fundamental issues are not technological in nature Campus Bridging = Cultural Bridging
10 Campus Bridging Direction Help the researcher use local resources Run on a local cluster (on campus) Run on several local clusters Use/share resources with a collaborator on another campus Access to the national cyberinfrastructure OSG (and also XSEDE) resources (BTW, OSG is also an XSEDE service provider) Submit Locally, Run Globally
11 OSG Campus Bridging Today Campus LSF PBS Local User Credential Condor Local Cluster Submit Host (Bosco) OSG Cloud External Campus (could also submit to XSEDE)
12 Summary OSG is focused on the researcher/artist Campus bridging = cultural bridging A single submit model (Bosco) can be useful OSG is exploring how best to collaborate with XSEDE on campus bridging
13 April 23, 2012 Introduction to XSEDE and its Campus Bridging Program Jim Ferguson, XSEDE TEOS team Education, Outreach & Training Director, NICS
14 Acknowledgements Craig Stewart, Rich Knepper, and Therese Miller of Indiana University, and others on the XSEDE campus bridging team. John Towns, NCSA, XSEDE PI 14
15 XD Solicitation/XD Program extreme Digital Resources for Science and Engineering (NSF ) High-Performance Computing and Storage Services aka Track 2 awardees High-Performance Remote Visualization and Data Analysis Services 2 awards; 5 years; $3M/year proposals due November 4, 2008 Integrating Services (5 years, $26M/year) Coordination and Management Service (CMS) 5 years; $12M/year Technology Audit and Insertion Service (TAIS) 5 years; $3M/year Advanced User Support Service (AUSS) 5 years; $8M/year Training, Education and Outreach Service (TEOS) 5 years, $3M/year
16 16 XSEDE Vision The extreme Science and Engineering Discovery Environment (XSEDE): enhances the productivity of scientists and engineers by providing them with new and innovative capabilities and thus facilitates scientific discovery while enabling transformational science/engineering and innovative educational programs
17 Science requires diverse digital capabilities XSEDE is a comprehensive, expertly managed and evolving set of advanced heterogeneous high-end digital services, integrated into a general-purpose infrastructure. XSEDE is about increased user productivity increased productivity leads to more science increased productivity is sometimes the difference between a feasible project and an impractical one 17
18 XSEDE s Distinguishing Characteristics - Governance World-class leadership partnership will be led by NCSA, NICS, PSC, TACC and SDSC CI centers with deep experience partners who strongly complement these CI centers with expertise in science, engineering, technology and education Balanced governance model strong central management provides rapid response to issues and opportunities delegation and decentralization of decision-making authority openness to genuine stakeholder participation stakeholder engagement, advisory committees improved professional project management practices formal risk management and change control 18
19 What is campus bridging? Term originated by Ed Seidel as he charged six task forces of the NSF Advisory Committee for Cyberinfrastructure. Considerable info and final ACCI Task force report, online at pti.iu.edu/campusbridging The Taskforce definition: Campus bridging is the seamlessly integrated use of cyberinfrastructure operated by a scientist or engineer with other cyberinfrastructure on the scientist s campus, at other campuses, and at the regional, national, and international levels as if they were proximate to the scientist... Catchy name, great ideas interest > our ability to implement yet Vision: Help XSEDE create the software, tools and training that will allow excellent interoperation between XSEDE infrastructure researchers local (campus) cyberinfrastructure; Enable excellent usability from the researcher s standpoint for a variety of modalities and types of computing: HPC, HTC, and data intensive computing Promote better use of local, regional and national CI resources 19
20 Campus Bridging Use Cases InCommon Authentication Economies of scale in training and usability Long term remote interactive graphic session Use of data resources from campus on XSEDE, or from XSEDE at a campus Support for distributed workflows spanning XSEDE and campus-based data, computational, and/or visualization resources Shared use of computational facilities mediated or facilitated by XSEDE Access to as a Service mediated or facilitated by XSEDE 20
21 Year 2 Strategic Plan Leveraging the XSEDE process of implementing new services via the systems engineering process (Architecture & Design => Software Development and Integration => Operations), begin deploying some new services that deliver campus bridging services Communicate effectively via Campus Champions, advocates for XSEDE now located at over 100 institutions. Develop relationship and terminology with OSG, as they have been bridging between institutions for several years. 21
22 Year 2 Strategic Plan Complete planned pilot projects GFFS Pilot Program CUNY PI: Paul Muzio KU PI: Thorbjorn Axelsson Miami PI: Joel Zysman TAMU PI: Guy Almes Begin delivering selected campus-bridging related tools GFFS Documentation ROCKS Rolls Communicate what is campus bridging 22
23 Example: More consistency in CI setups => economies of scale for all In reality, the four cluster admins depicted here being in agreement are all right. Experienced cluster admins all learned how to use what they learn when the tools were still developing, so the tool each sysadmin knows the best is the tool that lets that sysadmin do their work the best The only way to develop consistency is to provide installers that will make their work easier The XSEDE architecture group is developing installers for file management tools *A la Steven Colbert, the 4 out of 5 comment is not intended to be a factual statement 23
24 Your Comments, Please! Do we have the right direction? What is Campus Bridging to You? 24
25 25 Thank You!
26 April 23, 2012 Global Federated File System GFFS Andrew Grimshaw
27 Basic idea and canonical use cases Accessing the GFFS Attaching (provisioning) data to the GFFS Deployment 27
28 Basic idea: Map resources into a global directory structure Map global directory structure into local file system PDB NCBI EMBL Cluster 1 Cluster 2 APP 1 APP 2 Data SEQ_1 Cluster N Processing APP N Applications SEQ_1 Partner Institution APP 1 SEQ_2 Biology Research Institution SEQ_3 Biochemistry APP 2 Partner Institution
29 Canonical use cases Definitions Resource is {compute job data identity } Access means create, read, update, delete 1. Access center resource from campus 2. Access campus resource from center 3. Access campus resource from another campus Sharing file system or instrument data Sharing clusters 29
30 Basic idea and canonical use cases Accessing the GFFS Attaching (provisioning) data to the GFFS Deployment 30
31 Accessing the GFFS Via a file system mount Global directory structure mapped directly into the local operating system via FUSE mount XSEDE resources regardless of location can be accessed via the file system Files and directories can be accessed by programs and shell scripts as if they were local files Jobs can be started by copying job descriptions into directories One can see the jobs running or queued by doing an ls. One can cd into a running job and access the working directory where the job is running directly mkdir XSEDE nohup grid fuse mount local:xsede & 31
32 E.g., Access a job s running directory 32
33 Accessing the GFFS Via a command line tools, e.g., cp local:fred.txt /home/grimshaw/fred.txt rm /home/grimshaw/fred.txt 33
34 GUI Grid Client Typical folder based tool Tools to define, run, manage jobs Tools to manage grid queues Tools to export data Grid shell Shell has tab completion, history, help, scripting, etc. 34
35 GUI Grid Client: View Access Control To view access control information: Browse to and highlight resource, then select Security tab 35
36 Basic idea and canonical use cases Accessing the GFFS Attaching (provisioning) data to the GFFS Deployment 36
37 Exporting (mapping) data into the Grid Data clients Data clients Links directories and files from source location to GFFS directory and user-specified name Presents unified view of the data across platforms, locations, domains, etc. Sarah controls authorization policy. Sarah s department file server Sarah s instrument in the lab Sarah s TACC workspace Linux Windows TACC
38 Exporting/sharing data User selects Server that will perform the export Directory path on that server Path in GFFS to link it to grid export /containers/big-state-u/sarah-server /development/sources /home/sarah/dev Can also export Windows shares Directory structures via ssh (slow like sshfx) 38
39 Basic idea and canonical use cases Accessing the GFFS Attaching (provisioning) data to the GFFS Deployment 39
40 Deployment Sites that wish to export or share resources must run a Genesis II or UNICORE 6 container There will be an installer for the GFFS package for SPs, and a Campus Bridging package There is an installer for client side access There are training materials Used at TG 11 In the process of being turned into videos 40
41
42 On-Demand Research Computing - Infrastructure as a Service - - Software as a Service -
43 Infrastructure as a Service (IaaS) Cloud Red Cloud provides on-demand: Computing Cycles: Virtual Servers in Cloud Instances Storage: Virtual Disks in Elastic Block Storage ( EBS ) Volumes Virtual Servers Cloud Instances Cloud Management Red Cloud Virtual Disks Elastic Block Storage (EBS) Virtual Server Users
44 Software as a Service (SaaS) Cloud with MATLAB NVIDIA Tesla M2070s GPU Chassis Dell C410x Compute Nodes Dell C6100 Web Server Head Node DDN Storage SQL Server MyProxy Server GridFTP Server
45 Motivation Research computing means many different things Scientific workflows have different requirements at each step Cloud is only part of the solution Connecting to and from other CI resources is important Nobody likes a bad surprise Transparency, no hidden costs Need a way to bound financial risk Economies of scale Sharing hardware and software where it makes sense Pay for what you need, when you need it Customized environments for various disciplines Collaboration tools Data storage & analysis tools Flexibility to support different computing models (e.g. Hadoop)
46 Provides Predictable, Reproducible, Reliable Performance We publish hardware specifications (CPU, RAM, network) and do not oversubscribe. Convenient Need system up and running yesterday. Need a big fast machine for only a few months, weeks or days. Need a small server to run continuously. No Hidden Costs No cost for network traffic in or out of the cloud. Fast Access to Your Data Fast data transfers via 10Gb Ethernet in or out of the cloud at no additional charge. Globus Online access Economies of scale IaaS: Infrastructure SaaS: Software Expert Help System, application, and programming consulting are available. Easy Budgeting with Subscriptions No billing surprises! IaaS is Amazon API Compatible Migrate when your requirements outgrow Red Cloud.
47 Some Use Cases to Consider Support for Scientific Workflows Pre & post-processing of data and results Data analysis Globus Online for fast reliable data transfer Collaboration Wiki hosting Customized data analysis & computational environments Web Portals Science Gateways Domain Specific Portals Hub Zero Event-Driven Science Education, Outreach & Training Pre-configured systems & software tools providing consistent training platform Common laboratory computing environment Bursting Additional software and hardware on demand
48 Subscription-based Recovery Model with MATLAB Cornell University $500/core year* Cornell University $750/core year Other Academic Institutions $750/core year Other Academic Institutions $1200/core year *A core year is equal to 8585 hours Each subscription account includes 50GB of storage
49 What if??? Storage Consulting Additional Cornell Users $59.90/hour $0.91/GB/year Other Academic $85.47/hour $1.45/GB/year Institutions
50 Penguin Computing / IU Partnership HPC cluster as a service and Cloud Services Internet2 Spring Members Meeting 2012 Rich Knepper (rich@iu.edu) Manager, Campus Bridging Indiana University Copyright 2011 Penguin Computing, Inc. All rights reserved
51 What is POD On-demand HPC system > Compute, storage, low latency fabrics, GPU, non-virtualized Robust software infrastructure > Full automation Internet (150Mb, burstable to 1Gb) > User and administration space controls > Secure and seamless job migration > Extensible framework > Complete billing infrastructure Services > Custom product design > Site and workflow integration > Managed services > Application support HPC support expertise > Skilled HPC administrators > Leverage 13 yrs serving HPC market Copyright 2011 Penguin Computing, Inc. All rights reserved 51
52 Clouds look serene enough - But is ignorance bliss? In the cloud, do you know: > Where your data are? > What laws prevail over the physical location of your data? > What license you really agreed to? > What is the security (electronic / physical) around your data? > And how exactly do you get to that cloud, or get things out of it? > How secure your provider is financially? (The fact that something seems unimaginable, like cloud provider such-and-such going out of business abruptly, does not mean it is impossible!) Photo by es/z/in/photostream/
53 Penguin Computing & IU partner for Cluster as a Service Just what it says: Cluster as a Service Cluster physically located on IU s campus, in IU s Data Center Available to anyone at a.edu or FFRDC (Federally Funded Research and Development Center) To use it: > Go to podiu.penguincomputing.com > Fill out registration form > Verify via your > Get out your credit card > Go computing This builds on Penguin s experience - currently host Life Technologies' BioScope and LifeScope in the cloud (
54 We know where the data are and they are secure
55 An example of NET+ Services / Campus Bridging "We are seeing the early emergence of a meta-university a transcendent, accessible, empowering, dynamic, communally constructed framework of open materials and platforms on which much of higher education worldwide can be constructed or enhanced. Charles Vest, president emeritus of MIT, 2006 NET+ Goal: achieve economy of scale and retain reasonable measure of control See: Brad Wheeler and Shelton Waggener Above-Campus Services: Shaping the Promise of Cloud Computing for Higher Education. EDUCAUSE Review, vol. 44, no. 6 (November/December 2009): Campus Bridging goal make it all feel like it s just a peripheral to your laptop (see pti.iu.edu/campusbridging)
56 IU POD Innovation Through Partnership True On-Demand HPC for Internet2 Creative Public/Private model to address HPC shortfall Turning lost EC2 dollars into central IT expansion Tiered channel strategy expansion to EDU sector Program and discipline-specific enhancements under way Objective third party resource for collaboration > EDU, Federal and Commercial Copyright 2011 Penguin Computing, Inc. All rights reserved 56
57 POD IU (Rockhopper) specifications Server Information Architecture Penguin Computing Altus 1804 TFLOPS 4.4 Clock Speed 2.1GHz Nodes 11 compute; 2 login; 4 management; 3 servers CPUs 4 x 2.1GHz 12-core AMD Opteron 6172 processors per compute node Memory Type Distributed and Shared Total Memory 1408 GB Memory per Node 128GB 1333MHz DDR3 ECC Local Scratch Storage 6TB locally attached SATA2 Cluster Scratch 100TB Lustre Further Details OS CentOS 5 Network QDR (40Gb/s) Infiniband, 1Gb/s ethernet Job Management Software SGE Job Scheduling Software SGE Job Scheduling policy Fair Share Access keybased ssh login to headnodes remote job control via Penguin's PODShell
58 Available applications at POD IU (Rockhopper) Package name COAMPS Desmond GAMESS Galaxy GROMACS HMMER Intel LAMMPS MM5 mpiblast NAMD Summary Coupled ocean / atmosphere meoscale prediction system Desmond is a software package developed at D. E. Shaw Research to perform high-speed molecular dynamics simulations of biological systems on conventional commodity clusters. GAMESS is a program for ab initio molecular quantum chemistry. Galaxy is an open, web-based platform for data intensive biomedical research. GROMACS is a versatile package to perform molecular dynamics, i.e. simulate the Newtonian equations of motion for systems with hundreds to millions of particles. HMMER is used for searching sequence databases for homologs of protein sequences, and for making protein sequence alignments. compilers and libraries LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. The PSU/NCAR mesoscale model (known as MM5) is a limited-area, nonhydrostatic, terrain-following sigma-coordinate model designed to simulate or predict mesoscale atmospheric circulation. The model is supported by several pre- and post-processing programs, which are referred to collectively as the MM5 modeling system. mpiblast is a freely available, open-source, parallel implementation of NCBI BLAST. NAMD is a parallel molecular dynamics code for large biomolecular systems.
59 Thank you! Questions? Copyright 2011 Penguin Computing, Inc. All rights reserved 59
ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development
ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development Jeremy Fischer Indiana University 9 September 2014 Citation: Fischer, J.L. 2014. ACCI Recommendations on Long Term
More informationXSEDE Campus Bridging Tools Rich Knepper Jim Ferguson
April 3, 2014 XSEDE Campus Bridging Tools Rich Knepper (rich@iu.edu) Jim Ferguson (jwf@utk.edu) What is Campus Bridging? Bridging the gap between local researcher cyberinfrastructure, campus CI, and national
More informationHPC Capabilities at Research Intensive Universities
HPC Capabilities at Research Intensive Universities Purushotham (Puri) V. Bangalore Department of Computer and Information Sciences and UAB IT Research Computing UAB HPC Resources 24 nodes (192 cores)
More informationCampus Bridging: What is it and how do we do it? Rich Knepper
September 11, 2014 Campus Bridging: What is it and how do we do it? Rich Knepper rich@iu.edu What is Campus Bridging? Bridging the gap between local researcher cyberinfrastructure, campus CI, and national
More informationXSEDE Campus Bridging Tools Jim Ferguson National Institute for Computational Sciences
September 26, 2014 XSEDE Campus Bridging Tools Jim Ferguson National Institute for Computational Sciences jwf@utk.edu Quick Advertisement: Student Programs Research Experience 12-18 students per summer,
More informationCornell Red Cloud: Campus-based Hybrid Cloud. Steven Lee Cornell University Center for Advanced Computing
Cornell Red Cloud: Campus-based Hybrid Cloud Steven Lee Cornell University Center for Advanced Computing shl1@cornell.edu Cornell Center for Advanced Computing (CAC) Profile CAC mission, impact on research
More informationThe National Center for Genome Analysis Support as a Model Virtual Resource for Biologists
The National Center for Genome Analysis Support as a Model Virtual Resource for Biologists Internet2 Network Infrastructure for the Life Sciences Focused Technical Workshop. Berkeley, CA July 17-18, 2013
More informationTeraGrid TeraGrid and the Path to Petascale
TeraGrid TeraGrid and the Path to Petascale John Towns Chair, TeraGrid Forum Director, Persistent Infrastructure National Center for Supercomputing Applications University of Illinois jtowns@ncsa.illinois.edu
More informationXSEDE s Campus Bridging Project Jim Ferguson National Institute for Computational Sciences
January 3, 2016 XSEDE s Campus Bridging Project Jim Ferguson National Institute for Computational Sciences jwf@utk.edu What is XSEDE? extreme Science and Engineering Discovery Environment $121M project
More informationOverview of the Texas Advanced Computing Center. Bill Barth TACC September 12, 2011
Overview of the Texas Advanced Computing Center Bill Barth TACC September 12, 2011 TACC Mission & Strategic Approach To enable discoveries that advance science and society through the application of advanced
More informationJetstream: Adding Cloud-based Computing to the National Cyberinfrastructure
Jetstream: Adding Cloud-based Computing to the National Cyberinfrastructure funded by the National Science Foundation Award #ACI-1445604 Matthew Vaughn(@mattdotvaughn) ORCID 0000-0002-1384-4283 Director,
More informationMagellan Project. Jeff Broughton NERSC Systems Department Head October 7, 2009
Magellan Project Jeff Broughton NERSC Systems Department Head October 7, 2009 1 Magellan Background National Energy Research Scientific Computing Center (NERSC) Argonne Leadership Computing Facility (ALCF)
More informationGRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi
GRIDS INTRODUCTION TO GRID INFRASTRUCTURES Fabrizio Gagliardi Dr. Fabrizio Gagliardi is the leader of the EU DataGrid project and designated director of the proposed EGEE (Enabling Grids for E-science
More informationCyberinfrastructure Framework for 21st Century Science & Engineering (CIF21)
Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation, Integration Alan Blatecky Director OCI 1 1 Framing the
More informationRegional & National HPC resources available to UCSB
Regional & National HPC resources available to UCSB Triton Affiliates and Partners Program (TAPP) Extreme Science and Engineering Discovery Environment (XSEDE) UCSB clusters https://it.ucsb.edu/services/supercomputing
More informationJetstream: A science & engineering cloud
Jetstream: A science & engineering cloud Mike Lowe (jomlowe@iu.edu) Indiana University SC 16 Ceph BOF November 16, 2016 Expanding NSF XD s reach and impact Around 350,000 researchers, educators, & learners
More informationJetstream Overview A national research and education cloud
Jetstream Overview A national research and education cloud 9th workshop on Scientific Cloud Computing (ScienceCloud) June 11, 2018 Tempe, AZ John Michael Lowe jomlowe@iu.edu Senior Cloud Engineer, UITS
More informationSLATE. Services Layer at the Edge. First Meeting of the National Research Platform Montana State University August 7-8, 2017
SLATE Services Layer at the Edge Rob Gardner University of Chicago Shawn McKee University of Michigan Joe Breen University of Utah First Meeting of the National Research Platform Montana State University
More informationLonghorn Project TACC s XD Visualization Resource
Longhorn Project TACC s XD Visualization Resource DOE Computer Graphics Forum April 14, 2010 Longhorn Visualization and Data Analysis In November 2008, NSF accepted proposals for the Extreme Digital Resources
More informationPODShell: Simplifying HPC in the Cloud Workflow
PODShell: Simplifying HPC in the Cloud Workflow June 2011 Penguin provides Linux HPC Solutions Linux Systems Servers Workstations Cluster Management Software HPC as a Service - Penguin on Demand Professional
More informationGateways to Discovery: Cyberinfrastructure for the Long Tail of Science
Gateways to Discovery: Cyberinfrastructure for the Long Tail of Science ECSS Symposium, 12/16/14 M. L. Norman, R. L. Moore, D. Baxter, G. Fox (Indiana U), A Majumdar, P Papadopoulos, W Pfeiffer, R. S.
More informationOpenSees on Teragrid
OpenSees on Teragrid Frank McKenna UC Berkeley OpenSees Parallel Workshop Berkeley, CA What isteragrid? An NSF sponsored computational science facility supported through a partnership of 13 institutions.
More informationLBRN - HPC systems : CCT, LSU
LBRN - HPC systems : CCT, LSU HPC systems @ CCT & LSU LSU HPC Philip SuperMike-II SuperMIC LONI HPC Eric Qeenbee2 CCT HPC Delta LSU HPC Philip 3 Compute 32 Compute Two 2.93 GHz Quad Core Nehalem Xeon 64-bit
More informationirods at TACC: Secure Infrastructure for Open Science Chris Jordan
irods at TACC: Secure Infrastructure for Open Science Chris Jordan What is TACC? Texas Advanced Computing Center Cyberinfrastructure Resources for Open Science University of Texas System 9 Academic, 6
More informationGetting Started with XSEDE Andrew Grimshaw and Karolina Sarnowska- Upton
January 10, 2012 Getting Started with XSEDE Andrew Grimshaw and Karolina Sarnowska- Upton Audience End users and developers who want to Access and use NSF funded XSEDE compute, data, and storage resources
More informationIntroduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill
Introduction to FREE National Resources for Scientific Computing Dana Brunson Oklahoma State University High Performance Computing Center Jeff Pummill University of Arkansas High Peformance Computing Center
More informationAccelerate Your Cloud Journey
Dubai, UAE 20th March 2013 Accelerate Your Cloud Journey James Spearman Dimension Data - Solutions Architect Cloud 2012 2011 Cisco and/or its affiliates. All rights reserved. Cisco Connect 1 Dimension
More informationEucalyptus Overview The most widely deployed on-premise cloud computing platform
Eucalyptus Overview The most widely deployed on-premise cloud computing platform Vision Value Proposition Solution Highlights Ecosystem Background We bring the power of cloud to your business The world
More informationScience-as-a-Service
Science-as-a-Service The iplant Foundation Rion Dooley Edwin Skidmore Dan Stanzione Steve Terry Matthew Vaughn Outline Why, why, why! When duct tape isn t enough Building an API for the web Core services
More informationRESEARCH DATA DEPOT AT PURDUE UNIVERSITY
Preston Smith Director of Research Services RESEARCH DATA DEPOT AT PURDUE UNIVERSITY May 18, 2016 HTCONDOR WEEK 2016 Ran into Miron at a workshop recently.. Talked about data and the challenges of providing
More informationLarge Scale Computing Infrastructures
GC3: Grid Computing Competence Center Large Scale Computing Infrastructures Lecture 2: Cloud technologies Sergio Maffioletti GC3: Grid Computing Competence Center, University
More informationThe Stampede is Coming Welcome to Stampede Introductory Training. Dan Stanzione Texas Advanced Computing Center
The Stampede is Coming Welcome to Stampede Introductory Training Dan Stanzione Texas Advanced Computing Center dan@tacc.utexas.edu Thanks for Coming! Stampede is an exciting new system of incredible power.
More informationAccelerate Your Enterprise Private Cloud Initiative
Cisco Cloud Comprehensive, enterprise cloud enablement services help you realize a secure, agile, and highly automated infrastructure-as-a-service (IaaS) environment for cost-effective, rapid IT service
More informationCSD3 The Cambridge Service for Data Driven Discovery. A New National HPC Service for Data Intensive science
CSD3 The Cambridge Service for Data Driven Discovery A New National HPC Service for Data Intensive science Dr Paul Calleja Director of Research Computing University of Cambridge Problem statement Today
More informationGeorgia State University Cyberinfrastructure Plan
Georgia State University Cyberinfrastructure Plan Summary Building relationships with a wide ecosystem of partners, technology, and researchers are important for GSU to expand its innovative improvements
More informationUniversity at Buffalo Center for Computational Research
University at Buffalo Center for Computational Research The following is a short and long description of CCR Facilities for use in proposals, reports, and presentations. If desired, a letter of support
More informationOrganizational Update: December 2015
Organizational Update: December 2015 David Hudak Doug Johnson Alan Chalker www.osc.edu Slide 1 OSC Organizational Update Leadership changes State of OSC Roadmap Web app demonstration (if time) Slide 2
More informationLarge Scale Remote Interactive Visualization
Large Scale Remote Interactive Visualization Kelly Gaither Director of Visualization Senior Research Scientist Texas Advanced Computing Center The University of Texas at Austin March 1, 2012 Visualization
More informationData Virtualization Implementation Methodology and Best Practices
White Paper Data Virtualization Implementation Methodology and Best Practices INTRODUCTION Cisco s proven Data Virtualization Implementation Methodology and Best Practices is compiled from our successful
More informationOverview of HPC at LONI
Overview of HPC at LONI Le Yan HPC Consultant User Services @ LONI What Is HPC High performance computing is to use supercomputers to solve problems computationally The most powerful supercomputer today
More informationXSEDE New User Training. Ritu Arora November 14, 2014
XSEDE New User Training Ritu Arora Email: rauta@tacc.utexas.edu November 14, 2014 1 Objectives Provide a brief overview of XSEDE Computational, Visualization and Storage Resources Extended Collaborative
More informationUsers and utilization of CERIT-SC infrastructure
Users and utilization of CERIT-SC infrastructure Equipment CERIT-SC is an integral part of the national e-infrastructure operated by CESNET, and it leverages many of its services (e.g. management of user
More informationEvolution of the ATLAS PanDA Workload Management System for Exascale Computational Science
Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine,
More informationClouds: An Opportunity for Scientific Applications?
Clouds: An Opportunity for Scientific Applications? Ewa Deelman USC Information Sciences Institute Acknowledgements Yang-Suk Ki (former PostDoc, USC) Gurmeet Singh (former Ph.D. student, USC) Gideon Juve
More informationCyberinfrastructure!
Cyberinfrastructure! David Minor! UC San Diego Libraries! San Diego Supercomputer Center! January 4, 2012! Cyberinfrastructure:! History! Definitions! Examples! History! mid-1990s:! High performance computing
More informationDell helps you simplify IT
Dell helps you simplify IT Workshops the first step. Reduce desktop and data center complexity. Improve productivity. Innovate. Dell IT Consulting Services New Edition 2011 Introduction Are you spending
More informationAdvancing Library Cyberinfrastructure for Big Data Sharing and Reuse. Zhiwu Xie
Advancing Library Cyberinfrastructure for Big Data Sharing and Reuse Zhiwu Xie 2017 NFAIS Annual Conference, Feb 27, 2017 Big Data: How Big? Moving yardstick No longer unique to big science 1000 Genomes
More informationUAB Research Compu1ng Resources and Ac1vi1es
UAB Research Compu1ng Resources and Ac1vi1es Research Compu1ng Day September 13, 2012 UAB IT Research Compu1ng UAB IT Research Compu1ng Team Bob Cloud Execu1ve Director Infrastructure Services UAB IT Mike
More informationThe Cambridge Bio-Medical-Cloud An OpenStack platform for medical analytics and biomedical research
The Cambridge Bio-Medical-Cloud An OpenStack platform for medical analytics and biomedical research Dr Paul Calleja Director of Research Computing University of Cambridge Global leader in science & technology
More informationData publication and discovery with Globus
Data publication and discovery with Globus Questions and comments to outreach@globus.org The Globus data publication and discovery services make it easy for institutions and projects to establish collections,
More informationHigher Education in Texas: Serving Texas Through Transformational Education, Research, Discovery & Impact
Higher Education in Texas: Serving Texas Through Transformational Education, Research, Discovery & Impact M. Dee Childs, Vice President for Information Technology & Chief Information Officer v Texas A&M
More informationSuperMike-II Launch Workshop. System Overview and Allocations
: System Overview and Allocations Dr Jim Lupo CCT Computational Enablement jalupo@cct.lsu.edu SuperMike-II: Serious Heterogeneous Computing Power System Hardware SuperMike provides 442 nodes, 221TB of
More informationIntroduction to HPC Resources and Linux
Introduction to HPC Resources and Linux Burak Himmetoglu Enterprise Technology Services & Center for Scientific Computing e-mail: bhimmetoglu@ucsb.edu Paul Weakliem California Nanosystems Institute & Center
More informationLeveraging the InCommon Federation to access the NSF TeraGrid
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois at Urbana-Champaign jbasney@ncsa.uiuc.edu
More informationAccelerate your Azure Hybrid Cloud Business with HPE. Ken Won, HPE Director, Cloud Product Marketing
Accelerate your Azure Hybrid Cloud Business with HPE Ken Won, HPE Director, Cloud Product Marketing Mega trend: Customers are increasingly buying cloud services from external service providers Speed of
More informationNC Education Cloud Feasibility Report
1 NC Education Cloud Feasibility Report 1. Problem Definition and rationale North Carolina districts are generally ill-equipped to manage production server infrastructure. Server infrastructure is most
More informationMicrosoft SharePoint Server 2013 Plan, Configure & Manage
Microsoft SharePoint Server 2013 Plan, Configure & Manage Course 20331-20332B 5 Days Instructor-led, Hands on Course Information This five day instructor-led course omits the overlap and redundancy that
More informationHPC Cloud at SURFsara
HPC Cloud at SURFsara Offering cloud as a service SURF Research Boot Camp 21st April 2016 Ander Astudillo Markus van Dijk What is cloud computing?
More informationThe GISandbox: A Science Gateway For Geospatial Computing. Davide Del Vento, Eric Shook, Andrea Zonca
The GISandbox: A Science Gateway For Geospatial Computing Davide Del Vento, Eric Shook, Andrea Zonca 1 Paleoscape Model and Human Origins Simulate Climate and Vegetation during the Last Glacial Maximum
More informationData Movement & Storage Using the Data Capacitor Filesystem
Data Movement & Storage Using the Data Capacitor Filesystem Justin Miller jupmille@indiana.edu http://pti.iu.edu/dc Big Data for Science Workshop July 2010 Challenges for DISC Keynote by Alex Szalay identified
More informationXSEDE New User Tutorial
April 2, 2014 XSEDE New User Tutorial Jay Alameda National Center for Supercomputing Applications XSEDE Training Survey Make sure you sign the sign in sheet! At the end of the module, I will ask you to
More information13.f Toronto Catholic District School Board's IT Strategic Review - Draft Executive Summary (Refer 8b)
AGENDA ADDENDU TE REGULAR EETING OF TE AUDIT COITTEE COITTEE PUBLIC SESSION Tuesday, June 6, 2017 6:30 P.. Pages 13. Staff Reports 13.f Toronto Catholic District School Board's IT Strategic Review - Draft
More informationDeploying the TeraGrid PKI
Deploying the TeraGrid PKI Grid Forum Korea Winter Workshop December 1, 2003 Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu
More informationPROJECT FINAL REPORT. Tel: Fax:
PROJECT FINAL REPORT Grant Agreement number: 262023 Project acronym: EURO-BIOIMAGING Project title: Euro- BioImaging - Research infrastructure for imaging technologies in biological and biomedical sciences
More informationOutline. March 5, 2012 CIRMMT - McGill University 2
Outline CLUMEQ, Calcul Quebec and Compute Canada Research Support Objectives and Focal Points CLUMEQ Site at McGill ETS Key Specifications and Status CLUMEQ HPC Support Staff at McGill Getting Started
More informationThe National Fusion Collaboratory
The National Fusion Collaboratory A DOE National Collaboratory Pilot Project Presented by David P. Schissel at ICC 2004 Workshop May 27, 2004 Madison, WI PRESENTATION S KEY POINTS Collaborative technology
More informationGetting Started with XSEDE. Dan Stanzione
November 3, 2011 Getting Started with XSEDE Dan Stanzione Welcome to XSEDE! XSEDE is an exciting cyberinfrastructure, providing large scale computing, data, and visualization resources. XSEDE is the evolution
More informationIntroduction to High-Performance Computing
Introduction to High-Performance Computing Dr. Axel Kohlmeyer Associate Dean for Scientific Computing, CST Associate Director, Institute for Computational Science Assistant Vice President for High-Performance
More informationNAMD GPU Performance Benchmark. March 2011
NAMD GPU Performance Benchmark March 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Dell, Intel, Mellanox Compute resource - HPC Advisory
More informationBusiness today runs on technology. Modernize Your Datacenter. Challenges facing IT. Modernize Your Datacenter 10/17/ % Enterprise IT
Business today runs on technology 71% of surveyed internet, technology and social experts predict: In 2016, 82% of server workloads will be running in virtual environments. Total IT services spend: 45%
More informationMOHA: Many-Task Computing Framework on Hadoop
Apache: Big Data North America 2017 @ Miami MOHA: Many-Task Computing Framework on Hadoop Soonwook Hwang Korea Institute of Science and Technology Information May 18, 2017 Table of Contents Introduction
More informationGrid Scheduling Architectures with Globus
Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents
More informationAN INTRODUCTION TO CLUSTER COMPUTING
CLUSTERS AND YOU AN INTRODUCTION TO CLUSTER COMPUTING Engineering IT BrownBag Series 29 October, 2015 Gianni Pezzarossi Linux Systems Administrator Mark Smylie Hart Research Technology Facilitator WHAT
More informationMyCloud Computing Business computing in the cloud, ready to go in minutes
MyCloud Computing Business computing in the cloud, ready to go in minutes In today s dynamic environment, businesses need to be able to respond quickly to changing demands. Using virtualised computing
More informationHigh Performance Computing Resources at MSU
MICHIGAN STATE UNIVERSITY High Performance Computing Resources at MSU Last Update: August 15, 2017 Institute for Cyber-Enabled Research Misson icer is MSU s central research computing facility. The unit
More informationDT-ICT : Big data solutions for energy
DT-ICT-11-2019: Big data solutions for energy info day Stefano Bertolo, DG CONNECT Mario Dionisio, DG ENER Scientific Programme Officers Who we are DG CONNECT, Unit G1 Data Policy and Innovation DG ENERGY,
More informationA Cloud WHERE PHYSICAL ARE TOGETHER AT LAST
A Cloud WHERE PHYSICAL AND VIRTUAL STORAGE ARE TOGETHER AT LAST Not all Cloud solutions are the same so how do you know which one is right for your business now and in the future? NTT Communications ICT
More informationGrid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationSUCCESS STORY SEYFARTH SHAW SEYFARTH SHAW DRAMATICALLY IMPROVES USER EXPERIENCES WITH WINDOWS 10 AND NVIDIA GRID
SEYFARTH SHAW DRAMATICALLY IMPROVES USER EXPERIENCES WITH WINDOWS 10 AND NVIDIA GRID DRAMATICALLY IMPROVING USER EXPERIENCES WITH WINDOWS 10. INTRODUCTION: REASONS FOR NVIDIA GRID > Enhance productivity
More informationProvisioning IT at the Speed of Need with Microsoft Azure. Presented by Mark Gordon and Larry Kuhn Hashtag: #HAND5
Provisioning IT at the Speed of Need with Microsoft Azure Presented by Mark Gordon and Larry Kuhn Hashtag: #HAND5 Presenters: Mark Gordon Cloud Architect Aptera - markgo@apterainc.com Larry Kuhn Account
More informationFebruary 2018 Release
Oracle Cloud What's New for Oracle SOA Cloud Service Release 18.1.5 E72302-27 March 2018 What s New in Oracle SOA Cloud Service Learn about the new and changed features of Oracle SOA Cloud Service. Note:
More informationEMC ACADEMIC ALLIANCE
EMC ACADEMIC ALLIANCE Preparing the next generation of IT professionals for careers in virtualized and cloud environments. Equip your students with the broad and deep knowledge required in today s complex
More informationTUESDAY 24 APR 2012 GENERAL UPDATE JERRY GROCHOW, VICE PRESIDENT (INTERIM) SHEL WAGGENER, SENIOR VICE PRESIDENT (AFTER THE INTERIM)
TUESDAY 24 APR 2012 GENERAL UPDATE JERRY GROCHOW, VICE PRESIDENT (INTERIM) SHEL WAGGENER, SENIOR VICE PRESIDENT (AFTER THE INTERIM) Why Internet2 NET+ Services? Define a new generation of -developed and
More informationUniversity of California, Riverside. Computing and Communications. Computational UCR. March 28, Introduction 2
University of California, Riverside Computing and Communications Computational Clusters @ UCR March 28, 2008 1 Introduction 2 2 Campus Datacenter Co-Location Facility 2 3 Three Cluster Models 2 3.1 Departmentally
More informationEMC Business Continuity for Microsoft Applications
EMC Business Continuity for Microsoft Applications Enabled by EMC Celerra, EMC MirrorView/A, EMC Celerra Replicator, VMware Site Recovery Manager, and VMware vsphere 4 Copyright 2009 EMC Corporation. All
More informationSTRATEGIC PLAN
STRATEGIC PLAN 2013-2018 In an era of growing demand for IT services, it is imperative that strong guiding principles are followed that will allow for the fulfillment of the Division of Information Technology
More informationCenturyLink for Microsoft
Strategic Partner Alliances CenturyLink for Microsoft EMPOWER REACH AGILITY 2017 CenturyLink. All Rights Reserved. The CenturyLink mark, pathways logo and certain CenturyLink product names are the property
More informationDemystifying the Cloud With a Look at Hybrid Hosting and OpenStack
Demystifying the Cloud With a Look at Hybrid Hosting and OpenStack Robert Collazo Systems Engineer Rackspace Hosting The Rackspace Vision Agenda Truly a New Era of Computing 70 s 80 s Mainframe Era 90
More informationNET+ INFRASTRUCTURE AND PLATFORM SERVICES PORTFOLIO STATUS & UPDATE
NET+ INFRASTRUCTURE AND PLATFORM SERVICES PORTFOLIO STATUS & UPDATE Andrew Keating, Sean O'Brien, and Sara Jeanes NET+ Cloud Services 2014 Internet2 NET+ IPS Portfolio Update CONTENTS Goals and Updates
More informationNAMD Performance Benchmark and Profiling. January 2015
NAMD Performance Benchmark and Profiling January 2015 2 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Intel, Dell, Mellanox Compute resource
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationVideo Conferencing & Skype for Business: Your Need-to-Know Guide
Video Conferencing & Skype for Business: Your Need-to-Know Guide Effective, engaging collaboration that leverages video conferencing should incorporate features like content sharing, clear participant
More informationCloudLab. Updated: 5/24/16
2 The Need Addressed by Clouds are changing the way we look at a lot of problems Impacts go far beyond Computer Science but there's still a lot we don't know, from perspective of Researchers (those who
More informationThe University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager
The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or
More informationWVU RESEARCH COMPUTING INTRODUCTION. Introduction to WVU s Research Computing Services
WVU RESEARCH COMPUTING INTRODUCTION Introduction to WVU s Research Computing Services WHO ARE WE? Division of Information Technology Services Funded through WVU Research Corporation Provide centralized
More informationPicasso Panel Thinking Beyond 5 G David Corman
Picasso Panel Thinking Beyond 5 G David Corman Program Director Directorate for Computer and Information Science and Engineering National Science Foundation June 19, 2018 Some Motivation: Toward Smart
More informationAtoS IT Solutions and Services. Microsoft Solutions Summit 2012
Microsoft Solutions Summit 2012 1 Building Private Cloud with Microsoft Solution 2 Building Private Cloud with Microsoft Solution Atos integration Establish a new strategic IT partnership From July 2011
More informationJourney Towards Science DMZ. Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia
Malaysia's Computational Journey Towards Science DMZ Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia suhaimi@upm.my In the Beginning... Research on parallel/distributed
More informationPREPARE FOR TAKE OFF. Accelerate your organisation s journey to the Cloud.
PREPARE FOR TAKE OFF Accelerate your organisation s journey to the Cloud. cloud. Contents Introduction Program & Governance BJSS Cloud Readiness Assessment: Intro Platforms & Development BJSS Cloud Readiness
More informationCloud solution consultant
Cloud solution consultant Role brief Directorate Jisc technologies Base location Harwell or Bristol Grade B Level 18 Job family Professional services Date November 2017 Reports to Cloud services group
More information