Introduction to High Performance Computing at UEA. Chris Collins Head of Research and Specialist Computing ITCS
|
|
- Jessica Marshall
- 5 years ago
- Views:
Transcription
1 Introduction to High Performance Computing at UEA. Chris Collins Head of Research and Specialist Computing ITCS
2 Introduction to High Performance Computing High Performance Computing at UEA This presentation is available to download and look over at your own pace at: The exercises are available to download at: Introduction to Linux: There is a brief getting started guide to Linux available, which also includes some more advanced commands that may be useful for working on the cluster available at:
3 Introduction to High Performance Computing By the end of this course you should: Know why we have a HPC cluster and how it can benefit research Review the components of the HPC cluster Understand the process of submitting jobs to the HPC cluster Be able to connect to the HPC cluster and copy files and data to the HPC cluster Work interactively on the cluster Prepare job scripts and submit jobs to the appropriate queues requesting the appropriate resources
4 What is High Performance Computing? The goal of High Performance Computing is to reduce the execution time of a compute intensive or data intensive problem. HPC facilities are designed to deal with the grand challenges of science: Complex problems Large data sets Large memory requirements HPC systems are comprised of the fast processors, large memory capacities and fast interconnection networks. HPC designed to provide quick access to, and facilities for processing large amounts of data Problems are often sped up by dividing the work of the program up; so that many different processors work on parts of the problem concurrently. Two main uses of HPC facilities: High Throughput Computing High Performance Computing
5 HPC Usage at UEA Biological Sciences Chemistry Pharmacy Computing Sciences Environmental Sciences Mathematics Medicine, Health Policy and Practice Economics International Development Norwich Business School Usage includes: Climatic research statistical and dynamic climatology environmental modelling ocean biogeochemistry seismology fluid dynamics chemical modelling molecular dynamics crystallography and NMR protein sequence analysis evolutionary biology phylogenetics epidemiology evolutionary genomics large-scale RNA sequence analysis speech recognition knowledge discovery and data mining computer security statistical economics.
6 What a cluster looks like
7 Cluster components Processing nodes 301 (plus 1 GPGPU node) Total computational cores 4148 Ethernet cores 2324 Infiniband cores 1824 CPU Memory Infiniband interconnect GPU Dual x 6 core 2.66GHz + Dual x 8 core 2.6GHz 24/32/48/128 GB + DDR3 40Gb/s Quad Data Rate Nvidia Tesla C2050 Individual theoretical peak performance GFLOP/s (X5650) GFLOP/s (E5-2670) Theoretical peak performance (cluster) 65TFlops
8 Login Introduction to High Performance Computing cn001 cn003 cn005 cnxxx cn299 cn301 cn002 cn004 cn006 cnyyy cn300 cn302 Login node 1Gb/s network Processing nodes 302 Total computational cores 4148 Memory 24/32/48/64/128 GB High performance parallel GPFS storage 40Gb/s Infiniband low latency network
9 Login Introduction to High Performance Computing
10 Login Introduction to High Performance Computing
11 Login Introduction to High Performance Computing X=1 X=2 X=3 X=4 X=5 X=6
12 Login Introduction to High Performance Computing X=1 X=2 X=3 X=4 X=5 X=6
13 Login Introduction to High Performance Computing X=1 X=2 X=3 X=4 X=5 X=6
14 Login Introduction to High Performance Computing X=1 X=2 X=3 X=4 X=5 X=6
15 How is the HPC used? Individual tasks Single interactive tasks (possibly utilising GUI tools) or simple individual sequential tasks High Throughput Computing / Ensemble jobs Batch of sequential jobs Embarrassingly parallel Little or no communication required between parallel tasks PJob1 MPI1 Job1-9 Job1 Job2 Job3 Job1a Job1b Job1c Job4 Job5 Job1 Job6 Job1d Job1e Job1f Job1g Job7 Job1h Job8 Job9 Job1i Parallel computing - MPI
16 Why use the UEA HPC? Compared to desktop processing: Number of nodes means larger number of concurrent jobs Processing power Faster multicore processors Larger memory systems available Nodes with 24G, 32G, 48G, 64G and 128G of RAM Low latency / high speed interconnect for parallel processing systems Storage Enterprise level storage, secure, high availability and resilience Applications and libraries SAS 9.3, Stata 13-MP16, R v2.12 v2.15.1, Matlab 2010a 2013a and Matlab Statistical Toolbox, Maple. NetCDF, CDAT, Ferret, Gromacs, IDL, HTK... Parallel libraries Parallel NetCDF, Parallel HDF, MPI and MPICH What can you do: Run applications as you would on your desktop (Matlab, Stata, SAS etc) in interactive sessions with graphical interfaces Submit jobs that automatically start when resources are available (can run multiple jobs at a time) Run batch and array jobs with different inputs/data to the same scripts concurrently
17 Connecting to the cluster To connect with SSH use PuTTY in Windows Start > All Programs > UEA Network Applications > SSH Login (PuTTY) To transfer files to the cluster use WinSCP in Windows Start > All Programs > UEA Network Applications > WinSCP To display graphics on your local PC from the cluster in Windows (VcXsrv, Xming or Exceed) Start > All Programs > UEA Network Applications > Xming > Xming
18 Using SSH to connect SSH (Secure Shell) creates a secure channel between your local machine and a remote machine (i.e. the cluster). This channel can also be used to tunnel data such as graphical data and files. On Windows we use PuTTY: Start > All Programs > UEA Network Applications > SSH Login (PuTTY) 1. Host name (or IP address): grace.uea.ac.uk 2. Saved sessions: grace 3. Go to Connection > SSH > X11 4. Check Enable X11 forwarding 5. X display location: localhost:0 6. Session > Save 7. Open From Linux or Mac we can connect from the command line: ssh X username@grace.uea.ac.uk Depending on where you connect from you may be asked for your username and password, this will be your standard UEA credentials
19 Using SCP to transfer files Based on SSH, we use SCP (Secure Copy) to transfer files between computers. On Windows we use WinSCP: Start > All Programs > UEA Network Applications > WinSCP 1. New 2. Host name: grace.uea.ac.uk 3. User name: <your username> 4. Password: You can enter a password or leave it blank to be prompted on access 5. Save 6. Login From Linux or Mac we can connect from the command line: scp -r directory username@grace.uea.ac.uk:/gpfs/dep/username/
20 Cluster storage Path Use for HPC jobs Backed up Default quota Notes /gpfs/dep/username 30G Secure, high availability high resilience /gpfs/scratchdep/username 100G data for driving models; output prior to analysis /gpfs/esarchive/dep/username - /home/dep/username - - Long term storage of rarely used data UEA central filestore
21 Cluster storage File and Data Management Do not run HPC jobs from your UEA central filestore Use filesystems appropriately: Scratch for temporary data or data that can be easily downloaded or reproduced Home for important data that you need to keep Be aware of the data your job uses for input and produces as output Remove old unneeded files, e.g.: Job error and out files Old job log file Old temporary files Core dump files (e.g. core.13417) The command quotacheck will report your usage on all filesystems (note: while you have quota on other department filesystems you cannot write to them)
22 Modules Module files are used to dynamically update user s environments to provide access to different applications. Module files allow us to support multiple versions of applications. module list List modules currently loaded in your environment module avail Lists all the modules available module show packagename Shows information about the package module module add packagename Adds modulename to your environment module del packagename Removes modulename to your environment module switch packagenamea packagenameb Unloads first module and replaces with second module module purge Removes all modules from your environment Modules must be added to job submission scripts to provide access to applications Modules can be automatically loaded by adding module add commands to your.bashrc file
23 Modules applications and libraries module avail will show you the complete set of applications, tools and libraries available. Some of the applications available include: MrBayes R Gromacs 4.0.7,4.5.3,4.5.5; GPU Gromacs HDF ; HDF ; Parallel HDF HTK Matlab 2010a 2013a CDAT 5.2 NetCDF 3.6.3, 4.1.1; Parallel NetCDF Python 2.6.4, 2.7.1, Ruby 1.8.7, SAS 9.3 Stata 13 MP 16
24 Modules compilers and parallel communication Compiler modules icc/intel/11.1 Intel C/C++ and Fortran (F77/F90) compilers pgi/7.0.7 Portland Group compilers version pgi/10.9 Portland Group compilers version 10.9 GCC (available by default) GNU Compiler Collection Each compiler builds binaries that perform differently, Intel tends to result in the fastest performing binaries, then PGI Some code may have difficulties with certain compilers Parallel Communication There are various MPI (Message Passing Interface) libraries available. The main libraries are: mpi/platform/intel/8.1 mpi/platform/pgi/8.1 mpi/platform/gcc/8.1 mpi/openmpi/gcc/1.4.1 Platform MPI for Intel compilation Platform MPI for PGI compilation Platform MPI for GCC compilation OpenMPI for GCC compilation Platform MPI compiled code works on both standard Ethernet and Infiniband systems
25 Working interactively Grace uses Platform LSF (Load Sharing Facility) a batch queuing system that controls the allocation of jobs to nodes. A suite of commands are available for submitting, monitoring and managing jobs and managing queues. interactive Start an interactive session (alias of bsub -L /bin/bash -q interactive $@ -cwd "$HOME" -Is /bin/bash) Xinteractive Start a graphical interactive session (alias of bsub -XF -L /bin/bash -q interactive $@ -cwd "$HOME" -Is /bin/bash)
26 Working interactively - STATA
27 Working interactively - Matlab
28 Job Scheduler Grace uses First-Come, First-Served scheduler which assesses job priority, resource requirements, host availability and user and queue job slot limits Queues based on resource and run time: Queue Resource Time Limit interactive Standard 12 hours interactive-lm Large memory 12 hours short Standard 5 hours medium Standard 24 hours long Standard 5 days short-ib Infiniband 5 hours medium-ib Infiniband 24 hours long-ib Infiniband 5 days medium-lm Large memory 24 hours long-lm Large memory 5 days
29 Job Submission To submit a job to run automatically on the cluster, a job submission script is required The job submission script is a file that contains: A set of directives which define how and where the job should run Information to set up job environment including module commands to provide access to the applications required Run the application The base directives that should be set include: Select queue Set job name Set any additional resource requirements (memory, parallel) Jobs are submitted with the following command: bsub < JobSubmission.bsub
30 BSUB batch jobs #!/bin/sh #BSUB -q short #BSUB -J RTestJob #BSUB -oo R-%J.out #BSUB -eo R-%J.err. /etc/profile module add R/ R CMD BATCH Random.R
31 BSUB directives #BSUB -q QueueName Run this job on QueueName.q e.g. short, long, long-ib #BSUB -J JobName Name this job JobName #BSUB -J JobName[StartNum-EndNum] Creates array jobs, individual jobs between StartNum and EndNum, i.e #BSUB -n NumOfSlots Set parallel job number of slots required e.g. 16 #BSUB -B Get when job starts #BSUB -N Get when job ends #BSUB -o output.log Write job output to output.log (appends if file exists -oo overwrites if file exists) #BSUB -e error.log Write job errors to error log (appends if file exists, -oe overwrites if file exists) For both output and error logs, the following options can be used: %J can be used to include JOBID %I for array JOBINDEX If o and e are omitted, then LSF will job output
32 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11
33 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11
34 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11
35 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11
36 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 #BSUB n 4 #BSUB R 'span[ptile=4]'
37 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 #BSUB R "rusage[mem=10000] #BSUB M 12000
38 Job Resources CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 #BSUB x
39 Cluster components Parallel Computing Faster than standard Ethernet with a lower latency, Quad Data Rate Infiniband infrastructure upon which parallel job can be run. Ethernet QDR IB Bandwidth 1Gbit/s 40Gbit/s Latency 40µs 1.1µs Communication latency = Sender overhead + Transmission time + Receiver overhead HPL Problem Size Number of Nodes Ethernet Runtime Infiniband Runtime
40 BSUB parallel jobs #!/bin/sh #BSUB -q short-ib #BSUB -n 96 #BSUB -R 'select[ib]' #BSUB -R 'span[ptile=12]' #BSUB -R 'cu[maxcus=1]' #BSUB -oo ParTest-%J.log #BSUB -eo ParTest-%J.log #BSUB -J ParallelTest". /etc/profile module add mpi/platform/pgi/8.1 mpirun MyParallelBinary
41 Troubleshooting and reporting problems You can help us provide a faster solution by providing us with the following information when reporting issues: Login Issues Name and location of machine connecting from Confirmation you are trying to connect to grace.uea.ac.uk OS and connection method (Putty or Exceed etc) Confirmation you are using your standard UEA username and password General job issues Application being used A general description of the problem Output of which application Output of module list Any error or warning messages Location and name of job submission script and output files Location of input and output data Have you run this application before on the cluster successfully? Have you used this input data successfully on the cluster? Node name It is also worth checking Google, the application website or mailing list or with colleagues
42 High Performance Computing Chris Collins Head of Research and Specialist Computing Leo Earl Systems developer (HPC) Julie Harold (0.4FTE) Systems developer (HPC/Linux) IT Linux Mike Salmon Linux systems developer Julie Harold (0.4FTE) - Systems developer (Linux/HPC) Jimmy Cross Linux systems developer What does the IT Linux team support? The team primarily supports the UEA Ubuntu Linux desktops (~150 computers) Provide expertise for ad hoc scientific projects requiring Linux systems SVN - Subversion and Trac are provided at UEA to enable the research community to share version controlled files within a research group
Introduction to High Performance Computing at UEA. Chris Collins Head of Research and Specialist Computing ITCS
Introduction to High Performance Computing at UEA. Chris Collins Head of Research and Specialist Computing ITCS Introduction to High Performance Computing High Performance Computing at UEA http://rscs.uea.ac.uk/hpc/
More informationIntroduction to High-Performance Computing (HPC)
Introduction to High-Performance Computing (HPC) Computer components CPU : Central Processing Unit CPU cores : individual processing units within a Storage : Disk drives HDD : Hard Disk Drive SSD : Solid
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC On-class STAT8330 Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu Slides courtesy: Zhoufei Hou 1 Outline What
More informationINTRODUCTION TO THE CLUSTER
INTRODUCTION TO THE CLUSTER WHAT IS A CLUSTER? A computer cluster consists of a group of interconnected servers (nodes) that work together to form a single logical system. COMPUTE NODES GATEWAYS SCHEDULER
More informationIntroduction to PICO Parallel & Production Enviroment
Introduction to PICO Parallel & Production Enviroment Mirko Cestari m.cestari@cineca.it Alessandro Marani a.marani@cineca.it Domenico Guida d.guida@cineca.it Nicola Spallanzani n.spallanzani@cineca.it
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC On-class PBIO/BINF8350 Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? What
More informationIntroduction to GALILEO
November 27, 2016 Introduction to GALILEO Parallel & production environment Mirko Cestari m.cestari@cineca.it Alessandro Marani a.marani@cineca.it SuperComputing Applications and Innovation Department
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? What is HPC Concept? What is
More informationHigh Performance Computing (HPC) Using zcluster at GACRC
High Performance Computing (HPC) Using zcluster at GACRC On-class STAT8060 Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC?
More informationIntroduction to the Cluster
Follow us on Twitter for important news and updates: @ACCREVandy Introduction to the Cluster Advanced Computing Center for Research and Education http://www.accre.vanderbilt.edu The Cluster We will be
More informationUsing the IBM Opteron 1350 at OSC. October 19-20, 2010
Using the IBM Opteron 1350 at OSC October 19-20, 2010 Table of Contents Hardware Overview The Linux Operating System User Environment and Storage 2 Hardware Overview Hardware introduction Login node configuration
More informationIntroduction to GALILEO
Introduction to GALILEO Parallel & production environment Mirko Cestari m.cestari@cineca.it Alessandro Marani a.marani@cineca.it Alessandro Grottesi a.grottesi@cineca.it SuperComputing Applications and
More informationIntroduction to GALILEO
Introduction to GALILEO Parallel & production environment Mirko Cestari m.cestari@cineca.it Alessandro Marani a.marani@cineca.it Domenico Guida d.guida@cineca.it Maurizio Cremonesi m.cremonesi@cineca.it
More informationA Brief Introduction to The Center for Advanced Computing
A Brief Introduction to The Center for Advanced Computing May 1, 2006 Hardware 324 Opteron nodes, over 700 cores 105 Athlon nodes, 210 cores 64 Apple nodes, 128 cores Gigabit networking, Myrinet networking,
More informationUsing the computational resources at the GACRC
An introduction to zcluster Georgia Advanced Computing Resource Center (GACRC) University of Georgia Dr. Landau s PHYS4601/6601 course - Spring 2017 What is GACRC? Georgia Advanced Computing Resource Center
More informationHPC Middle East. KFUPM HPC Workshop April Mohamed Mekias HPC Solutions Consultant. Agenda
KFUPM HPC Workshop April 29-30 2015 Mohamed Mekias HPC Solutions Consultant Agenda 1 Agenda-Day 1 HPC Overview What is a cluster? Shared v.s. Distributed Parallel v.s. Massively Parallel Interconnects
More informationHPC DOCUMENTATION. 3. Node Names and IP addresses:- Node details with respect to their individual IP addresses are given below:-
HPC DOCUMENTATION 1. Hardware Resource :- Our HPC consists of Blade chassis with 5 blade servers and one GPU rack server. a.total available cores for computing: - 96 cores. b.cores reserved and dedicated
More informationIntroduction to HPC Using zcluster at GACRC On-Class GENE 4220
Introduction to HPC Using zcluster at GACRC On-Class GENE 4220 Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu Slides courtesy: Zhoufei Hou 1 OVERVIEW GACRC
More informationIntroduction to Discovery.
Introduction to Discovery http://discovery.dartmouth.edu The Discovery Cluster 2 Agenda What is a cluster and why use it Overview of computer hardware in cluster Help Available to Discovery Users Logging
More informationBefore We Start. Sign in hpcxx account slips Windows Users: Download PuTTY. Google PuTTY First result Save putty.exe to Desktop
Before We Start Sign in hpcxx account slips Windows Users: Download PuTTY Google PuTTY First result Save putty.exe to Desktop Research Computing at Virginia Tech Advanced Research Computing Compute Resources
More informationIntroduction to Joker Cyber Infrastructure Architecture Team CIA.NMSU.EDU
Introduction to Joker Cyber Infrastructure Architecture Team CIA.NMSU.EDU What is Joker? NMSU s supercomputer. 238 core computer cluster. Intel E-5 Xeon CPUs and Nvidia K-40 GPUs. InfiniBand innerconnect.
More informationConnecting to Grace and using Stata from an Xinteractive perspective
Connecting to Grace and using Stata from an Xinteractive perspective Prior to using Grace you will need to register for an account. This can be done from the link below. We aim to setup all new accounts
More informationIntroduction to Discovery.
Introduction to Discovery http://discovery.dartmouth.edu The Discovery Cluster 2 Agenda What is a cluster and why use it Overview of computer hardware in cluster Help Available to Discovery Users Logging
More informationMinnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved.
Minnesota Supercomputing Institute Introduction to MSI Systems Andrew Gustafson The Machines at MSI Machine Type: Cluster Source: http://en.wikipedia.org/wiki/cluster_%28computing%29 Machine Type: Cluster
More informationIntroduction to High-Performance Computing (HPC)
Introduction to High-Performance Computing (HPC) Computer components CPU : Central Processing Unit cores : individual processing units within a CPU Storage : Disk drives HDD : Hard Disk Drive SSD : Solid
More informationIntroduction to CINECA HPC Environment
Introduction to CINECA HPC Environment 23nd Summer School on Parallel Computing 19-30 May 2014 m.cestari@cineca.it, i.baccarelli@cineca.it Goals You will learn: The basic overview of CINECA HPC systems
More informationIntroduction to the SHARCNET Environment May-25 Pre-(summer)school webinar Speaker: Alex Razoumov University of Ontario Institute of Technology
Introduction to the SHARCNET Environment 2010-May-25 Pre-(summer)school webinar Speaker: Alex Razoumov University of Ontario Institute of Technology available hardware and software resources our web portal
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu 1 Outline What is GACRC? What is HPC Concept? What
More informationEffective Use of CCV Resources
Effective Use of CCV Resources Mark Howison User Services & Support This talk... Assumes you have some familiarity with a Unix shell Provides examples and best practices for typical usage of CCV systems
More informationUsing a Linux System 6
Canaan User Guide Connecting to the Cluster 1 SSH (Secure Shell) 1 Starting an ssh session from a Mac or Linux system 1 Starting an ssh session from a Windows PC 1 Once you're connected... 1 Ending an
More informationHow to run applications on Aziz supercomputer. Mohammad Rafi System Administrator Fujitsu Technology Solutions
How to run applications on Aziz supercomputer Mohammad Rafi System Administrator Fujitsu Technology Solutions Agenda Overview Compute Nodes Storage Infrastructure Servers Cluster Stack Environment Modules
More informationThe GPU-Cluster. Sandra Wienke Rechen- und Kommunikationszentrum (RZ) Fotos: Christian Iwainsky
The GPU-Cluster Sandra Wienke wienke@rz.rwth-aachen.de Fotos: Christian Iwainsky Rechen- und Kommunikationszentrum (RZ) The GPU-Cluster GPU-Cluster: 57 Nvidia Quadro 6000 (29 nodes) innovative computer
More informationIntroduction to High Performance Computing (HPC) Resources at GACRC
Introduction to High Performance Computing (HPC) Resources at GACRC Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? Concept
More informationRWTH GPU-Cluster. Sandra Wienke March Rechen- und Kommunikationszentrum (RZ) Fotos: Christian Iwainsky
RWTH GPU-Cluster Fotos: Christian Iwainsky Sandra Wienke wienke@rz.rwth-aachen.de March 2012 Rechen- und Kommunikationszentrum (RZ) The GPU-Cluster GPU-Cluster: 57 Nvidia Quadro 6000 (29 nodes) innovative
More informationA Brief Introduction to The Center for Advanced Computing
A Brief Introduction to The Center for Advanced Computing February 8, 2007 Hardware 376 Opteron nodes, over 890 cores Gigabit networking, Myrinet networking, Infiniband networking soon Hardware: nyx nyx
More informationA Brief Introduction to The Center for Advanced Computing
A Brief Introduction to The Center for Advanced Computing November 10, 2009 Outline 1 Resources Hardware Software 2 Mechanics: Access Transferring files and data to and from the clusters Logging into the
More informationMinnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved.
Minnesota Supercomputing Institute Introduction to MSI for Physical Scientists Michael Milligan MSI Scientific Computing Consultant Goals Introduction to MSI resources Show you how to access our systems
More informationHigh Performance Computing (HPC) Prepared By: Abdussamad Muntahi Muhammad Rahman
High Performance Computing (HPC) Prepared By: Abdussamad Muntahi Muhammad Rahman 1 2 Introduction to High Performance Computing (HPC) Introduction High-speed computing. Originally pertaining only to supercomputers
More informationIntroduction to NCAR HPC. 25 May 2017 Consulting Services Group Brian Vanderwende
Introduction to NCAR HPC 25 May 2017 Consulting Services Group Brian Vanderwende Topics we will cover Technical overview of our HPC systems The NCAR computing environment Accessing software on Cheyenne
More informationOutline. March 5, 2012 CIRMMT - McGill University 2
Outline CLUMEQ, Calcul Quebec and Compute Canada Research Support Objectives and Focal Points CLUMEQ Site at McGill ETS Key Specifications and Status CLUMEQ HPC Support Staff at McGill Getting Started
More informationHPCC New User Training
High Performance Computing Center HPCC New User Training Getting Started on HPCC Resources Eric Rees, Ph.D. High Performance Computing Center Fall 2018 HPCC User Training Agenda HPCC User Training Agenda
More informationName Department/Research Area Have you used the Linux command line?
Please log in with HawkID (IOWA domain) Macs are available at stations as marked To switch between the Windows and the Mac systems, press scroll lock twice 9/27/2018 1 Ben Rogers ITS-Research Services
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu Slides courtesy: Zhoufei Hou OVERVIEW GACRC High Performance
More informationCluster Clonetroop: HowTo 2014
2014/02/25 16:53 1/13 Cluster Clonetroop: HowTo 2014 Cluster Clonetroop: HowTo 2014 This section contains information about how to access, compile and execute jobs on Clonetroop, Laboratori de Càlcul Numeric's
More informationParallel Computing at DESY Zeuthen. Introduction to Parallel Computing at DESY Zeuthen and the new cluster machines
Parallel Computing at DESY Zeuthen. Introduction to Parallel Computing at DESY Zeuthen and the new cluster machines Götz Waschk Technical Seminar, Zeuthen April 27, 2010 > Introduction > Hardware Infiniband
More informationOur new HPC-Cluster An overview
Our new HPC-Cluster An overview Christian Hagen Universität Regensburg Regensburg, 15.05.2009 Outline 1 Layout 2 Hardware 3 Software 4 Getting an account 5 Compiling 6 Queueing system 7 Parallelization
More informationIntroduction to High-Performance Computing (HPC)
Introduction to High-Performance Computing (HPC) Computer components CPU : Central Processing Unit cores : individual processing units within a CPU Storage : Disk drives HDD : Hard Disk Drive SSD : Solid
More informationIntroduction to the Cluster
Introduction to the Cluster Advanced Computing Center for Research and Education http://www.accre.vanderbilt.edu Follow us on Twitter for important news and updates: @ACCREVandy The Cluster We will be
More informationUsing Cartesius and Lisa. Zheng Meyer-Zhao - Consultant Clustercomputing
Zheng Meyer-Zhao - zheng.meyer-zhao@surfsara.nl Consultant Clustercomputing Outline SURFsara About us What we do Cartesius and Lisa Architectures and Specifications File systems Funding Hands-on Logging
More informationUsing Cartesius & Lisa
Using Cartesius & Lisa Introductory course for Cartesius & Lisa Jeroen Engelberts jeroen.engelberts@surfsara.nl Consultant Supercomputing Outline SURFsara About us What we do Cartesius and Lisa Architectures
More informationIntroduction to High Performance Computing Using Sapelo2 at GACRC
Introduction to High Performance Computing Using Sapelo2 at GACRC Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu 1 Outline High Performance Computing (HPC)
More informationThe RWTH Compute Cluster Environment
The RWTH Compute Cluster Environment Tim Cramer 29.07.2013 Source: D. Both, Bull GmbH Rechen- und Kommunikationszentrum (RZ) The RWTH Compute Cluster (1/2) The Cluster provides ~300 TFlop/s No. 32 in TOP500
More informationAdvanced Topics in High Performance Scientific Computing [MA5327] Exercise 1
Advanced Topics in High Performance Scientific Computing [MA5327] Exercise 1 Manfred Liebmann Technische Universität München Chair of Optimal Control Center for Mathematical Sciences, M17 manfred.liebmann@tum.de
More informationUL HPC Monitoring in practice: why, what, how, where to look
C. Parisot UL HPC Monitoring in practice: why, what, how, where to look 1 / 22 What is HPC? Best Practices Getting Fast & Efficient UL HPC Monitoring in practice: why, what, how, where to look Clément
More informationFrequently Asked Questions
Frequently Asked Questions Fabien Archambault Aix-Marseille Université 2012 F. Archambault (AMU) Rheticus: F.A.Q. 2012 1 / 13 1 Rheticus configuration 2 Front-end connection 3 Modules 4 OAR submission
More informationIntroduction to Discovery.
Introduction to Discovery http://discovery.dartmouth.edu March 2014 The Discovery Cluster 2 Agenda Resource overview Logging on to the cluster with ssh Transferring files to and from the cluster The Environment
More informationUniversity at Buffalo Center for Computational Research
University at Buffalo Center for Computational Research The following is a short and long description of CCR Facilities for use in proposals, reports, and presentations. If desired, a letter of support
More informationACEnet for CS6702 Ross Dickson, Computational Research Consultant 29 Sep 2009
ACEnet for CS6702 Ross Dickson, Computational Research Consultant 29 Sep 2009 What is ACEnet? Shared resource......for research computing... physics, chemistry, oceanography, biology, math, engineering,
More informationHPC Introductory Course - Exercises
HPC Introductory Course - Exercises The exercises in the following sections will guide you understand and become more familiar with how to use the Balena HPC service. Lines which start with $ are commands
More informationPACE. Instructional Cluster Environment (ICE) Orientation. Research Scientist, PACE
PACE Instructional Cluster Environment (ICE) Orientation Mehmet (Memo) Belgin, PhD Research Scientist, PACE www.pace.gatech.edu What is PACE A Partnership for an Advanced Computing Environment Provides
More informationUoW HPC Quick Start. Information Technology Services University of Wollongong. ( Last updated on October 10, 2011)
UoW HPC Quick Start Information Technology Services University of Wollongong ( Last updated on October 10, 2011) 1 Contents 1 Logging into the HPC Cluster 3 1.1 From within the UoW campus.......................
More informationGenius Quick Start Guide
Genius Quick Start Guide Overview of the system Genius consists of a total of 116 nodes with 2 Skylake Xeon Gold 6140 processors. Each with 18 cores, at least 192GB of memory and 800 GB of local SSD disk.
More informationLaohu cluster user manual. Li Changhua National Astronomical Observatory, Chinese Academy of Sciences 2011/12/26
Laohu cluster user manual Li Changhua National Astronomical Observatory, Chinese Academy of Sciences 2011/12/26 About laohu cluster Laohu cluster has 85 hosts, each host has 8 CPUs and 2 GPUs. GPU is Nvidia
More informationGraham vs legacy systems
New User Seminar Graham vs legacy systems This webinar only covers topics pertaining to graham. For the introduction to our legacy systems (Orca etc.), please check the following recorded webinar: SHARCNet
More informationIntroduction to HPC Using zcluster at GACRC
Introduction to HPC Using zcluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Suchitra Pakala pakala@uga.edu Slides courtesy: Zhoufei Hou 1 OVERVIEW GACRC High Performance
More informationUsing Sapelo2 Cluster at the GACRC
Using Sapelo2 Cluster at the GACRC New User Training Workshop Georgia Advanced Computing Resource Center (GACRC) EITS/University of Georgia Zhuofei Hou zhuofei@uga.edu 1 Outline GACRC Sapelo2 Cluster Diagram
More informationIntroduction to BioHPC
Introduction to BioHPC New User Training [web] [email] portal.biohpc.swmed.edu biohpc-help@utsouthwestern.edu 1 Updated for 2018-03-07 Overview Today we re going to cover: What is BioHPC? How do I access
More informationPACE. Instructional Cluster Environment (ICE) Orientation. Mehmet (Memo) Belgin, PhD Research Scientist, PACE
PACE Instructional Cluster Environment (ICE) Orientation Mehmet (Memo) Belgin, PhD www.pace.gatech.edu Research Scientist, PACE What is PACE A Partnership for an Advanced Computing Environment Provides
More informationIntroduction to Cheyenne. 12 January, 2017 Consulting Services Group Brian Vanderwende
Introduction to Cheyenne 12 January, 2017 Consulting Services Group Brian Vanderwende Topics we will cover Technical specs of the Cheyenne supercomputer and expanded GLADE file systems The Cheyenne computing
More informationIntel Manycore Testing Lab (MTL) - Linux Getting Started Guide
Intel Manycore Testing Lab (MTL) - Linux Getting Started Guide Introduction What are the intended uses of the MTL? The MTL is prioritized for supporting the Intel Academic Community for the testing, validation
More informationThe Why and How of HPC-Cloud Hybrids with OpenStack
The Why and How of HPC-Cloud Hybrids with OpenStack OpenStack Australia Day Melbourne June, 2017 Lev Lafayette, HPC Support and Training Officer, University of Melbourne lev.lafayette@unimelb.edu.au 1.0
More informationSuperMike-II Launch Workshop. System Overview and Allocations
: System Overview and Allocations Dr Jim Lupo CCT Computational Enablement jalupo@cct.lsu.edu SuperMike-II: Serious Heterogeneous Computing Power System Hardware SuperMike provides 442 nodes, 221TB of
More informationHPC system startup manual (version 1.20)
HPC system startup manual (version 1.20) Document change log Issue Date Change 1 12/1/2012 New document 2 10/22/2013 Added the information of supported OS 3 10/22/2013 Changed the example 1 for data dowonload
More informationUsing the Yale HPC Clusters
Using the Yale HPC Clusters Stephen Weston Robert Bjornson Yale Center for Research Computing Yale University Oct 2015 To get help Send an email to: hpc@yale.edu Read documentation at: http://research.computing.yale.edu/hpc-support
More informationMinnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved.
Minnesota Supercomputing Institute Introduction to Job Submission and Scheduling Andrew Gustafson Interacting with MSI Systems Connecting to MSI SSH is the most reliable connection method Linux and Mac
More informationPACE Orientation. Research Scientist, PACE
PACE Orientation Mehmet (Memo) Belgin, PhD Research Scientist, PACE www.pace.gatech.edu What is PACE A Partnership for an Advanced Computing Environment Provides faculty and researchers vital tools to
More informationIntroduction to CINECA Computer Environment
Introduction to CINECA Computer Environment Today you will learn... Basic commands for UNIX environment @ CINECA How to submitt your job to the PBS queueing system on Eurora Tutorial #1: Example: launch
More informationÜbung zur Vorlesung Architektur paralleler Rechnersysteme
Übung zur Vorlesung Architektur paralleler Rechnersysteme SoSe 17 L.079.05814 www.uni-paderborn.de/pc2 Architecture of Parallel Computer Systems SoSe 17 J.Simon 1 Overview Computer Systems Test Cluster
More informationIntroduction to HPC Using the New Cluster at GACRC
Introduction to HPC Using the New Cluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? What is the new cluster
More informationIntroduction to the NCAR HPC Systems. 25 May 2018 Consulting Services Group Brian Vanderwende
Introduction to the NCAR HPC Systems 25 May 2018 Consulting Services Group Brian Vanderwende Topics to cover Overview of the NCAR cluster resources Basic tasks in the HPC environment Accessing pre-built
More informationHPC Resources at Lehigh. Steve Anthony March 22, 2012
HPC Resources at Lehigh Steve Anthony March 22, 2012 HPC at Lehigh: Resources What's Available? Service Level Basic Service Level E-1 Service Level E-2 Leaf and Condor Pool Altair Trits, Cuda0, Inferno,
More informationXSEDE New User Training. Ritu Arora November 14, 2014
XSEDE New User Training Ritu Arora Email: rauta@tacc.utexas.edu November 14, 2014 1 Objectives Provide a brief overview of XSEDE Computational, Visualization and Storage Resources Extended Collaborative
More informationHow to Use a Supercomputer - A Boot Camp
How to Use a Supercomputer - A Boot Camp Shelley Knuth Peter Ruprecht shelley.knuth@colorado.edu peter.ruprecht@colorado.edu www.rc.colorado.edu Outline Today we will discuss: Who Research Computing is
More informationTech Computer Center Documentation
Tech Computer Center Documentation Release 0 TCC Doc February 17, 2014 Contents 1 TCC s User Documentation 1 1.1 TCC SGI Altix ICE Cluster User s Guide................................ 1 i ii CHAPTER 1
More informationLSF at SLAC. Using the SIMES Batch Cluster. Neal Adams. Stanford Linear Accelerator Center
LSF at SLAC Using the SIMES Batch Cluster Neal Adams Stanford Linear Accelerator Center neal@slac.stanford.edu Useful LSF Commands bsub submit a batch job to LSF bjobs display batch job information bkill
More informationCrash Course in High Performance Computing
Crash Course in High Performance Computing Cyber-Infrastructure Days October 24, 2013 Dirk Colbry colbrydi@msu.edu Research Specialist Institute for Cyber-Enabled Research https://wiki.hpcc.msu.edu/x/qamraq
More informationCornell Theory Center 1
Cornell Theory Center Cornell Theory Center (CTC) is a high-performance computing and interdisciplinary research center at Cornell University. Scientific and engineering research projects supported by
More informationFor Dr Landau s PHYS8602 course
For Dr Landau s PHYS8602 course Shan-Ho Tsai (shtsai@uga.edu) Georgia Advanced Computing Resource Center - GACRC January 7, 2019 You will be given a student account on the GACRC s Teaching cluster. Your
More informationARMINIUS Brief Instructions
ARMINIUS Brief Instructions Version 19.12.2017 University of Paderborn Paderborn Center for Parallel Computing Warburger Str. 100, D-33098 Paderborn http://pc2.uni-paderborn.de/ 2 ARMINIUS BRIEF INSTRUCTIONS
More informationCOMP Superscalar. COMPSs at BSC. Supercomputers Manual
COMP Superscalar COMPSs at BSC Supercomputers Manual Version: 2.4 November 9, 2018 This manual only provides information about the COMPSs usage at MareNostrum. Specifically, it details the available COMPSs
More informationHIGH PERFORMANCE COMPUTING (PLATFORMS) SECURITY AND OPERATIONS
HIGH PERFORMANCE COMPUTING (PLATFORMS) SECURITY AND OPERATIONS AT PITT Kim F. Wong Center for Research Computing SAC-PA, June 22, 2017 Our service The mission of the Center for Research Computing is to
More informationIntroduction to HPC Resources and Linux
Introduction to HPC Resources and Linux Burak Himmetoglu Enterprise Technology Services & Center for Scientific Computing e-mail: bhimmetoglu@ucsb.edu Paul Weakliem California Nanosystems Institute & Center
More informationCompiling applications for the Cray XC
Compiling applications for the Cray XC Compiler Driver Wrappers (1) All applications that will run in parallel on the Cray XC should be compiled with the standard language wrappers. The compiler drivers
More informationCerebro Quick Start Guide
Cerebro Quick Start Guide Overview of the system Cerebro consists of a total of 64 Ivy Bridge processors E5-4650 v2 with 10 cores each, 14 TB of memory and 24 TB of local disk. Table 1 shows the hardware
More informationIntroduction to BioHPC New User Training
Introduction to BioHPC New User Training [web] [email] portal.biohpc.swmed.edu biohpc-help@utsouthwestern.edu 1 Updated for 2018-04-04 Overview Today we re going to cover: What is BioHPC? How do I access
More informationCluster Network Products
Cluster Network Products Cluster interconnects include, among others: Gigabit Ethernet Myrinet Quadrics InfiniBand 1 Interconnects in Top500 list 11/2009 2 Interconnects in Top500 list 11/2008 3 Cluster
More informationRunning Applications on The Sheffield University HPC Clusters
Running Applications on The Sheffield University HPC Clusters Deniz Savas dsavas.staff.sheffield.ac.uk June 2017 Topics 1. Software on an HPC system 2. Available Applications 3. Available Development Tools
More informationIntroduction to Unix Environment: modules, job scripts, PBS. N. Spallanzani (CINECA)
Introduction to Unix Environment: modules, job scripts, PBS N. Spallanzani (CINECA) Bologna PATC 2016 In this tutorial you will learn... How to get familiar with UNIX environment @ CINECA How to submit
More informationCSC Supercomputing Environment
CSC Supercomputing Environment Jussi Enkovaara Slides by T. Zwinger, T. Bergman, and Atte Sillanpää CSC Tieteen tietotekniikan keskus Oy CSC IT Center for Science Ltd. CSC IT Center for Science Ltd. Services:
More informationIntroduction Workshop 11th 12th November 2013
Introduction Workshop 11th 12th November Lecture II: Access and Batchsystem Dr. Andreas Wolf Gruppenleiter Hochleistungsrechnen Hochschulrechenzentrum Overview Access and Requirements Software packages
More information