MAKING CONTAINERS EASIER WITH HPC CONTAINER MAKER. Scott McMillan September 2018
|
|
- Peregrine Nicholson
- 5 years ago
- Views:
Transcription
1 MAKING CONTAINERS EASIER WITH HPC CONTAINER MAKER Scott McMillan September 2018
2 NVIDIA GPU CLOUD (NGC) Simple Access to Ready to-run, GPU-Accelerated Software Discover 35 GPU-Accelerated Containers Deep learning, HPC applications, NVIDIA HPC visualization tools, and partner applications Innovate in Minutes, Not Weeks Get up and running quickly and reduce complexity Access from Anywhere Containers run on supported cloud providers, NVIDIA DGX Systems, and PCs with NVIDIA Volta or Pascal architecture GPUs 2
3 HPC APP CONTAINERS ON NGC CANDLE CHROMA LATTICE MILC MICROBES PIConGPU BigDFT GAMESS GROMACS LAMMPS NAMD RELION PGI RAPID CONTAINER ADDITION RAPID USER ADOPTION 3
4 GET STARTED TODAY WITH NGC Sign Up and Access Containers for Free To learn more about all of the GPUaccelerated software from NGC, visit: nvidia.com/cloud To sign up or explore NGC, visit: ngc.nvidia.com 4
5 WHAT IF A CONTAINER IMAGE IS NOT AVAILABLE FROM NGC? 5
6 TYPICAL BARE METAL WORKFLOW Login to system (e.g., CentOS 7 with Mellanox OFED 3.4) $ module load PrgEnv/GCC+OpenMPI $ module load cuda/9.0 $ module load gcc $ module load openmpi/ What is the equivalent container workflow? Steps to build application Result: application binary suitable for that particular bare metal system 6
7 CONTAINER WORKFLOW Login to system (e.g., CentOS 7 with Mellanox OFED 3.4) FROM nvidia/cuda:9.0-devel-centos7 $ module load PrgEnv/GCC+OpenMPI $ module load cuda/9.0 $ module load gcc $ module load openmpi/ Steps to build application Result: application binary suitable for that particular bare metal system 7
8 OPENMPI DOCKERFILE VARIANTS Real examples which one should you use? RUN apt-get update \ && apt-get install -y --no-install-recommends \ libopenmpi-dev \ openmpi-bin \ openmpi-common \ && rm -rf /var/lib/apt/lists/* ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib/openmpi/lib RUN OPENMPI_VERSION=3.0.0 && \ wget -q -O - mpi.org/software/ompi/v3.0/downloads/openmpi- ${OPENMPI_VERSION}.tar.gz tar -xzf - && \ cd openmpi-${openmpi_version} && \./configure --enable-orterun-prefix-by-default --with-cuda -- with-verbs \ --prefix=/usr/local/mpi --disable-getpwuid && \ make -j"$(nproc)" install && \ cd.. && rm -rf openmpi-${openmpi_version} && \ echo "/usr/local/mpi/lib" >> /etc/ld.so.conf.d/openmpi.conf && ldconfig ENV PATH /usr/local/mpi/bin:$path COPY openmpi /usr/local/openmpi WORKDIR /usr/local/openmpi RUN /bin/bash -c "source /opt/pgi/license.txt && CC=pgcc CXX=pgc++ F77=pgf77 FC=pgf90./configure --with-cuda -- prefix=/usr/local/openmpi RUN /bin/bash -c "source /opt/pgi/license.txt && make all install" A B C RUN mkdir /logs RUN wget -nv && \ D tar -xzf openmpi tar.gz && \ cd openmpi-*&&./configure --with-cuda=/usr/local/cuda \ --enable-mpi-cxx --prefix=/usr 2>&1 tee /logs/openmpi_config && \ make -j 32 2>&1 tee /logs/openmpi_make && make install 2>&1 tee /logs/openmpi_install && cd /tmp \ && rm -rf openmpi-* WORKDIR /tmp ADD /tmp RUN tar -xzf openmpi tar.gz && \ cd openmpi-*&&./configure --with-cuda=/usr/local/cuda \ --enable-mpi-cxx --prefix=/usr && \ make -j 32 && make install && cd /tmp \ && rm -rf openmpi-* RUN wget -q -O - tar - xjf - && \ cd openmpi && \ CXX=pgc++ CC=pgcc FC=pgfortran F77=pgfortran./configure -- prefix=/usr/local/openmpi --with-cuda=/usr/local/cuda --with-verbs --disable-getpwuid && \ make -j4 install && \ rm -rf /openmpi E F
9 HPC CONTAINER MAKER Tool for creating HPC application Dockerfiles and Singularity recipe files You will still need to build the container images Makes it easier to create HPC application containers by encapsulating best practices into building blocks Open source (Apache 2.0) pip install hpccm 9
10 BUILDING BLOCKS TO CONTAINER RECIPES Stage0 += openmpi() hpccm Generate corresponding Dockerfile instructions for the HPCCM building block # OpenMPI version RUN yum install -y \ bzip2 file hwloc make openssh-clients perl tar wget && \ rm -rf /var/cache/yum/* RUN mkdir -p /var/tmp && wget -q -nc --no-check-certificate -P /var/tmp && \ mkdir -p /var/tmp && tar -x -f /var/tmp/openmpi tar.bz2 -C /var/tmp -j && \ cd /var/tmp/openmpi && CC=gcc CXX=g++ F77=gfortran F90=gfortran FC=gfortran./configure -- prefix=/usr/local/openmpi --disable-getpwuid --enable-orterun-prefix-by-default --with-cuda=/usr/local/cuda --with-verbs && \ make -j4 && \ make -j4 install && \ rm -rf /var/tmp/openmpi tar.bz2 /var/tmp/openmpi ENV LD_LIBRARY_PATH=/usr/local/openmpi/lib:$LD_LIBRARY_PATH \ PATH=/usr/local/openmpi/bin:$PATH 11
11 EQUIVALENT HPC CONTAINER MAKER WORKFLOW Login to system (e.g., CentOS 7 with Mellanox OFED 3.4) Stage0 += baseimage(image='nvidia/cuda:9.0-devel-centos7') Stage0 += mlnx_ofed(version= ) $ module load PrgEnv/GCC+OpenMPI $ module load cuda/9.0 $ module load gcc $ module load openmpi/ Steps to build application Result: application binary suitable for that particular bare metal system Stage0 += gnu() Stage0 += openmpi(version='1.10.7') Steps to build application Result: portable application container capable of running on any system 12
12 HIGHER LEVEL ABSTRACTION Building blocks to encapsulate best practices, avoid duplication, separation of concerns openmpi(check=false, # run make check? configure_opts=['--disable-getpwuid', ], # configure command line options cuda=true, # enable CUDA? directory='', # path to source in build context infiniband=true, # enable InfiniBand? ospackages=['bzip2', 'file', 'hwloc', ], # Linux distribution prerequisites prefix='/usr/local/openmpi', # install location toolchain=toolchain(), # compiler to use version='3.0.0') # version to download Examples: openmpi(prefix='/opt/openmpi', version=' ) openmpi(infiniband=false, toolchain=pgi.toolchain) Full building block documentation can be found in RECIPES.md 13
13 INCLUDED BUILDING BLOCKS As of version 18.8 CUDA is included via the base image, see Compilers GNU PGI Intel (BYOL) HPC libraries Charm++ FFTW, MKL, OpenBLAS CGNS, HDF5, NetCDF, PnetCDF Miscellaneous Boost CMake InfiniBand Mellanox OFED OFED (upstream) MPI Intel MPI MVAPICH2, MVAPICH2-GDR OpenMPI Package management packages (Linux distro aware), or apt_get yum 14
14 RECIPES INCLUDED WITH CONTAINER MAKER HPC Base Recipes: Ubuntu CentOS 7 GNU compilers PGI compilers OpenMPI MVAPICH2 2.3rc2 CUDA 9.0 FFTW HDF Mellanox OFED Python 2 and 3 15
15 BUILDING APPLICATION CONTAINER IMAGES WITH HPCCM Container template generator 1. Generate the desired container template starting from one of the HPC base recipes included with HPCCM $ hpccm --recipe recipes/hpcbase-gnu-openmpi.py --single-stage --format docker > Dockerfile $ hpccm --recipe recipes/hpcbase-gnu-openmpi.py --single-stage --format singularity > Singularity 2. Edit Dockerfile to add application build instructions 3. Build the container image $ docker build -t myapp -f Dockerfile. 2. Edit Singularity recipe file to add application build instructions 3. Build the container image $ sudo singularity build myapp.simg Singularity 16
16 BUILDING APPLICATION CONTAINER IMAGES WITH HPCCM HPC Base Images 1. Generate the desired container base image starting from one of the HPC base recipes included with HPCCM $ hpccm --recipe recipes/hpcbase-gnu-openmpi.py --single-stage --format docker > Dockerfile $ docker build -t hpcbase-gnu-openmpi -f Dockerfile. 2. Create Dockerfile referencing the HPC base image and containing the application build instructions FROM hpcbase-gnu-openmpi 3. Build the container image $ docker build -t myapp -f Dockerfile. 2. Create Singularity recipe file referencing the HPC base image and containing the application build instructions BootStrap: Docker From: hpcbase-gnu-openmpi 3. Build the container image $ sudo singularity build myapp.simg Singularity 17
17 BUILDING APPLICATION CONTAINER IMAGES WITH HPCCM Application recipe $ cat mpi-bandwidth.py # Setup GNU compilers, Mellanox OFED, and OpenMPI Stage0 += baseimage(image='nvidia/cuda:9.0-devel-centos7') Stage0 += gnu() Stage0 += mlnx_ofed(version=' ') Stage0 += openmpi(version='3.0.0') # Application build steps below # Using MPI Bandwidth from Lawrence Livermore National Laboratory (LLNL) as an example # 1. Copy source code into the container Stage0 += copy(src='mpi_bandwidth.c', dest='/tmp/mpi_bandwidth.c') # 2. Build the application Stage0 += shell(commands=['mkdir -p /workspace', 'mpicc -o /workspace/mpi_bandwidth /tmp/mpi_bandwidth.c ]) $ hpccm --recipe mpi-bandwidth.py --format 18
18 BUILDING APPLICATION CONTAINERS IMAGES WITH HPCCM Application recipes Dockerfile Singularity recipe file CUDA CentOS base BootStrap: docker image FROM nvidia/cuda:9.0-devel-centos7 From: nvidia/cuda:9.0-devel-centos7 %post. /.singularity.d/env/10-docker.sh # GNU compiler RUN yum install -y \ GNU compiler gcc \ # GNU gcc-c++ \ %post gcc-gfortran && \ yum install -y \ rm -rf /var/cache/yum/* gcc \ gcc-c++ \ gcc-gfortran # Mellanox OFED version rm -rf /var/cache/yum/* RUN yum install -y \ libnl \ libnl3 \ # Mellanox OFED version numactl-libs \ %post wget && \ yum install -y \ rm -rf /var/cache/yum/* libnl \ RUN mkdir -p /var/tmp && wget -q -nc --no-check-certificate -P /var/tmp Mellanox OFED libnl3 \ x86_64.tgz && \ numactl-libs \ mkdir -p /var/tmp && tar -x -f /var/tmp/mlnx_ofed_linux rhel7.2-x86_64.tgz -C /var/tmp -z && \ wget rpm --install /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibverbs-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2- rm -rf /var/cache/yum/* x86_64/rpms/libibverbs-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibverbs-utils-*.x86_64.rpm /var/tmp/mlnx_ofed_linux %post rhel7.2-x86_64/rpms/libibmad-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibmad-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux mkdir -p /var/tmp && wget -q -nc --no-check-certificate -P /var/tmp rhel7.2-x86_64/rpms/libibumad-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibumad-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux x86_64.tgz rhel7.2-x86_64/rpms/libmlx4-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libmlx5-*.x86_64.rpm && \ mkdir -p /var/tmp && tar -x -f /var/tmp/mlnx_ofed_linux rhel7.2-x86_64.tgz -C /var/tmp -z rm -rf /var/tmp/mlnx_ofed_linux rhel7.2-x86_64.tgz /var/tmp/mlnx_ofed_linux rhel7.2-x86_64 rpm --install /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibverbs-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2- x86_64/rpms/libibverbs-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibverbs-utils-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibmad-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibmad-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux # OpenMPI version rhel7.2-x86_64/rpms/libibumad-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libibumad-devel-*.x86_64.rpm /var/tmp/mlnx_ofed_linux RUN yum install -y \ rhel7.2-x86_64/rpms/libmlx4-*.x86_64.rpm /var/tmp/mlnx_ofed_linux rhel7.2-x86_64/rpms/libmlx5-*.x86_64.rpm bzip2 \ rm -rf /var/tmp/mlnx_ofed_linux rhel7.2-x86_64.tgz /var/tmp/mlnx_ofed_linux rhel7.2-x86_64 file \ hwloc \ make \ # OpenMPI version openssh-clients \ %post perl \ yum install -y \ tar \ bzip2 \ wget && \ OpenMPI file \ rm -rf /var/cache/yum/* hwloc \ RUN mkdir -p /var/tmp && wget -q -nc --no-check-certificate -P /var/tmp && \ make \ mkdir -p /var/tmp && tar -x -f /var/tmp/openmpi tar.bz2 -C /var/tmp -j && \ openssh-clients \ cd /var/tmp/openmpi &&./configure --prefix=/usr/local/openmpi --disable-getpwuid --enable-orterun-prefix-by-default --with-cuda --with-verbs && \ perl \ make -j4 && \ tar \ make -j4 install && \ wget rm -rf /var/tmp/openmpi tar.bz2 /var/tmp/openmpi rm -rf /var/cache/yum/* ENV LD_LIBRARY_PATH=/usr/local/openmpi/lib:$LD_LIBRARY_PATH \ %post PATH=/usr/local/openmpi/bin:$PATH mkdir -p /var/tmp && wget -q -nc --no-check-certificate -P /var/tmp mkdir -p /var/tmp && tar -x -f /var/tmp/openmpi tar.bz2 -C /var/tmp -j cd /var/tmp/openmpi &&./configure --prefix=/usr/local/openmpi --disable-getpwuid --enable-orterun-prefix-by-default --with-cuda --with-verbs COPY mpi_bandwidth.c /tmp/mpi_bandwidth.c make -j4 make -j4 install rm -rf /var/tmp/openmpi tar.bz2 /var/tmp/openmpi RUN mkdir -p /workspace && \ %environment mpicc -o /workspace/mpi_bandwidth /tmp/mpi_bandwidth.c export LD_LIBRARY_PATH=/usr/local/openmpi/lib:$LD_LIBRARY_PATH export PATH=/usr/local/openmpi/bin:$PATH %post export LD_LIBRARY_PATH=/usr/local/openmpi/lib:$LD_LIBRARY_PATH export PATH=/usr/local/openmpi/bin:$PATH MPI Bandwidth %files mpi_bandwidth.c /tmp/mpi_bandwidth.c %post mkdir -p /workspace mpicc -o /workspace/mpi_bandwidth /tmp/mpi_bandwidth.c 19
19 RECIPES INCLUDED WITH CONTAINER MAKER HPC Base Recipes: Ubuntu GNU compilers CentOS 7 PGI compilers Reference Recipes: OpenMPI MVAPICH2 2.3rc2 CUDA 9.0 FFTW HDF Mellanox OFED Python 2 and 3 MPI Bandwidth GROMACS MILC 20
20 CONTAINER SPECIFICATION FORMAT ABSTRACTION Single source to either Docker or Singularity HPC Container Maker Dockerfile Singularity recipe file baseimage(image='ubuntu:16.04') FROM ubuntu:16.04 Bootstrap: docker From: ubuntu:16.04 shell(commands=['a', 'b', 'c']) RUN a && \ b && \ c %post a b c copy(src='a', dest='b') COPY a b %files a b Recommendation: avoid using primitives when a building block is available 21
21 CONTAINER SPECIFICATION FORMAT ABSTRACTION Single source supporting either Ubuntu or CentOS/RHEL base images HPC Container Maker packages(ospackages=['gcc']) apt_get(ospackages=['g++']) Ubuntu base image baseimage(image='ubuntu:16.04') RUN apt-get update y && apt-get install y --no-install-recommends \ gcc && \ rm rf /var/lib/apt/lists/* RUN apt-get update y && apt-get install y --no-install-recommends \ g++ && \ rm rf /var/lib/apt/lists/* yum(ospackages=['gcc-c++'])!!! packages(apt=['g++'], yum=['gcc-c++']) RUN apt-get update y && apt-get install y --no-install-recommends \ g++ && \ rm rf /var/lib/apt/lists/* CentOS base image baseimage(image='centos:7') RUN yum install y \ gcc && \ rm -rf /var/cache/yum/*!!! RUN yum install y \ gcc-c++ && \ rm -rf /var/cache/yum/* RUN yum install y \ gcc-c++ && \ rm -rf /var/cache/yum/* Recommendation: always use the packages building block to install distro packages 22
22 USER ARGUMENTS Easy way to enable configurable recipes $ cat recipes/examples/userargs.py # Set the image tag based on the specified version (default to 9.1) cuda_version = USERARG.get('cuda', '9.1') image = 'nvidia/cuda:{}-devel-ubuntu16.04'.format(cuda_version) Stage0.baseimage(image) # Set the OpenMPI version based on the specified version (default to 3.0.0) ompi_version = USERARG.get('ompi', '3.0.0') ompi = openmpi(infiniband=false, version=ompi_version) Stage0 += ompi $ hpccm --recipe recipes/examples/userargs.py --userarg cuda=9.0 ompi=2.1.2 $ hpccm --recipe recipes/examples/userargs.py --userarg cuda=9.2 23
23 MULTISTAGE RECIPES Only supported by Docker $ cat recipes/examples/multistage.py # Devel stage base image Stage0.name = 'devel' Stage0.baseimage('nvidia/cuda:9.0-devel-ubuntu16.04') # Install compilers (upstream) g = gnu() Stage0 += g # Build FFTW using all default options f = fftw() Stage0 += f # Runtime stage base image Stage1.baseimage('nvidia/cuda:9.0-runtime-ubuntu16.04') # Compiler runtime (upstream) Stage1 += g.runtime() # Copy the FFTW build from the devel stage and setup the runtime environment. # The _from option is not necessary, but increases clarity. Stage1 += f.runtime(_from=stage0.name) 24
24 SUMMARY HPC Container Maker simplifies creating a container specification file Best practices used by default Building blocks included for many popular HPC components Flexibility and power of Python Supports Docker (and other frameworks that use Dockerfiles) and Singularity Open source: pip install hpccm 25
25 BACKUP 26
26 BIG PICTURE 27
27 BUILDING AN HPC APPLICATION IMAGE Analogous workflows for Singularity 1. Use the HPC base image as your starting point Base recipe Dockerfile Base image App Dockerfile 2. Generate a Dockerfile from the HPC base recipe Dockerfile and manually edit it to add the steps to build your application Base recipe Dockerfile App Dockerfile 3. Copy the HPC base recipe file and add your application build steps to the recipe Base recipe App recipe See 28
28 FULL PROGRAMMING LANGUAGE AVAILABLE Conditional branching, validation, etc. # get and validate precision VALID_PRECISION = [ single, double, mixed ] precision = USERARG.get( LAMMPS_PRECISION, single ) if precision not in VALID_PRECISION: raise ValueError( Invalid precision ) Stage0 += shell(commands=[ make f Makefile.linux.{}.format(precision), ]) $ hpccm --userarg LAMMPS_PRECISION=single Courtesy of Logan Herche 29
29
HPC IN CONTAINERS: WHY CONTAINERS, WHY HPC, WHY NVIDIA GTC 18, S8642, Monday March 26, 11am
HPC IN CONTAINERS: WHY CONTAINERS, WHY HPC, WHY NVIDIA GTC 18, S8642, Monday March 26, 11am CJ Newburn, HPC Architect, NVIDIA Compute SW Principal Engineer OUTLINE Motivation What NVIDIA is doing Collaborations
More informationContainers. Pablo F. Ordóñez. October 18, 2018
Containers Pablo F. Ordóñez October 18, 2018 1 Welcome Song: Sola vaya Interpreter: La Sonora Ponceña 2 Goals Containers!= ( Moby-Dick ) Containers are part of the Linux Kernel Make your own container
More informationShifter and Singularity on Blue Waters
Shifter and Singularity on Blue Waters Maxim Belkin June 7, 2018 A simplistic view of a scientific application DATA RESULTS My Application Received an allocation on Blue Waters! DATA RESULTS My Application
More informationShifter: Fast and consistent HPC workflows using containers
Shifter: Fast and consistent HPC workflows using containers CUG 2017, Redmond, Washington Lucas Benedicic, Felipe A. Cruz, Thomas C. Schulthess - CSCS May 11, 2017 Outline 1. Overview 2. Docker 3. Shifter
More informationShifter on Blue Waters
Shifter on Blue Waters Why Containers? Your Computer Another Computer (Supercomputer) Application Application software libraries System libraries software libraries System libraries Why Containers? Your
More informationLinux Essentials Objectives Topics:
Linux Essentials Linux Essentials is a professional development certificate program that covers basic knowledge for those working and studying Open Source and various distributions of Linux. Exam Objectives
More informationBright Cluster Manager: Using the NVIDIA NGC Deep Learning Containers
Bright Cluster Manager: Using the NVIDIA NGC Deep Learning Containers Technical White Paper Table of Contents Pre-requisites...1 Setup...2 Run PyTorch in Kubernetes...3 Run PyTorch in Singularity...4 Run
More informationPresented By: Gregory M. Kurtzer HPC Systems Architect Lawrence Berkeley National Laboratory CONTAINERS IN HPC WITH SINGULARITY
Presented By: Gregory M. Kurtzer HPC Systems Architect Lawrence Berkeley National Laboratory gmkurtzer@lbl.gov CONTAINERS IN HPC WITH SINGULARITY A QUICK REVIEW OF THE LANDSCAPE Many types of virtualization
More informationNGC CONTAINER. DU _v02 November User Guide
NGC CONTAINER DU-08812-001_v02 November 2017 User Guide TABLE OF CONTENTS Chapter 1. Docker Containers... 1 1.1. What Is A Docker Container?... 1 1.2. Why Use A Container?... 2 Chapter 2. Prerequisites...3
More informationSingularity: container formats
Singularity Easy to install and configure Easy to run/use: no daemons no root works with scheduling systems User outside container == user inside container Access to host resources Mount (parts of) filesystems
More informationDocker & why we should use it
Docker & why we should use it Vicențiu Ciorbaru Software Engineer @ MariaDB Foundation * * Agenda What is Docker? What Docker brings to the table compared to KVM and Vagrant? Docker tutorial What is Docker
More informationUSING NGC WITH YOUR NVIDIA TITAN PC
USING NGC WITH YOUR NVIDIA TITAN PC DU-08832-001_v02 December 2017 Setup Guide TABLE OF CONTENTS Chapter 1. Introduction...1 Chapter 2. Installing the NVIDIA Driver... 2 2.1. Setting Up the Driver Repository...
More informationCentre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules. Singularity overview. Vanessa HAMAR
Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules Singularity overview Vanessa HAMAR Disclaimer } The information in this presentation was compiled from different
More informationBuilding and Installing Software
Building and Installing Software On UD HPC Community Clusters William Totten Network & Systems Services Conventions when Installing Software Installation base directory /opt/shared /home/work/ lab/sw/name/version
More informationOptimizing Docker Images
Optimizing Docker Images Brian DeHamer - CenturyLink Labs bdehamer CenturyLinkLabs @bdehamer @centurylinklabs Overview Images & Layers Minimizing Image Size Leveraging the Image Cache Dockerfile Tips
More informationTool installation for PMC-MC-X2/X4 with P2020 series processor
DYNAMIC ENGINEERING 150 DuBois, Suite C Santa Cruz, CA 95060 (831) 457-8891 Fax (831) 457-4793 http://www.dyneng.com sales@dyneng.com Est. 1988 Tool installation for PMC-MC-X2/X4 with P2020 series processor
More informationDeploying (community) codes. Martin Čuma Center for High Performance Computing University of Utah
Deploying (community) codes Martin Čuma Center for High Performance Computing University of Utah m.cuma@utah.edu Outline What codes our users need Prerequisites Who installs what? Community codes Commercial
More informationIntroduction to Containers. Martin Čuma Center for High Performance Computing University of Utah
Introduction to Containers Martin Čuma Center for High Performance Computing University of Utah m.cuma@utah.edu Overview Why do we want to use containers? Containers basics Prepare your computer for containers
More informationCompile and run RAPID on the Microsoft Azure Cloud
Compile and run RAPID on the Microsoft Azure Cloud By Cédric H. David (cedric.david@jpl.nasa.gov), 09 Jul 2014, updated 05 Aug 2014, 08 Sep 2014, 04 Nov 2014, 21 Jan 2015 Introduction Foreword This tutorial
More informationMellanox GPUDirect RDMA User Manual
Mellanox GPUDirect RDMA User Manual Rev 1.0 www.mellanox.com NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS-IS
More informationcget Documentation Release Paul Fultz II
cget Documentation Release 0.1.0 Paul Fultz II Jun 27, 2018 Contents 1 Introduction 3 1.1 Installing cget.............................................. 3 1.2 Quickstart................................................
More informationNexus Application Development - SDK
This chapter contains the following sections: About the Cisco SDK, page 1 Installing the SDK, page 1 Procedure for Installation and Environment Initialization, page 2 Using the SDK to Build Applications,
More informationMellanox GPUDirect RDMA User Manual
Mellanox GPUDirect RDMA User Manual Rev 1.2 www.mellanox.com NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES AS-IS
More informationPREPARING TO USE CONTAINERS
PREPARING TO USE CONTAINERS DU-08786-001_v001 May 2018 Getting Started Guide TABLE OF CONTENTS Chapter Introduction To Docker And Containers...1 Chapter 2. Preparing Your DGX System For Use With nvidia-docker...
More informationIBM Deep Learning Solutions
IBM Deep Learning Solutions Reference Architecture for Deep Learning on POWER8, P100, and NVLink October, 2016 How do you teach a computer to Perceive? 2 Deep Learning: teaching Siri to recognize a bicycle
More informationEvaluating Shifter for HPC Applications Don Bahls Cray Inc.
Evaluating Shifter for HPC Applications Don Bahls Cray Inc. Agenda Motivation Shifter User Defined Images (UDIs) provide a mechanism to access a wider array of software in the HPC environment without enduring
More informationSingularity: Containers for High-Performance Computing. Grigory Shamov Nov 21, 2017
Singularity: Containers for High-Performance Computing Grigory Shamov Nov 21, 2017 Outline Software and High Performance Computing: Installation/Maintenance of the HPC Software stack Why containers and
More informationRunning Blockchain in Docker Containers Prerequisites Sign up for a LinuxONE Community Cloud trial account Deploy a virtual server instance
Running Blockchain in Docker Containers The following instructions can be used to install the current hyperledger fabric, and run Docker and blockchain code in IBM LinuxONE Community Cloud instances. This
More informationADINA DMP System 9.3 Installation Notes
ADINA DMP System 9.3 Installation Notes for Linux (only) Updated for version 9.3.2 ADINA R & D, Inc. 71 Elton Avenue Watertown, MA 02472 support@adina.com www.adina.com ADINA DMP System 9.3 Installation
More informationLinux Software Installation Exercises 2 Part 1. Install PYTHON software with PIP
Linux Software Installation Exercises 2 Part 1. Install PYTHON software with PIP 1.1 Login to the BioHPC machine and install deeptools; Login (ssh) to the machine that you are assigned for this workshop
More informationCan we further boost HPC Performance? Integrate IBM Power System to OpenStack Environment (Part 1) Ankit Purohit, Research Engineer NTT
Can we further boost HPC Performance? Integrate IBM Power System to OpenStack Environment (Part 1) Ankit Purohit, Research Engineer NTT Communications 1 Agenda 1. Our Background 2. Providing GPU Resources:
More informationNVIDIA COLLECTIVE COMMUNICATION LIBRARY (NCCL)
NVIDIA COLLECTIVE COMMUNICATION LIBRARY (NCCL) DU-08730-210_v01 March 2018 Installation Guide TABLE OF CONTENTS Chapter 1. Overview... 1 Chapter 2. Prerequisites...3 2.1. Software Requirements... 3 2.2.
More informationShifter at CSCS Docker Containers for HPC
Shifter at CSCS Docker Containers for HPC HPC Advisory Council Swiss Conference Alberto Madonna, Lucas Benedicic, Felipe A. Cruz, Kean Mariotti - CSCS April 9 th, 2018 Table of Contents 1. Introduction
More informationSunday, February 19, 12
1 LEARNIT EXPRESS in a Nutshell 2 THE LINUX ENVIRONMENT Most programs have preferences that tailor their behavior Word, Matlab, Mathematica: all rely on preference files The BASH shell (and many other
More informationInstall your scientific software stack easily with Spack
Install your scientific software stack easily with Spack Les mardis du développement technologique Florent Pruvost (SED) Outline 1. Context 2. Features overview 3. In practice 4. Some feedback Florent
More informationThe Why and How of HPC-Cloud Hybrids with OpenStack
The Why and How of HPC-Cloud Hybrids with OpenStack OpenStack Australia Day Melbourne June, 2017 Lev Lafayette, HPC Support and Training Officer, University of Melbourne lev.lafayette@unimelb.edu.au 1.0
More informationTensorflow v0.10 installed from scratch on Ubuntu 16.04, CUDA 8.0RC+Patch, cudnn v5.1 with a 1080GTX
Tensorflow v0.10 installed from scratch on Ubuntu 16.04, CUDA 8.0RC+Patch, cudnn v5.1 with a 1080GTX While Tensorflow has a great documentation, you have quite a lot of details that are not obvious, especially
More informationBUILDING A GPU-FOCUSED CI SOLUTION
BUILDING A GPU-FOCUSED CI SOLUTION Mike Wendt @mike_wendt github.com/nvidia github.com/mike-wendt Need for CPU CI Challenges of GPU CI Methods to Implement GPU CI AGENDA Improving GPU CI Today Demo Lessons
More informationWho is Docker and how he can help us? Heino Talvik
Who is Docker and how he can help us? Heino Talvik heino.talvik@seb.ee heino.talvik@gmail.com What is Docker? Software guy view: Marriage of infrastucture and Source Code Management Hardware guy view:
More informationDGX-1 DOCKER USER GUIDE Josh Park Senior Solutions Architect Contents created by Jack Han Solutions Architect
DGX-1 DOCKER USER GUIDE 17.08 Josh Park Senior Solutions Architect Contents created by Jack Han Solutions Architect AGENDA Introduction to Docker & DGX-1 SW Stack Docker basic & nvidia-docker Docker image
More informationDocker task in HPC Pack
Docker task in HPC Pack We introduced docker task in HPC Pack 2016 Update1. To use this feature, set the environment variable CCP_DOCKER_IMAGE of a task so that it could be run in a docker container on
More informationOpen SpeedShop Build and Installation Guide Version November 14, 2016
Open SpeedShop Build and Installation Guide Version 2.3.0 November 14, 2016 Introduction... 3 What is CBTF and how does it relate to Open SpeedShop?... 3 Some Initial Notes... 3 Prerequisite Packages...
More informationParallel Applications on Distributed Memory Systems. Le Yan HPC User LSU
Parallel Applications on Distributed Memory Systems Le Yan HPC User Services @ LSU Outline Distributed memory systems Message Passing Interface (MPI) Parallel applications 6/3/2015 LONI Parallel Programming
More informationTOSS - A RHEL-based Operating System for HPC Clusters
TOSS - A RHEL-based Operating System for HPC Clusters Supercomputing 2017 Red Hat Booth November 14, 2017 Ned Bass System Software Development Group Leader Livermore Computing Division LLNL-PRES-741473
More informationTENSORFLOW. DU _v1.8.0 June User Guide
TENSORFLOW DU-08601-001_v1.8.0 June 2018 User Guide TABLE OF CONTENTS Chapter 1. Overview Of... 1 1.1. Contents Of The NVIDIA Container... 1 Chapter 2. Pulling The Container... 3 Chapter 3. Running A Container...4
More informationFrom 0 to 6 GHz in 30 minutes bootstrap your SDR Experience!
From 0 to 6 GHz in 30 minutes bootstrap your SDR Experience! Start from scratch today, hack the EM spectrum tomorrow! Marcus Müller FOSDEM 2017 February 4, 2017 Introduction From theory to practice Engineering
More informationDGX SOFTWARE WITH RED HAT ENTERPRISE LINUX 7
DGX SOFTWARE WITH RED HAT ENTERPRISE LINUX 7 RN-09301-001 _v02 January 2019 Installation Guide TABLE OF CONTENTS Chapter 1. Introduction...1 1.1. Related Documentation... 1 1.2. Prerequisites... 1 1.2.1.
More informationCONTAINERIZING JOBS ON THE ACCRE CLUSTER WITH SINGULARITY
CONTAINERIZING JOBS ON THE ACCRE CLUSTER WITH SINGULARITY VIRTUAL MACHINE (VM) Uses so&ware to emulate an en/re computer, including both hardware and so&ware. Host Computer Virtual Machine Host Resources:
More informationÜbung zur Vorlesung Architektur paralleler Rechnersysteme
Übung zur Vorlesung Architektur paralleler Rechnersysteme SoSe 17 L.079.05814 www.uni-paderborn.de/pc2 Architecture of Parallel Computer Systems SoSe 17 J.Simon 1 Overview Computer Systems Test Cluster
More informationBe smart. Think open source.
Dockerfiles Be smart. Think open source. Dockerfiles What is a Dockerfile? Build instructions for Docker images Each command creates a layer in the image FROM centos:7 LABEL maintainer="foo.bar@example.com"
More informationTENSORRT 4.0 RELEASE CANDIDATE (RC)
TENSORRT 4.0 RELEASE CANDIDATE (RC) DU-08731-001_v4.0 RC March 2018 Installation Guide TABLE OF CONTENTS Chapter 1. Overview... 1 Chapter 2. Getting Started... 2 Chapter 3. Downloading TensorRT...3 Chapter
More informationArm in HPC. Toshinori Kujiraoka Sales Manager, APAC HPC Tools Arm Arm Limited
Arm in HPC Toshinori Kujiraoka Sales Manager, APAC HPC Tools Arm 2019 Arm Limited Arm Technology Connects the World Arm in IOT 21 billion chips in the past year Mobile/Embedded/IoT/ Automotive/GPUs/Servers
More informationTrinityCore Documentation
TrinityCore Documentation Release TrinityCore Developers February 21, 2016 Contents 1 Compiling TrinityCore 3 1.1 Requirements............................................... 3 1.2 Build Environment............................................
More informationArticle Number: 569 Rating: 2.7/5 from 3 votes Last Updated: Tue, Sep 12, 2017 at 2:54 AM
Nagios Plugins - Installing Nagios Plugins From Source Article Number: 569 Rating: 2.7/5 from 3 votes Last Updated: Tue, Sep 12, 2017 at 2:54 AM O ve r vie w This KB article provides instructions on installing
More informationIntroduction to Containers. Martin Čuma Center for High Performance Computing University of Utah
Introduction to Containers Martin Čuma Center for High Performance Computing University of Utah m.cuma@utah.edu Overview Why do we want to use containers? Containers basics Prepare your computer for containers
More informationswiftenv Documentation
swiftenv Documentation Release 1.3.0 Kyle Fuller Sep 27, 2017 Contents 1 The User Guide 3 1.1 Installation................................................ 3 1.2 Getting Started..............................................
More informationTravis Cardwell Technical Meeting
.. Introduction to Docker Travis Cardwell Tokyo Linux Users Group 2014-01-18 Technical Meeting Presentation Motivation OS-level virtualization is becoming accessible Docker makes it very easy to experiment
More informationCOUCHDB - INSTALLATION
COUCHDB - INSTALLATION http://www.tutorialspoint.com/couchdb/couchdb_installation.htm Copyright tutorialspoint.com This chapter teaches you how to install CouchDB in windows as well as Linux systems. Installing
More informationJay Kruemcke Sr. Product Manager, HPC, Arm,
Jay Kruemcke Sr. Product Manager, HPC, Arm, POWER jayk@suse.com @mr_sles What s changed in the last year? 1.More capable Arm server chips New processors from Cavium, Qualcomm, HiSilicon, Ampere 2.Maturing
More informationMellanox GPUDirect RDMA User Manual
Mellanox GPUDirect RDMA User Manual Rev 1.5 www.mellanox.com Mellanox Technologies NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT ( PRODUCT(S) ) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX
More informationdocker & HEP: containerization of applications for development, distribution and preservation
docker & HEP: containerization of applications for development, distribution and preservation Sébastien Binet LAL/IN2P3 2015-04-13 S. Binet (LAL) docker-hep 2015-04-13 1 / 16 Docker: what is it? http://www.docker.io/
More informationDEPLOYMENT MADE EASY!
DEPLOYMENT MADE EASY! Presented by Hunde Keba & Ashish Pagar 1 DSFederal Inc. We provide solutions to Federal Agencies Our technology solutions connect customers to the people they serve 2 Necessity is
More informationBuilding Containers for Intel Omni-Path Fabrics using Docker* and Singularity*
Building Containers for Intel Omni-Path Fabrics using Docker* and Singularity* Document Number: J57474-4.0 Legal Disclaimer Legal Disclaimer You may not use or facilitate the use of this document in connection
More informationModules and Software. Daniel Caunt Harvard FAS Research Computing
Modules and Software Daniel Caunt Harvard FAS Research Computing 1 What is Research Computing? Faculty of Arts and Sciences (FAS) department that handles non-enterprise IT requests from researchers. (Contact
More informationThe configurations of each Dell R730:
Introduction The Mass Open Cloud (MOC) is a collaborative project between higher education, government, non-profit entities and industry. The mission of the MOC is To create a self-sustaining at-scale
More informationS INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS
S8497 - INSIDE NVIDIA GPU CLOUD DEEP LEARNING FRAMEWORK CONTAINERS Chris Lamb CUDA and NGC Engineering, NVIDIA John Barco NGC Product Management, NVIDIA NVIDIA GPU Cloud (NGC) overview AGENDA Using NGC
More informationRunning Docker* Containers on Intel Xeon Phi Processors
Running Docker* Containers on Intel Xeon Phi Processors White Paper March 2017 Revision 001 Document Number: 335644-001US Notice: This document contains information on products in the design phase of development.
More informationBEST PRACTICES FOR DOCKER
BEST PRACTICES FOR DOCKER DG-08863-001 _v001 December 2018 Best Practices TABLE OF CONTENTS Chapter 1. NVIDIA Container Best Practices...1 1.1. Hello World For Containers... 1 1.2. Logging Into Docker...
More informationCombining CVMFS, Nix, Lmod, and EasyBuild at Compute Canada. Bart Oldeman, McGill HPC, Calcul Québec, Compute Canada
Combining CVMFS, Nix, Lmod, and EasyBuild at Compute Canada Bart Oldeman, McGill HPC, Calcul Québec, Compute Canada Motivation 1. New bigger national systems replacing many smaller local clusters, with
More informationNVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI
NVIDIA DGX SYSTEMS PURPOSE-BUILT FOR AI Overview Unparalleled Value Product Portfolio Software Platform From Desk to Data Center to Cloud Summary AI researchers depend on computing performance to gain
More informationHPC Middle East. KFUPM HPC Workshop April Mohamed Mekias HPC Solutions Consultant. Agenda
KFUPM HPC Workshop April 29-30 2015 Mohamed Mekias HPC Solutions Consultant Agenda 1 Agenda-Day 1 HPC Overview What is a cluster? Shared v.s. Distributed Parallel v.s. Massively Parallel Interconnects
More informationIntel Media Server Studio 2017 R2 Driver, SDK for Linux* Getting Started Guide
Intel Media Server Studio 2017 R2 Driver, SDK for Linux* Getting Started Guide Overview For the most up to date version of this guide please refer to Getting Started Guide Linux* Installation on the Intel
More informationTENSORRT 3.0. DU _v3.0 February Installation Guide
TENSORRT 3.0 DU-08731-001_v3.0 February 2018 Installation Guide TABLE OF CONTENTS Chapter 1. Overview... 1 Chapter 2. Getting Started... 2 Chapter 3. Downloading TensorRT...4 Chapter 4. Installing TensorRT...
More informationCentreon SSH Connector Documentation
Centreon SSH Connector Documentation Release 1.1.2 Centreon November 24, 2015 Contents i ii Centreon SSH Connector is a free software from Centreon available under the Apache Software License version
More informationRunning Applications on The Sheffield University HPC Clusters
Running Applications on The Sheffield University HPC Clusters Deniz Savas dsavas.staff.sheffield.ac.uk June 2017 Topics 1. Software on an HPC system 2. Available Applications 3. Available Development Tools
More informationSource pack installa0on of OpenFOAM. 4.0 into RHL. Open CAE Local Study Mee0ng Y. Takagi July 2, 2016
Source pack installa0on of OpenFOAM. 4.0 into RHL Open CAE Local Study Mee0ng Y. Takagi July 2, 2016 Download the packages from the official website Where should we install? If you have a machine only
More informationHigh-Performance Training for Deep Learning and Computer Vision HPC
High-Performance Training for Deep Learning and Computer Vision HPC Panel at CVPR-ECV 18 by Dhabaleswar K. (DK) Panda The Ohio State University E-mail: panda@cse.ohio-state.edu http://www.cse.ohio-state.edu/~panda
More informationNVIDIA VOLTA DEEP LEARNING AMI
NVIDIA VOLTA DEEP LEARNING AMI RN-08791-18.09.1 _v01 September 2018 Release Notes TABLE OF CONTENTS 1. Overview... 1 2. Version 18.09.1... 2 3. Version 18.08.0... 3 4. Version 18.07.0... 4 5. Version 18.06.0...
More informationBEST PRACTICES FOR DOCKER
BEST PRACTICES FOR DOCKER DG-08863-001 _v001 March 2018 Best Practices TABLE OF CONTENTS Chapter 1. Docker Best Practices with NVIDIA Containers... 1 1.1. Prerequisites... 1 1.1.1. Hello World For Containers...
More informationMovidius Neural Compute Stick
Movidius Neural Compute Stick You may not use or facilitate the use of this document in connection with any infringement or other legal analysis concerning Intel products described herein. You agree to
More informationDocumentation of the chemistry-transport model. [version 2017r4] July 25, How to install required libraries under GNU/Linux
Documentation of the chemistry-transport model [version 2017r4] July 25, 2018. How to install required libraries under GNU/Linux Contents 1 pnetcdf and NetCDF4 formats 2 1.1 Problems with NetCDF4 files..........................
More informationOPEN MPI WITH RDMA SUPPORT AND CUDA. Rolf vandevaart, NVIDIA
OPEN MPI WITH RDMA SUPPORT AND CUDA Rolf vandevaart, NVIDIA OVERVIEW What is CUDA-aware History of CUDA-aware support in Open MPI GPU Direct RDMA support Tuning parameters Application example Future work
More informationOur new HPC-Cluster An overview
Our new HPC-Cluster An overview Christian Hagen Universität Regensburg Regensburg, 15.05.2009 Outline 1 Layout 2 Hardware 3 Software 4 Getting an account 5 Compiling 6 Queueing system 7 Parallelization
More informationn N c CIni.o ewsrg.au
@NCInews NCI and Raijin National Computational Infrastructure 2 Our Partners General purpose, highly parallel processors High FLOPs/watt and FLOPs/$ Unit of execution Kernel Separate memory subsystem GPGPU
More informationNetApp ONTAP AI, Powered by NVIDIA Scalable AI Infrastructure for Real-World Deep Learning Use Cases: Deployment Guide
NetApp Verified Architecture NetApp ONTAP AI, Powered by NVIDIA Scalable AI Infrastructure for Real-World Deep Learning Use Cases: Deployment Guide David Arnette, Amit Borulkar, and Robert Franz, NetApp
More informationMariaDB ColumnStore C++ API Building Documentation
MariaDB ColumnStore C++ API Building Documentation Release 1.1.3-acf32cc MariaDB Corporation Feb 22, 2018 CONTENTS 1 Licensing 1 1.1 Documentation Content......................................... 1 1.2
More informationCUDNN. DU _v07 December Installation Guide
CUDNN DU-08670-001_v07 December 2017 Installation Guide TABLE OF CONTENTS Chapter Overview... 1 Chapter Installing on Linux... 2 Prerequisites... 2 Installing NVIDIA Graphics Drivers... 2 Installing CUDA...
More informationNEW FEATURES IN CUDA 6 MAKE GPU ACCELERATION EASIER MARK HARRIS
NEW FEATURES IN CUDA 6 MAKE GPU ACCELERATION EASIER MARK HARRIS 1 Unified Memory CUDA 6 2 3 XT and Drop-in Libraries GPUDirect RDMA in MPI 4 Developer Tools 1 Unified Memory CUDA 6 2 3 XT and Drop-in Libraries
More informationInstalling Virtualbox Guest Additions Vboxadditions on CentOS 7, Fedora 19 / 20 and RHEL 6.5 / 5.10 on Windows host
Installing Virtualbox Guest Additions Vboxadditions on CentOS 7, Fedora 19 / 20 and RHEL 6.5 / 5.10 on Windows host Author : admin If you decided to use Redhat based Linux distribution inside Virtualbox
More informationIntroduction to Containers
Introduction to Containers Shawfeng Dong Principal Cyberinfrastructure Engineer University of California, Santa Cruz What are Containers? Containerization, aka operating-system-level virtualization, refers
More informationEtherLab R Version 2.1.0
ther ab EtherLab R Version 2.1.0 created by Ingenieurgemeinschaft Essen January 2013 Ingenieurgemeinschaft IgH Heinz-Bäcker-Str. 34 D-45356 Essen Tel.: +49-201-36014-0 Fax.: +49-201-36014-14 E-mail: igh@igh-essen.com
More informationSupercomputing environment TMA4280 Introduction to Supercomputing
Supercomputing environment TMA4280 Introduction to Supercomputing NTNU, IMF February 21. 2018 1 Supercomputing environment Supercomputers use UNIX-type operating systems. Predominantly Linux. Using a shell
More informationSPC Documentation. Release Wesley Brewer
SPC Documentation Release 0.33 Wesley Brewer Nov 14, 2018 Contents 1 Getting started 3 2 Installing Apps 5 3 Pre-/Post-processing 9 4 User Authentication 11 5 Web Server 13 6 Job Scheduler 15 7 config.py
More informationNAMD GPU Performance Benchmark. March 2011
NAMD GPU Performance Benchmark March 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Dell, Intel, Mellanox Compute resource - HPC Advisory
More informationThe Path to GPU as a Service in Kubernetes Renaud Gaubert Lead Kubernetes Engineer
The Path to GPU as a Service in Kubernetes Renaud Gaubert , Lead Kubernetes Engineer May 03, 2018 RUNNING A GPU APPLICATION Customers using DL DL Application RHEL 7.3 CUDA 8.0 Driver 375
More informationIntroduction to CINECA HPC Environment
Introduction to CINECA HPC Environment 23nd Summer School on Parallel Computing 19-30 May 2014 m.cestari@cineca.it, i.baccarelli@cineca.it Goals You will learn: The basic overview of CINECA HPC systems
More informationCompiling Software on UNIX. System Administration Decal Spring 2009 Lecture #4 George Wu Slides prepared by Joshua Kwan
Compiling Software on UNIX System Administration Decal Spring 2009 Lecture #4 George Wu Slides prepared by Joshua Kwan Today How to turn source code into programs that run on Linux? What if that software
More informationAutomatic Dependency Management for Scientific Applications on Clusters. Ben Tovar*, Nicholas Hazekamp, Nathaniel Kremer-Herman, Douglas Thain
Automatic Dependency Management for Scientific Applications on Clusters Ben Tovar*, Nicholas Hazekamp, Nathaniel Kremer-Herman, Douglas Thain Where users are Scientist says: "This demo task runs on my
More informationImplementing DPDK based Application Container Framework with SPP YASUFUMI OGAWA, NTT
x Implementing DPDK based Application Container Framework with SPP YASUFUMI OGAWA, NTT Agenda Introduction of SPP SPP Container Containerize DPDK Apps SPP Container Tools Usecases Limitations and Restrictions
More informationWhat is Research Computing?
Spring 2017 3/19/17 Modules and Software Plamen Krastev, PhD Harvard - Research Computing 1 What is Research Computing? Faculty of Arts and Sciences (FAS) department that handles nonenterprise IT requests
More information