5.3 Install grib_api for OpenIFS
|
|
- Ethan Parrish
- 5 years ago
- Views:
Transcription
1 5.3 Install grib_api for OpenIFS Introduction The ECMWF grib_api software library provides a set of functions/subroutines and command line tools for encoding and decoding WMO FM- 92 GRIB edition 1 and edition 2 messages. The OpenIFS models use GRIB for its input and output files. The grib_api software library must be built and installed before compiling any OpenIFS model that needs it. If you have a version of grib_api on your system already that would most likely work, though check the minimum grib-api version required for each model. It is recommended that you build and install grib-api as described below to ensure the correct configuration is used. Also, we recommend compiling your own to ensure the same compiler and compiler version is used for the model, as otherwise, error messages about conflicting module versions when compiling can arise. For more information about grib_api, to download and install it please visit the grib_api website. Before you start Decide where you will put the grib_api package. For a single user, grib_api might be installed in your home directory. For a multi-user environment, say a cluster or High Performance Computing Facility (HPCF), installing the grib_api package centrally once only is probably best and pointing your build configuration to this location. In the walk-through example that follows, a single-user download and install is assumed. OpenIFS does not need the 'jasper' library in grib-api. To avoid linking against the jasper library it can be disabled (see below). On this page Download and unpack Create a directory called $HOME/ecmwf in which grib-api will be downloaded and compiled. If you haven't already obtained the grib_api package, get it from the grib-api web site. We recommend downloading the latest version. Some of the instructions for options below may differ with the very latest versions. Unpacking grib_api To unpack the software: Create directory and unpack source mkdir -p ecmwf/src cd ecmwf/src tar zxf grib_api source.tar.gz or if your version of tar doesn't support the 'z' option, do: gunzip grib_api_ tar.gz tar xf grib_api tar
2 Configuring using CMake Grib_api uses the CMake command for configuration and compilation. CMake is available for modern Linux systems but may have to be installed. Alternately grib_api supports installation via a 'configure' script, though this option is deprecated. CMake compilation must be done in a separate build directory to both the source and the install directory. Steps to configure grib-api with CMake assuming gnu compilers mkdir bld mkdir grib-api cd bld cmake../grib_api source \ -DCMAKE_C_COMPILER=gcc \ -DCMAKE_Fortran_COMPILER=gfortran \ -DCMAKE_INSTALL_PREFIX="../grib-api" \ -DENABLE_NETCDF=ON \ -DENABLE_JPG=OFF \ -DENABLE_PNG=OFF \ -DENABLE_PYTHON=ON \ -DENABLE_FORTRAN=ON \ -DENABLE_GRIB_OMP_THREADS=ON \ -DBUILD_SHARED_LIBS=OFF Explanation of lines. Note that all options are prefixed by '-D': CMAKE_C_COMPILER=gcc CMAKE_Fortran_COMPILER=gfortran CMAKE_INSTALL_PREFIX="../grib_api" ENABLE_NETCDF=ON ENABLE_JPG=OFF ENABLE_PNG=OFF ENABLE_PYTHON=ON ENABLE_FORTRAN=ON ENABLE_GRIB_OMP_THREADS=ON BUILD_SHARED_LIBS=OFF These lines set the choice of compiler. CMake is often able to determine the available compilers for itself. However, in cases where multiple compilers are available, or where compiler wrappers are used (as on HPC systems), it's preferable to set these explicitly. These lines can often be omitted. Note the CMake variables are preferred rather than set environment variables CC and FC. This specifies the location where the 'make install' command will place the grib-api installation. Enabling netcdf ensures the grib_to_netcdf command can be used. As OpenIFS models do not deal with any image based GRIB dat these options can be disabled, unless you have other grib data containing images that you need to work with. Some of the utilities that come with the OpenIFS model make use of the python interface to grib_api, e.g. the tools to create and manipulate the model data. For this option to work, ensure that a python installation is available. This option is not needed for the single column nor offline surface models currently. This enables the Fortran interface to grib_api and should always be on. Not essential but recommended. This ensures grib_api supports OpenMP threads. Note this is not the same as the option ENABLE_GRIB_THREADS which is for Posix threading and not used by the OpenIFS model. Although OpenIFS models do not currently use multiple threaded calls to grib-api, future versions may do so this option is recommended. grib_api can be built with both 'shared' and 'static' libraries for linking. Normally static libraries are sufficient. Note that some IBM users may experience problems if shared libraries are built. Available options
3 To get additional help on the available options (similar to the 'configure --help' command) run the command: cmake -LH grib_api source This command will cause cmake to run its system discovery if this is the first time the command has been used. On some systems, this may take time to complete. Configuring using autotools Grib_api compilation can be made using the GNU configure tool. This will be familiar to many who have previously installed software. The configure command is probably the easiest method as it does not rely on having the CMake package installed, though note it is deprecated in favour of using cmake (see above). The configure command is contained in the grib_api directory. A few options are needed to suit the OpenIFS models and gcc & gfortran compilers are assumed in the example below. If you use different compilers, see below. gcc/gfortran compilers cd grib_api_ source CC=gcc FC=gfortran./configure --prefix=$home/ecmwf/grib_api --enablepthread --enable-python --disable-jpeg A description of what these options are for: CC=gcc FC=gfortran --prefix --disable-jpeg --enable-pthread --enable-python These set the choice of C and Fortran compilers. They can be omitted as the configure script will usually find them. However, if you have multiple compilers available and want to use a particular compiler, use these environment variables. This specifies where you want the grib_api files to be installed. In example here, the source code is in $HOME/ecmwf /grib_api_ source and the compiled grib_api libraries will go in directory $HOME/ecmwf/grib_api. You are free to choose any installation directory but it's recommended to keep the installed binaries & libraries in a separate directory to the source code, in case different compiler versions are needed. On a shared high performance computer facility, the install path would most likely be somewhere central. If nothing is specified for -- prefix, by default grib_api will install in /usr/local. OpenIFS models do not need to support JPEG and PNG for data compression. This removes the need to link against the Jasper library (libjasper.a). This option ensures that grib_api is thread-safe and is a recommended option. This option is not essential but desirable. It enables the python interface and is required as some utilities make use of the grib-api python interface. If the make fails because of a missing numpy header file we recommend installing numpy. Although you could add the --disable-numpy option, if this option does not work, some of the tools provided with OpenIFS models may not work. Available options --help option to configure can be used to see what other options are possible, also see the grib_api website for more detailed documentation. --enable-vector option should be used on vector based computers (e.g. NEC). Grib_api will then use a more efficient packing/unpacking method suitable for vector hardware. n.b. there is a bug in the release that if the --disable-vector option is used, this has the reverse effect of enabling the vector code. See grib_api issue GRIB-269 for more details..
4 Shared and static libraries grib_api will build both shared and static libraries by default. Shared libraries may need to be built if the python interface is used, depending on your installation. Some compilers will link to the shared version by default if both are found (e.g. the GNU compiler). Alternately, the option --disable-shared stops the shared libraries from being generated, only the static libraries are built and will be linked. However, this may prevent other grib api tools working and is not generally recommended. IBM users may find that the grib-api fortran tests will fail unless --disable-shared is used. Preferred compiler options By default, cmake and configure will use the preferred compiler and set appropriate compiler options accordingly (for cmake, this depends on the build type). This may not be what you need if you have multiple compilers available and want to direct cmake/configure to the most appropriate one to use. Recommended options given below are conservative to ensure stability and bit-reproducibility. Changing compiler options is not normally necessary. However, the following examples show the recommended compiler options and how to set them for the cmake and configure commands.
5 Compiler options if using cmake click here to expand... With cmake, it is better to use the cmake variables to define the compilers rather than rely on environment variables FC and CC. gcc/gfortran compilers cmake... -DCMAKE_C_COMPILER=gcc - DCMAKE_Fortran_COMPILER=gfortran -DCMAKE_C_FLAGS="-g -O2" - DCMAKE_Fortran_FLAGS="-g -O2" Intel compiler: cmake... -DCMAKE_C_COMPILER=icc - DCMAKE_Fortran_COMPILER=ifort -DCMAKE_C_FLAGS="-g -O1 -fpmodel precise" \ -DCMAKE_Fortran_FLAGS="-g -O1 -fp-model precise" Cray compiler (cce) cmake... -DCMAKE_C_COMPILER=cc -DCMAKE_Fortran_COMPILER=ftn -DCMAKE_C_FLAGS="-O1 -G2 -hflex_mp=conservative -hadd_paren - hfp1" \ -DCMAKE_Fortran_FLAGS="-O1 -G2 - hflex_mp=conservative -hadd_paren -hfp1" IBM compiler: cmake... -DCMAKE_C_COMPILER=xlc_r - DCMAKE_Fortran_COMPILER=xlf90_r -DCMAKE_C_FLAGS="-g -O2 - qstrict -qarch=auto -qtune=auto" \ -DCMAKE_Fortran_FLAGS="-g -O2 -qstrict -qarch=auto -qtune=auto"
6 Compiler options if using configure click here to expand... export CC=gcc export FC=gfortran export CCFLAGS="-g -O2" export FCFLAGS="-g -O2"./configure... gcc/gfortran compilers Intel compiler: export CC=icc export FC=ifort export CFLAGS="-g -O1 -fp-model precise" export FCFLAGS="-g -O1 -fp-model precise"./configure... Cray compiler (cce) export CC=cc export FC=ftn export CFLAGS="-O1 -G2 -hflex_mp=conservative -hadd_paren - hfp1" export FCFLAGS="-O1 -G2 -hflex_mp=conservative -hadd_paren - hfp1"./configure... IBM compiler: export CC=xlc_r export FC=xlf90_r export CFLAGS="-g -O2 -qstrict -qarch=auto -qtune=auto" export FCFLAGS="-g -O2 -qstrict -qarch=auto -qtune=auto"./configure.. Compiling, checks and installing After configuration the next steps are to compile grib-api and install it. To compile grib_api do: make tee make.out which will send all the output from the make command to the file 'make.out' as well as the terminal. This is recommended as the output is lengthy. Seeing command output with cmake If using cmake, it will normally hide all the output from the compile commands. If you want to see the compile command (to check the compile options), do:
7 make VERBOSE=1 Parallel make If your computer has multiple cores as many, use the -j flag to make to build grib_api faster. e.g. make -j 3 tee make.out Next, to verify grib_api works correctly run: make check tee check.out Verify that all the grib_api tests have passed. If not, go back and check your configure options. In case of difficulty, contact Software. Support@ecmwf.int. Finally, to install grib_api do: make install tee install.out At the end of this step, in the directory $HOME/ecmwf/ we are using in this example you should now have a directory called grib_api (or some other compiler suffix) which contains the following: % ls grib_api bin include lib share % ls grib_api/lib libgrib_api.a libgrib_api.la libgrib_api_f77.a libgrib_api_f77.la libgrib_api_f90.a libgrib_api_f90.la pkgconfig After this stage, next steps are to download and install FCM and then download the OpenIFS code and accompanying files. Possible problems For help contact... OpenIFS support: openifs-support@ecmwf.int. Cray Possible issues with the Cray systems (using cce or gnu compilers) are related to building shared libraries and linking with supporting netcdf and python libraries. 1. If problems occur, first try using the option "--disable-shared" (configure) or "-DBUILD_SHARED_LIBS=OFF") to only build statically linked libraries. 2. If linking problems still occur, try unloading the Cray ATP module which has been known to cause problems. module unload atp 3. -llibm link error.
8 If the following occurs: /usr/bin/ld: attempted static link of dynamic object `/usr/lib64/libm. so' set the environment variable CRAYPE_LINK_TYPE=dynamic (or add the compiler option '-dynamic'). 4. Missing python library If this error occurs when compiling _gribapi_swig.so: /usr/bin/ld: cannot find -lpython it means the directory path of the python library is not on the linkers list of directories to search. Make sure the python module is loaded. Then check any PYTHON environment variables set by the module and confirm the location of the libpython (or other version) library. Set the environment variable LIBRARY_PATH to the correct directory so that the linker can find it: e.g. export LIBRARY_PATH=/home/anaconda/2.2.0-python2/lib64 LIBRARY_PATH is only used at compile/link time. It may also be necessary to add this directory to the LD_LIBRARY_PATH environment variable which is searched for libraries at runtime. Intel compiler We currently recommend not using a higher optimization level than -O1 with the Intel compiler. Failures have been seen with grib_api and the Intel compiler when compiled with -O2. Some versions of the Intel compiler (v14.0.x) can produce an error "unknown option -soname" when using 'configure. If this occurs try using "--disable-shared" or try the cmake command instead. IBM compiler For the IBM xlc compiler we recommend disabling the creation of 'shared libraries' which is known to cause problems with some versions of grib_api. In this example, note the use of the '_r' form of the IBM compiler to ensure grib_api is compiled 'thread-safe'. Building on High Performance Computer Systems Some HPC batch systems have a different hardware architecture for their login (or frontend node) to the batch node, but the frontend compilation system is targeted at the batch nodes. This is known as cross-compilation. If this is the case you may see failures in the 'make check' stage because the checks, although compiled for the backend batch nodes, are being run on the frontend nodes and therefore may not work correctly. If this is the case on your system, we recommend using a batch job to do the 'configure; make; make check; make install' steps. In some cases, the batch system cannot be used for compilation at all. In this case, you have to compile on the frontend but without extra flags 'configure' will assume the build is for the frontend. You can make use of the --host option to ensure the build is correct for the architecture of the batch system. Again though, the tests will fail, a small serial batch job is recommended to make sure grib_api is installed correctly. Note if you plan on using the grib_api software in your own software that runs on the frontend nodes you will need to install grib_api twice; one for the batch system and again for the frontend system. If you have any questions installing grib_api in this type of environment, please contact: openifs-support@ecmwf.int for assistance. Verify the installation
9 To verify that the installation was successful, first ensure that the grib_api bin directory is added to your PATH environment variable and then run the grib_info command e.g. % export PATH=$PATH:$HOME/ecmwf/grib_api_gcc/bin % grib_info grib_api Version Default definition files path is used:.../grib_api_gcc/share /definitions Definition files path can be changed setting GRIB_DEFINITION_PATH environment variable Default SAMPLES path is used:.../grib_api_gcc/share/samples SAMPLES path can be changed setting GRIB_SAMPLES_PATH environment variable If the installation was successful, grib_info will report the installation directories. Any problems, please contact openifs-support@ecmwf.int.
Compiling environment
Compiling environment Working on Ecgate Xavi Abellan Xavier.Abellan@ecmwf.int ECMWF February 21, 2017 Outline Introduction Fortran Compiler Linking Libraries Make Debugging Profiling Practical session
More informationGUT. GUT Installation Guide
Date : 17 Mar 2011 1/6 GUT Contents 1 Introduction...2 2 Installing GUT...2 2.1 Optional Extensions...2 2.2 Installation using the Binary package...2 2.2.1 Linux or Mac OS X...2 2.2.2 Windows...4 2.3 Installing
More informationCompiling environment
Compiling environment Xavi Abellan Xavier.Abellan@ecmwf.int ECMWF February 23, 2016 Outline Introduction Fortran Compiler Linking Libraries Make Debugging Profiling Practical session 2 Introduction Compiling
More informationECMWF Environment on the CRAY practical solutions
ECMWF Environment on the CRAY practical solutions Xavi Abellan Xavier.Abellan@ecmwf.int User Support Section HPCF 2015 Cray ECMWF Environment ECMWF 2015 Slide 1 Let s play Start a fresh session on cca,
More informationDalton/LSDalton Installation Guide
Dalton/LSDalton Installation Guide Release 2016.0 Dalton/LSDalton developers October 13, 2016 Contents 1 Supported platforms and compilers 1 2 Basic installation 3 2.1 General..................................................
More informationGUT. GUT Installation Guide
Date : 02 Feb 2009 1/5 GUT Table of Contents 1 Introduction...2 2 Installing GUT...2 2.1 Optional Extensions...2 2.2 Installing from source...2 2.3 Installing the Linux binary package...4 2.4 Installing
More informationUser's Guide for the NMM Core of the Weather Research and Forecast (WRF) Modeling System Version 3. Chapter 2: Software Installation
User's Guide for the NMM Core of the Weather Research and Forecast (WRF) Modeling System Version 3 Chapter 2: Software Installation Table of Contents Introduction Required Compilers and Scripting Languauges
More informationeccodes GRIB Fortran 90 - Python APIs Practicals 2 Dominique Lucas and Xavi Abellan
eccodes GRIB Fortran 90 - Python APIs Practicals 2 Dominique Lucas and Xavi Abellan Dominique.Lucas@ecmwf.int Xavier.Abellan@ecmwf.int ECMWF March 1, 2016 Practical 2: eccodes indexing ecgate$ cd $SCRATCH/eccodes_api_practicals/exercise2
More informationPROGRAMMING MODEL EXAMPLES
( Cray Inc 2015) PROGRAMMING MODEL EXAMPLES DEMONSTRATION EXAMPLES OF VARIOUS PROGRAMMING MODELS OVERVIEW Building an application to use multiple processors (cores, cpus, nodes) can be done in various
More informationMARS Code Reorganization
MARS Code Reorganization Build Systems, Code Repositories, and much more... Tiago Quintino Sebastien Villaume, Manuel Fuentes, Baudouin Raoult mars-admins@ecmwf.int ECMWF March 9, 2016 Code Cleanup MARS
More informationIntroduction to OpenMP. Lecture 2: OpenMP fundamentals
Introduction to OpenMP Lecture 2: OpenMP fundamentals Overview 2 Basic Concepts in OpenMP History of OpenMP Compiling and running OpenMP programs What is OpenMP? 3 OpenMP is an API designed for programming
More informationeccodes GRIB Fortran 90 - Python APIs Practicals 2 Dominique Lucas and Xavi Abellan
eccodes GRIB Fortran 90 - Python APIs Practicals 2 Dominique Lucas and Xavi Abellan Dominique.Lucas@ecmwf.int Xavier.Abellan@ecmwf.int ECMWF March 1, 2017 Practical 2: eccodes indexing ecgate$ cd $SCRATCH/eccodes_api_practicals/exercise2
More informationDocumentation of the chemistry-transport model. [version 2017r4] July 25, How to install required libraries under GNU/Linux
Documentation of the chemistry-transport model [version 2017r4] July 25, 2018. How to install required libraries under GNU/Linux Contents 1 pnetcdf and NetCDF4 formats 2 1.1 Problems with NetCDF4 files..........................
More informationDominique Lucas Xavier Abellan Ecija User Support
GRIB APIs Fortran 90 - C - Python interfaces part 1 Dominique Lucas Xavier Abellan Ecija User Support COM GRIB: GRIB APIs Fortran 90 - C - Python interfaces ECMWF 2015 Slide 1 Content Introduction The
More informationInstalling WRF & WPS. Kelly Keene NCAR/MMM January 2015
Installing WRF & WPS Kelly Keene NCAR/MMM January 2015 1 Installing Steps Check system requirements Installing Libraries Download source data Download datasets Compile WRFV3 Compile WPS 2 System Requirements
More informationTool for Analysing and Checking MPI Applications
Tool for Analysing and Checking MPI Applications April 30, 2010 1 CONTENTS CONTENTS Contents 1 Introduction 3 1.1 What is Marmot?........................... 3 1.2 Design of Marmot..........................
More informationMUST. MPI Runtime Error Detection Tool
MUST MPI Runtime Error Detection Tool April 18, 2012 1 CONTENTS CONTENTS Contents 1 Introduction 3 2 Installation 3 2.1 P n MPI................................. 4 2.2 GTI..................................
More informationGeneric TriBITS Project, Build, Test, and Install Reference Guide
Generic TriBITS Project, Build, Test, and Install Reference Guide Author: Roscoe A. Bartlett Contact: bartlett.roscoe@gmail.com Date: 2018-03-12 Version: tribits_start-2039-g2119b16 Abstract: This document
More informationcget Documentation Release Paul Fultz II
cget Documentation Release 0.1.0 Paul Fultz II Jun 27, 2018 Contents 1 Introduction 3 1.1 Installing cget.............................................. 3 1.2 Quickstart................................................
More informationPractical: a sample code
Practical: a sample code Alistair Hart Cray Exascale Research Initiative Europe 1 Aims The aim of this practical is to examine, compile and run a simple, pre-prepared OpenACC code The aims of this are:
More informationBuilding and Installing Software
Building and Installing Software On UD HPC Community Clusters William Totten Network & Systems Services Conventions when Installing Software Installation base directory /opt/shared /home/work/ lab/sw/name/version
More informationLinux Clusters Institute:
Linux Clusters Institute: 3 rd Party Software Management Instructor: Timothy Bouvet Title: System Engineer NCSA Email: tbouvet@illinois.edu 3 rd Party Software Management Topics: Best Practices Software
More informationEmbedded Systems Programming
Embedded Systems Programming OS Linux - Toolchain Iwona Kochańska Gdansk University of Technology Embedded software Toolchain compiler and tools for hardwaredependent software developement Bootloader initializes
More informationCompiling applications for the Cray XC
Compiling applications for the Cray XC Compiler Driver Wrappers (1) All applications that will run in parallel on the Cray XC should be compiled with the standard language wrappers. The compiler drivers
More informationShifter and Singularity on Blue Waters
Shifter and Singularity on Blue Waters Maxim Belkin June 7, 2018 A simplistic view of a scientific application DATA RESULTS My Application Received an allocation on Blue Waters! DATA RESULTS My Application
More informationIntroduction to HPC Programming 4. C and FORTRAN compilers; make, configure, cmake. Valentin Pavlov
Introduction to HPC Programming 4. C and FORTRAN compilers; make, configure, cmake Valentin Pavlov About these lectures This is the fourth of series of six introductory lectures discussing
More informationIntroduction to OpenMP
Introduction to OpenMP Lecture 2: OpenMP fundamentals Overview Basic Concepts in OpenMP History of OpenMP Compiling and running OpenMP programs 2 1 What is OpenMP? OpenMP is an API designed for programming
More informationHPCF Cray Phase 2. User Test period. Cristian Simarro User Support. ECMWF April 18, 2016
HPCF Cray Phase 2 User Test period Cristian Simarro User Support advisory@ecmwf.int ECMWF April 18, 2016 Content Introduction Upgrade timeline Changes Hardware Software Steps for the testing on CCB Possible
More informationMUST. MPI Runtime Error Detection Tool
MUST MPI Runtime Error Detection Tool November 9, 2011 1 CONTENTS CONTENTS Contents 1 Introduction 3 2 Installation 3 2.1 P n MPI................................. 4 2.2 GTI..................................
More informationCALCEPH - Fortran 77/90/95 language
CALCEPH - Fortran 77/90/95 language Release 3.0.0 M. Gastineau, J. Laskar, A. Fienga, H. Manche Feb 05, 2018 CONTENTS 1 Introduction 3 2 Installation 5 2.1 Quick instructions for installing on a Unix-like
More informationInstalling Steps. WRF & WPS: Compilation Process. System Requirements. Check System Requirements
WRF & WPS: Compilation Process Kelly Werner NCAR/MMM January 2018 Installing Steps 1 2 System Requirements On what kinds of systems will WRF run? Generally any 32- or 64-bit hardware, running a UNIX-like
More informationCSC BioWeek 2016: Using Taito cluster for high throughput data analysis
CSC BioWeek 2016: Using Taito cluster for high throughput data analysis 4. 2. 2016 Running Jobs in CSC Servers A note on typography: Some command lines are too long to fit a line in printed form. These
More informationImage Sharpening. Practical Introduction to HPC Exercise. Instructions for Cirrus Tier-2 System
Image Sharpening Practical Introduction to HPC Exercise Instructions for Cirrus Tier-2 System 2 1. Aims The aim of this exercise is to get you used to logging into an HPC resource, using the command line
More informationXeon Phi Native Mode - Sharpen Exercise
Xeon Phi Native Mode - Sharpen Exercise Fiona Reid, Andrew Turner, Dominic Sloan-Murphy, David Henty, Adrian Jackson Contents June 19, 2015 1 Aims 1 2 Introduction 1 3 Instructions 2 3.1 Log into yellowxx
More informationFirst steps on using an HPC service ARCHER
First steps on using an HPC service ARCHER ARCHER Service Overview and Introduction ARCHER in a nutshell UK National Supercomputing Service Cray XC30 Hardware Nodes based on 2 Intel Ivy Bridge 12-core
More informationSCALABLE HYBRID PROTOTYPE
SCALABLE HYBRID PROTOTYPE Scalable Hybrid Prototype Part of the PRACE Technology Evaluation Objectives Enabling key applications on new architectures Familiarizing users and providing a research platform
More informationCSC BioWeek 2018: Using Taito cluster for high throughput data analysis
CSC BioWeek 2018: Using Taito cluster for high throughput data analysis 7. 2. 2018 Running Jobs in CSC Servers Exercise 1: Running a simple batch job in Taito We will run a small alignment using BWA: https://research.csc.fi/-/bwa
More informationHow to install and build an application
GEANT4 BEGINNERS COURSE GSSI, L Aquila (Italy) 27-30 June 2016 How to install and build an application tutorial course Outline Supported platforms & compilers Required software Where to download the packages
More informationMPICH Installer s Guide Version Mathematics and Computer Science Division Argonne National Laboratory
MPICH Installer s Guide Version 3.2.1 Mathematics and Computer Science Division Argonne National Laboratory Abdelhalim Amer Pavan Balaji Wesley Bland William Gropp Yanfei Guo Rob Latham Huiwei Lu Lena
More informationSupercomputing environment TMA4280 Introduction to Supercomputing
Supercomputing environment TMA4280 Introduction to Supercomputing NTNU, IMF February 21. 2018 1 Supercomputing environment Supercomputers use UNIX-type operating systems. Predominantly Linux. Using a shell
More informationShifter on Blue Waters
Shifter on Blue Waters Why Containers? Your Computer Another Computer (Supercomputer) Application Application software libraries System libraries software libraries System libraries Why Containers? Your
More informationHow to install and build an application. Giuliana Milluzzo INFN-LNS
How to install and build an application Giuliana Milluzzo INFN-LNS Outline Supported platforms & compilers Required software Where to download the packages Geant4 toolkit installation (release 10) Using
More informationSunday, February 19, 12
1 LEARNIT EXPRESS in a Nutshell 2 THE LINUX ENVIRONMENT Most programs have preferences that tailor their behavior Word, Matlab, Mathematica: all rely on preference files The BASH shell (and many other
More informationHPC Input/Output. I/O and Darshan. Cristian Simarro User Support Section
HPC Input/Output I/O and Darshan Cristian Simarro Cristian.Simarro@ecmwf.int User Support Section Index Lustre summary HPC I/O Different I/O methods Darshan Introduction Goals Considerations How to use
More informationProgramming Environment 4/11/2015
Programming Environment 4/11/2015 1 Vision Cray systems are designed to be High Productivity as well as High Performance Computers The Cray Programming Environment (PE) provides a simple consistent interface
More informationXeon Phi Native Mode - Sharpen Exercise
Xeon Phi Native Mode - Sharpen Exercise Fiona Reid, Andrew Turner, Dominic Sloan-Murphy, David Henty, Adrian Jackson Contents April 30, 2015 1 Aims The aim of this exercise is to get you compiling and
More informationInstalling the Quantum ESPRESSO distribution
Joint ICTP-TWAS Caribbean School on Electronic Structure Fundamentals and Methodologies, Cartagena, Colombia (2012). Installing the Quantum ESPRESSO distribution Coordinator: A. D. Hernández-Nieves Installing
More informationEE/CSCI 451 Introduction to Parallel and Distributed Computation. Discussion #4 2/3/2017 University of Southern California
EE/CSCI 451 Introduction to Parallel and Distributed Computation Discussion #4 2/3/2017 University of Southern California 1 USC HPCC Access Compile Submit job OpenMP Today s topic What is OpenMP OpenMP
More informationVIRTUAL INSTITUTE HIGH PRODUCTIVITY SUPERCOMPUTING. BSC Tools Hands-On. Germán Llort, Judit Giménez. Barcelona Supercomputing Center
BSC Tools Hands-On Germán Llort, Judit Giménez Barcelona Supercomputing Center 2 VIRTUAL INSTITUTE HIGH PRODUCTIVITY SUPERCOMPUTING Getting a trace with Extrae Extrae features Platforms Intel, Cray, BlueGene,
More informationLinux Software Installation Exercises 2 Part 1. Install PYTHON software with PIP
Linux Software Installation Exercises 2 Part 1. Install PYTHON software with PIP 1.1 Login to the BioHPC machine and install deeptools; Login (ssh) to the machine that you are assigned for this workshop
More informationCS480. Compilers Eclipse, SVN, Makefile examples
CS480 Compilers Eclipse, SVN, Makefile examples January 26, 2015 New Project New Project C/C++ Project Create a New C Project Choose Makefile Project EmptyProject Toolchain: Linux GCC Next Advanced C/C++
More informationposki: Parallel Optimized Sparse Kernel Interface Library User s Guide for Version 1.0.0
poski: Parallel Optimized Sparse Kernel Interface Library User s Guide for Version 1.0.0 Jong-Ho Byun James W. Demmel Richard Lin Katherine A. Yelick Berkeley Benchmarking and Optimization (BeBOP) Group
More informationStable Cray Support in EasyBuild 2.7. Petar Forai
Stable Cray Support in EasyBuild 2.7 Petar Forai 1 Major Areas of Interest Specific to Cray Support Version pinning in Cray toolchain to achieve reproducible builds New toolchain naming scheme that is
More informationCOMPILING FOR THE ARCHER HARDWARE. Slides contributed by Cray and EPCC
COMPILING FOR THE ARCHER HARDWARE Slides contributed by Cray and EPCC Modules The Cray Programming Environment uses the GNU modules framework to support multiple software versions and to create integrated
More informationBeginner's Guide for UK IBM systems
Beginner's Guide for UK IBM systems This document is intended to provide some basic guidelines for those who already had certain programming knowledge with high level computer languages (e.g. Fortran,
More informationCALCEPH - Fortran 2003 language
CALCEPH - Fortran 2003 language Release 3.2.0 M. Gastineau, J. Laskar, A. Fienga, H. Manche Oct 19, 2018 CONTENTS 1 Introduction 3 2 Installation 5 2.1 Quick instructions for installing on a Unix-like
More informationInstalling WRF- Sfire
Installing WRF- Sfire Workshop on Modeling of Wildfires and their Environmental Impacts, Trieste, IT June 2015 Adam Kochanski Installing Steps Check system requirements Download required libraries Install
More informationMcGill University School of Computer Science Sable Research Group. *J Installation. Bruno Dufour. July 5, w w w. s a b l e. m c g i l l.
McGill University School of Computer Science Sable Research Group *J Installation Bruno Dufour July 5, 2004 w w w. s a b l e. m c g i l l. c a *J is a toolkit which allows to dynamically create event traces
More informationSDPLR 1.03-beta User s Guide (short version)
SDPLR 3-beta User s Guide (short version) August 12, 2009 1 Summary SDPLR is a C software package for solving large-scale semidefinite programming problems. Source code, binaries, and a Matlab interface
More informationCALCEPH - Python language
CALCEPH - Python language Release 3.1.0 M. Gastineau, J. Laskar, A. Fienga, H. Manche May 22, 2018 CONTENTS 1 Introduction 3 2 Installation 5 2.1 Quick instructions for installing on a Unix-like system
More informationApplied Informatics POCO PRO C++ Frameworks
Applied Informatics POCO PRO C++ Frameworks Getting Started Guide Version 1.10 Purpose of This Document This document guides developers interested in the POCO PRO C++ Frameworks by Applied Informatics
More informationSupported platforms & compilers Required software Where to download the packages Geant4 toolkit installation (release 10.1.p02)
Supported platforms & compilers Required software Where to download the packages Geant4 toolkit installation (release 10.1.p02) Using CMake Building a Geant4 application with CMake Example of a Geant4
More informationGSI Fundamentals (1): Setup and Compilation
GSI Fundamentals (1): Setup and Compilation Donald Stark Na-onal Center for Atmospheric Research (NCAR) The Developmental Testbed Center (DTC) Tuesday 11 August, 2015 Outline GSI fundamentals (1): Setup
More informationBeyond Makefiles: Autotools and the GNU Build System
SEA : Autotools and the GNU Build System Patrick Nichols Software Engineer CISL Consulting Group UCAR SEA December 10, 2015 Why do we need more tools? Diversity! 1. Compilers, programming languages and
More informationGNU-AVR Building the GNU AVR Toolchain for Mac OS X and Linux
GNU-AVR Building the GNU AVR Toolchain for Mac OS X and Linux BDMICRO http://www.bdmicro.com/ Brian S. Dean bsd@bdmicro.com April 24, 2007 Copyright (c) 2005 BDMICRO All Rights Reserved. GNU-AVR April
More informationSharpen Exercise: Using HPC resources and running parallel applications
Sharpen Exercise: Using HPC resources and running parallel applications Andrew Turner, Dominic Sloan-Murphy, David Henty, Adrian Jackson Contents 1 Aims 2 2 Introduction 2 3 Instructions 3 3.1 Log into
More informationIntel Parallel Studio XE 2011 SP1 for Linux* Installation Guide and Release Notes
Intel Parallel Studio XE 2011 SP1 for Linux* Installation Guide and Release Notes Document number: 323804-002US 21 June 2012 Table of Contents 1 Introduction... 1 1.1 What s New... 1 1.2 Product Contents...
More informationMDF4 Lib. Product Information
Product Information Table of Contents 1 Overview...3 1.1 Introduction...3 1.2 Application Areas...3 1.3 Overview of Advantages...3 2 Features and Advantages...4 2.1 Supported MDF Versions...4 3 Functional
More informationInstalling SW4 version 2.0
Installing SW4 version 2.0 N. Anders Petersson Björn Sjögreen November 6, 2017 Contents 1 Introduction 1 2 Compilers and third party libraries 2 3 Unpacking the source code tar ball 4 4 Installing SW4
More informationThe build2 Toolchain Installation and Upgrade
The build2 Toolchain Installation and Upgrade Copyright 2014-2019 Code Synthesis Ltd Permission is granted to copy, distribute and/or modify this document under the terms of the MIT License This revision
More informationBSC Tools Hands-On. Judit Giménez, Lau Mercadal Barcelona Supercomputing Center
BSC Tools Hands-On Judit Giménez, Lau Mercadal (lau.mercadal@bsc.es) Barcelona Supercomputing Center 2 VIRTUAL INSTITUTE HIGH PRODUCTIVITY SUPERCOMPUTING Extrae Extrae features Parallel programming models
More informationBUFR decoding. Dominique Lucas User Support. February Intro Bufr decoding
BUFR decoding Dominique Lucas User Support February 2017 1 Content What is BUFR BUFR tools BUFR format BUFR decoding Practical examples February 2017 2 What is BUFR Binary representation of meteorological
More informationBatch environment PBS (Running applications on the Cray XC30) 1/18/2016
Batch environment PBS (Running applications on the Cray XC30) 1/18/2016 1 Running on compute nodes By default, users do not log in and run applications on the compute nodes directly. Instead they launch
More informationHPC Middle East. KFUPM HPC Workshop April Mohamed Mekias HPC Solutions Consultant. Agenda
KFUPM HPC Workshop April 29-30 2015 Mohamed Mekias HPC Solutions Consultant Agenda 1 Agenda-Day 1 HPC Overview What is a cluster? Shared v.s. Distributed Parallel v.s. Massively Parallel Interconnects
More informationChe-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University
Che-Wei Chang chewei@mail.cgu.edu.tw Department of Computer Science and Information Engineering, Chang Gung University 1. Introduction 2. System Structures 3. Process Concept 4. Multithreaded Programming
More informationProgramming Techniques for Supercomputers. HPC RRZE University Erlangen-Nürnberg Sommersemester 2018
Programming Techniques for Supercomputers HPC Services @ RRZE University Erlangen-Nürnberg Sommersemester 2018 Outline Login to RRZE s Emmy cluster Basic environment Some guidelines First Assignment 2
More informationIntel Parallel Studio XE 2015 Composer Edition for Linux* Installation Guide and Release Notes
Intel Parallel Studio XE 2015 Composer Edition for Linux* Installation Guide and Release Notes 23 October 2014 Table of Contents 1 Introduction... 1 1.1 Product Contents... 2 1.2 Intel Debugger (IDB) is
More informationFFTSS Library Version 3.0 User s Guide
Last Modified: 31/10/07 FFTSS Library Version 3.0 User s Guide Copyright (C) 2002-2007 The Scalable Software Infrastructure Project, is supported by the Development of Software Infrastructure for Large
More informationMaintaining Large Software Stacks in a Cray Ecosystem with Gentoo Portage. Colin MacLean
Maintaining Large Software Stacks in a Cray Ecosystem with Gentoo Portage Colin MacLean Large Software Stacks Most modules are, at most, a handful of packages Currently available tools ill-suited for large
More informationIntel Parallel Studio XE 2011 for Linux* Installation Guide and Release Notes
Intel Parallel Studio XE 2011 for Linux* Installation Guide and Release Notes Document number: 323804-001US 8 October 2010 Table of Contents 1 Introduction... 1 1.1 Product Contents... 1 1.2 What s New...
More informationCompile and run RAPID on the Microsoft Azure Cloud
Compile and run RAPID on the Microsoft Azure Cloud By Cédric H. David (cedric.david@jpl.nasa.gov), 09 Jul 2014, updated 05 Aug 2014, 08 Sep 2014, 04 Nov 2014, 21 Jan 2015 Introduction Foreword This tutorial
More informationHow to install and build an application
GEANT4 BEGINNERS COURSE GSSI, L Aquila (Italy) 6-10 July 2015 How to install and build an application tutorial course Outline Supported platforms & compilers Required software Where to download the packages
More informationNever forget Always use the ftn, cc, and CC wrappers
Using Compilers 2 Never forget Always use the ftn, cc, and CC wrappers The wrappers uses your module environment to get all libraries and include directories for you. You don t have to know their real
More informationConfigure Error No Acceptable C Compiler Found In Xcode Installed
Configure Error No Acceptable C Compiler Found In Xcode Installed Xcode and command line tool are installed. It was created by Sage configure 6.6.rc3, which was generated by GNU Autoconf 2.69. Why do I
More informationHow to install and build an application
GEANT4 BEGINNERS COURSE GSSI, L Aquila (Italy) 12 nd May 2014 How to install and build an application tutorial course Outline Supported platforms & compilers Required software Where to download the packages
More informationEasyBuild on Cray Linux Environment (WIP) Petar Forai
EasyBuild on Cray Linux Environment (WIP) Petar Forai Short Introduction to Cray Development Environment Cray provides module files for the products that are shipped with the system (like compilers, Cray
More informationTENSORRT 4.0 RELEASE CANDIDATE (RC)
TENSORRT 4.0 RELEASE CANDIDATE (RC) DU-08731-001_v4.0 RC March 2018 Installation Guide TABLE OF CONTENTS Chapter 1. Overview... 1 Chapter 2. Getting Started... 2 Chapter 3. Downloading TensorRT...3 Chapter
More informationBuilding and Installing QGIS
Building and Installing QGIS Gary Sherman Tim Sutton September 1, 2005 Contents 1 Introduction 1 1.1 Installing Windows Version..................................... 2 1.2 Installing Mac OS X Version....................................
More informationEvaluating Shifter for HPC Applications Don Bahls Cray Inc.
Evaluating Shifter for HPC Applications Don Bahls Cray Inc. Agenda Motivation Shifter User Defined Images (UDIs) provide a mechanism to access a wider array of software in the HPC environment without enduring
More informationMIGRATING TO THE SHARED COMPUTING CLUSTER (SCC) SCV Staff Boston University Scientific Computing and Visualization
MIGRATING TO THE SHARED COMPUTING CLUSTER (SCC) SCV Staff Boston University Scientific Computing and Visualization 2 Glenn Bresnahan Director, SCV MGHPCC Buy-in Program Kadin Tseng HPC Programmer/Consultant
More informationParallel Tools Platform for Judge
Parallel Tools Platform for Judge Carsten Karbach, Forschungszentrum Jülich GmbH September 20, 2013 Abstract The Parallel Tools Platform (PTP) represents a development environment for parallel applications.
More informationnemo-nocl Documentation
nemo-nocl Documentation Release 0 James Harle January 20, 2017 Contents 1 Working Environment 3 1.1 NEMO on ARCHER........................................... 3 1.2 NEMO on Mobius............................................
More informationInstallation Guide for sundials v2.6.2
Installation Guide for sundials v2.6.2 Eddy Banks, Aaron M. Collier, Alan C. Hindmarsh, Radu Serban, and Carol S. Woodward Center for Applied Scientific Computing Lawrence Livermore National Laboratory
More informationDebugging Intel Xeon Phi KNC Tutorial
Debugging Intel Xeon Phi KNC Tutorial Last revised on: 10/7/16 07:37 Overview: The Intel Xeon Phi Coprocessor 2 Debug Library Requirements 2 Debugging Host-Side Applications that Use the Intel Offload
More informationIntroduction to the NCAR HPC Systems. 25 May 2018 Consulting Services Group Brian Vanderwende
Introduction to the NCAR HPC Systems 25 May 2018 Consulting Services Group Brian Vanderwende Topics to cover Overview of the NCAR cluster resources Basic tasks in the HPC environment Accessing pre-built
More informationPGDBG Debugger Installation Guide. Version The Portland Group
PGDBG Debugger Installation Guide Version 12.10 The Portland Group While every precaution has been taken in the preparation of this document, The Portland Group (PGI ), a wholly-owned subsidiary of STMicroelectronics,
More informationSharpen Exercise: Using HPC resources and running parallel applications
Sharpen Exercise: Using HPC resources and running parallel applications Contents 1 Aims 2 2 Introduction 2 3 Instructions 3 3.1 Log into ARCHER frontend nodes and run commands.... 3 3.2 Download and extract
More informationCS354R: Game Technology
CS354R: Game Technology DevOps and Quality Assurance Fall 2018 What is DevOps? Development Operations Backend facilitation of development Handles local and remote hardware Maintains build infrastructure
More informationAutomatic trace analysis with the Scalasca Trace Tools
Automatic trace analysis with the Scalasca Trace Tools Ilya Zhukov Jülich Supercomputing Centre Property Automatic trace analysis Idea Automatic search for patterns of inefficient behaviour Classification
More informationCode Blocks Cannot Find Compiler Executable Windows 7
Code Blocks Cannot Find Compiler Executable Windows 7 Windows. Once you've installed a new compiler, be sure to read the I couldn't find a way to force CB to use a unix-link shell, but was able to find
More information