Parallel Programming Techniques. Intro to PSC Tom Maiden

Similar documents
Basic Unix Commands. CGS 3460, Lecture 6 Jan 23, 2006 Zhen Yang

Welcome to getting started with Ubuntu Server. This System Administrator Manual. guide to be simple to follow, with step by step instructions

Data Management at ARSC

Introduction to the Linux Command Line

Chapter Two. Lesson A. Objectives. Exploring the UNIX File System and File Security. Understanding Files and Directories

AMS 200: Working on Linux/Unix Machines

UNIX. Basic UNIX Command

SIEMENS UserAdmin Workshop TELEPERM XP Version 4 Chapter 1

Linux hep.wisc.edu

Lecture # 2 Introduction to UNIX (Part 2)

Programming and Data Structure Laboratory (CS13002)

Lecture 01 - Working with Linux Servers and Git

Getting Started With UNIX Lab Exercises

Lab 1 Introduction to UNIX and C

Lab Working with Linux Command Line

Embedded Linux Systems. Bin Li Assistant Professor Dept. of Electrical, Computer and Biomedical Engineering University of Rhode Island

Virtual Machine. Linux flavor : Debian. Everything (except slides) preinstalled for you.

Introduction to UNIX command-line

Getting Started with UNIX

Introduction to Linux

EE516: Embedded Software Project 1. Setting Up Environment for Projects

CS CS Tutorial 2 2 Winter 2018

Linux Essentials. Programming and Data Structures Lab M Tech CS First Year, First Semester

User Guide Version 2.0

Introduction to UNIX command-line II

Introduction to High Performance Computing Using Sapelo2 at GACRC

Introduction to Linux. Fundamentals of Computer Science

UoW HPC Quick Start. Information Technology Services University of Wollongong. ( Last updated on October 10, 2011)

Hands-On Workshop bwunicluster June 29th 2015

Linux Nuts and Bolts

HIGH PERFORMANCE COMPUTING (PLATFORMS) SECURITY AND OPERATIONS

Introduction to Linux Environment. Yun-Wen Chen

Using Linux as a Virtual Machine

GNU/Linux 101. Casey McLaughlin. Research Computing Center Spring Workshop Series 2018

Introduction to UNIX Command Line

Logging in to the CRAY

Linux Operating System Environment Computadors Grau en Ciència i Enginyeria de Dades Q2

Introduction to HPC Resources and Linux

The cluster system. Introduction 22th February Jan Saalbach Scientific Computing Group

Basic Shell Commands

LAB #7 Linux Tutorial

Lab 1 Introduction to UNIX and C

CSE Linux VM. For Microsoft Windows. Based on opensuse Leap 42.2

Introduction to Unix - Lab Exercise 0

Batch Scheduling on XT3

M.C.A. (Sem.-lll) (CBCS) Examination November CCA-3003 Operating System and LinuxlUnix programming

Unix Tools / Command Line

Computer Systems and Architecture

Some useful UNIX Commands written down by Razor for newbies to get a start in UNIX

Part I. Introduction to Linux

Short Read Sequencing Analysis Workshop

Helpful Tips for Labs. CS140, Spring 2015

Unix Filesystem. January 26 th, 2004 Class Meeting 2

Arkansas High Performance Computing Center at the University of Arkansas

Using the computational resources at the GACRC

Introduction to the UNIX command line

Computer Systems and Architecture

5/8/2012. Creating and Changing Directories Chapter 7

The Supercomputing Facility for Bioinformatics & Computational Biology, IIT Delhi

Introduction to Sheffield University High Performance Computing Facilities

CMSC 201 Spring 2018 Lab 01 Hello World

Introduction to UNIX. Logging in. Basic System Architecture 10/7/10. most systems have graphical login on Linux machines

CSCI 2132 Software Development. Lecture 4: Files and Directories

Unix L555. Dept. of Linguistics, Indiana University Fall Unix. Unix. Directories. Files. Useful Commands. Permissions. tar.

Introduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill

Introduction to Linux and Cluster Computing Environments for Bioinformatics

Introduction to Linux and Supercomputers

Basic Unix and Matlab Logging in from another Unix machine, e.g. ECS lab Dells

Access: bwunicluster, bwforcluster, ForHLR

Unix/Linux Operating System. Introduction to Computational Statistics STAT 598G, Fall 2011

Unix File System. Class Meeting 2. * Notes adapted by Joy Mukherjee from previous work by other members of the CS faculty at Virginia Tech

CMSC 201 Spring 2017 Lab 01 Hello World

CSE 390a Lecture 1. introduction to Linux/Unix environment

bwunicluster Tutorial Access, Data Transfer, Compiling, Modulefiles, Batch Jobs

bwunicluster Tutorial Access, Data Transfer, Compiling, Modulefiles, Batch Jobs

Aliases are set manually or in a login script. Aliases that were set manually will be gone the next time you login.

COMS 6100 Class Notes 3

Basic UNIX commands. HORT Lab 2 Instructor: Kranthi Varala

CENG 334 Computer Networks. Laboratory I Linux Tutorial

CSE 391 Lecture 1. introduction to Linux/Unix environment

Chapter-3. Introduction to Unix: Fundamental Commands

UNIX. The Very 10 Short Howto for beginners. Soon-Hyung Yook. March 27, Soon-Hyung Yook UNIX March 27, / 29

CSC116: Introduction to Computing - Java

CSE 391 Lecture 1. introduction to Linux/Unix environment

Linux Tutorial. Ken-ichi Nomura. 3 rd Magics Materials Software Workshop. Gaithersburg Marriott Washingtonian Center November 11-13, 2018

Introduction to remote command line Linux. Research Computing Team University of Birmingham

Linux Introduction Martin Dahlö Valentin Georgiev

Unix/Linux Basics. Cpt S 223, Fall 2007 Copyright: Washington State University

Linux Survival Guide

COSC UNIX. Textbook. Grading Scheme

Introduction to Linux for BlueBEAR. January

Where can UNIX be used? Getting to the terminal. Where are you? most important/useful commands & examples. Real Unix computers

Our Workshop Environment

The Command Line. Matthew Bender. September 10, CMSC Command Line Workshop. Matthew Bender (2015) The Command Line September 10, / 25

Carnegie Mellon. Linux Boot Camp. Jack, Matthew, Nishad, Stanley 6 Sep 2016

Basic Linux Commands. Srihari Kalgi M.Tech, CSE (KReSIT), IIT Bombay. May 5, 2009

Unix Tutorial Haverford Astronomy 2014/2015

Brief Linux Presentation. July 10th, 2006 Elan Borenstein

Introduction: What is Unix?

What are Clusters? Why Clusters? - a Short History

Transcription:

Parallel Programming Techniques Intro to PSC Tom Maiden tmaiden@psc.edu

What is the PSC? PSC is a joint effort between: Carnegie Mellon University University of Pittsburgh Westinghouse Electric Company

PSC s Mission Enable solutions to important problems in Science and Engineering by providing leading-edge computational resources to the national community. Advance computational science, computational techniques and the National Information Infrastructure. Educate researchers in high performance techniques and their applications to science and engineering. Assist the private sector in exploiting high performance computing for their competitive advantage. Alcoa Pfizer Chevron USX

PSC s Mission (continued) In meeting our mission, we ve developed valuable programs and resources, including: Computational resources Partnerships with other research centers and universities Biomedical Supercomputing Initiative Scientific Visualization research and support The Corporate Program Networking Research and Operations There are numerous research and development efforts currently underway at PSC.

Disciplines Grants of time on our supercomputers are awarded to researchers from many disciplines, including: Chemistry Physics Atmospheric Science Materials Science Engineering Geological Science Astronomy Biophysics Biochemistry Neuroscience Economics and Social Science John Pople, a pioneer researchers at PSC, was awarded the 1998 Nobel Prize in chemistry. Peter Kollman, of the University of California at San Francisco, used PSC s T3D and T3E extensively for his Microsecond Villin Headpiece Folding Simulation.

Machine Environment: Supercomputers J90 ginger Number of Processors 8 Processor Peak Speed Peak Aggregate Speed 200 MFLOPs 1.6 GFLOPs Clock Cycle 10 nsec ginger.psc.edu Memory Operating System 128 MW Unicos 9.0.2.5 with AFS

Machine Environment: Supercomputers Intel Cluster Number of Compute Nodes 20 Processor Speed 10 400Mhz 10 550Mhz Numbers of Compute Processors 80 intel2.psc.edu Memory Operating System 1 Gbyte per Node Linux

Machine Environment: Supercomputers jaromir.psc.edu MPP (Massively Parallel Processing Platform) CRAY T3E PSC's T3E supercomputer is currently rated number 85 as of November 2001. 512 application processors running at 450 Mhz. Machine's theoretical peak speed : about 460 GFlops. 128 MB/processor

Machine Environment: Supercomputers lemieux.psc.edu Compaq Terascale Computing System Alphaserver SC LeMieux PSC s Alphaserver SC is currently the fastest academically available machine in the world 3024 processors (760 nodes) running at 1 GHz Theoretical peak 6048 GFlops Each node is 4 processor SMP with 4 Gbytes of memory

Machine Environment: Supercomputers Cray J90 Golem golem.psc.edu 2 Storage Tek robotic silos 6000 internally stored tapes per silo

Login Procedures Users can access the PSC Computing Platforms by using SSH

Changing Passwords VMS front ends set password AFS kpasswd T3E(jaromir) passwd FAR(golem) ssh to golem then choose the password reset selecton

Disk Quota VMS 10,000 blocks AFS 50 Mbytes T3E 20 Mbytes in $HOME T3E 32 Gbytes in $TMP Far No quota

Online Information http://www.psc.edu VMS bulletin T3E news

Using the T3E ssh jaromir.psc.edu Use scp, kftp or far to retrieve files Keep only scripts and source code in your home dir Run executables from $TMP Store output to far Remove files when you are finished

Using FAR ssh golem.psc.edu Change your password by selecting passwd Exit

Storing and Retrieving Files far get file1 file1 far get file1 file2 file3 $TMP far store file1 file1 far store file1 file2 file3 output far rget dir copies an entire subtree far rstore dir dir stores entire subtree

Moving around in far Enter far simply by typing far cp copies files mkdir create a directory mv renames a file pwd prints the current directory name rm deletes a file rmdir deletes an empty directory

Recommended Storage Use tar to combine multiple small files tar cvf file.tar * far store file.tar file.tar far get file.tar. tar xvf file.tar

Accounting Usage tracked in Service Units 1 SU is approx. 1 computing hour on 1 PE

Allocations Participants interested in obtaining production time on PSC systems should apply for a grant. http://www.psc.edu/grants/grants.html Who can apply? Post-Docs, Professors and Research Staff

Workshops Networking Biomedical Application Specific Parallel Programming

Consultation Hotline 1-412-268-6350 1-800-221-1641 Staffed six days a week: Mon-Fri 9AM-8PM Sat 9AM-4PM

Remarks Email Mail to remarks@psc.edu Response on or before the next business day Include pertinent information in the email to save time

Exercises Login to jaromir ssh jaromir.psc.edu Reset your password passwd Create a file emacs test.txt

Exercises Cont. Store the file to far far store test.txt test.txt List the files in far far ls Rename the file far mv test.txt test2.txt

Exercises Cont. Retrieve the new file to your temporary directory far get test2.txt $TMP Move to the temporary directory and then list the file cd $TMP ls