Guillimin HPC Users Meeting April 13, 2017

Size: px
Start display at page:

Download "Guillimin HPC Users Meeting April 13, 2017"

Transcription

1 Guillimin HPC Users Meeting April 13, 2017 McGill University / Calcul Québec / Compute Canada Montréal, QC Canada

2 Please be kind to your fellow user meeting attendees Limit to two slices of pizza per person to start please And please recycle your pop cans. Thank you! 2

3 Outline Compute Canada News System Status Scheduled Power Maintenance Training News Special Topic Remote Visualization on Guillimin 3

4 Compute Canada News 2017 Resource Allocation Competitions Announcement of Awards: Done Implementation of Awards: Mid June 2017 Important notes: There is some small number of migrations of allocations, either partial or full, from Guillimin to other Compute Canada systems (such as the new Cedar and Graham) Affected users should prepare their migration by configuring their Globus account and by cleaning their storage spaces: removing unnecessary data, grouping and compressing files in archives We can help answer any questions regarding migration if your allocation is on a different system 4

5 Compute Canada News 2017 High Performance Computing Symposium HPCS June 5th 9th Queen's University, Kingston (Ontario) Call for papers and posters: submissions due April 17 5

6 System Status The HDP (Hortonworks Data Platform) hadoop cluster has been upgraded Upgrade from hdp2.3 on CentOS 6 --> hdp2.5 on CentOS 7. We will soon publish the Hadoop-on-Guillimin documentation on the Calcul Quebec Wiki For access and questions please contact us at guillimin@calculquebec.ca Some ongoing issues with Xeon Phi nodes - we are investigating (jobs do not always clean up properly) 6

7 System Status Storage /gs : went from 99% used to 92% (as of April 13) due to the scheduled clean-up of /scratch, as well as from the general clean-up request - Thank you Upcoming retirement of /sb and /lb storage hardware (DDN SFA 10k from 2011) Will require migration of a few TeraBytes of /home directories to a new location on /gs Migration intended to be transparent to end users The migration schedule is still to be confirmed, but may occur during the week of April

8 System Status Upcoming scheduled power maintenance: April Major power maintenance by ETS to upgrade 25kV feeds to campus and therefore to the HPC Centre Scheduled cuts: April 22-23, April 25-26, April Impact (from April 22 at approximately noon) All access (worker nodes, login nodes, storage) closed on Saturday April 22 at noon (12 PM). VMs on local disks will be closed at 5 PM Significantly reduced or no access to worker nodes during the week To be confirmed: Guillimin storage and login nodes may be placed on generator so as to enable access to data during that week Outages of April and April would affect all Guillimin (including login nodes and storage) 8

9 System Status Upcoming scheduled power maintenance: April Recommendations Attempt to complete any important project beforehand If you need to work on any code or data during that week, make sure to keep a copy at another site, when feasible More information regarding the schedule of activity and service operations will be distributed to all users via , as well as be posted to 9

10 Training News All upcoming events: calculquebec.eventbrite.ca May Location: Université du Québec à Trois-Rivières Format: lesson in the morning, project in the afternoon Track 1: Data Analysis with R Track 2: Parallel Programming Recently completed: March 23 - Introduction to OpenMP (McGill) Apr. 4 - Analyse de données massives avec Spark (U. Laval) Apr. 6 - Programmation en R intermédiaire (UdeM) All materials from previous workshops are available online: wiki.calculquebec.ca/w/formations/en All user meeting presentations online at 10

11 Other News Support Level Activity during the long week-end April 14 to April 17 inclusive - returning April 18 Reduced level of access to general user support All systems and services available and will be closely monitored Priority and critical issues will be addressed 11

12 User Feedback and Discussion Questions? Comments? We value your feedback. Contact us at: Guillimin Operational News for Users Status Pages (all CQ systems) Follow us on Twitter 12

13 Remote Visualization on Guillimin April 13, 2017 McGill University / Calcul Québec / Compute Canada Montréal, QC Canada

14 About X11 Forwarding X-forwarding ssh -X qsub -I -X./app & Typically, graphics are rendered on your local machine - the remote GPU is not used Potentially heavy on network and CPU You must keep the connection active XQuartz: to fix OpenGL issue, run in a local shell: defaults write org.macosforge.xquartz.x11 \ enable_iglx -bool true Then restart XQuartz 14

15 Why X2Go? Why VNC? Introduction to X2Go and VNC Complete Linux desktop experience Graphics are rendered on the worker node Compressed video stream received from an SSH tunnel Keyboard and mouse inputs are sent to worker node Supports dropped connections Can reconnect from different client locations Specifically to X2Go The client requires a local X11 server Support for sound, file and clipboard sharing Server currently only supported on login nodes Specifically to VNC: server supported on all nodes 15

16 Using the X2Go Client Internet Login node X2Go server X11 Server + X2Go client SSH Tunnel 16

17 Using the X2Go Client Installation notes: Windows: the X11 server comes with X2Go Mac OS X: Must install XQuartz first Install X2Go Log out and log in Linux: X2Go will use the local Xorg server When creating a new session: Provide a unique session name Recommended: the Host should be a specific login node, e.g. guillimin5.calculquebec.ca guillimin[4-8].calculquebec.ca Demo 17

18 1) VNC Server, 2) SSH Tunnel, 3) VNC Client Internet Login node Switch ssh + VNC client Port: 159XY Any available port SSH Tunnel Port: 59XY Display :Y or :XY Worker node VNC Server 18

19 1) VNC Server Goal: starting a VNC server on a worker node Prerequisite: Setting a VNC password vncserver vncserver -kill :Y Import (and edit) scripts: # Edit Y value cp -a /software/workshop/vnc ~/ vnc/vncserver.sh: submission script Starts VNC, sleeps, stops VNC vnc/killsleep.sh: to stop the job cleanly Submit a job that will start the VNC server: qsub ~/vnc/vncserver.sh 19

20 2) SSH Tunnel Goal: establish an SSH tunnel between the worker node and the local workstation On which node is VNC Server running? And which display is opened? showq -r -u $USER ls -ltr ~/.vnc tail -n 2 (Mac OSX and Linux) Use your local terminal in order to create the tunnel (edit: worker_node, XY): ssh -L 159XY:worker_node:59XY username@login.node ssh -L 15901:hb-2r04-n08:5901 username@login.node 20

21 2) SSH Tunnel (with PuTTY) 21

22 3) VNC Client On Linux: TigerVNC or any other VNC package vncviewer & On Windows and Mac OS X: RealVNC or any other VNC client Set the VNC Server to: localhost:159xy For example: localhost:15901 Password: your new VNC password! Your desktop session may be locked by the screen saver: use your regular password If some root password is requested, let us know 22

23 Closing VNC session Quick disconnect: Close VNC client Close SSH tunnel Terminate the VNC session: Connect to login node Then, connect to worker node There should be a sleep process ps -eo user,pid,cmd grep $USER Use the provided script to end the whole job ~/vnc/killsleep.sh 23

24 Conclusion Any question? For other questions: 24

Guillimin HPC Users Meeting March 16, 2017

Guillimin HPC Users Meeting March 16, 2017 Guillimin HPC Users Meeting March 16, 2017 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Please be kind to your fellow user meeting attendees Limit to

More information

Guillimin HPC Users Meeting November 16, 2017

Guillimin HPC Users Meeting November 16, 2017 Guillimin HPC Users Meeting November 16, 2017 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Please be kind to your fellow user meeting attendees Limit

More information

Guillimin HPC Users Meeting October 20, 2016

Guillimin HPC Users Meeting October 20, 2016 Guillimin HPC Users Meeting October 20, 2016 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Please be kind to your fellow user meeting attendees Limit

More information

Guillimin HPC Users Meeting June 16, 2016

Guillimin HPC Users Meeting June 16, 2016 Guillimin HPC Users Meeting June 16, 2016 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Compute Canada News System Status Software Updates Training News

More information

Guillimin HPC Users Meeting. Bryan Caron

Guillimin HPC Users Meeting. Bryan Caron July 17, 2014 Bryan Caron bryan.caron@mcgill.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News Upcoming Maintenance Downtime in August Storage System

More information

Guillimin HPC Users Meeting December 14, 2017

Guillimin HPC Users Meeting December 14, 2017 Guillimin HPC Users Meeting December 14, 2017 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Please be kind to your fellow user meeting attendees Limit

More information

Guillimin HPC Users Meeting. Bart Oldeman

Guillimin HPC Users Meeting. Bart Oldeman June 19, 2014 Bart Oldeman bart.oldeman@mcgill.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News Upcoming Maintenance Downtime in August Storage System

More information

Guillimin HPC Users Meeting January 13, 2017

Guillimin HPC Users Meeting January 13, 2017 Guillimin HPC Users Meeting January 13, 2017 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Please be kind to your fellow user meeting attendees Limit

More information

Guillimin HPC Users Meeting February 11, McGill University / Calcul Québec / Compute Canada Montréal, QC Canada

Guillimin HPC Users Meeting February 11, McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Guillimin HPC Users Meeting February 11, 2016 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Compute Canada News Scheduler Updates Software Updates Training

More information

Guillimin HPC Users Meeting July 14, 2016

Guillimin HPC Users Meeting July 14, 2016 Guillimin HPC Users Meeting July 14, 2016 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News System Status Software Updates Training

More information

Introduction to Cuda Visualization. Graphical Application Tunnelling on Palmetto

Introduction to Cuda Visualization. Graphical Application Tunnelling on Palmetto Introduction to Cuda Visualization The CUDA programming paradigm is NVidia's development tool which is used to enable advanced computer processing on their GPGPU (General Purpose graphics Processing Units)

More information

Outline. March 5, 2012 CIRMMT - McGill University 2

Outline. March 5, 2012 CIRMMT - McGill University 2 Outline CLUMEQ, Calcul Quebec and Compute Canada Research Support Objectives and Focal Points CLUMEQ Site at McGill ETS Key Specifications and Status CLUMEQ HPC Support Staff at McGill Getting Started

More information

Guillimin HPC Users Meeting March 17, 2016

Guillimin HPC Users Meeting March 17, 2016 Guillimin HPC Users Meeting March 17, 2016 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News System Status Software Updates Training

More information

Remote Connection to the Zoo

Remote Connection to the Zoo YALE UNIVERSITY DEPARTMENT OF COMPUTER SCIENCE CPSC 427: Object-Oriented Programming Handout #3 Professor M. J. Fischer February 2, 2016 1 Introduction Remote Connection to the Zoo The Zoo computers can

More information

Guillimin HPC Users Meeting

Guillimin HPC Users Meeting Guillimin HPC Users Meeting July 16, 2015 guillimin@calculquebec.ca McGill University / Calcul Québec / Compute Canada Montréal, QC Canada Outline Compute Canada News Storage Updates Software Updates Training

More information

Tools for Handling Big Data and Compu5ng Demands. Humani5es and Social Science Scholars

Tools for Handling Big Data and Compu5ng Demands. Humani5es and Social Science Scholars Tools for Handling Big Data and Compu5ng Demands Humani5es and Social Science Scholars Outline Overview of Compute Canada and WestGrid Focus on Humani5es and Social Sciences The Resource Alloca5on Compe55on

More information

Introduction to the RHUL-Psychology computing system

Introduction to the RHUL-Psychology computing system Introduction to the RHUL-Psychology computing system Tibor Auer Research Fellow in MRI Overview Resources Accessing resources Data Scientific software Best practices Overview Resources Accessing resources

More information

Name Department/Research Area Have you used the Linux command line?

Name Department/Research Area Have you used the Linux command line? Please log in with HawkID (IOWA domain) Macs are available at stations as marked To switch between the Windows and the Mac systems, press scroll lock twice 9/27/2018 1 Ben Rogers ITS-Research Services

More information

Introduction to HPC Resources and Linux

Introduction to HPC Resources and Linux Introduction to HPC Resources and Linux Burak Himmetoglu Enterprise Technology Services & Center for Scientific Computing e-mail: bhimmetoglu@ucsb.edu Paul Weakliem California Nanosystems Institute & Center

More information

UoW HPC Quick Start. Information Technology Services University of Wollongong. ( Last updated on October 10, 2011)

UoW HPC Quick Start. Information Technology Services University of Wollongong. ( Last updated on October 10, 2011) UoW HPC Quick Start Information Technology Services University of Wollongong ( Last updated on October 10, 2011) 1 Contents 1 Logging into the HPC Cluster 3 1.1 From within the UoW campus.......................

More information

Graham vs legacy systems

Graham vs legacy systems New User Seminar Graham vs legacy systems This webinar only covers topics pertaining to graham. For the introduction to our legacy systems (Orca etc.), please check the following recorded webinar: SHARCNet

More information

PARALLEL COMPUTING IN R USING WESTGRID CLUSTERS STATGEN GROUP MEETING 10/30/2017

PARALLEL COMPUTING IN R USING WESTGRID CLUSTERS STATGEN GROUP MEETING 10/30/2017 PARALLEL COMPUTING IN R USING WESTGRID CLUSTERS STATGEN GROUP MEETING 10/30/2017 PARALLEL COMPUTING Dataset 1 Processor Dataset 2 Dataset 3 Dataset 4 R script Processor Processor Processor WHAT IS ADVANCED

More information

To remotely use the tools in the CADE lab, do the following:

To remotely use the tools in the CADE lab, do the following: To remotely use the tools in the CADE lab, do the following: Windows: PUTTY: Putty happens to be the easiest ssh client to use since it requires no installation. You can download it at: http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html

More information

Linux for Biologists Part 2

Linux for Biologists Part 2 Linux for Biologists Part 2 Robert Bukowski Institute of Biotechnology Bioinformatics Facility (aka Computational Biology Service Unit - CBSU) http://cbsu.tc.cornell.edu/lab/doc/linux_workshop_part2.pdf

More information

High Performance Computing (HPC) Club Training Session. Xinsheng (Shawn) Qin

High Performance Computing (HPC) Club Training Session. Xinsheng (Shawn) Qin High Performance Computing (HPC) Club Training Session Xinsheng (Shawn) Qin Outline HPC Club The Hyak Supercomputer Logging in to Hyak Basic Linux Commands Transferring Files Between Your PC and Hyak Submitting

More information

New User Tutorial. OSU High Performance Computing Center

New User Tutorial. OSU High Performance Computing Center New User Tutorial OSU High Performance Computing Center TABLE OF CONTENTS Logging In... 3-5 Windows... 3-4 Linux... 4 Mac... 4-5 Changing Password... 5 Using Linux Commands... 6 File Systems... 7 File

More information

WA2503 Hadoop Programming on the. Hortonworks Data Platform. Lab Setup Guide. Web Age Solutions Inc. Copyright Web Age Solutions Inc.

WA2503 Hadoop Programming on the. Hortonworks Data Platform. Lab Setup Guide. Web Age Solutions Inc. Copyright Web Age Solutions Inc. WA2503 Hadoop Programming on the Hortonworks Data Platform Lab Setup Guide Web Age Solutions Inc. Copyright Web Age Solutions Inc. 1 Table of Contents Part 1 - Minimum Hardware Requirements...3 Part 2

More information

BRC HPC Services/Savio

BRC HPC Services/Savio BRC HPC Services/Savio Krishna Muriki and Gregory Kurtzer LBNL/BRC kmuriki@berkeley.edu, gmk@lbl.gov SAVIO - The Need Has Been Stated Inception and design was based on a specific need articulated by Eliot

More information

Zadara Enterprise Storage in

Zadara Enterprise Storage in Zadara Enterprise Storage in Google Cloud Platform (GCP) Deployment Guide March 2017 Revision A 2011 2017 ZADARA Storage, Inc. All rights reserved. Zadara Storage / GCP - Deployment Guide Page 1 Contents

More information

JHU Economics August 24, Galaxy How To SSH and RDP

JHU Economics August 24, Galaxy How To SSH and RDP Galaxy How To SSH and RDP The host name for the Econ Linux server is galaxy.econ.jhu.edu. It is running Ubuntu 14.04 LTS. Please NOTE: you need to be connected to the Hopkins VPN before attempting a connection

More information

For Dr Landau s PHYS8602 course

For Dr Landau s PHYS8602 course For Dr Landau s PHYS8602 course Shan-Ho Tsai (shtsai@uga.edu) Georgia Advanced Computing Resource Center - GACRC January 7, 2019 You will be given a student account on the GACRC s Teaching cluster. Your

More information

OBTAINING AN ACCOUNT:

OBTAINING AN ACCOUNT: HPC Usage Policies The IIA High Performance Computing (HPC) System is managed by the Computer Management Committee. The User Policies here were developed by the Committee. The user policies below aim to

More information

A Hands-On Tutorial: RNA Sequencing Using High-Performance Computing

A Hands-On Tutorial: RNA Sequencing Using High-Performance Computing A Hands-On Tutorial: RNA Sequencing Using Computing February 11th and 12th, 2016 1st session (Thursday) Preliminaries: Linux, HPC, command line interface Using HPC: modules, queuing system Presented by:

More information

Programming Environment on Ranger Cluster

Programming Environment on Ranger Cluster Programming Environment on Ranger Cluster Cornell Center for Advanced Computing December 8, 2010 12/8/2010 www.cac.cornell.edu 1 User Guides TACC Ranger (http://services.tacc.utexas.edu/index.php/ranger-user-guide)

More information

Remote & Collaborative Visualization. Texas Advanced Computing Center

Remote & Collaborative Visualization. Texas Advanced Computing Center Remote & Collaborative Visualization Texas Advanced Computing Center TACC Remote Visualization Systems Longhorn NSF XD Dell Visualization Cluster 256 nodes, each 8 cores, 48 GB (or 144 GB) memory, 2 NVIDIA

More information

Workstations & Thin Clients

Workstations & Thin Clients 1 Workstations & Thin Clients Overview Why use a BioHPC computer? System Specs Network requirements OS Tour Running Code Locally Submitting Jobs to the Cluster Run Graphical Jobs on the Cluster Use Windows

More information

NoMachine Remote Access Evaluation Report

NoMachine Remote Access Evaluation Report NoMachine Remote Access Evaluation Report 2015 Version 1.0 NoMachine Remote Access Evaluation Report Page 1 Table of Contents A. Document History B. Document Scope C. Executive Summary D. Introduction

More information

LOG ON TO LINUX AND LOG OFF

LOG ON TO LINUX AND LOG OFF EXPNO:1A LOG ON TO LINUX AND LOG OFF AIM: To know how to logon to Linux and logoff. PROCEDURE: Logon: To logon to the Linux system, we have to enter the correct username and password details, when asked,

More information

FUJITSU Cloud Service S5 Connecting to a Virtual Machine (VM)

FUJITSU Cloud Service S5 Connecting to a Virtual Machine (VM) FUJITSU Cloud Service S5 Connecting to a Virtual Machine (VM) This guide describes the process for connecting to a FUJITSU Cloud Service S5 Virtual Machine Each Virtual System provides the ability to establish

More information

Setting Up VNC, SSH Tunnels, and RDP

Setting Up VNC, SSH Tunnels, and RDP Setting Up VNC, SSH Tunnels, and RDP Thomas Pepler August 8, 2016 If you have suggestions for improving this document, please email them to: tpepler@doe.carleton.ca Contents 1 Connecting to DOE Linux Machines

More information

Introduction to BioHPC

Introduction to BioHPC Introduction to BioHPC New User Training [web] [email] portal.biohpc.swmed.edu biohpc-help@utsouthwestern.edu 1 Updated for 2015-06-03 Overview Today we re going to cover: What is BioHPC? How do I access

More information

Introduction to High-Performance Computing (HPC)

Introduction to High-Performance Computing (HPC) Introduction to High-Performance Computing (HPC) Computer components CPU : Central Processing Unit cores : individual processing units within a CPU Storage : Disk drives HDD : Hard Disk Drive SSD : Solid

More information

Minnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved.

Minnesota Supercomputing Institute Regents of the University of Minnesota. All rights reserved. Minnesota Supercomputing Institute Introduction to Job Submission and Scheduling Andrew Gustafson Interacting with MSI Systems Connecting to MSI SSH is the most reliable connection method Linux and Mac

More information

An Introduction to Cluster Computing Using Newton

An Introduction to Cluster Computing Using Newton An Introduction to Cluster Computing Using Newton Jason Harris and Dylan Storey March 25th, 2014 Jason Harris and Dylan Storey Introduction to Cluster Computing March 25th, 2014 1 / 26 Workshop design.

More information

Using HIPE remotely: NHSC Remote Computing and running batch jobs

Using HIPE remotely: NHSC Remote Computing and running batch jobs NHSC Data Processing Workshop Pasadena 26 th - 30 th Aug 2013 Using HIPE remotely: NHSC Remote Computing and running batch jobs Presenter: Dave Shupe, NHSC with Jeff Jacobson and many other contributors

More information

Introduction to HPC Using zcluster at GACRC

Introduction to HPC Using zcluster at GACRC Introduction to HPC Using zcluster at GACRC On-class PBIO/BINF8350 Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? What

More information

Introduction to BioHPC

Introduction to BioHPC Introduction to BioHPC New User Training [web] [email] portal.biohpc.swmed.edu biohpc-help@utsouthwestern.edu 1 Updated for 2018-03-07 Overview Today we re going to cover: What is BioHPC? How do I access

More information

IBM Cloud Client Technical Engagement Education Network Columbus, Ohio

IBM Cloud Client Technical Engagement Education Network Columbus, Ohio IBM Cloud Client Technical Engagement Education Network Columbus, Ohio In order to access the lab environment you need to install a VPN client. Please follow these instructions to install the Connect Tunnel

More information

Practical Introduction to

Practical Introduction to 1 2 Outline of the workshop Practical Introduction to What is ScaleMP? When do we need it? How do we run codes on the ScaleMP node on the ScaleMP Guillimin cluster? How to run programs efficiently on ScaleMP?

More information

Robert Bukowski Jaroslaw Pillardy 6/27/2011

Robert Bukowski Jaroslaw Pillardy 6/27/2011 COMPUTATIONAL BIOLOGY SERVICE UNIT, 3CPG RNA Seq CBSU Computational Resources for the Workshop Robert Bukowski (bukowski@cornell.edu); Jaroslaw Pillardy (jp86@cornell.edu) 6/27/2011 In this edition of

More information

Protected Environment at CHPC. Sean Igo Center for High Performance Computing September 11, 2014

Protected Environment at CHPC. Sean Igo Center for High Performance Computing September 11, 2014 Protected Environment at CHPC Sean Igo Center for High Performance Computing Sean.Igo@utah.edu September 11, 2014 Purpose of Presentation Overview of CHPC environment / access Actually this is most of

More information

An Introduction to Gauss. Paul D. Baines University of California, Davis November 20 th 2012

An Introduction to Gauss. Paul D. Baines University of California, Davis November 20 th 2012 An Introduction to Gauss Paul D. Baines University of California, Davis November 20 th 2012 What is Gauss? * http://wiki.cse.ucdavis.edu/support:systems:gauss * 12 node compute cluster (2 x 16 cores per

More information

XSEDE New User Tutorial

XSEDE New User Tutorial April 2, 2014 XSEDE New User Tutorial Jay Alameda National Center for Supercomputing Applications XSEDE Training Survey Make sure you sign the sign in sheet! At the end of the module, I will ask you to

More information

Basic UNIX commands. HORT Lab 2 Instructor: Kranthi Varala

Basic UNIX commands. HORT Lab 2 Instructor: Kranthi Varala Basic UNIX commands HORT 59000 Lab 2 Instructor: Kranthi Varala Client/Server architecture User1 User2 User3 Server (UNIX/ Web/ Database etc..) User4 High Performance Compute (HPC) cluster User1 Compute

More information

Using Sapelo2 Cluster at the GACRC

Using Sapelo2 Cluster at the GACRC Using Sapelo2 Cluster at the GACRC New User Training Workshop Georgia Advanced Computing Resource Center (GACRC) EITS/University of Georgia Zhuofei Hou zhuofei@uga.edu 1 Outline GACRC Sapelo2 Cluster Diagram

More information

Agent and Agent Browser. Updated Friday, January 26, Autotask Corporation

Agent and Agent Browser. Updated Friday, January 26, Autotask Corporation Agent and Agent Browser Updated Friday, January 26, 2018 2018 Autotask Corporation Table of Contents Table of Contents 2 The AEM Agent and Agent Browser 3 AEM Agent 5 Privacy Mode 9 Agent Browser 11 Agent

More information

Installing Exceed. (Exceed Exceed 14 3D + SecureShell 14) Introduction

Installing Exceed. (Exceed Exceed 14 3D + SecureShell 14) Introduction Installing Exceed (Exceed 14.0 + Exceed 14 3D + SecureShell 14) Introduction University of Sheffield has a site license for the X-Windows terminal emulation software named Exceed. ( For information: Exceed

More information

Introduction to remote command line Linux. Research Computing Team University of Birmingham

Introduction to remote command line Linux. Research Computing Team University of Birmingham Introduction to remote command line Linux Research Computing Team University of Birmingham Linux/UNIX/BSD/OSX/what? v All different v UNIX is the oldest, mostly now commercial only in large environments

More information

Before We Start. Sign in hpcxx account slips Windows Users: Download PuTTY. Google PuTTY First result Save putty.exe to Desktop

Before We Start. Sign in hpcxx account slips Windows Users: Download PuTTY. Google PuTTY First result Save putty.exe to Desktop Before We Start Sign in hpcxx account slips Windows Users: Download PuTTY Google PuTTY First result Save putty.exe to Desktop Research Computing at Virginia Tech Advanced Research Computing Compute Resources

More information

Parallel Programming Pre-Assignment. Setting up the Software Environment

Parallel Programming Pre-Assignment. Setting up the Software Environment Parallel Programming Pre-Assignment Setting up the Software Environment Authors: B. Wilkinson and C. Ferner. Modification date: Aug 21, 2014 (Minor correction Aug 27, 2014.) Software The purpose of this

More information

New User Seminar: Part 2 (best practices)

New User Seminar: Part 2 (best practices) New User Seminar: Part 2 (best practices) General Interest Seminar January 2015 Hugh Merz merz@sharcnet.ca Session Outline Submitting Jobs Minimizing queue waits Investigating jobs Checkpointing Efficiency

More information

Using WestGrid from the desktop Oct on Access Grid

Using WestGrid from the desktop Oct on Access Grid Using WestGrid from the desktop Oct 11 2007 on Access Grid Introduction Simon Sharpe, UCIT Client Services The best way to contact WestGrid support is to email support@westgrid.ca This seminar gives you

More information

BIOINFORMATICS POST-DIPLOMA PROGRAM SUBJECT OUTLINE Subject Title: OPERATING SYSTEMS AND PROJECT MANAGEMENT Subject Code: BIF713 Subject Description:

BIOINFORMATICS POST-DIPLOMA PROGRAM SUBJECT OUTLINE Subject Title: OPERATING SYSTEMS AND PROJECT MANAGEMENT Subject Code: BIF713 Subject Description: BIOINFORMATICS POST-DIPLOMA PROGRAM SUBJECT OUTLINE Subject Title: OPERATING SYSTEMS AND PROJECT MANAGEMENT Subject Code: BIF713 Subject Description: This course provides Bioinformatics students with the

More information

Computer Systems and Architecture

Computer Systems and Architecture Computer Systems and Architecture Introduction to UNIX Stephen Pauwels University of Antwerp October 2, 2015 Outline What is Unix? Getting started Streams Exercises UNIX Operating system Servers, desktops,

More information

HPC Account and Software Setup

HPC Account and Software Setup HPC Account and Software Setup Ken-ichi Nomura MAGICS 2 nd Workshop at USC March 2, 2018 Wireless Network Configuration 1. USC Secure Wireless 2. eduroam 3. MAGICS@USC password: magics@usc 4. USC Guest

More information

Remote and Collaborative Visualization

Remote and Collaborative Visualization Remote and Collaborative Visualization Aaron Birkland Cornell Center for Advanced Computing Data Analysis on Ranger January 2012 Large Data, Remote Systems Ranger CAC, other HPC /scratch, /work /ranger/scratch

More information

The cluster system. Introduction 22th February Jan Saalbach Scientific Computing Group

The cluster system. Introduction 22th February Jan Saalbach Scientific Computing Group The cluster system Introduction 22th February 2018 Jan Saalbach Scientific Computing Group cluster-help@luis.uni-hannover.de Contents 1 General information about the compute cluster 2 Available computing

More information

Using Compute Canada. Masao Fujinaga Information Services and Technology University of Alberta

Using Compute Canada. Masao Fujinaga Information Services and Technology University of Alberta Using Compute Canada Masao Fujinaga Information Services and Technology University of Alberta Introduction to cedar batch system jobs are queued priority depends on allocation and past usage Cedar Nodes

More information

Introduction to High-Performance Computing (HPC)

Introduction to High-Performance Computing (HPC) Introduction to High-Performance Computing (HPC) Computer components CPU : Central Processing Unit cores : individual processing units within a CPU Storage : Disk drives HDD : Hard Disk Drive SSD : Solid

More information

Introduction to High Performance Computing

Introduction to High Performance Computing Introduction to High Performance Computing By Pier-Luc St-Onge pier-luc.st-onge@mcgill.ca September 11, 2014 Objectives Familiarize new users with the concepts of High Performance Computing (HPC). Outline

More information

Introduction to Joker Cyber Infrastructure Architecture Team CIA.NMSU.EDU

Introduction to Joker Cyber Infrastructure Architecture Team CIA.NMSU.EDU Introduction to Joker Cyber Infrastructure Architecture Team CIA.NMSU.EDU What is Joker? NMSU s supercomputer. 238 core computer cluster. Intel E-5 Xeon CPUs and Nvidia K-40 GPUs. InfiniBand innerconnect.

More information

New CentOS7 Development Virtual Machines (CC7 VPCs) Luigi Gallerani Pablo Pinés León BE-CO-IN 19 October 2017

New CentOS7 Development Virtual Machines (CC7 VPCs) Luigi Gallerani Pablo Pinés León BE-CO-IN 19 October 2017 New CentOS7 Development Virtual Machines (CC7 VPCs) Luigi Gallerani Pablo Pinés León BE-CO-IN 19 October 2017 Introduction Since Jan 2017, CentOS7 (CC7) is the operational platform in the CCC During 2016

More information

Supercomputing environment TMA4280 Introduction to Supercomputing

Supercomputing environment TMA4280 Introduction to Supercomputing Supercomputing environment TMA4280 Introduction to Supercomputing NTNU, IMF February 21. 2018 1 Supercomputing environment Supercomputers use UNIX-type operating systems. Predominantly Linux. Using a shell

More information

2017 Resource Allocations Competition Results

2017 Resource Allocations Competition Results 2017 Resource Allocations Competition Results Table of Contents Executive Summary...3 Computational Resources...5 CPU Allocations...5 GPU Allocations...6 Cloud Allocations...6 Storage Resources...6 Acceptance

More information

Getting Started with eggplant Functional

Getting Started with eggplant Functional Published on Documentation (http://127.0.0.1) Home > Getting Started Getting Started Getting Started with eggplant Functional This manual provides the background and set-up instructions you need to get

More information

Siemens PLM Software. HEEDS MDO Setting up a Windows-to- Linux Compute Resource.

Siemens PLM Software. HEEDS MDO Setting up a Windows-to- Linux Compute Resource. Siemens PLM Software HEEDS MDO 2018.04 Setting up a Windows-to- Linux Compute Resource www.redcedartech.com. Contents Introduction 1 On Remote Machine B 2 Installing the SSH Server 2 Configuring the SSH

More information

Introduction to Python for Scientific Computing

Introduction to Python for Scientific Computing 1 Introduction to Python for Scientific Computing http://tinyurl.com/cq-intro-python-20151022 By: Bart Oldeman, Calcul Québec McGill HPC Bart.Oldeman@calculquebec.ca, Bart.Oldeman@mcgill.ca Partners and

More information

Introduction to Linux

Introduction to Linux Introduction to Linux University of Bristol - Advance Computing Research Centre 1 / 47 Operating Systems Program running all the time Interfaces between other programs and hardware Provides abstractions

More information

Blended Learning Outline: Developer Training for Apache Spark and Hadoop (180404a)

Blended Learning Outline: Developer Training for Apache Spark and Hadoop (180404a) Blended Learning Outline: Developer Training for Apache Spark and Hadoop (180404a) Cloudera s Developer Training for Apache Spark and Hadoop delivers the key concepts and expertise need to develop high-performance

More information

Anvil: HCC's Cloud. June Workshop Series - June 26th

Anvil: HCC's Cloud. June Workshop Series - June 26th Anvil: HCC's Cloud June Workshop Series - June 26th Anvil: HCC's Cloud OpenStack Cloud Resource offering customizable virtual machines For projects not well served by a traditional Linux environment: Software

More information

Guide for Attempting an HDP Certification Practice Exam. Revision 2 Hortonworks University

Guide for Attempting an HDP Certification Practice Exam. Revision 2 Hortonworks University Guide for Attempting an HDP Certification Practice Exam Revision 2 Hortonworks University Overview Hortonworks University has developed a practice environment that emulates our actual exam environment.

More information

Introduction to the NCAR HPC Systems. 25 May 2018 Consulting Services Group Brian Vanderwende

Introduction to the NCAR HPC Systems. 25 May 2018 Consulting Services Group Brian Vanderwende Introduction to the NCAR HPC Systems 25 May 2018 Consulting Services Group Brian Vanderwende Topics to cover Overview of the NCAR cluster resources Basic tasks in the HPC environment Accessing pre-built

More information

STARTING THE DDT DEBUGGER ON MIO, AUN, & MC2. (Mouse over to the left to see thumbnails of all of the slides)

STARTING THE DDT DEBUGGER ON MIO, AUN, & MC2. (Mouse over to the left to see thumbnails of all of the slides) STARTING THE DDT DEBUGGER ON MIO, AUN, & MC2 (Mouse over to the left to see thumbnails of all of the slides) ALLINEA DDT Allinea DDT is a powerful, easy-to-use graphical debugger capable of debugging a

More information

Introduction to the Cluster

Introduction to the Cluster Introduction to the Cluster Advanced Computing Center for Research and Education http://www.accre.vanderbilt.edu Follow us on Twitter for important news and updates: @ACCREVandy The Cluster We will be

More information

High Performance Computing (HPC) Using zcluster at GACRC

High Performance Computing (HPC) Using zcluster at GACRC High Performance Computing (HPC) Using zcluster at GACRC On-class STAT8060 Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC?

More information

Introduction to BioHPC New User Training

Introduction to BioHPC New User Training Introduction to BioHPC New User Training [web] [email] portal.biohpc.swmed.edu biohpc-help@utsouthwestern.edu 1 Updated for 2018-04-04 Overview Today we re going to cover: What is BioHPC? How do I access

More information

Debugging with TotalView

Debugging with TotalView Debugging with TotalView Le Yan HPC Consultant User Services Goals Learn how to start TotalView on Linux clusters Get familiar with TotalView graphic user interface Learn basic debugging functions of TotalView

More information

VMware Horizon FLEX Client User Guide

VMware Horizon FLEX Client User Guide Horizon FLEX 1.10 This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for more recent editions of this

More information

DogeCash Masternode Setup Guide Version 1.2 (Ubuntu 16.04)

DogeCash Masternode Setup Guide Version 1.2 (Ubuntu 16.04) DogeCash Masternode Setup Guide Version 1.2 (Ubuntu 16.04) This guide will assist you in setting up a DogeCash Masternode on a Linux Server running Ubuntu 16.04. (Use at your own risk) If you require further

More information

How to Use a Supercomputer - A Boot Camp

How to Use a Supercomputer - A Boot Camp How to Use a Supercomputer - A Boot Camp Shelley Knuth Peter Ruprecht shelley.knuth@colorado.edu peter.ruprecht@colorado.edu www.rc.colorado.edu Outline Today we will discuss: Who Research Computing is

More information

EPSCOR and Geosciences Department Remote Desktop Server: TREX

EPSCOR and Geosciences Department Remote Desktop Server: TREX EPSCOR and Geosciences Department Remote Desktop Server: TREX What The RDS (Remote Desktop Server) provides remote Windows-based host sessions on a workstation-class system to multiple users at the same

More information

Duke Compute Cluster Workshop. 3/28/2018 Tom Milledge rc.duke.edu

Duke Compute Cluster Workshop. 3/28/2018 Tom Milledge rc.duke.edu Duke Compute Cluster Workshop 3/28/2018 Tom Milledge rc.duke.edu rescomputing@duke.edu Outline of talk Overview of Research Computing resources Duke Compute Cluster overview Running interactive and batch

More information

Allinea DDT Debugger. Dan Mazur, McGill HPC March 5,

Allinea DDT Debugger. Dan Mazur, McGill HPC  March 5, Allinea DDT Debugger Dan Mazur, McGill HPC daniel.mazur@mcgill.ca guillimin@calculquebec.ca March 5, 2015 1 Outline Introduction and motivation Guillimin login and DDT configuration Compiling for a debugger

More information

CSE Linux VM. For Microsoft Windows. Based on opensuse Leap 42.2

CSE Linux VM. For Microsoft Windows. Based on opensuse Leap 42.2 CSE Linux VM For Microsoft Windows Based on opensuse Leap 42.2 Dr. K. M. Flurchick February 2, 2017 Contents 1 Introduction 1 2 Requirements 1 3 Procedure 1 4 Usage 3 4.1 Start/Stop.................................................

More information

TSMC NA Secure Chamber Quick Start Guide V2.3

TSMC NA Secure Chamber Quick Start Guide V2.3 TSMC NA Secure Chamber Quick Start Guide V2.3 1. TSMC NA Secure Chamber supports windows client only, please use windows to connect to your chamber. 2. Citrix Receiver supports version 11 or above only,

More information

System Manager Unit (SMU) Hardware Reference

System Manager Unit (SMU) Hardware Reference System Manager Unit (SMU) Hardware Reference MK-92HNAS065-02 Notices and Disclaimer Copyright 2015 Hitachi Data Systems Corporation. All rights reserved. The performance data contained herein was obtained

More information

Preparation of alignments for variant calling with GATK: exercise instructions for BioHPC Lab computers

Preparation of alignments for variant calling with GATK: exercise instructions for BioHPC Lab computers Preparation of alignments for variant calling with GATK: exercise instructions for BioHPC Lab computers Data used in the exercise We will use D. melanogaster WGS paired-end Illumina data with NCBI accessions

More information

Introduction to Visualization on Stampede

Introduction to Visualization on Stampede Introduction to Visualization on Stampede Aaron Birkland Cornell CAC With contributions from TACC visualization training materials Parallel Computing on Stampede June 11, 2013 From data to Insight Data

More information

Sandbox Setup Guide for HDP 2.2 and VMware

Sandbox Setup Guide for HDP 2.2 and VMware Waterline Data Inventory Sandbox Setup Guide for HDP 2.2 and VMware Product Version 2.0 Document Version 10.15.2015 2014-2015 Waterline Data, Inc. All rights reserved. All other trademarks are the property

More information

Introduction to HPC Using zcluster at GACRC

Introduction to HPC Using zcluster at GACRC Introduction to HPC Using zcluster at GACRC Georgia Advanced Computing Resource Center University of Georgia Zhuofei Hou, HPC Trainer zhuofei@uga.edu Outline What is GACRC? What is HPC Concept? What is

More information