HPC Aaditya User Policies & Support

Transcription

1 HPC Aaditya User Policies & Support Ketan B. Kulkarni Indian Institute of Tropical Meteology, Pashan Pune India

2 Outline INCOIS Resources Home Directory File Storage Job Schedular Queue Interactive Jobs User Support Redmine Software stack Module System

3 INCOIS Resources Compute 100 TF (approx 4 rack or 312 nodes or 4900 procs) Storage 500 TB = /incois /moes/home 100GB/user /moes/data (common data) /moes/models (common models) /moes/scratch System Admin Annapurnaiah for INCOIS Mr.

4 Home Directory Users can find their home directory under /moes/home/$logname (e.g /moes/home/ketan) Home directory is limited to 100GB. (soft limit 90GB) This directory should be used for important datasets, scripts, results etc. (not for model runtime output) As a policy, support staff will not enter into any users personal area. Incremenatal daily backup on the tape. Finite snapshots available.

5 File Storage Users should use following file system to run their applications /incois User should create his/her own personal directory under this file system and launch jobs e.g. /incois/$incoisuser Currently no user based quotas have been implemented on this file system. To be implemented after consultation with system administrator. All INCOIS users have been grouped under same group incois unix File access control prevents user write access into other directories/groups. Users from same group can share data freely.

6 File Storage Scratch space available at /moes/scratch Any files older than 7 days will be automatically deleted. No touch command is allowed on this storage. Standard model release versions /moes/models Various model related data, input files, initial conditions etc. Read access only. /moes/data Read access only Details in the process of finalization

7 Job Schedular Queue INCOIS users should use following LSF queue #BSUB q incois Job priorities to be decided by system admin. Currently no job types (e.g. large, medium, small etc) have been implemented. These will be decided after consultation with system administrator. Dynamic login on compute nodes has been disabled to prevent abuse of the system. Users can only log in onto the compute nodes on which their jobs are running

8 Interactive Jobs Interactive jobs should not be run on login nodes. Login nodes are submiting the jobs. for compiling, editing and Use utility nodes for interactive and graphically intensive jobs. Access utility nodes as follows From any login node type ssh X iitmutil01 or iitmutil02 iitmutil03 iitmutil04

9 Interactive Jobs Utility node configuration 2.6 GHz Intel Xeon E (Sandy Bridge) processors dual socket, 8 cores per socket (similar to login node) 256 GB RAM (double the login node, 4 times the compute node) Grpahics card NVIDIA Corporation GF100GL [Quadro 4000] Matlab, IDL, NCL etc can be interactively used on utility nodes.

10 User Support For application/system related queries write to us on following address. For general purpose information about the system visit Aaditya HPC website at Emergency contact only Time of response/solution is set to 2 working days. After this period, escalate issues to your system administrator. Beyond that, escalate to Mr. Jeelani. Due to limitations of in tracking an issue, a new issue/bug tracking system has been implemented. (For application related issues only) Currently in testing and soon to be released to general user community.

11 Redmine Redmine is an open source project management tool released under GNU public licence. Some of the main features of Redmine are: Multiple projects support Flexible role based access control Flexible issue tracking system News, documents & files management Time tracking Custom fields for issues, time entries, projects and users SCM integration (SVN, CVS, Git, Mercurial, Bazaar and Darcs) Issue creation via Multiple LDAP authentication support User self registration support source:

12 Redmine

13 Redmine

14 Redmine

15

16 Software Stack Software module system which dynamically alters user environment is implemented. On log in users see a default list of modules. module list will list currently loaded modules.

17 Module System To see list of all the available modules, use module avail

18 Module System To load a desired module, use module load GNU paraview/4.0.1 To unload unwanted module module unload GNU paraview/4.0.1 To switch between versions module swap GNU paraview/4.2.0 To list module path module show GNU paraview/4.2.0 [ketan@iitmlogin3 ~]$ module show GNU paraview/4.2.0 /gpfs1/home/libs/gnu/module/modules /Modules/GNU/GNU paraview/4.2.0: module whatis PARAVIEW (gcc, g++, gfortran) prepend path PATH /gpfs1/home/libs/gnu/paraview/paraview Linux 64bit/bin prepend path 64bit/lib prepend path LD_LIBRARY_PATH /gpfs1/home/libs/gnu/paraview/paraview Linux LIBRARY_PATH /gpfs1/home/libs/gnu/paraview/paraview Linux 64bit/lib A comprehensive list of all the modules/applications is available under Aaditya HPC website.

19 Special Thanks To IITM Dr. A. Surachandra Rao Dr. A. K. Sahai Dr. Bipin Kumar Shri. S. M. D. Jeelani IBM Pharthiphan Ashok Amit Patil Rajamanickam M. Ranjith Ganeshan Pravesh Goyal

20 Thank You!!!