Ganglia is monitring system for high performance computing systems. We have two node potter.isb.ots.com and harry.isb.ots.com both are HPC nodes.

Transcription

1 Date : 13-Oct-2009 Ganglia installation Howto By Syed Asim Abbas For comments and suggestions : asimabbas31 at gmail dot com Ganglia is monitring system for high performance computing systems We have two node potter.isb.ots.com and harry.isb.ots.com both are HPC nodes. For HPC installation html #######Download Ganglia Package [root@potter ~]# wget angley%29/ganglia tar.gz?use_mirror=nchc [root@potter ~]# cd tmp/ 1 / 22

2 tmp]# tmp]# tar zxvf ganglia tar.gz ganglia-3.1.2/ ganglia-3.1.2/build/ ganglia-3.1.2/build/config.guess ganglia-3.1.2/build/config.sub ganglia-3.1.2/build/depcomp tmp]# cd ganglia ganglia-3.1.2]# whereis python 2 / 22

3 python: /usr/bin/python2.5 /usr/bin/python2.5-config /usr/bin/python /usr/lib/python2.5 /usr/include/python2.5 /usr/share/man/man1/python.1.gz ganglia-3.1.2]#./configure --with-python=/usr/bin/python2.5 --with-gmetad --enable-status checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for gawk... gawk checking whether make sets $(MAKE)... yes checking build system type... i686-pc-linux checking host system type... i686-pc-linux checking for gcc... gcc checking for C compiler default output file name... a.out #####ERROR 3 / 22

4 checking rrd.h presence... no checking for rrd.h... no checking for rrd_create in -lrrd... no Trying harder by including the X library path checking for rrd_create in -lrrd... no #####RRDTOOLs required [root@potter tmp]# yum install rrdtool* Loaded plugins: refresh-packagekit Setting up Install Process Parsing package install arguments Package rrdtool fc10.i386 already installed and latest version Resolving Dependencies 4 / 22

5 --> Running transaction check ---> Package rrdtool-php.i386 0: fc10 set to be updated ---> Package rrdtool-ruby.i386 0: fc10 set to be updated --> Processing Dependency: ruby(abi) = 1.8 for package: rrdtool-ruby --> Processing Dependency: libruby.so.1.8 for package: rrdtool-ruby ---> Package rrdtool-devel.i386 0: fc10 set to be updated ---> Package rrdtool-python.i386 0: fc10 set to be updated ---> Package rrdtool-tcl.i386 0: fc10 set to be updated --> Processing Dependency: tcl >= 8.0 for package: rrdtool-tcl ---> Package rrdtool-doc.i386 0: fc10 set to be updated ---> Package rrdtool-perl.i386 0: fc10 set to be updated 5 / 22

6 --> Running transaction check ---> Package tcl.i386 1: fc10 set to be updated ---> Package ruby-libs.i386 0: fc10 set to be updated --> Finished Dependency Resolution Dependencies Resolved ======================================================================== ======================================================================= Package Arch Version Repository Size ======================================================================== ======================================================================= Installing: rrdtool-devel i fc10 updates 27 k rrdtool-doc i fc10 updates 237 k 6 / 22

7 rrdtool-perl i fc10 updates 39 k rrdtool-php i fc10 updates 24 k rrdtool-python i fc10 updates 27 k rrdtool-ruby i fc10 updates 17 k rrdtool-tcl i fc10 updates 20 k Installing for dependencies: ruby-libs i fc10 fedora 1.7 M tcl i386 1: fc10 fedora 2.2 M Transaction Summary ======================================================================== ======================================================================= Install 9 Package(s) Update 0 Package(s) 7 / 22

8 Remove 0 Package(s) Total download size: 4.3 M Is this ok [y/n]: y Downloading Packages: ###########Again configure ganglia [root@potter ganglia-3.1.2]#./configure --with-python=/usr/bin/python2.5 --with-gmetad --enable-status The ganglia graphs are created using RRDTool ( Checking for python checking Python version checking Python support... yes Checking for apr 8 / 22

9 checking for apr-1-config... /usr/bin/apr-1-config checking for apr_socket_send in -lapr-1... yes The ganglia utilities use the Apache Portable Runtime functions ( Found a suitable libapr1 library Checking for confuse checking for cfg_parse in -lconfuse... no Trying harder including gettext checking for cfg_parse in -lconfuse... no Trying harder including iconv checking for cfg_parse in -lconfuse... no libconfuse not found ###########Again error ok rrdtools installed now libconfuse required 9 / 22

10 ~]# yum install libconfuse* ======================================================================== ======================================================================= Package Arch Version Repository Size ======================================================================== ======================================================================= Installing: libconfuse i fc9 fedora 86 k libconfuse-devel i fc9 fedora 15 k [root@potter ganglia-3.1.2]#./configure --with-python=/usr/bin/python2.5 --with-gmetad --enable-status config.status: creating config.h config.status: executing depfiles commands Welcome to.. 10 / 22

11 / / / (_) / / / `/ / `/ / / `/ / /_/ / /_/ / / / / /_/ / / / /_/ / /,_/_/ /_/, /_/_/,_/ / / Copyright (c) 2005 University of California, Berkeley [root@potter ganglia-3.1.2]# make make all-recursive make[1]: Entering directory `/tmp/ganglia-3.1.2' Making all in lib 11 / 22

12 make[2]: Entering directory `/tmp/ganglia-3.1.2/lib' if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/usr/include/apr-1 -I.. -I. -I../include/ -D_LARGEFILE64_SOURCE -g -O2 -fno-strict-aliasing -Wall -D_REENTRANT -MT getopt1.o -MD -MP -MF ".deps/getopt1.tpo" -c -o getopt1.o getopt1.c; then mv -f ".deps/getopt1.tpo" ".deps/getopt1.po"; else rm -f ".deps/getopt1.tpo"; exit 1; fi if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/usr/include/apr-1 -I.. -I. -I../include/ -D_LARGEFILE64_SOURCE -g -O2 -fno-strict-aliasing -Wall -D_REENTRANT -MT getopt.o -MD -MP -MF ".deps/getopt.tpo" -c -o getopt.o getopt.c; ganglia-3.1.2]# echo $? 0 ########No error make successful #########now make install [root@potter ganglia-3.1.2]# make install Making install in lib make[1]: Entering directory `/tmp/ganglia-3.1.2/lib' 12 / 22

13 make[2]: Entering directory `/tmp/ganglia-3.1.2/lib' test -z "/usr/lib" mkdir -p -- "/usr/lib" #######Gnaglia installed successfully ###########Now start configuration #########copy web dir and services from ganglia ganglia-3.1.2]# cp -a web /var/www/html/ganglia/ ganglia-3.1.2]# cp gmetad/gmetad.init /etc/rc.d/init.d/gmetad ganglia-3.1.2]# mkdir /etc/ganglia ganglia-3.1.2]# cp gmetad/gmetad.conf /etc/ganglia/ ganglia-3.1.2]# mkdir -p /var/lib/ganglia/rrds ganglia-3.1.2]# chown nobody:nobody /var/lib/ganglia/rrds 13 / 22

14 ganglia-3.1.2]# chkconfig --add gmetad ganglia-3.1.2]# chkconfig --add gmond error reading information on service gmond: No such file or directory ganglia-3.1.2]# cp gm gmetad/ gmetric/ gmond/ ganglia-3.1.2]# cp gmond/gmond.init gmond.init gmond.init.suse ganglia-3.1.2]# cp gmond/gmond.init /etc/rc.d/init.d/gmond ############Open configuration file and edit the following lines ganglia-3.1.2]# vi /etc/ganglia/gmetad.conf cluster { name = "Beowulf" 14 / 22

15 owner = "Asim Abbas" latlong = "unspecified" url = "unspecified" } #########Add the line under modules section module { name = "python_module" path = "modpython.so" params = "/usr/lib/ganglia/" #####change your lib path depand on system arch } ########Start services 15 / 22

16 ganglia]# /etc/init.d/gmond start Starting GANGLIA gmond: [ OK ] [root@potter ganglia]# /etc/init.d/gm gmetad gmond [root@potter ganglia]# /etc/init.d/gmetad start Starting GANGLIA gmetad: [ OK ] [root@potter ganglia]# /etc/init.d/httpd restart Stopping httpd: [FAILED] Starting httpd: [ OK ] [root@potter ganglia]# ps aux grep http root ? Ss 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd 16 / 22

17 apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd apache ? S 07:29 0:00 /usr/sbin/httpd #########Open browser # ganglia1.png 17 / 22

18 #####Click on potter.isb.ots.com # ganglia2.png 18 / 22

19 #########Ok one node "potter.isb.ots.com" addedharry:/etc/ganglia/ successfully #########Now we0.7kb/s add second HPC node harry:/usr/sbin/gmond "Harry.isb.ots.com" copy the files from potter.isb.ots.com toharry:/usr/lib harry.isb.ots.com #######Simply cluster]# scp /usr/sbin/gmond 126KB 125.8KB/s /etc/ganglia/gmond.conf gmond.conf KB/s /etc/init.d/gmond harry:/etc/init.d/ gmond 742 cluster]# scp /usr/lib/libganglia so.0 libganglia so libganglia so.0 193KB 193.2KB/s /usr/lib/libconfuse.so.0 harry:/usr/lib libconfuse.so.0 43KB 43.5KB/s cluster]# scp /usr/lib/libapr-1.so.0 harry:/usr/lib libapr-1.so.0 173KB 172.8KB/s -r /usr/lib/ganglia/ harry:/usr/lib moddisk.so 128KB 127.5KB/s modsys.so 128KB 128.1KB/s modpython.so 42KB 42.4KB/s modproc.so 127KB 127.4KB/s modgstatus.so 12KB 12.0KB/s modnet.so 128KB 127.7KB/s modload.so 127.5KB/s modmulticpu.so 40KB 39.7KB/s modcpu.so 132KB 132.0KB/s modmem.so 128KB 128.3KB/s #######Start 4 time" gmond on ]2nd HPC node "harry.isb.ots.com and refresh the browser 3 or [root@harry ~]# /etc/init.d/gmond start Starting GANGLIA gmond: [ OK You have new mail in service /var/spool/mail/root # ganglia3.png 19 / 22

20 # ganglia4.png 20 / 22

21 # ganglia5.png 21 / 22

22 22 / 22