Document Version: EMI Component Version: Date:

Size: px

Start display at page:

Download "Document Version: EMI Component Version: Date:"

Mildred Nicholson
6 years ago
Views:

1 EMI WN v Date: EUROPEAN MIDDLEWARE INITIATIVE EMI WN V Dcument Versin: EMI Cmpnent Versin: Date: This wrk is c-funded by the EC EMI prject under the FP7 Cllabrative Prjects Grant Agreement Nr. INFSO-RI

2 Dcument Lg Issue Date Cmment Authr / Partner Updated t EMI 3 versin C. Aiftimiei/INFN 2 3 Cpyright ntice: Cpyright (c) Members f the EMI Cllabratin See fr details n the cpyright hlders. EMI ( Eurpean Middleware Initiative ) is a prject partially funded by the Eurpean Cmmissin. Fr mre infrmatin n the prject, its partners and cntributrs please see This dcument is released under the Open Access license. Yu are permitted t cpy and distribute verbatim cpies f this dcument cntaining this cpyright ntice, but mdifying this dcument is nt allwed. Yu are permitted t cpy this dcument in whle r in part int ther dcuments if yu attach the fllwing reference t the cpied elements: "Cpyright (C) Members f the EMI Cllabratin. ". The infrmatin cntained in this dcument represents the views f EMI as f the date they are published. EMI des nt guarantee that any infrmatin cntained herein is errr-free, r up t date. EMI MAKES NO WARRANTIES, EXPRESS, IMPLIED, OR STATUTORY, BY PUBLISHING THIS DOCUMENT.

4 Table f Cntents Functinal Descriptin... 4 EMI Middleware clients & libraries present n an EMI WN... 4 Client Installatin & Cnfiguratin... 6 Installing the Operating System... 6 Scientific Linux 5 & Nde synchrnizatin, NTP installatin and cnfiguratin... 7 Installing & Cnfiguring the Middleware... 8 The Certificatin Authrity repsitry... 8 The EPEL repsitry... 8 Cnfiguring the use f EMI 2 repsitries... 9 Installatin... 9 Cnfiguratin Ntes n cnfiguring a Batch system Service Reference Card Functinal Descriptin The Wrker Nde (WN) is the cmputing nde inside the Grid where the user s jbs are finally executed at a site, the jb having been submitted t the Cmputing Element and the Batch System. On the WN the necessary middleware cmpnents such as the Lgging and Bkkeeping, File and Strage clients need t be installed. Additinal sftware cmpnents may be necessary accrding t the requirements f the site supprted VOs. EMI Middleware clients & libraries present n an EMI WN AMGA: emi.amga.amga- cli dcache: dcap dcap- tunnel- gsi dcap- tunnel- telnet dcap- tunnel- krb dcap- tunnel- ssl dcap- libs dcap- devel dcache- srmclient

5 CERN Grid DataManagement: - (*) - An asterisk indicates a package which shuld be installed in bth 32 and 64 bit versins n x86_64 DPM dpm dpm- libs (*) dpm- perl dpm- pythn dpm- pythn26 (SL5 nly) LFC ffc lfc- libs (*) lfc- perl lfc- pythn lfc- pythn26 (SL5 nly) LCGDM cmmn lcgdm- libs (*) lcgdm- devel (*) GFAL, LCG_Util gfal (*) gfal- py26 (SL5 nly) gfal- pythn lcg- util lcg- util- libs (*) lcg- util- py26 (SL5 nly) lcg- util- pythn gridftp- ifce (*) srm- ifce (*) is- interface (*) GFAL 2.0 gfal2- all gfal2- pythn gfalfs gfal2- dc gfal2- devel lcg- inf clients lcg- inf lcg- infsites GridSite: gridsite- libs L & B: glite- jbid- api- c glite- lb- client glite- lb- client- prgs glite- lb- cmmn glite- lbjp- cmmn- gss glite- lbjp- cmmn- tri SAGA emi.saga- adapter.cntext- cpp emi.saga- adapter.isn- cpp

6 emi.saga- adapter.sd- cpp VOMS: vms- clients3 vms- devel WMS: glite- wms- brkerinf- access Others: a1_grid_env c- ares cleanup- grid- accunts emi- versin fetch- crl glite- service- discvery- api- c glite- wn- inf glite- yaim- clients glite- yaim- cre lcg- ManageVOTag lcg- tags penldap- clients pythn- ldap uberftp util- c Client Installatin & Cnfiguratin General infrmatin n installatin and cnfiguratin can be fund at: inem3 Yu can find sme details bellw. Installing the Operating System Fr the mment EMI WNs are fully supprted n the SL5/x86_64 & SL6/x86_64 platfrms with EPEL as repsitry fr external cmpnents. Scientific Linux 5 & 6 Fr mre infrmatin n Scientific Linux please check: All the infrmatin t install this perating system can be fund at Example f sl5.rep file: [cre] name=name=sl 5 base baseurl=

7 L L prtect=0 Example f sl6.rep file: [cre] name=name=sl 6 base baseurl= prtect=0 Nde synchrnizatin, NTP installatin and cnfiguratin A general requirement is that the ndes are synchrnized. This requirement may be fulfilled in several ways. If yur ndes run under AFS they are mst likely already synchrnized. Otherwise, yu can use the NTP prtcl with a time server. Instructins and examples fr a NTP client cnfiguratin are prvided in this sectin. If yu are nt planning t use a time server n yur machine yu can just skip this sectin. Use the latest ntp versin available fr yur system. If yu are using APT, an apt- get install ntp will d the wrk. Cnfigure the file /etc/ntp.cnf by adding the lines dealing with yur time server cnfiguratin such as, fr instance: restrict <time_server_ip_address> mask nmdify ntrap nquery server <time_server_name> Additinal time servers can be added fr better perfrmance results. Fr each server, the hstname and IP address are required. Then, fr each time- server yu are using, add a cuple f lines similar t the nes shwn abve int the file /etc/ntp.cnf. Edit the file /etc/ntp/step- tickers adding a list f yur time server(s) hstname(s), as in the fllwing example: If yu are running a kernel firewall, yu will have t allw inbund cmmunicatin n the NTP prt. If yu are using iptables, yu can add the fllwing t /etc/syscnfig/iptables -A INPUT -s NTP-serverIP-1 -p udp --dprt 123 -j ACCEPT -A INPUT -s NTP-serverIP-2 -p udp --dprt 123 -j ACCEPT Remember that, in the prvided examples, rules are parsed in rder, s ensure that there are n matching REJECT lines preceding thse that yu add. Yu can then relad the firewall # /etc/init.d/iptables restart Activate the ntpd service with the fllwing cmmands:

8 # ntpdate <yur ntp server name> # service ntpd start # chkcnfig ntpd n Yu can check ntpd's status by running the fllwing cmmand # ntpq -p Installing & Cnfiguring the Middleware The Certificatin Authrity repsitry All the details n hw t install the CAs can be fund in EGI IGTF release pages ( It cntain infrmatin abut hw t cnfigure YUM & APT managers fr dwnlading and installing the trust anchrs ("Certificatin Authrities" r "CAs") that all sites shuld install. The EPEL repsitry If nt present by default n yur ndes, yu shuld enable the EPEL repsitry ( EPEL has an 'epel- release' package that includes gpg keys fr package signing and repsitry infrmatin. Installing the latest versin f epel- release package available n EPEL5 and EPEL6 repsitries like: r 6_64/ shuld allw yu t use nrmal tls, such as yum, t install packages and their dependencies. By default the stable EPEL rep is enabled. The middleware (EMI) repsitries All EMI prducts are distributed frm a single repsitry ( The packages are signed with the EMI gpg key, that can be dwnladed frm GPG- KEY- emi. Please imprt the key BEFORE starting! The fingerprint f the key is: pub 1024D/DF9E12EF Key fingerprint = AC82 01B1 DD50 6F4D 649E DFFC 27B3 331E DF9E 12EF uid Dina Cristina Aiftimiei (EMI Release Manager) aiftim@pd.infn.it sub 2048g/C1E fr SL5/SL6 save the key under /etc/pki/rpm- gpg/ # rpm --imprt KEY-emi

9 Cnfiguring the use f EMI 3 repsitries EMI 3 prductin repsitries are available at: YUM & APT cnfiguratin files are available at: SL5 - SL6 - Use Case 1: - update EMI repsitries n a nde with EMI 1 middleware t EMI 3 (SL5/x86_64): remve first the emi- release package installed n yur nde: # rpm -e emi-release install the EMI 3 emi- release package: # wget e/emi-release el5.narch.rpm # yum lcalinstall emi-release el5.narch.rpm Use Case 2: - update EMI repsitries n a nde with EMI 2 middleware t EMI 3 (SL5/x86_64): # rpm Uvh mi-release el5.narch.rpm Use Case 3: - install EMI 2 repsitries n a fresh nde, withut EMI middleware: SL5/x86_64: # wget base/emi-release el5.narch.rpm (*) # yum lcalinstall emi-release el5.narch.rpm SL6/x86_64: # wget 64/base/emi-release el6.narch.rpm (*) # yum lcalinstall emi-release el6.narch.rpm (*) - please add the ptin "- - ngpgcheck" if yu didn't dwnlad first the key. These packages will install required dependencies, the EMI public key and ensures the precedence f EMI repsitries ver EPEL Installatin Yu need t have enabled nly the abve repsitries (Operating System, EPEL, Certificatin Authrity, EMI). SL5/SL6: # yum install emi-wn

10 Cnfiguratin Please see fr mre details n hw t use YAIM fr cnfiguring a WN. Few details n the specific cnfiguratin files and variables needed in the WN case: yu shuld use the same <site- inf.def>, <users.cnf>, <grups.cnf> files yu used fr cnfiguring yur CE YAIM cnfiguratin variables Mandatry general variables BDII_HOST MON_HOST (nt needed anymre in glite 3.2 WN) SE_LIST SITE_NAME USERS_CONF VOS VO_<v- name>_sw_dir VO_<v- name>_voms_ca_dn (Mandatry fr glite- yaim- cre > ) VO_<v- name>_vomses Optinal service specific variables: they can be fund in /pt/glite/yaim/examples/siteinf/services/glite- wn: GLITE_LOCAL_CUSTOMIZATION_DIR This is an ptinal variable t define a scratch area fr pl accunts via EDG_WL_SCRATCH. Mre details - here Default service specific variables: they can be fund in /pt/glite/yaim/defaults/glite- wn.pst: WN_INFO_CONFIG_FILE Lcatin f the glite-wn-inf utility cnfiguratin file. Default value: ${GLITE_LOCATION}/etc/glite- wn- inf.cnf If the installatin was successful ne shuld run the cnfiguratin: # <path-t-yaim>/yaim -c -s <path_t_file>/site-inf.def -n WN n <nde-type-1> -n <nde-type-2> Ntes n cnfiguring a Batch system YAIM nly prvides WN cnfiguratin steps fr the fllwing batch system interactin: Trque

11 Trque On the WN yu shuld als install the emi- trque- client metapackage # yum install emi-wn emi-trque-client # <path-t-yaim>/yaim -c -s site-inf.def -n WN -n TORQUE_client Other batch systems Cnfigure first yur batch system (LSF, SGE, Cndr, etc) and nly after cnfigure the WN thrugh yaim: # <path-t-yaim>/yaim -c -s <path_t_file>/site-inf.def -n WN Specific cnfiguratin details fr different middleware clients present n a UI AMGA client: manual_2_4_0.pdf - Sectin 2.1, 3.1 dcache- clients: 2.2/ckbk/cb- clients- fhs- cmments.shtml CERN DataManagement clients GFAL/lcg_utils: GridSite clients: SAGA clients: uk/sd/sagac++sd.pdf - Sectin 3 uk/sd/sagac++isn.pdf - Sectin 3 VOMS clients: clients- guide User Guides & Trubleshting Guides references AMGA client manual_2_4_0.pdf - Sectin 4, 5, 6, 7, 14, 15, 16, 17 dcache client User Guide : 2.2/ckbk/cb- clients- fhs- cmments.shtml Other dcumentatin: 2.2/index- fhs.shtml

12 DPM clients: LFC clients: GFAL/lcg_utils: wtlcg.html L&B clients: User Guide: SAGA clients: User Trubleshting Guide: API Dcumentatin: User Guides: uk/sd/sagac++sd.pdf uk/sd/sagac++isn.pdf Man Pages/Online Help: man saga- sd saga- sd - - help man saga- isn saga- isn help API Dcumentatin: /usr/share/dc/glite- saga- adapters- cpp/html/ Other Dcumentatin: uk/sd/ VOMS clients: clients- guide Service Reference Card EMI WN reference card -

Document Version: EMI Component Version: Date:

Document Version: EMI Component Version: Date: EMI UI v. 3.0.0 Date: 14.02.2013 EUROPEAN MIDDLEWARE INITIATIVE EMI UI V. 3.0.0 Dcument Versin: 3.0.0 EMI Cmpnent Versin: 3.0.0 Date: 14.02.2013 This wrk is c-funded by the EC EMI prject under the FP7