GRIF. IRFU: Sophie Ferry Zoulikha Georgette Fred Schaer Pierrick Micout Jean-Pierre Meyer IPNO: Christophe Diarra

Transcription

1 GRIF LLR: Pascale Hennion Igor Semeniouk Andrea Sartirana LAL: Michel Jouvin Guillaume Philippon APC: Michele Detournay Cecile Cavet Suyan Dong LPNHE: Liliana Martin Victor Mendoza IRFU: Sophie Ferry Zoulikha Georgette Fred Schaer Pierrick Micout Jean-Pierre Meyer IPNO: Christophe Diarra 1

2 In a nutshell 8.7k slots/86k HSI06 9 CE + 3 paral. clusters; 4.4PB disk storage 7 DPM + 1 native xrootd; grid services VOMS, WMS, BDII, MyProxy; 10Gbps network backbone and conn. to LHCOne/OPN; ~45 VO supported 4LHC + (non)-hep, bio; R&D projects stratuslab, gridcl, ; central admin/monitoring quattor, nagios, ; cloud infrastructure stratuslab. multiple contexts LCG-FR, FranceGrilles, Mesocenteres, P2IO,. 2

3 History/Goals Phase 1: demonstrator In 2004 LAL and IRFU, soon followed by other 4 laboratories in the Paris region - LPNHE, IPNO, LLR, APC - started creating a distributed GRID Tier-2 site. LHC 7TeV LHC 8TeV Phase 2: create and manage a T2 site for supporting the data taking of LHC GRIF provides computing resources to HEP and in particular to LHC community. It also encourages usage of GRID resources by other research communities; LHC LS 1 Phase 3: LHC high lumi/energy. Goal of the GRIF collaboration is to build and share an expertise in the creation and administration of computing resources for the scientific research; 3

4 Organization executive decisions administration of the computing resources projects/goals funds usage funds sharing intellectual properties external visibility etc Gentlemen Agreement Memorandum of understanding 4

5 Cooperative administration Monthly Technical Committee face to face meetings long/medium term planning; administration problems; weekly Technical Committee videoconf short term actions; follow up of long terms actions; daily interaction mailing list; vidyo based chat room (soon); daily Tour De Garde scheduled on weekly basis. GGUS GStat NGI nagios VOs nagios 5

6 Cooperative administration Shared configuration tool: Quattor central server and configuration repository at LAL; all grid services and many non-grid machines installed/configured with quattor; important contribution to the QWG; monitoring infrastructure: nagios central server at IRFU; slave servers at LLR, IPNO(funded by P2IO), LPNHE; Testing Puppet IRFU: service deployed services: WMS, N4U GW, psonar, accounting, VM server; LLR & APC joined the tests small demonstrator of a distributed site. common Wiki on trac know-how shared among administrators; tickets, actions/issues tracking, minutes of meetings, etc ; login intersite setup each administrator can connect to other site s machines configured sudo commands for managing/debugging/fixing problems; 6

7 Projects/VO s LHC experiments: the central activity of GRIF and its original reason of being; Alice (IPNO, IRFU); CMS (IRFU, LPNHE, LLR, LAL); Atlas (LPNHE, LAL, IRFU); LHCb (LAL, APC, LPNHE); other HEP VO s D0, ILC/Calice, supernemo, ; astrophysics and astro-particles astro VO, auger, CTA, GLASS, HESS, CTA, planck, virgo; non-hep or non-physics VO s biomed (managing the monitoring nagiosbox); climate-g, COMPCHEM, EDGI, EDGeS, EGEODE, etics, ESR, geant4, complex-systems, gear, ISCPIF, MURE, neugrid, panda, UCAD. 7

8 Projects/VO s StratusLab: cloud infrastructure for science and education; tests with GPU machines at (IPNO): UI with GPU cards; gridcl project (P2IO): help in migrating physics applications on many-cores architectures (GPU, Xeon Phi): CTA, CMS, SDO, RooFit; testing usage of many-core HW in grid sites; collaboration with Eoulsan testing hadoop architectures within grid. 8

9 Infrastructure Each site has its own infrastructure 2*65m2, ~200KW (UPS) 80m2 (almost filled) 10Gb/s conn Renater/GRIF/LHCOne infra. upgrade: in ~ 1 month 20Gb/s shared GRIF/LHCOne/Inet 60m2 (cooling pbs) 60m2, (cooling limit) new room 10/2013 (next slide) 10Gb/s conn to GRIF new room 10/2013 (next slide) 10Gb/s shared GRIF/LHCOne/Inet 45m2 machine room 222m2 shared with Poly labs re-modeling fall Gb/s GRIF/LHCOne + Saphir 10Gb/s conn to GRIF Connected by 10Gbps Renater backbone 9

10 Infrastructure Labex P2IO Orsay Machine Room co-funded LAL,IAS,IPNO,IMNC, CSNSN, LPT, P2IO; existing building; 100M2, 400KW, 2x350KW cooling, 28racks; end of works 31/7, avail 1/10; CSNSM, IAS, IMNC, IPNO, LAL, LPT, LLR IRFU; tech. pole for HEP, Astro, Nucl.Phys. and their applications; Virtual Data Group IT group for P2IO; Building common infrastructure Ecole Poly. Machine Room funded by E.Poly + P2IO for part of the racks; re-equipping current machine room; 222M2, 800KW (450KW UPS), cooling redundancy; works start 11/2013; phase 2: up to 250m2 phase 2: new datacenter

11 Resources/services 3.4k slots,1.9pb 30% T3; Grid services: WMS, topbdii, LFC, psonar, NGI account.; VO services: PhEDEx, squid, N4U GW; GRIF services: nagios, puppet; 1.2k slots,1pb Grid services: topbdii, psonar; 1.2k slots,0.8pb T3:200slt,30TB MPI: 128cores Grid services: argus, psonar(soon); VO services: PhEDEx, squid, N4U GW; GRIF services: pakity; Cloud StratusLab: 2 HyperVisor (soon); GPU/MIC nodes (soon) 4 servers (4GPU/4MIC) 300 slots, 19TB: paral. cluster: 250 cores, 4TB; 1.7k slots,0.8pb Grid services: VOMS, WMS, LFC, argus, MyProxy, psonar; GRIF services: quattor, svn; Cloud StratusLab: 18 HyperVisor + 15TB; 0.9k slots,17tb 277TB xrootd; 400cores MPI; GRIF services: WMS; UI with Nvidia GPU. 11

12 Resources/Services 23M GRIF WCT Hours by VO in last 12 months Atlas LHC VO GRIF usage (12 months) 12M Alice CMS LHCb 8.7k hours = 1 slot LHCb 5% CMS 27% Alice 18% Atlas 50% All VO GRIF usage in last 12 months GRIF job eff by VO (12 months) 1.0 MP jobs APC 1% LHVb 4% HESS 1% IPNO 4% Others 7% Alice 14% CMS 22% Biomed 2% Atlas 41% auger 4% 12

13 Resources/Services GRIF WCT Hours history in last 12 months 5M Full month = 6M hours GRIF contribution to FR T1/T2 sites GRIF 28% 4M GRIF contribution to FR T2 sites What about storage? 1PB IRFU GRIF 44% LLR 13

14 (%) Resources/services GRIF Availability (last 12 months) 100, , , , , ,5 Problems with tests when switching topbdii Atlas CMS LHCb Alice Apr

15 Highlights GRIF is providing itself with a formal definition by an MoU among the participating labs: just formalize what has been established by the past years of collaboration; important from the pov of external relations; ongoing infrastructure upgrade Orsay machine room available 1/10/2013 (P2IO); Palaiseau machine room re-equipping starting 11/2013 (P2IO); IRFU: machine room upgrade in ~1 month, LPNHE/APC recently done; important contribution to France GRID computing 44% of FR Tier-2 activity (28% overall grid activity); contributions to several working groups: QWG, perfsonar,dpm, ; testing new tools, new technologies new HW architectures: GPU, MIC; new computing tools: hadoop, ; new administration tools: puppet. 15