Spanish Tier-2. Francisco Matorras (IFCA) Nicanor Colino (CIEMAT) F. Matorras N.Colino, Spain CMS T2,.6 March 2008"

Transcription

1 Spanish Tier-2 Francisco Matorras (IFCA) Nicanor Colino (CIEMAT)

2 Introduction Report here the status of the federated T2 for CMS basically corresponding to the budget concentrate on last year results Goals (as on the proposal): Main objective is to be prepared early in 2008 for first physics run Provide resources equivalent to 5% of the total CMS needs for T2 as agreed for WLCG MoU Provide the corresponding services with a good quality Provide a computing environment to the Spanish CMS HEP community for an appropriate profit of LHC physics potential Contribute to CMS with the required resources for common computing tasks Training of specialized manpower for operation, maintenance and future upgrade of the centre Additional important role for our T2: User support to physicists for software and computing issues Encourage and help the integration of users into grid analysis tools

3 Spanish T2 Activities Remark: very good integration of physics, detector and software needs! not only participating in challenges as computer exercise, commissioning the system, but already providing services and resources From the start of CSA06 had a very active and successful activity Good quality of data transfers Several exercises run (alignment and analysis ) Successful integration of a significant number of physicists Usage maintained after the CSA06: more or less continuous flat usage even outside challenges Contributed to CSA07 within the limited tasks expected for T2 Continuous contribution to physics analysis Providing resources and services for real data (cosmic) analysis: Detector and software commissioning muon reconstruction alignment and calibration tasks MTCC data was (and is) being analyzed at our T2 GR (Global Run) Significant contribution to MC production during these years (above the 5% share)

4 Cosmic Data MTCC, Magnet Test and Cosmic Challenge during 2006 CMS magnet was tested data was taken for a fraction of the detector The Spanish T2 was one of the few sites where data was transferred a total 20 TB transferred and published for physics (still available) Widely used by Spanish community still being used several CMS notes only real data ongoing analysis (cosmic muon charge ratio) muon reconstruction alignment and calibration tasks important for detector and software commissioning Similar work going on with Global Run end 2007 and more coming soon

5 Data transfers Spanish Tier2 has participated in the different data transfer tests during these two-year period data was also transferred for analysis under Spanish physicist request Over 1 PB was imported and over 400 TB were exported connected to all CMS T1 Transfer to Spanish T2 Transfer from Spanish T2

6 Transfer quality Good transfer quality during CSA07 obviously some bad periods during debugging in most cases the problem was on T1 side

7 Transfer quality two examples of average quality over a year compared to other T2 sites from CNAF from PIC

8 Commissioned links CMS requires to maintain a reasonable efficiency and activity to keep links active If not fulfilled links are deactivated for production transfer Driven by challenges and physics requirements need to have the link active to the T1 where the data is sitting According to computing model: download from all T1 (not T0) and upload to one T1 (PIC) In practice: link from T0 allowed and needed for some tasks link from all T1 not (yet) necessary upload to at least two T1 (as backup) Spanish sites have commissioned most of the links (all the needed ones) the non-active links were never attempted because unnecessary (not requested by CMS and no interesting data stored at the sites)

9 Site Name To T1 From T1 Current number of active links Site Name To T1 From T1 T2_AT_Vienna 2 2 T2_BE_IIHE 3 5 T2_BE_UCL 3 4 T2_BR_SPRACE 0 0 T2_BR_UERJ 1 1 T2_CH_CSCS 4 6 T2_CN_Beijing 2 3 T2_DE_DESY 5 8 T2_DE_RWTH 4 6 T2_EE_Estonia 5 3 T2_ES_CIEMAT 2 5 T2_ES_IFCA 3 8 T2_FI_HIP 1 3 T2_FR_GRIF_DAPNIA 0 0 T2_FR_GRIF_LAL 2 1 T2_FR_GRIF_LLR 2 0 T2_FR_GRIF_LPNHE 2 0 T2_HU_Budapest 1 1 T2_IN_TIFR 0 1 T2_IT_Bari 4 6 T2_IT_Legnaro 2 5 T2_IT_Pisa 4 7 T2_IT_Rome 2 4 T2_PT_LIP_Coimbra 2 2 T2_PT_LIP_Lisbon 1 2 T2_RU_IHEP 0 0 T2_RU_ITEP 1 1 T2_RU_JINR 1 1 T2_RU_PNPI 0 0 T2_RU_RRC_KI 0 0 T2_RU_SINP 0 0 T2_TR_METU 0 1 T2_TR_ULAKBIM 0 0 T2_TW_Taiwan 3 6 T2_UK_London_Brunel 2 3 T2_UK_London_Imperial 2 3 T2_UK_London_QMUL 0 0 T2_UK_London_RHUL 0 1 T2_UK_SouthGrid_Bristol 2 1 T2_UK_SouthGrid_RALPPD 1 3 T2_US_Caltech 1 5 T2_US_Florida 1 5 T2_US_MIT 1 5 T2_US_Nebraska 4 8 T2_US_Purdue 1 5 T2_US_UCSD 2 3 T2_PL_Warsaw 3 3 T2_US_Wisconsin 1 7

10 MC production CIEMAT Continuous and efficient production at CIEMAT. At IFCA, interrupted due to CMS incompatibility with DPM storage 24 Mevt (~ 7% of all production, 10% if T1 excluded) in 2007, Contribution to production integration and operation (LCG1 team, Spanish and Portuguese sites)

11 Site availability Scheduled downtime

12 Job Load Continuous activity production tests analysis nearly 7000 jobs/week in 2008 Jobs/6 days at IFCA Jobs/6 days at CIEMAT Sch. dowtime

13 Job load Averaging over the last year: Spanish T2 supported 6.2% of total T2 load Spanish T2 supported 7.4% of analysis jobs Analysis jobs CIEMAT Any type of jobs IFCA

14 Analysis activity User analysis (not central production) jobs in 2008 both the Spanish sites among the more active (of >40 sites) mainly driven by local physicists community

15 Services Both sites support different EGEE and CMS dedicated services: each imply some resources often duplicated for tests imply a significant of manpower for installation and maintenance CMS Services: PhEDEx for data transfer SQuidserver for FroNTier (condition DB) cache software repository EGEE GRID Services CE+UI+RB Torque + Maui scheduler SE in particular was a very demanding issue (sill not totally solved) CASTOR/DPM/DCache/Storm

16 Budget and resources Project started with a significant reduction on the budget Very tight on personnel, the full budget (and more) was spent and support from institutes many and very demanding tasks that need dedicated expert (technical) manpower! More requirements on general infrastructure and resources for services However: LHC did not run in 2007 institutes provided resources for running in 2006 and 2007, purchase delayed to the end of 2007, significant saving other sources of funding contributing Resources for 2008 purchased, installed and operational or being tested Will be fully operational for June (effective storage, including formatting, raid, spares...) CIEMAT IFCA T2-ES 5% of MoU CPU (KSI2k) Disk Storage (TB)

17 Computer resources at sites A description of the current resources at the sites follow Note that part of the resources are provided by the institute or other projects not on FPA budget cannot be compromised for CMS can often be used for CMS (as done for most of 2006/2007)

18 Computing GEANT GEANT RedIris RedIris Other services: 4 User Interfaces SW repository FroNTier / Squid 1 Gbps CIEMAT CIEMAT Internal Internalnetwork network 1 Gbps Gbps Storage Element: dcache 1.7 SRM v1 50 TB of disk + 30 TB to add (Castor) Disk servers in RAID 5 No tape Dell PowerEdge 1850 Supermicro X7DB8 Computing Element: lcg-ce, PBS 336 cores: SL4 116 Xeon 5160, 3.2 GHz 64 Opteron 270, 2 GHz 156 Xeon, 3.0 GHz 680 KSpecInt

19 Storage /pnfs/ciemat.es/data/... /cms/prod cms prod permanent 35 TB srm.ciemat.es /cms/prod/scratch cms prod volatile 2.31 TB /cms/ cms (rest) permanent 2.03 TB PNFS /cms/scratch cms (rest) volatile 0.46 TB /ops ops volatile 0.46 TB dcache admin /dteam dteam volatile 0.45 TB Currently 24 TB of CMS data (9 TB CSA07 skims)

20 Processing Power: WN s & Services at IFCA (non CMS dedicated) Cluster eifca 90 IBM x336 (2 Xeon 3.2GHz, 2GB RAM, 2 GE) 180 cores Cluster INGRID 16 IBM x3550: 2 Intel (dual core) Xeon 5160, 3.0GHz, 4GB RAM, 2GE+Infiniband) 4 IBM x3550: 2 Intel (quad core) Xeon 5345, 2.33GHz, 4GB RAM, 2GE+Infiniband) 96 cores EGEE GRID Services CE+UI+RB per project 1 common batch system: Torque + Maui Nodes for interactive access and development 20 IBM 206, Pentium IV 3.2 GHz

21 Resources: Processing power (CMS specific) New cluster recently installed (purchased with FPA budget) 2 IBM Blade Center E 14 servers/bladecenter 4 power supply/bladecenter 2 10Gbit copper Gbit fibre/bladecenter 28 servers IBM Blade HS21 XM 2 Intel Quad Core 2.33 GHz 16GB RAM 1 HD SAS 73GB/10k 2 GE per blade 224 cores 515 KSi2K in total

22 Resources: Storage DPM (Disk Pool Manager) 1 server : Mysql DB 3 disk servers: HP Proliant 370 (8 sata disks) 3 disk servers: IBM 3500 (8 sata disks) 3 disk servers: HP Proliant 320s1 (12 disks) 44 TB RAID5 / 72 Hard Disks / 1+8 Servers GPFS based SE (installation in progress) 2 servers : GPFS at IFCA 1 server : SRM 2 fiber switchs, SAN (Storage Area Network) 7 Disk Arrays: IBM 1 ds exp Hard Disks 750GBo = 84TBo 10 Disk Arrays: IBM 2 ds exp Hard Disks 500GBo = 75TBo (30%) > 100 TB for CMS

23 Additional benefits The activity has produced several publications CMS-note-2004/030 DC04 at the Spanish sites CMS-note-2006/087 SC3 at the Spanish sites CMS-note-2007/022 CSA06 at the Spanish sites CMS-note-2005/019 Implementation of MC production in LCG CMS-note-2007/016 Integration and operational experience in MC production in LCG CHEP 2007 contributions: Exercising CMS dataflows and workflows in computing challenges at the Spanish Tier-1 and Tier-2 sites A software and computing prototype for CMS Muon System alignment 'MC production in the WLCG computing Grid' The good performance of the Federated T2 has also produced a better visibility in CMS, which lead to some of its member being proposed for coordination of different groups: Integration and commissioning coordinator Site commissioning (part of PADA subgroup) Responsibility for running production in Spain and Portugal As physicists the main outcome it that we already have provided resources and user support for developing physics: TDR, CMS notes...

24 Conclusions Spanish T2 during these last 2 years has clearly fulfilled all of its goals: Sites are prepared for first physics run in the coming months have provide over 5% of the total CMS needs for T2 the last couple of years have read 5% of resources as agreed for WLCG MoU services are established and working with a good quality Spanish users have made a good usage of the resources and had a better situation to perform the analysis Have contributed above the 5% for simulation Have started to train specialized manpower for operation, maintenance and future upgrade of the centre Need to maintain and increase the manpower! closeness of computing and physicists has proved to work very well User support to physicists provided and feed-back received large optimization and efficiency to define and obtain data samples Resources and services are ready for 2008, waiting for LHC first collisions!