Past. Inputs: Various ATLAS ADC weekly s Next: TIM wkshop in Glasgow, 6-10/06

Transcription

1 Introduction T2s L. Poggioli, LAL Past Machine Learning wkshop CERN HEP Software foundation LAL Will get a next CAF Inputs: Various ATLAS ADC weekly s Next: TIM wkshop in Glasgow, 6-10/06 ie NO S&C week in June CAF_T2_ Luc 1

2 LHC & ATLAS planning LHC status 300 bunches L(peak)~1033 Next increase #bunches Priority is ICHEP DS & > end May ~1.5 fb-1? DS2 +3 weeks -> end June ~5 fb-1? LHCC 25/05 Dave, weekly 10/05 Recommendation on maintain 4.5 months EYETS at end 2016, or go to standard 3-month YETS? HI run 8 TeV (ATMLAS+CMS) or 5 TeV (ALICE) CAF_T2_ Luc 2

3 MC15c Production 94.3% done 4.4B evts donec, 270M left CAF_T2_ Luc 3

4 Activities since last CAF (1) wrt last period: Dip in simulation (MC15c&b issues, ~ No repro) Average 0.85M jobs/day (was 1M) CAF_T2_ Luc 4

5 Activities since last CAF (2) Running slots Constant ~200k running slots Loss of activity end March (MC15c & b pileup jobs too slow) CAF_T2_ Luc 5

6 Activities since last CAF (3) Walltime /processing cloud FR cloud 10.95% (last period 10.8%) CAF_T2_ Luc 6

7 MCORE (Production only) MCORE contribution 80% total (production only) In WallTime FR-cloud: 11.5% in WT(last period 11.2%) 78% production on MCORE CAF_T2_ Luc 7

8 FR-Cloud (1) WT all cloud: CC, Tokyo, GRIF T2s: 85% production on MCORE (Goal 80%) CAF_T2_ Luc 8

9 FR-Cloud (2) T2s Production: Success/all efficiency Errors: Get error, Lost HB, Execution CAF_T2_ Luc 9

10 HTTP Transfer modes WLCG HTTP Deployment Task Force -> promote HTTP interfaces deployment to storage Please follow GGUS opened to your site SRM-Less DPM Test at LAPP (S. Blunier et al) FAX Failover: Running well Overflow Only turned on for US+CA - 8% analysis jobs use FAX CAF_T2_ Luc 10

11 Transfers FR as source RO-14 (LPSC because of US) FR as destination RO-14 (RO-02 from RO-14) CAF_T2_ Luc 11

12 FR-sites availability (ATLAS_CRITICAL) All sites very good, but RO-14 But limited info included CAF_T2_ Luc 12

13 Sites ranking ASAP (ICB) Analysis availability Integr ed over 2 months Online (since last CAF) All above 90% Instabilities: LAL, IRFU CAF_T2_ Luc 13

14 Beijing & HPC More simulation jobs on HPC than on grid!! CAF_T2_ Luc 14

15 LOCALGROUPDISK Filling up (fact of life) Deletion campain Efficient (thx Manoulis) 62TB available NB For archiving can use LOCALGROUPTAPE Request via DATRI 8TB available (flexible) Needs Last access time for files (as for sps) CAF_T2_ Luc 15

16 SPS Stable after cleaning campain ~28 TB free 47% last access > 1yr!! (last CAF 45%) 73% last access > 6m!! (last CAF 59%!) To be discussed this afternoon Archiving old files on tape CAF_T2_ Luc 16

17 Sites evolution in ATLAS Dedicated session at GDB yesterday eg A. Forti 50/ / _GDB_lightweight_v2.pdf Storage evolution Regroup larger sites Caching Protocols streamlining Object Stores Reduce CE/BS comb ions eg ARC-CE/HTCondor Alternative to BS VAC/Vcycle, BOINC, Openstack/EC2 CAF_T2_ Luc 17

18 Storage in FR-Cloud All sites > 400TB except Beijing 370 RO RO RO For those sites Do not invest in disk Increase CPU CAF_T2_ Luc 18

19 Pledges deployment (FR sites) A priori pledges deployed at - GRIF, LAPP (1.5pB?) CAF_T2_ Luc 19

20 Beijing Issues (1) CRL issue (IPV6) GGUS: HPC queue failing GGUS: (sw installation) Tokyo MCORE failing -> vmem increased to 38.4GB RO-07 Lost partition GGUS: Needed to clean dpm DB by dpm-dbck. ASAP stable now RO-16 Transfers failing GGUS: & GGUS: CAF_T2_ Old boost sw, storage Luc rebuild, dmlite update 20

21 RO-14 Issues (2) Long SDT. Transfer issues (still ongoing GGUS: & ) Upgrade and pb w/ new pbs system IRFU Memory issue -> moved to cgroups Deletion failures GGUS: (power cut on storage over the weekend) LAL Deletion issues (power cut) GGUS: Also disk server failure (19/04) No SE dump since November! CAF_T2_ Luc 21

22 LPSC Issues (3) dpm upgrade (ASAP in red) The 200TB miracle! ASAP instabilities a priori understood (old storage server) LPC ASAP stable now. No clear explanation LAPP Deletion errors (GGUS:120718) solved changing GBIC on network card CAF_T2_ Luc 22

23 Ongoing HTTP WLCG Task force Sites installed cron (CRLs issue) Ongoing Pledges deployment CC: Finalization this afternoon New blacklisting tests for FR ANALY_LAPP-TEST (SRM-less tests) Ongoing. Now pointing to MWTEST_DATADISK SE dumps: To be provided every month Hong-Kong deployment ongoing CAF_T2_ Luc 23