Grid-related related Activities around KISTI Tier2 Center for ALICE

Transcription

1 2010 APCTP LHC Konkuk Univ. Grid-related related Activities around KISTI Tier2 Center for ALICE August 10, 2010 Soonwook Hwang KISTI 1

2 Outline Introduction to KISTI KISTI ALICE Tier2 Center Development of PROOF 2

3 Introduction to KISTI

4 Who we are? Location located in Daejeon Organization 3 centers 10 departments 5 branch offices Personnel About 350 regular staffs 150 part-time workers Annual Revenue About 100M USD mostly funded by a government

5 We are a pioneer in building Cyber-Infrastructure of Korea! a Government funded Research Institute to serve Scientists and Engineers in Korea with Scientific/Industrial Database, Research Network & Supercomputing Infrastructure Information Analysis Center Knowledge Information Center S&T Information Resource & Service Technological & Industrial Information Analysis Supercomputing service High Performance R&D Network service Supercomputing Center

6 National Research Network (KREONET) SuperSIRe N Incheo n Suwon 10 40Gbps Cheonan Jeonju Kwangju Seou l 20Gbps 10 Gbps Daejeon 5Gbps Changwon Kangneu ng Ochang 10 Gbps Daegu Pohang 10 Gbps Busan KREONET is the national science & research network of Korea, funded by MEST since 1988 Around 200 linked organizations - Universities, Government labs, Industry labs GLORIAD for international connections 14 regional centers 2.5 Gbps Jeju

7 GLORIAD 10G Networks OC192 KRLight OC192 US Amsterdam Moscow Russia (Novosibirsk) China (Beijing) Hong Kong, CN 2*10G KREONET 10G (KR-US) Seattle, US CANARIE, Canada Seattle Calgary Toronto NYC Chicago EU CNIC, China (Hong Kong) HKLight OC192 10G (KR-HK) Korea KISTI, Korea (Daejeon) Korea OC192 GLO-KR/ CANARIE nodes (L1, L2) 10GE OC192 StarLight PacificWave GLIF node (CANARIE, PW) CSTNET

8 KISTI s 4 th Supercomputer Cluster System (1 st phase) SUN C48 Target Performance : 24 Tflops Infiniband 4x DDR 20Gbps External Storage : 200TBytes 2 nd phase SUN About 300 TFlops Target performance About 21,000 CPU cores 1.0 PBytes external storage Expected to be delivered in the early 2010 SMP System IBM p595 & p6: 10 (1 st ), 24 nodes(2 nd ) Target Performance:36TFlops Internal Disk : 1,17 GB External Storage : 63TB(1 st ), 273 TB(2 nd ) HPS(1 st ) interconnect network & Infiniband 4x DDR (2 nd )

9 KISTI ALICE Tier2 Centre

10 Brief History of KISTI-ALICE Collaboration September, 2006 Dr. Federico Carminati visited KISTI to discuss the construction of ALICE Tier2 Center in KISTI February, 2007 Approved as an ALICE-LCG site October, 2007 WLCG MoU signed between KICOS and CERN KISTI becoming an official Tier2 site for ALICE experiment July, 2008 International Summer School on Grid computing and e-science Tutorial on ALICE computing (AliEn, ROOT, PROOF) October, 2009 KISTI developers visited CERN ALICE Computing Group to extend our collaboration to include development work including PROOF for ALICE computing framework

11 Pledged Resources WLCG MoU signed on October 23, 2007 Signing Party CERN : Dr. Jos Engelen (CSO of CERN) Funding Agency : Chun Il Eom (KICOS) ALICE experiment support 11

12 ALICE Tier2 Centre ALICE Services & Computing Resources ALICE-related services RB, WMS+LB, PX, RGMA, BDII, VOMS, LFC, VOBOX, UI, VOMS LCG-CE Removed since the end of CREAM-CE 128 CPU cores (HP Blade Server 16 nodes) Dedicated to the ALICE experiment SE 30 TB disk space with 10Gbps international connection At first, DPM (Disk Pool Manager) used as Storage Management System Since early September, a pure xrootd server has been up and running 12

13 glite Middleware Services Deployed in KISTI ALICE T2 Center 13

14 ALICE Tier2 Centre Site Overview 14

15 Active jobs on the KISTI CREAM-CE CE

16 Status of Storage Element Status of KISTI SE Size: 28TB Used: 17.26TB no of files: 356,702

17 KISTI s Contribution to ALICE Computing Total Wall Time for ALICE Last Week: 1.21% 17

18 KISTI s contribution to ALICE computing 1.2% contribution to ALICE computing in the total job execution Processing near 8000 jobs per month in average 1.2 %

19 PROOF Parallel ROOt Facility PROOF is part of ROOT If you have ROOT installed on your desktop/laptop, you have PROOF (prooflite) as well If you have clusters, you need to manually configure/enable them PROOF is ROOT on a cluster of computers (approximate) Input files are processed on the set of computer(s) (masters +workers) in parallel and results are sent to back to you Where to use PROOF Central Analysis Facilities (CAF) Department workgroup facilities desktops and lap-tops with multi-cores and/or multi disks PROOF facilities ALICE: CAF at CERN, Switzerland SKAF at Bratislava, Slovak LAF at Lyon, France KISTI test, development farm

20 Trivial / Ideal Parallelism

21 The PROOF Approach Cluster perceived as an extension of local PC More dynamic use of resources Real-time feedback Automatic splitting and merging

22 Dynamic Load Balancing Pull architecture guarantees scalability Adapts to performance variations

23 Some other PROOF features Background / asynchronous running Real-time feedback Can define a set of objects to be sent back Par files User defined packages Automatic merge for user-defined class (if user defines Merge method) PROOF itself is not related to Grid Can access Grid files Plan on Proof sessions on the Grid

24 PROOF architecture

25 PROOF Benchmark Suite

26 Objectives Provide a library to measure/tune performance of PROOF cluster for administrator and developers With the suite, optimal configuration parameters of the cluster could be determined Large scale cluster, multi-master cluster, with many-cores, large disks/files, and many users

27 Tasks CPU-bound test Test pure CPU processing and merging 1D, 2D, 3D histograms Summary plot Event rate (#events/sec) IO-bound test Event generation $ROOTSYS/test/Event class A few different file distribution and processing strategies available Summary plots Event rate (#events/sec) IO rate (MB/sec) ALICE Analysis Workship for Asian Communities, Hiroshima Univ., Japan

28 PROOF Cluster at KISTI Proof cluster at KISTI Software development/test 40 cores (=5 nodes, 8 cores/node) ~60 GB/node 1 Gbps NIC Memory: 16 GB/node PROOF/xrootd/cmsd, AliRoot, etc on SLC

29 Status and Plan ProofBench SVN: A few improvements planned Couples of quick (non-proper) solutions Bug fixes Documentation Test on large-scale system (ex. CERN CAF) One single steering class for user s convenience Next ROOT release will include it Next PROOF development Multi-master PROOF Combine multiple PROOF sites with a unique entry point Enable PROOF on the Grid

30 30

31 Three Centers of KISTI Knowledge Information Center Establishment of digital information dissemination infrastructure by developing science and technology Information resources Information Analysis Center Provision of information analysis on domestic and foreign science and technology trend, prospecting research area and technology market Supercomputing Center Establishment of world-class supercomputing environment, R&D supporting infrastructure and global S&T collaboration research network