The usage of Grid Middleware at KIT, C 3 Grid at D-Grid and the Future of Grid Computing

Transcription

1 The usage of Grid Middleware at KIT, C 3 Grid at D-Grid ad the Future of Grid Computig Frak.Schmitz@kit.edu Die Kooperatio vo Forschugszetrum Karlsruhe GmbH ud Uiversität Karlsruhe (TH)

2 Ageda Itroductio KIT ad SCC, orgaisatio ad resources Grid computig ad scietists? I/O-Performace ad bechmark results Usage ad resources Europea projects D-Grid ad C 3 Cloud computig Uicore for HPC Coclusio 2 Steibuch Cetre for Computig , La Serea

3 Karlsruhe Istitute of Techology (KIT) KIT Uiversity Uiversity fakulties fakulties 10 km 120 istitutes 120 istitutes 15 mi 4,000 4,000 employees employees 18,500 18,500 studets studets budget 250 budget 250 mio mio Forschugszetrum Forschugszetrum sciece 10 (researchareas) areas 10 programs programs(research educatio 21 large istitutes 21 large istitutes structures for the admiistratio 4,000 4,000 employees employees istitutes services mio mio ifrastructure 3 Steibuch Cetre for Computig , La Serea budget budget

4 KIT / SCC Karlsruhe Istitute of Techology - two strog parters uited Uiversität Karlsruhe (TH) Oe of the most research orieted uiversities i Germay Nomiated to oe of three top uiversities i October 2006 Capitalized with over 100 millio Forschugzetrum Karlsruhe Member of the Helmholtz Associatio Iteratioally ackowledged o-uiversity istitutio Uder the roof of KIT Steibuch Cetre for Computig Computig Ceter of the Uiversität Karlsruhe (TH) Istitute of Scietific Computig at the Forschugszetrum Karlsruhe 4 Steibuch Cetre for Computig , La Serea

5 Virtual Computig Cetre Karlsruhe sice 1996 RZ Ui KA IWR / FZK Virtual Computig Cetre sice 1996 IT-Services for UKA High Performace Computig Numerical Methods o HPC Itegrated Iformatio Mgmt. IT-Services for FZK Scietific Computig GridKa, CampusGrid, D-Grid Nat. & Itl. Grid Projects 5 Steibuch Cetre for Computig , La Serea

6 10 SCC Departmets! " #$% #! 6 Steibuch Cetre for Computig , La Serea

7 HP XC4000 Bade-Württemberg-State-Supercomputer Phase 2 (Q3 2006)»750 4-way odes (two sockets) - dual core AMD Optero 2.6 Ghz - 16 GB mai memory»10 server odes»10 file server odes - Approx. 56 TB storage system»ifiibad DDR itercoect»20 water cooled racks (HP MCS)» Total of 3000 processor cores» Total of 15.6 TFlop/s peak performace» Total of 12 TB of mai memory» Total 110 TB of local disk space (scratch) 7 Steibuch Cetre for Computig , La Serea

8 Cofiguratio of the HP XC Compute odes Local Disks à 72 GB Etheret Admiistratio Ifiibad 4x (DDR) Fast Itercoect... Logi odes Lustre Service odes Globales Filesystem 56 TB 8 Steibuch Cetre for Computig , La Serea

9 Parallel File System HP SFS o XC4000 Shared storage for all odes of XC system 10 file server odes 2 MDS / Admi 2 OSS for $HOME 6 OSS for $WORK 56 TB file space 8 TB $HOME 48 TB $WORK Badwidth Read / write from oe ode: 340 MB/s / 340 MB/s Total read / write badwidth of $HOME: 600 MB/s / 360 MB/s Total read / write badwidth of $WORK: 3600 MB/s / 2200 MB/s 9 Steibuch Cetre for Computig , La Serea

10 Hardware ruig at KIT >11000 Itel ad AMD based compute cores mailly for the projects CampusGrid ( D-Grid ( GridKa ( BW-Grid ( ad the HPC system for Bade-Württemberg 5 PB olie storage, 2PB tape storage 52 Power4 cores 16 vector processors each 32 GB mai memory additioal more tha 17 PByte i the ext 3 years but floor space is limited ad the power cosumptio is dramatically 10 Steibuch Cetre for Computig , La Serea

11 Parts of the CampusGrid Project a SX-9 ode will be added i autum Steibuch Cetre for Computig , La Serea

12 Is Grid computig user friedly? if users usig UNICORE, yes! if users wat to use GT4 or glite, o. glite, it s oly for high-eergie physicists or you have to write a web based iterface later o I will explai the ew buzzword cloud computig 12 Steibuch Cetre for Computig , La Serea

13 I/O performace Why? because CPU is waitig to fiish the iput or output operatio But o problem i a oly Grid-based eviromet, CPU is cheap! But a problem i the HPC eviromet, the high-speed etwork is 30-40% of the ode costs depedig o the mai memory size Bechmark results A factor betwee for a the applicatio LM from DWD for a give set of data. It meas, from the price-poit, a SX-8R (8 processors, 128 GB mai memory) ode prize should ot exceed T 150 i summer 2007 to be comparable i prize ad performace for LM as give applicatio. 13 Steibuch Cetre for Computig , La Serea

14 Performace of a small IfiiBad cluster usig a FC-Gateway from qlogic (StorNextFS) iozoe (StorNextFS, write usig fsyc, 8 odes, 8 processes) The processes are started at the same time but have a ru time diffeece of 1h 20m usig a maximum of 5h 40m executio time (ot oly write)! iozoe (StorNextFS, write usig fsyc, 8 odes, 8 processes, peak of a process is 260 MByte/s, three years old EMC² disk system) Trasferrate (MByte/s) Recordsize (KByte) Filesize (KByte) 14 Steibuch Cetre for Computig , La Serea

15 I/O performace Why? because CPU is waitig to fiish the iput or output operatio But o problem i a oly Grid-based eviromet, CPU is cheap! But a problem i the HPC eviromet, the high-speed etwork is 30-40% of the ode costs depedig o the mai memory size Bechmark results A factor betwee for a the applicatio LM from DWD for a give set of data. It meas, from the price-poit, a SX-8R (8 processors, 128 GB mai memory) ode prize should ot exceed T 150 i summer 2007 to be comparable i prize ad performace for LM as give applicatio. 15 Steibuch Cetre for Computig , La Serea

16 16 Steibuch Cetre for Computig , La Serea Factor betwee Cluster ad vector computer

17 America s Cup: Shosholoza (1) Shosholoza Team (South Africa) Mai sposor: T-Systems Head of the Scietific Advisory Board 17 Steibuch Cetre for Computig , La Serea

18 America s Cup: Shosholoza (2) Simulatio of the Hydrodyamic Formig Optimizatio (hull, keel, wiglets) Cotrollig ad Timig of the Wave Patters Tactic ad Strategy with the HP XC 1 18 Steibuch Cetre for Computig , La Serea

19 The ifluece of a Storage Lake i the Arid Elqui Valley i Chile o the Local Climate (i) (out) 225 x 135 horizotal gridpoits 100 vertical levels out: x = 800 m, y = 800m i(1): x = 400 m, y = 400 m i(2): x = 200 m, y = 200 m i(3): x = 100 m, y = 100 m 19 Steibuch Cetre for Computig , La Serea

20 20 Steibuch Cetre for Computig , La Serea

21 HPC Grid-projects i the EU Framework Program Euforia: timeframe, the mai objectives of the FP 7 Euforia EU fuded project are the deploymet of Grid ad HPC ifrastructure, the adaptatio ad optimisatio of Fusio Codes for the ITER-project ad the ad the developmet of advaced tools for Workflow maagemet, Visualizatio tools ad Data miig. This project is already heavily ivolved i the use of Globus ad UNICORE stadards. glite of the momet oly o Liux based clusters at KIT, but.. New computig power ew powerful results 21 Steibuch Cetre for Computig , La Serea

22 HPC Grid-projects it.eu.grid: (FP 6), the iteractive Europea Grid project will deal with MPI applicatios based o Liux-clusters without fast etwork devices. Medical applicatios (computer tomography, brai perfusio, blood flow) 22 Steibuch Cetre for Computig , La Serea

23 C 3 -Grid: Collaborative Climate Commuity Grid i the D-Grid project ( Why? research activities to ivestigate the iteractio of the climate system with the socio-ecoomical system rus i the past (20 years or more!) at differet departmets i Germay more complex ad high-resolutio model simulatios the availability of icreasig satellite data is relevat for moitorig the earth system Goal Coectio of distributed climate data archives Uiform access ad cetral metadata catalogue it is ot a prior aim to participate i compute Grid resources! 23 Steibuch Cetre for Computig , La Serea

24 C 3 -Grid Explaatio Access to data collectios of differet orgaizatios is extremely difficult because of local storage architecture ad ihomogeeous data iformatio. To lik various data sets together is a essetial part of a scietist's workflow for the research. Thus, the missig uiform access is a critical shortage for the earth system research commuity. Historically, if data volume is high, it is decetralized stored at distributed archives at various research departmets. 24 Steibuch Cetre for Computig , La Serea

25 C 3 -Grid Solutio Access rules to the distributed data storage will be defied by the research departmet holdig the data. A Grid-based access must be available. 25 Steibuch Cetre for Computig , La Serea

26 C 3 -Grid Parters Official Parters KIT with the Istitute of Meteorology ad Climate Research ad the SCC are associated to the project 26 Steibuch Cetre for Computig , La Serea

27 Cloud Computig What does it meas? Partly fuded by the Europea Uio (M Haifa lab i Israel ad 17 Europea orgaizatios will look at maagig IT services across domais, IT platforms ad geographies. The project is called RESERVOIR - Resources ad Services Virtualizatio without Barriers. I the Uited States of America IBM collaborates with the Georgia Istitute of Techology ad Ohio State Uiversity to develop ew autoomic techology o selfmaagig features for virtualized data ceters i a cloud computig eviromet. The coordiated use of hardware, operatig systems, middleware ad applicatios is a must. Applicatios must rely o Web-based programs. 27 Steibuch Cetre for Computig , La Serea

28 Cloud Computig for C 3 Example Workflow Virtualized data ceter with guaratied data lifetime ad compute resources 28 Steibuch Cetre for Computig , La Serea

29 Cloud Computig Compaies Microsoft will expad its Microsoft Olie Services utilizig Microsoft Exchage Server 2007 as well as Microsoft Office SharePoit Service Services such as , cotacts, caledars ad coferecig will all be available to use ad syc olie. Google s olie office utility is workig i the same directio. IBM ad Su are offerig a compute cloud for HPC. Amazo Elastic Compute Cloud (Amazo EC2) is a web service that provides resizable compute ad storage capacity i the cloud. It is desiged to make web-scale computig easier for developers. But it s ot HPC! Amazo EC2's web service iterface allows you to obtai ad cofigure capacity with miimal frictio. It lets you ru o Amazo's prove computig eviromet. Amazo EC2 provides developers the tools to build failure resiliet applicatios ad isolate themselves from commo failure scearios. 29 Steibuch Cetre for Computig , La Serea

30 Uicore Ca be used as a so called submit egie Is a Grid middleware used i D-Grid, at KIT i the project CampusGrid o vector computer, IfiiBad cluster ad power4 systems from IBM It s very practical i use! It s a must to have a certificate! What to do 30 Steibuch Cetre for Computig , La Serea

31 Globus Toolkit 4 (GT4) "The Globus Toolkit is a ope source software toolkit used for buildig grids." [ GT4 is a WSRF compliat applicatio developmet framework. GT4 is collectio of ready-to-use of high-level Grid services. Much more a Grid based solutio tha Uicore It s a must to have a certificate! What to do =ID_ You have to use a special machie for logi It s based o Grid services Will be available soo for the vector system SX8-R 31 Steibuch Cetre for Computig , La Serea

32 Globus Toolkit 4 (GT4) What GT4 provides? collectio of solutios, which frequetly comes up whe tryig to build collaborative distributed applicatios impemetatio of stadards: use of existig stadards (IETF, W3C, OASIS, GGF) provide referece implemetatios of ew/proposed stadards a set of servicesfocused o ifrastructure maagemet commo iterfaces to heterogeeous resources stadard-based security ifrastructure cliet APIs ad commad lie programs for accessig services a toolkit for buildig ew Web Services service-orieted architectures (SOA) 32 Steibuch Cetre for Computig , La Serea

33 Globus Toolkit 4 (GT4) Web services 33 Steibuch Cetre for Computig , La Serea

34 Globus Toolkit 4 (GT4) 34 Steibuch Cetre for Computig , La Serea

35 Coclusio KIT is the largest research ad developmet orgaizatio i Germay. SCC provides a lot of IT resources worldwide. D-Grid is a success story. Applicatios are ot simple to gridify! C 3 is the climate project as part of D-Grid. The future of Grid computig is.. Cloud computig could be a way for stadardizig accessig IT ifrastructure ad to itegrate i a quite simple way scietific applicatios ad busiess applicatios. Uicore GT4 35 Steibuch Cetre for Computig , La Serea

36 Thak you! Questios? 36 Steibuch Cetre for Computig , La Serea