Institute of Physics, Belgrade Scientific Computing Laboratory FREE SCIENTIFIC COMPUTING GRID COMPUTING Branimir Acković March 4, 2007 Petnica Science Center
Overview 1/2 escience Brief History of UNIX Feeling Free Licensing, Copyright, Copyleft GNU, Free Software Foundation Open Source Licenses Linux Supercomputers Clusters Why do we need Grid?
Overview 2/2 Making Grid to work Problems VOs Grid Site What really happens? Middleware Developing & Using Grid EGEE SEE-GRID AEGIS
escience Trivial: text editing, Internet services elementary visualization, special functions,... Nontrivial: differential eq., large linear systems, searching combinatorial spaces complex symbolic algebraic statistical data analysis complex visualization,... Advanced: stochastic simulations part functions/functional integrals risk assessment in complex systems dynamics of the systems with many degrees of freedom,...
Brief History of UNIX
Feeling Free Licensing, Copyright, Copyleft 1/3 1973. Licensing of UNIX by AT&T Copyright Copyleft
Feeling Free - GNU, Free Software Foundation 2/3 Free software is the matter of liberty, not price. To understand the concept you should think of free as in free speech, not as in free beer. 1983/1984. GNU's not UNIX Richard Stallman Free Software Foundation The freedom to run the program, for any purpose (freedom 0). The freedom to study how the program works, and adapt it to your needs (freedom 1). Access to the source code is a precondition for this. The freedom to redistribute copies so you can help your neighbor (freedom 2). The freedom to improve the program, and release your improvements to the public, so that the whole community benefits (freedom 3). Access to the source code is a precondition for this.
Feeling Free - Open Source Licenses 3/3 GPL, GLPL BSD Licenses Apache License MIT (X11) License Mozilla Public License
Linux Main distributions Red Hat, Fedora Core SuSE Linux Enterprize, Open SuSE Debian Slackware Mandriva Ubuntu Scientific Linux, CERN Linux Shell Desktop Environments KDE GNOME Window Maker Black Box
Supercomputers First computers were supercomputers? TOP500.ORG
Clusters Commodity hardware become available in the last 10 years Local network 100-1000 Mbps easily deployed Linux mature and widely available Software available and even standardized - MPI
Why do we need Grid Dramatically increasing efficiency Easy ti install Easy to maintenance Easy to use Easy to upgrade
Making Grid to work problems 1/5 Too hard to keep track of authentication data (ID/password) across institutions SOLUTION: VOs Too hard to monitor system and application status across institutions SOLUTION: Grid Monitoring Tools Too many ways to submit jobs SOLUTION: GDL - Grid Description Language Too many ways to store, access & keep track of files and data SOLUTION: LFC Logical Filename Catalog
Making Grid to work VOs 2/5 Computing Center Service VO Computing Center
Making Grid to work Grid Site 3/5 Information Services Computing element Storage element Worker nodes Disk pool
Making Grid to work What really happens? 4/5 User interface Input sandbox Output sandbox Workload management System DataSets info Replica Catalogue Auth. &Auth. Job Submit Event Job Query Job Status Output sandbox SE & CE info Input sandbox + Broker Info Publish Logging & Book-keeping Job Status Computing Element
Making Grid to work Middleware 5/5 EDG European Data Grid LCG Large Hadron Collider Computing Grid glite LCG-1 LCG-2 EGEE-1 EGEE-2 Globus 2 based Web services based
EGEE Enabling Grids for escience About 50 countries More than 220 sites About 40000 CPUs More than 13 PB storage
SEE-GRID South East Europe GRID 13 countries Greece project lider, SEE-GRID CA, backup VOMS, Serbia WP3 lider, RB, WMS, BDII, My proxy, LFC Turkey WP4 lider, backup RB Croatia - WP4 lider, VOMS Hungary - pgrade Bosnia and Herzegovina SAM tests Bulgaria - Registry FYR of Macedonia Gridice Romania - Security Albania, Moldavia, Switzerland About 30 sites About 430 CPUs More than 13 TB storage
AEGIS01-PHY-SCL 1/5 Scientific Computing Laboratory, Institute of Physics, Belgrade wns: 100 CPU 25x dual dual Xeon 2.8GHz, 1GB RAM services: CE, gce, SE core services: RB, WMS, VOMS, BDII, MyProxy VOs: AEGIS, Atlas, CMS, ESR, Dteam, SEE-GRID, SEE, OPS
AEGIS02-RCUB 2/5 RCUB, University of Belgrade scavenger wns: 14 CPU 2.0GHz AMD Sempron, 1GB RAM services: CE, SE core services: LFC VOs: AEGIS, SEE-GRID, Dteam, SGDemo
AEGIS03-ELEF-LEDA 3/5 Laboratory for Electronic Design Automation, Faculty of Electric Engineering, University of Nis wns: 4 CPU PIV 2.4GHz, 512MB RAM services: CE, SE VOs: Aegis, SEE-GRID, Dteam
AEGIS04-KG 4/5 Center for Scientific Research, University of Kragujevac wns: 8 CPU PIV 1.7GHz, 1GB RAM services: CE, SE, gce VOs: AEGIS, SEE-GRID, Dteam
AEGIS05-ETFBG 5/5 School of Electrical Engineering, University of Belgrade scavenger wns: 30 CPU 2.6GHz AMD Sempron, 1GB RAM services: CE, SE