BaBar Computing: Technologies and Costs October 11, 2000
BaBar Offline Systems: August 1999
SLAC-BaBar Data Analysis System 50/400 simultaneous/total physicists, 300 Tbytes per year HARDWARE UNITS End FY1999 End FY2000 estimate End FY2000 reality silos Tape Silos (STK Powderhorn, 6 6 6 6000 tapes each) Tape Drives (STK Eagle, 20 drives 20 40 20 Gbyte, 10 Mbytes/s) Disk (net capacity of RAID arrays) Tbytes 20 56 61 File Servers and Data Movers CPUs 73 150 ~180 (Sun) Interactive Servers (Sun + CPUs 82 140 ~140 Linux) Batch Servers (Sun + Linux) CPUs 300 900 1000 Network Switches (Cisco 6509) switches 5 14 9
Technologies: CPU System Purchase Date per CPU Cost $$$ SMP CPU Sun E10000, 64 procs (400 MHz), 32 GB 1998-9 25,000 Data Server CPU Sun E220R Tape Servers, 2 procs (450 MHz), 256 MB 2000 10,000 Sun E420R Objectivity Servers, 4 procs (450 MHz), 4 GB (19.6 SPECint95 and 27.1 SPECfp95 @ 450MHz) 2000 8,500 Dell Linux Objectivity Servers, 4 procs (700 MHz), 4GB not yet list 8800 Target server cost Dec-00 6,000 Farm CPU Sun Netra T1 (440 MHz) 2000 3,300 Dell 2450, 2 procs (733 Mhz), 512 MB (Dell 420 is 35.3 SPECint95 and 30.5 SPECfp95 @ 733 MHz) Sep-00 2,000 Target farm cost (excluding infrastructure) Dec-00 1,600
Some BaBar Servers: Build, Objy Catalog, Objy Journal, Objy Test...
Sun Netra T1 Farm now installing 450 machines about to order another 260
Technologies: Disk Disk System or File Server Purchase Date Raw Disk Cost/TB RAIDed Disk Cost/TB RAID+ Server Cost/TB Actuators per TB Sun A3500s (18GB disks) + 420R used for Objy 18 GB SCSI disks (1" thick) + 2*FCAL to 5*SCSI RAID Controller Feb-00 74,074 92,593 115,741 56 Network Appliance F760s used for Kanga 36 GB (1" thick) FCAL disks Apr-00 108,000 28 Sun A3500s (36GB disks) + 420R used for Objy 36 GB (1" thick) SCSI disks + 2*FCAL to 5*SCSI RAID Controller Sep-00 42,593 53,241 64,815 28 SAG Array + Sun 220R 73 GB (1.6" thick) SCSI disks + 2*FCAL to 8*SCSI RAID Contoller Sep-00 26,907 31,197 35,541 14 Electronix IDE Disk RAID Array with SCSI Interface 75 GB (1" thick) IDE disks (Sun 220R with 4 arrays assumed) Sep-00 15,249 20,332 26,443 13
Sun A3500 disk arrays used by BaBar (about 20 TB)
NFS File Servers: Network Appliance F760 et al. ~ 3TB
Technologies: Tape System Purchase Date Cost $$$ per tape Cost $$$ STK Powderhorn Silo (no drives or media) 1999 230,000 42 STK 9840 Eagle tape drive, 20 GB, 20 per silo 1999 22,000 80 STK 9840 tape 1999 95 95 STK 9840 tape 2000 70 70 STK 9940 tape drive, 60 GB, 20 per silo Nov-00 22,000 80 STK 9940 tape Nov-00 95 95 Future drive costs (10 per silo) 2002 22,000 40 Future tape costs 2002 70 70
STK Powderhorn Silo
Money and People
BaBar Offline Computing at SLAC: Costs other than Personnel (does not include per physicist costs such as desktop support, help desk, telephone, general site network) $M 12.00 10.00 8.00 6.00 other net datamove tape Does not include tape media 4.00 disk farm cpu 2.00 smp cpu 0.00 FY 1997 FY 1998 FY 1999 FY2000 FY2001
BaBar Offline Computing at SLAC: Costs other than Personnel (does not include per physicist costs such as desktop support, help desk, telephone, general site network) 12.00 10.00 $M 8.00 6.00 4.00 2.00 Software Materials and Supplies Equipment 0.00 FY 1997 FY 1998 FY 1999 FY2000 FY 2001
BaBar Computing at SLAC: Personnel (SCS) People 120 100 80 60 40 20 SLAC-SCS BaBar Applications SLAC-SCS Systems 0 FY 1997 FY 1998 FY 1999 FY 2000 FY 2001
BaBar Computing at SLAC: Personnel for Applications and Production Support 120 People 100 80 60 40 20 Some guesses non-doe BaBar Applications and Production (at SLAC) DoE BaBar Applications and Production (at SLAC) SLAC-SCS BaBar Applications SLAC-SCS Systems 0 FY 1997 FY 1998 FY 1999 FY 2000 FY 2001
BaBar Computing Personnel The Whole Story? People 160 140 120 100 80 60 40 20 M a n y g u e s s e s BaBar Physicists doing computing SLAC Physicists doing computing non-doe BaBar Applications and Production (at SLAC) DoE BaBar Applications and Production (at SLAC) SLAC-SCS BaBar Applications 0 SLAC-SCS Systems FY 1997 FY 1998 FY 1999 FY 2000 FY 2001
How much does it really cost to buy a CPU or a disk? Infrastructure (server, tape systems, network ) as a fraction of annual expenditure: FY 1997 FY 1998 FY 1999 FY 2000 47% 56% 45% 37% Assume 37.5% infrastructure for 2001 on. (multiply physics CPU and disk costs by 1.6 to get total necessary expenditure).