Experimental Computing. Frank Porter System Manager: Juan Barayoga

Transcription

1 Experimental Computing Frank Porter System Manager: Juan Barayoga 1 Frank Porter, Caltech DoE Review, June 29, 2009

2 UseofComputeFarm MINOS Monte Carlo simulation; Caltech will continue to be a major contributer in simulation production presently under preparation. Recent very heavy use for ν e appearance analysis. NOvA Expecting growing demands on computing resources. BaBar Will continue to contribute as a simulation site; a major production is nearly ready to begin. Recent service as dedicated site for simulations requiring a special conditions database Use of fileserver to support analysis not possible at SLAC. Data analysis of b sγ. SuperB Large TDR production planned; Caltech will participate. 2 Frank Porter, Caltech DoE Review, June 29, 2009

3 HEP Experimental Computing System Description (I) CPU farm Linux on dual-intel-cpu rack-mounted nodes, 1-2 GByte memory/node Currently 546 CPUs (all newer nodes have hyperthreading enabled, providing not-quite-double raw core count on those nodes) Networkboot-up PBS batch system for resource allocation 100BaseT network connection to each unit KVM switches for local keyboard/mouse/monitor File servers Also Linux/Intel-based SATA RAID 5 technology 65.6 TByte capacity on eight servers Gbit ethernet NFS, AFS, Samba file serving software 3 Frank Porter, Caltech DoE Review, June 29, 2009

4 HEP Experimental Computing System Description (II) Interactive servers Desktop mixture of Linux and Windows on Intel Central interactive Linux servers (5 dual-cpu) Other CPU services Windows domain servers (primary and secondary) Web servers (Linux and NT) Tape drives DLT tape library on fileserver DLT drive on Windows Mostly used for backups now 4 Frank Porter, Caltech DoE Review, June 29, 2009

5 HEP Experimental Computing System Description (III) Network 100BaseT capability available everywhere Production farm is on a private network for security Four HEP gigabit ethernet switches, plus CITNET 2000 Gbit connection to file servers; proposing upgrade to Gbit switch for newer blade compute servers, which have Gbit NICs Wireless Mbps, maintained by Caltech WAN supported by Caltech ( Internet2 ) Printers (principally 2 color and 2 B&W) VGA projectors (conference rooms, plus roamer) UPS for critical services (network, file servers, mail server, web server) 5 Frank Porter, Caltech DoE Review, June 29, 2009

6 6 Frank Porter, Caltech DoE Review, June 29, 2009

7 Caltech Support Caltech s IMSS (Information Management Systems and Services) provides variety of services benefitting HEP Site-wide software license agreements Visio, Pro Engineer, Autocad Maple, Mathematica, Matlab Microsoft: OS, Office, Visual Studio, Project Symantec antivirus PCTeX X-Win32, WinSCP Adobe Acrobat, Illustrator, Photoshop RedHatLinux 7 Frank Porter, Caltech DoE Review, June 29, 2009

8 Caltech Support Networking Networking support Campus backbone, and equipment/maintenance for WAN connection provided by Caltech Caltech provides ISP (cable modem, PPP, ISDN) service Caltech monitors security alerts Major Caltech campus-wide network upgrade Uniform wireless b/g implementation 8 Frank Porter, Caltech DoE Review, June 29, 2009

9 A very effective model. Continuous Evolution Farm continues to grow to match needs. Experiments require greater statistics; complexity (compute time per event) also grows. Blade server prices have come down to where they are now the obvious packaging of choice. Higher density computing. Lower power consumption. Cooler aggregate operation. Easier management. Disk space continues to grow to match needs Cost/unit approximately constant, performance/unit increases. Security remains a constant area of vigilance. The move of the production farm to a private network helped considerably. 9 Frank Porter, Caltech DoE Review, June 29, 2009

10 Computing Equipment Budget Proposal FY08 FY09 FY10 Actual Actual Proposed Item Blade chassis with 14 dual quad-core nodes Cisco 48-port gigabit switch (2) UPS (3) Fileserver chassis with 24-1TB disks 12-1TB disks for existing fileserver chasis Desktop workstation upgrades Virtual network servers (2) Price 41k 7k 3k 5k 2k 10k 7k 10 Frank Porter, Caltech DoE Review, June 29, 2009