DESY site report. HEPiX Spring 2016 at DESY. Yves Kemp, Peter van der Reest. Zeuthen,

Transcription

1 DESY site report HEPiX Spring 2016 at DESY Yves Kemp, Peter van der Reest Zeuthen,

2 Accelerators news > XFEL: : All segments of first light-generating system installed in European XFEL All three of the undulators planned for the starting phase of the European XFEL will be operational by the end of 2016 XFEL planning to start in 2017 > Petra-III has restarted data taking since > First users on FLASH 2 ( ) Free electron laser > Early phase of planning for Petra-4 Planning phase involves very high amount of computer simulations Yves Kemp et al. DESY site report Page 2

3 User support Services > User application deployment under Windows using DSM full service since start of 2016 > Implementation of campus room booking using Zimbra Collaboration Suite > Involved in Arbeitskreis Windows-Linux of Helmholtz Centres > Windows: Currently Windows 7 main working horse Starting with first user tests of Windows Q3 Yves Kemp et al. DESY site report Page 3

4 Load Balancing and Application Delivery > F5 Hardware End of Lifetime 600 Services with 140 Server-Pools on 270 Server > Many Mission Critical Services Web (DESY, EXFEL, DOOR, Indico, HEPiX J ) Certs, Server-Hiding, URL-Mapping, Mail Port Translation, Terminalserver, Puppet, Oracle, > Successor and Enhancements needed Cluster members in separate locations TLS (F5 V11.6) important for Mail PFS and Long (4k) Certs APP-Firewall for legacy applications > Investigate A10 Hard- and Software All-In-One-Pricing Learnt that Technical Base Features differ Buy-After-Successful-Test-Model Client Rate Shaping TCP Express SSL TrafficShield Microkernel Caching XML WebAccelerator Client Side 3 rd Party TCP Proxy Server Side Compression Yves Kemp et al. DESY site report Page 4 OneConnect TCP Express irules High Performance HardwareiControl API Server

5 DESYcloud > Pilot service built on OwnCloud 7 Community Ed. and dcache fully integrated in User Registry and infrastructure services users have no quota we will provide groups with reports on storage usage and the equivalent DESY$ no backups are made thinking about end user retrieval schemes using dcache functionalities > Experiences gained have given input to both products > Starting transition to production service with OwnCloud 9 in the coming weeks/months currently running functional and integration tests investigating move to OwnCloud Enterprise Ed. > Feedback has been generally positive but HEP and Photon Science users tend to develop challenging use cases Yves Kemp et al. DESY site report Page 5

6 Support for BELLE2 collaborative services B2CS > Belle II collaboration decided to migrate the current set of services into the existing IT infrastructure at DESY > In order to make optimal use of the existing services and support structures at DESY, migration of existing services are necessary not all services can simply be copied but will have to be adapted or even restructured in preparation for the final migration small groups of experts went through the details of all services to identify problems and to develop alternative solutions. > In the future the Belle II collaboration will be visible in web under the DESY hosted domain 'belle2.org Members will have credentials to access B2CS. A certificate and VO membership based portal is set up which allows for authentication and authorization of users. Migration processes started in spring. They must be finished before the KEK summer shutdown in July. At Fall HEPiX and CHEP16 we will report on various aspects of migration processes and the new services. Yves Kemp et al. DESY site report Page 6

7 Open Storage Manager OSM > OSM is the tape backend system of dcache at DESY at both sites OSM is a client/server application running on multiple machines DESY bought the source license in the past and has modified the sources several times over the years (adaptions for new tape drives, larger files, better scheduling,...) in both locations we have more than mill files with PB on tape main tape technology is lto6 at the moment, but we still run lto4, lto3 and 9940 drives > to modernize the service, a migration from Solaris to Linux was started some years ago > also, a rewrite of the codebase (partly more than 20 years old) was initiated and included port from Vendor specific Database (RAIMA) to PostgreSQL currently running on SL6 and first Tests on SL7/EL7 effort of last 3 years carried by two students working on code refresh and adding new functions: automatic internal file migration, automatic verification of files and tapes, checksum support Yves Kemp et al. DESY site report Page 7

8 Virtualization and Cloud > Currently ~800 VMs on ~60 hypervisors (XEN, Vmware) Server consolidation, mission critical VMs making use of virtualization HA features OS deployment workflow similar to hardware server OS deployment > Setting up OpenStack compute cloud environment in parallel Using Liberty Networking: Neutron + Open vswitch + Arista 7500 Storage: Ceph > Will migrate to Mitaka Waiting for cells to come Work more on networking > Short-term goal: Create self-service kiosque system Yves Kemp et al. DESY site report Page 8

9 Networking > Replacement of Zeuthen Firewall in December last year * SRX-5400 Juniper firewall cluster * redundant 10GE uplink via Hamburg (X-Win, LHC-One) > Hamburg has been running Juniper equipment successfully for some years now > new offering for spin-off firms on DESY campus network connectivity is routed through dedicated DSL lines academic network contracts do not allow for private usage of bandwidth by firms Yves Kemp et al. DESY site report Page 9

10 Infrastructure > Computing Centre 1 is being overhauled for EXFEL computing challenges from 2 nd half of 2016 onwards, production in 2017 dedicated talk during the week > Hamburg: Icinga 2 HA cluster including new web interface Icinga Web 2 Metric Visualization with Graphite + Grafana, HA setup ~4000 hosts, ~45k services... And increasing Yves Kemp et al. DESY site report Page 10

11 HPC HH reorganization > Previous installation spread over three islands in two computing rooms Configuration, support, data organisation mess > With the new water-cooled racks, migrating everything in there Prerequisite for a homogeneous configuration HPC was the first system in the new water-cooled racks! > HH is expanding Need for classic HPC resources Need for InfiniBand and fat machines for data analytics (e.g. Petra-III) Also new user communities > HPC HH now christened Maxwell Yves Kemp et al. DESY site report Page 11

12 Talks by DESY people > DCD - Desktop Chromodynamics, or: Linux on DESY Desktops Yves Kemp, Monday, 14:50 > The State of OpenAFS Stephan Wiesand, Monday, 15:45 > ASAP3: Status update and activities for XFEL Stefan Dietrich, Wednesday, 11:10 > HTCondor at DESY Christoph Beyer, Wednesday, 14:25 > Using Docker container virtualization in DESY HPC environment Sergey Yakubov, Thursday, 9:25 > Ideas for a journal around "Computing and Software for data-intensive physics Yves Kemp, Thursday, 12:00 > DESY Hamburg infrastructure Martin Koch, Friday, 10:15 Yves Kemp et al. DESY site report Page 12