Report from CHEP2015. Vladimir Sapunenko INFN- CNAF

Transcription

1 Report from CHEP2015 Vladimir Sapunenko INFN- CNAF

2 CHEP2015 The conference was held at OIST, Okinawa InsGtute of Science and Technology graduate university, in Okinawa, Japan. It is located in the Onna village at the center of Okinawa Island, which is located at about 1,500 km south from Tokyo, Japan. 4/28/15 Report from CHEP 2015, V.Sapunenko 2

3 Okinawa, Giappone CHEP /28/15 Report from CHEP 2015, V.Sapunenko 3

4 OIST: Okinawa InsGtute of Science and Technology 4/28/15 Report from CHEP 2015, V.Sapunenko 4

5 WorkShop WLCG Bernd Panzer: Technology, Market and costs trends hyps://indico.cern.ch/event/345619/session/1/contribugon/10/material/slides/1.pdf Redefine our nogon of storage space: Storage space plus performance Split MC+processing faciliges and analysis faciliges Should not talk about disk, SSD or tape but rather storage units (space+performance) 4/28/15 Report from CHEP 2015, V.Sapunenko 5

6 Bernd Panzer: Technology, Market and costs trends TB enterprise tape 100 TB LTO tape 60 TB HDD 25 TB SSD Not a direct rela;onship to costs 4/28/15 Report from CHEP 2015, V.Sapunenko 6

7 Bernd Panzer: Technology, Market and costs trends HEP is here ~15M$ out of 52B$ CERN purchases of disk servers: costs defined by component costs, economy of scale (homogeneity!) and the Architecture (also socware dependent) Architecture changes during the last years: RAID5! RAID1 Integrated disk server! CPU frontend with SAS aeached JBOD array RAID1! socware data replica;on One array per server! two arrays per server! LTO has > 96% of the market, (LTO- 6, 2.5TB Cartridges)! Enterprise tapes (ORACLE- 8.5TB, IBM 10TB) niche products! TDK&Maxwell stopped producing tapes! R&D looks okay, 220 TB (IBM/Fuji) and 185 TB (Sony) tape in the labs! LTO roadmap lately extended to 10 genera;ons, but steady decrease of revenues! LTO 6 capacity was reduced (3.2! 2.5 TB) 4/28/15 Report from CHEP 2015, V.Sapunenko 7

8 Back- of- an- Envelope Calcula;ons, storage component savings CERN disk server: CPU server with SAS aeached JBOD array 2013! 2014 Infrastructure and architecture overhead =~ factor 7 Cheapest server disk today is the 8 TB Seagate SMR (0.03 Euro/GB) 200 TB RAW capacity 100 TB usable! 0.2 Euro/GB Example: 'improve the storage costs by a factor 3: 1440 TB RAW capacity 1152 TB usable! 0.06 Euro/GB 4 TB server disk ~0.05 Euro/GB! 8 TB SMR ~0.03 Euro/GB (low- end desktop 6 TB) Dual 24- bay disk tray! three 60- bay disk trays per frontend RAID0 / data replica! Erasure code, data increase by 1.25 instead of 2 This improves the space costs but reduces considerable the IO capabili;es. But how much IO do we actually need? (Applica;on, data management, data distribu;on dependent) Much more tuning between applica;on and hardware needed.. Redefine our no;on of storage space! Storage space plus performance Split MC+processing facili;es - - analysis facili;es different IO architecture based on Seagate Kine;c object drive model or the HGST Open Ethernet drive FLAPE Flash+Tape 4/28/15 Report from CHEP 2015, V.Sapunenko 8

9 Bernd Panzer: Technology, Market and costs trends Summary Semiconductor Component and end- user markets are stabilizing. Satura;on effects seen nearly everywhere, moving to 'replacement' markets Very few companies domina;ng the market: technology evolu;on, not revolu;on Moore's Law validity being debated. 3D technology helps. Expect s;ll con;nuous price/performance improvements, but lower levels Server market is small compared to the consumer market, stable and highly profitable Market - - > high prices. Microservers show in principle poten;al, but currently overrated Way to improve price/performance beyond the technology - - > architecture Should not talk about disk, SSD or tape but rather storage units (space+performance) There will be processing and storage technologies in 2025 and most likely not too different from today, but es;ma;ng the cost is preey difficult. So.. You will get what you get ( equal or rather lower budget than today) 4/28/15 Report from CHEP 2015, V.Sapunenko 9

10 Luca Masceb - New Storage Technologies hyps://indico.cern.ch/event/345619/session/1/contribugon/17/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 10

11 Luca Masceb - New Storage Technologies 4/28/15 Report from CHEP 2015, V.Sapunenko 11

12 Luca Masceb - New Storage Technologies 4/28/15 Report from CHEP 2015, V.Sapunenko 12

13 Intel hyp://indico.cern.ch/event/304944/session/15/contribugon/552/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 13

14 Michael Poat: Performance Comparison Studies With Real- Life Scenarios in an Experimental Data Taking Context Leveraging OpenStack Swid & Ceph 4/28/15 Report from CHEP 2015, V.Sapunenko 14

15 Christopher HOLLOWELL(BNL): Mean PB to Failure hyps://indico.cern.ch/event/304944/session/3/contribugon/2/material/slides/1.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 15

16 Tapes at CERN hyps://indico.cern.ch/event/304944/session/3/contribugon/59/material/slides/1.pdf Data: ~100 PB physics data (CASTOR) ~7 PB backup (TSM) Tape libraries: IBM TS3500 (3+2) Oracle SL8500 (4) Tape drives: 100 archive 50 backup Capacity: ~ slots ~ tapes 4/28/15 Report from CHEP 2015, V.Sapunenko 16

17 Tapes at CERN 4/28/15 Report from CHEP 2015, V.Sapunenko 17

18 Tapes at CERN: Technology/market forecast 4/28/15 Report from CHEP 2015, V.Sapunenko 18

19 Dario Barberis: The ATLAS EventIndex hyps://indico.cern.ch/event/304944/session/3/contribugon/208/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 19

20 SebasGan Lopienski (CERN): Computer Security in 2015 Average Gme between intrusion and detecgon 8 month "There are two kinds of organizagons those who know they've been hacked, and those who don t know Criminals are just ader the money, so they usually chose the easy targets "If you're gebng chased by a lion, you don't need to run faster than the lion, just the people running with you. 4/28/15 Report from CHEP 2015, V.Sapunenko 20

21 Computer Security in 2015 Government sponsored ayacks EquaGon group HDD firmware reprogramming CompuGng power = money Bitcoin minning at CERN (Gen. 2015) Risks are there, whether we like it or not Addressing them means invesgng in protecgon and preparagon Including security early is the only opgon We need awareness and educagon on all levels Addi4onally, our systems and outside threats constantly evolve 4/28/15 Report from CHEP 2015, V.Sapunenko 21

22 Computer security (2) hyps://indico.cern.ch/event/304944/session/5/contribugon/47/material/slides/0.pdf Resist to Gov. Security agencies: Unfavorable bayleground - Outcome unlikely posigve Focus on protecgng your people as best as possible 4/28/15 Report from CHEP 2015, V.Sapunenko 22

23 Data preservagon Bodhitha JAYATILAKA (Fermilab): Data PreservaGon at the Fermilab Tevatron hyps://indico.cern.ch/event/304944/session/5/contribugon/11/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 23

24 Andreas Peters: EOS as the present and future solugon for data storage at CERN hyps://indico.cern.ch/event/304944/session/3/contribugon/296/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 24

25 Andreas Peters: IntegraGng CEPH in EOS hyps://indico.cern.ch/event/304944/session/3/contribugon/297/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 25

26 Andreas Peters: Ceph based storage services for Run2 and beyond hyps://indico.cern.ch/event/304944/session/3/contribugon/287/material/slides/0.pdf 4/28/15 Report from CHEP 2015, V.Sapunenko 26

27 Experiences on File Systems: Which is the best FS for you? hyps://indico.cern.ch/event/304944/session/15/contribugon/567/material/slides/0.pdf discussion at coffee break: Why you are using GPFS? It s boring, it s just works " 4/28/15 Report from CHEP 2015, V.Sapunenko 27

28 4/28/15 Report from CHEP 2015, V.Sapunenko 28