SSD. DEIM Forum 2014 D8-6 SSD I/O I/O I/O HDD SSD I/O

Transcription

1 DEIM Forum 214 D8-6 SSD, SSD SSD HDD 1 1 I/O I/O I/O I/O,, OLAP, SSD 1. (HDD) CPU NAND flash-based Solid State Drive (SSD) NAND flash chip Google [7] Facebook [14] SSD SSD HDD HDD SSD HDD HDD SSD SSD SSD I/O I/O SSD HDD HDD 1 1 SSD I/O SSD SSD I/O SSD HDD I/O I/O SSD I/O CPU SSD I/O I/O SSD

2 HDD I/O I/O SSD SSD SSD 2. SSD SSD I/O CPU I/O 2. 1 Grace [1] R S S Grace R S S Grace 2 R S R S (R i S i ) S i R i 2. 2 [15] Grace S 1 S 1 S 1 R 1 I/O 2. 3 HDD I/O Grace I/O S I/O I/O I/O 1-1 HDD I/O HDD SSD I/O I/O I/O SSD HDD S SSD I/O 3. 1

3 1: CPU Xeon 2.27GHz x 4 L3 Cache 24MB /CPU DRAM 64GB Storage (SSD) iodrive Duo x4 (8 Logical units, Software RAID) Storage (HDD) SEAGATE ST314687FC x12 (Software RAID) kernel linux File system ext4 DBMS PostgreSQL Shared buffer 8GB SSD PCI-express HDD fibre channel I/O noop RAID( = 64kB) ext4 HDD I/O work mem PostgreSQL [2] PostgreSQL work mem CPU mpstat(1) I/O iostat(1) L3 linux perf 4. SSD SSD I/O SSD HDD I/O 4. 1 SSD I/O SSD I/O I/O I/O I/O 1 SSD HDD I/O I/O I/O SSD Throughput [MB/s] ssd sequentialread 1 ssd randomread hdd sequentialread hdd randomread.1 1k 1k 1k 1M 1M I/O size [B] 1: SSD HDD / I/O 1 SELECT count( ) FROM lineitem, part 2 WHERE l partkey = p partkey 2: lineitem part I/O HDD 3.1 I/O I/O SSD HDD I/O I/O I/O 4. 2 SSD HDD TPC-H [3] Scale Factor = 1 SSD HDD 112GB 2 lineitem part part key 1 part lineitem 2GB 8GB part 8MB work mem 64kB - 2GB 3 4 SSD HDD work mem (usr, system, iowait, irq, soft irq, idle) usr CPU sys I/O iowait I/O sys iowait I/O work mem = 64kB 16MB L3 SSD HDD HDD work mem I/O I/O SSD I/O HDD

4 Time[s] idle soft irq iowait sys usr 64k 256k 1M 4M 16M 64M 256M 1G 4G work_mem[byte] L3 cache size 3: work mem (SSD) Time[s] idle soft irq iowait sys usr 64k 256k 1M 4M 16M 64M 256M 1G 4G work_mem[byte] L3 cache size 4: work mem (HDD) count 1.4e+1 1.2e+1 1e+1 8e+9 6e+9 4e+9 2e+9 cache-references cache-misses cache-miss-rates L3 cache size 64k 256k 1M 4M 16M64M256M1G 4G work_mem [byte] cache miss rate [%] 5: work mem L3 (SSD) I/O work mem > 32MB L3 work mem CPU work mem L3 5 SSD work mem L3 work mem > 32MB work mem CPU work mem = 4MB 1GB work mem = 1GB DRAM 1ns work mem = 1GB (ns) = 7(s) I/O 3 CPU work mem ( 8MB) 1 work mem 512MB 1GB work mem = 1GB work mem 64kB kB kB - 512MB 5.7 1GB 1.5 lineitem GB 512MB ( ) PostgreSQL 4. 3 SSD 4 I/O 2. 3 HDD I/O 3 SSD I/O CPU CPU SSD I/O HDD I/O L3 SSD CPU 3 64kB I/O

5 5. SSD Flash I/O [6] SSD I/O CPU HDD I/O SSD I/O 1 HDD CPU TPC-H Scale Factor = GB part lineitem 32MB 8.8GB part 8MB CPU CPU 16 2CPU CPU work mem 64kB - 512MB 6 work mem work mem idle I/O I/O I/O CPU 5 work mem L3 32MB CPU MB 4 8MB 8 4MB L3 L3 CPU 8 8 L CPU work mem 32 2 Speed up work_mem = 256kB work_mem = 256MB # of queries 7: CPU (work mem = 256 kb, 256 MB) 7 (work mem = 256 kb) HDD (work mem = 256 MB) CPU work mem = 256 MB ( 1) CPU 1 CPU work mem = 256 kb work mem = 256 MB work mem = 256 kb 59.8 work mem = 256 MB 2.6 work mem = 256 kb

6 Time [s] k 256k 1M 4M 16M 64M 256M work_mem [byte] 6: work mem idle soft irq iowait sys usr CPU work mem = 256 MB CPU work mem = 256 kb I/O L3 work mem < 2MB 1-8 SSD I/O I/O I/O 8 work mem = 256kB I/O (MB/S) I/O ( 8a - 3s 8g - 26s ) part lineitem I/O 1-4 I/O PostgreSQL OS 8 I/O I/O I/O I/O 26MB/s MB/s I/O # of queries 9: I/O work mem I/O work mem SSD I/O I/O [6] I/O 16 I/O I/O 5. 2 SSD 6 SSD

7 (a) = 1 (b) = 2 (c) = 4 (d) = (e) = 16 (f) = 32 (g) = 64 8: I/O (work mem = 256kB) 6 work mem = 256 kb I/O I/O 2 2 I/O I/O I/O I/O SSD I/O SSD I/O I/O 6. SSD SSD HDD SSD DRAM Bhattacharjee temperature-aware caching (TAC) schema [4], [5] Kang FaCE [9] multiversion FIFO Flash Oracle Exadata [17] IBM XIV Storage System [1] SSD HDD HDD SSD HDD Koltsidas [11] read-intensive SSD write-intensive HDD SSD [8] OLTP hstorage-db [13] DBMS semantic information I/O FD-tree [12] SSD

8 PIO B-tree [9] SSD I/O Tsirogiannis [16] I/O Flash scan Flash join Flash scan Flash join SSD HDD I/O SSD I/O I/O I/O SSD 7. HDD SSD SSD CPU SSD I/O I/O 64kB I/O HDD I/O I/O SSD JSPS [1] IBM XIV Storage System. systems/storage/disk/xiv/index.html. [2] PostgreSQL. [3] Transaction Processing Performance Council, an ad-hoc, decision support benchmark. [4] Bishwaranjan Bhattacharjee, Kenneth A. Ross, Christian Lang, George A. Mihaila, and Mohammad Banikazemi. Enhancing recovery using an ssd buffer pool extension. DaMoN 11, pp ACM, 211. [5] Mustafa Canim, George A. Mihaila, Bishwaranjan Bhattacharjee, Kenneth A. Ross, and Christian A. Lang. SSD bufferpool extensions for database systems. Proc. VLDB Endow., Vol. 3, No. 1-2, pp , September 21. [6] Feng Chen, David A. Koufaty, and Xiaodong Zhang. Understanding Intrinsic Characteristics and System Implications of Flash Memory Based Solid State Drives. SIGMETRICS Perform. Eval. Rev., Vol. 37, No. 1, pp , June 29. [7] Thomas Claburn. Google Plans To Use Intel SSD Storage In Servers, infrastructure/storage/google-plans-to-use-intel-ssd-storagein-servers/d/d-id/167741? [8] Jaeyoung Do, Donghui Zhang, Jignesh M. Patel, David J. DeWitt, Jeffrey F. Naughton, and Alan Halverson. Turbocharging DBMS buffer pool using SSDs. SIGMOD 11, pp ACM, 211. [9] Woon-Hak Kang, Sang-Won Lee, and Bongki Moon. Flashbased extended cache for higher throughput and faster recovery. Proc. VLDB Endow., Vol. 5, No. 11, pp , July 212. [1] Masaru Kitsuregawa, Hidehiko Tanaka, and Tohru Moto- Oka. Relational Algebra Machine GRACE. In Proceedings of RIMS Symposium on Software Science and Engineering, pp Springer-Verlag, [11] Ioannis Koltsidas and Stratis D. Viglas. Flashing up the storage layer. Proc. VLDB Endow., Vol. 1, No. 1, pp , August 28. [12] Yinan Li, Bingsheng He, Robin Jun Yang, Qiong Luo, and Ke Yi. Tree indexing on solid state drives. Proc. VLDB Endow., Vol. 3, No. 1-2, pp , September 21. [13] Tian Luo, Rubao Lee, Michael Mesnier, Feng Chen, and Xiaodong Zhang. hstorage-db: heterogeneity-aware data management to exploit the full capability of hybrid storage systems. Proc. VLDB Endow., Vol. 5, No. 1, pp , June 212. [14] Domas Mituzas. Flashcache at Facebook: From 21 to 213 and beyond, facebook-engineering/flashcache-at-facebook-from-21-to-213- and-beyond/ [15] Donovan A. Schneider and David J. DeWitt. A performance evaluation of four parallel join algorithms in a sharednothing multiprocessor environment. SIGMOD 89, pp ACM, [16] Dimitris Tsirogiannis, Stavros Harizopoulos, Mehul A. Shah, Janet L. Wiener, and Goetz Graefe. Query Processing Techniques for Solid State Drives. SIGMOD 9, pp ACM, 29. [17] Ronald Weiss. A Technical Overview of the Oracle Exadata Database Machine and Exadata Storage Server. White paper, Oracle, database/exadata/exadata-technical-whitepaper pdf.