PCIe Storage Beyond SSDs

Transcription

1 PCIe Storage Beyond SSDs Fabian Trumper NVM Solutions Group PMC-Sierra Santa Clara, CA 1

2 Classic Memory / Storage Hierarchy FAST, VOLATILE CPU Cache DRAM Performance Gap Performance Tier (SSDs) SLOW, NON-VOLATILE Capacity Tier (HDDs) Santa Clara, CA 2

3 Some system hot spots don t fit well within that hierarchy DATA De-dup Indexing Compression Encryption Mapping DATA METADATA WRITE BUFFER METADATA DATA* DATA* Hot Spot I/Os >= (all I/O in the System)

4 Both fall into the Performance Gap CPU Cache WRITE BUFFER DRAM Mission-Critical Performance Gap METADATA Performance Tier (SSDs) Capacity Tier (HDDs) Santa Clara, CA 4

5 Two Mission Critical Data Sets Requirements WRITE BUFFER METADATA Transaction Size Variable / Small Fixed Bandwidth Low/Moderate Very High Response Time Very Low Very Low Non Volatile Yes Yes Write Endurance Very High Very High Multi-Port Access Preferably Preferably Mission Critical (Fail Safe) Yes Yes Santa Clara, CA 5

6 Can we use SSDs for that? As performance increases so do endurance 400GB SSD requirements It 100 is not practical to solve this problem with SSD s Endurance (DW/D) 1, SSD Endurance Threshold 1 50, , , ,000 1,000,000 Performance (I/Os) Santa Clara, CA 6

7 What if we doubled the capacity? As performance increases so do endurance requirements It 100 is not practical to solve this problem with SSD s Endurance (DW/D) 1, SSD Capacity (GB) , , , ,000 1,000,000 Performance (I/Os) Santa Clara, CA 7

8 Quadrupled? More? 1,000 As performance increases so do endurance requirements It 100 is not practical to solve this problem with SSD s Endurance (DW/D) 10 SSD Capacity (GB) , , , ,000 1,000,000 Performance (I/Os) Santa Clara, CA 8

9 Can t solve this with Flash Endurance (DW/D) 1, We need to be here! SSDs are here 50, , , ,000 1,000,000 Performance (I/Os) 1600 Santa Clara, CA 9

10 How about DRAM then? DRAM is susceptible to power failures To protect mission critical information, either - Use UPS or BBU maintenance nightmare Log everything to Storage Complexity, Performance and Endurance trade-offs 10

11 What about PCM? RRAM? MRAM? We ve been waiting for years Santa Clara, CA 11

12 Back to the drawing board.. Santa Clara, CA 12

13 Can we combine both? Requirements DRAM Solid State Drive PCI-Express Memory Mapped Storage DMA Initiator No No Yes Memory Addressable Yes No Yes Variable Size Objects Yes No Yes Write Endurance Yes No Yes Multi-Port Access No Yes Yes Persistent No Yes Yes Santa Clara, CA 13

14 Mt Ramon Project Hybrid Memory Card So we went ahead and built it 16GB NV-RAM NVMe and Direct Memory Interface Access Modes 4GB/8GB/16GB DRAM Unlimited Endurance Flash Backup Module PCIe 3.0 Performance Low Latency Access Backup Power Module

15 What did we get? More than 1 Million IOPS More than 4X better than next best alternative Memory Mapped NVRAM SSD A SSD B 4KB RW 4KB RR Sustained and Symmetrical Performance

16 And what about CPU utilization? Up to 4x Better CPU Utilization MB/s per 1% Utilization HW Details CPU I DDR 1333MHz Frq 3.2Ghz PCI X8 Gen3 # of cores CPU Load/Store PCIe DMA

17 Memory Mapped Write IOPS 15 Million Random Write IOPS for 64B Transactions Millions IOPS 64B Memory Mapped 512B Memory Mapped 512B SSD A 512B SSD B Memory Mapped Interfaces provides higher IOPS for small write transactions Ideal for in-place updates of metadata and database records

18 What next? Enable the Industry to support Memory-Mapped Storage by working through standards bodies: NVMexpress SNIA NVM Programming TWG Enable Applications and Operating Systems ISV Adopt methods and APIs to recognize and take advantage of memory-mapped devices Santa Clara, CA 18

19 Thank You! See us in booth # 416 for a live demo Santa Clara, CA 19