SAS Technical Update Connectivity Roadmap and MultiLink SAS Initiative Jay Neer Molex Corporation Marty Czekalski Seagate Technology LLC

Similar documents
SAS Standards and Technology Update Harry Mason LSI Corp. Marty Czekalski Seagate

SAS: Today s Fast and Flexible Storage Fabric. Rick Kutcipal President, SCSI Trade Association Product Planning and Architecture, Broadcom Limited

Scale your Data Center with SAS Marty Czekalski Market and Ecosystem Development for Emerging Technology, Western Digital Corporation

Marty Czekalski President, SCSI Trade Association - Emerging Interface and Architecture Program Manager, Seagate Technology

SAS: Today s Fast and Flexible Storage Fabric

SAS & SATA Combine to Change the Storage Market. Marty Czekalski, Seagate Technology Terry Gibbons, LSI Corporation

Marty Czekalski President, SCSI Trade Association - Emerging Interface and Architecture Program Manager, Seagate Technology

EDUCATION Harry Mason Marty Czekalski

Interface Trends for the Enterprise I/O Highway

Performance and Innovation of Storage. Advances through SCSI Express

Flash Storage with 24G SAS Leads the Way in Crunching Big Data

SAS & SATA Combine to Change the Storage Market

NETWORKING FLASH STORAGE? FIBRE CHANNEL WAS ALWAYS THE ANSWER!

Update. Marty Czekalski President, SCSI Trade Association Interface and Emerging Architecture Program Manager - Seagate Technology

The Transition to PCI Express* for Client SSDs

FC-NVMe. NVMe over Fabrics. Fibre Channel the most trusted fabric can transport NVMe natively. White Paper

Frequently Asked Questions. s620 SATA SSD Enterprise-Class Solid-State Device

Next Generation Computing Architectures for Cloud Scale Applications

NVMe SSDs Becoming Norm for All Flash Storage

SSD Architecture Considerations for a Spectrum of Enterprise Applications. Alan Fitzgerald, VP and CTO SMART Modular Technologies

Hálózatok üzleti tervezése

Cisco HyperFlex HX220c M4 Node

PMC Adaptec Trusted Storage Solutions. A complete portfolio of 12Gb/s Host Bus Adapters, RAID Adapters, SAS Expander and Cables

HPE Synergy HPE SimpliVity 380

IBM Europe Announcement ZG , dated February 13, 2007

Microsemi Adaptec Trusted Storage Solutions. A complete portfolio of 12 Gbps Host Bus Adapters, RAID Adapters, SAS Expander and Cables

NAS for Server Virtualization Dennis Chapman Senior Technical Director NetApp

Switched SAS. Sharable, Scalable SAS Infrastructure. Terry Gibbons, Director Software Planning and Strategy, LSI Corporation.

STORAGE NETWORKING TECHNOLOGY STEPS UP TO PERFORMANCE CHALLENGES

Storage Update and Storage Best Practices for Microsoft Server Applications. Dennis Martin President, Demartek January 2009 Copyright 2009 Demartek

Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini

NVM Express TM Ecosystem Enabling PCIe NVMe Architectures

SSDs Driving Greater Efficiency in Data Centers

Density Optimized System Enabling Next-Gen Performance

NVMe over Universal RDMA Fabrics

Cisco HyperFlex HX220c M4 and HX220c M4 All Flash Nodes

Virtualization of the MS Exchange Server Environment

Intel Solid State Drive Data Center Family for PCIe* in Baidu s Data Center Environment

IBM Emulex 16Gb Fibre Channel HBA Evaluation

Vblock Architecture. Andrew Smallridge DC Technology Solutions Architect

24G SAS Opens the Way to the Latest High-Performance Applications

Design a Remote-Office or Branch-Office Data Center with Cisco UCS Mini

Top 5 Reasons to Consider

An Introduction. (for Military Storage Application) Redefining Flash Storage

Bus Example: Pentium II

Build a Better Data Center with 24G SAS

Dell PowerEdge R720xd with PERC H710P: A Balanced Configuration for Microsoft Exchange 2010 Solutions

PCI Express SATA III RAID Controller Card with Mini-SAS Connector (SFF-8087) - HyperDuo SSD Tiering

FLASHARRAY//M Business and IT Transformation in 3U

Why NVMe/TCP is the better choice for your Data Center

Deploy a High-Performance Database Solution: Cisco UCS B420 M4 Blade Server with Fusion iomemory PX600 Using Oracle Database 12c

Performance Benefits of NVMe over Fibre Channel A New, Parallel, Efficient Protocol

Evaluation Report: Improving SQL Server Database Performance with Dot Hill AssuredSAN 4824 Flash Upgrades

VMware Virtual SAN. Technical Walkthrough. Massimiliano Moschini Brand Specialist VCI - vexpert VMware Inc. All rights reserved.

The protocol can efficiently use interconnect and fabric techno-

Describe the features and performance characteristics of server-class hard disks and solid state drives.

The QLogic 8200 Series is the Adapter of Choice for Converged Data Centers

LSI and HGST accelerate database applications with Enterprise RAID and Solid State Drives

Fibre Channel. Roadmap to your SAN Future! HP Technology Forum & Expo June, 2007, Las Vegas Skip Jones, FCIA Chair, QLogic

Serial ATA (SATA) Interface. Jin-Soo Kim Computer Systems Laboratory Sungkyunkwan University

Storage Systems Market Analysis Dec 04

Accelerating Real-Time Big Data. Breaking the limitations of captive NVMe storage

Microsoft Exchange Server 2010 workload optimization on the new IBM PureFlex System

Assessing and Comparing HP Parallel SCSI and HP Small Form Factor Enterprise Hard Disk Drives in Server Environments

Direct-Attached Storage (DAS) is an architecture

N V M e o v e r F a b r i c s -

NVMe Takes It All, SCSI Has To Fall. Brave New Storage World. Lugano April Alexander Ruebensaal

The Datacentered Future Greg Huff CTO, LSI Corporation

Entry-level Intel RAID RS3 Controller Family

Adaptec Series 7 SAS/SATA RAID Adapters

Flash In the Data Center

JMR ELECTRONICS INC. WHITE PAPER

How To Get The Most Out Of Flash Deployments

Dell PowerVault MD Family. Modular storage. The Dell PowerVault MD storage family

Cisco HyperFlex HX220c M4 and HX220c M4 All Flash Nodes

Cisco UCS Virtual Interface Card 1225

Architected for Performance. NVMe over Fabrics. September 20 th, Brandon Hoff, Broadcom.

Low latency and high throughput storage access

Cisco HyperFlex HX220c Edge M5

Dell PowerVault MD Family. Modular Storage. The Dell PowerVault MD Storage Family

SNIA Developers Conference - Growth of the iscsi RDMA (iser) Ecosystem

STORAGE CONSOLIDATION WITH IP STORAGE. David Dale, NetApp

Target Environments The Smart Array 6i Controller offers superior investment protection to the following environments: Non-RAID

Getting it Right: Testing Storage Arrays The Way They ll be Used

Deep Learning Performance and Cost Evaluation

Open storage architecture for private Oracle database clouds

Hitachi Virtual Storage Platform Family

Technology Insight Series

Best Practices for Deploying a Mixed 1Gb/10Gb Ethernet SAN using Dell EqualLogic Storage Arrays

Micron NVMe in the Open19 Platform: Low-Latency Storage at the Edge.

Building Your Own Robust and Powerful Software Defined Storage with VMware vsan. Tips on Choosing Hardware for vsan Deployment

Solid Access Technologies, LLC

Data Storage World - Tokyo December 16, 2004 SAN Technology Update

Deep Learning Performance and Cost Evaluation

NVMe over Fabrics. High Performance SSDs networked over Ethernet. Rob Davis Vice President Storage Technology, Mellanox

Cold Storage: The Road to Enterprise Ilya Kuznetsov YADRO

Data Storage World - Tokyo December 16, 2004 SAN Technology Update

NVMe Direct. Next-Generation Offload Technology. White Paper

Dell EMC SCv3020 7,000 Mailbox Exchange 2016 Resiliency Storage Solution using 7.2K drives

EMC Innovations in High-end storages

Transcription:

SAS Technical Update Connectivity Roadmap and MultiLink SAS Initiative Jay Neer Molex Corporation Marty Czekalski Seagate Technology LLC

SAS Connectivity Roadmap Background Connectivity Objectives Converged Connectivity Connectivity Roadmap 2

SAS Background Ultra320 SCSI gave way to 3Gb/s SAS (2005-06) 6Gb/s SAS was announced in 4Q08 6Gb/s SAS systems now widely shipping 6Gb/s SAS advances dramatically in external storage shipments Drive attach: significant penetration Host attach: steadily growing The need for improved host connectivity is driving SAS Advanced Connectivity Roadmap 3

SAS Host Connectivity Improvements Mid-Range Storage, Cloud computing, large data centers, and scalable data enterprises require more from SAS: Distances Flexibility Scalability Serviceability Usability 4

SAS Advanced Connectivity Objectives Provide managed connectivity standards Provide converged high-density connectivity Provide active copper solution to 20m Provide optical solution to 100m Support 6Gb/s SAS deployments Extensible to 12Gb/s SAS deployments Drive market consistency Simplify cable and connector options 5

SAS Converged Connectivity One connecter style for: Greater density Electrically improved signaling Identical active and passive schemes for 6Gb/s SAS and next generation 12Gb/s SAS Integrated SAS Connectivity Management The SAS Advanced Connectivity roadmap is based on the Small Form Factor high-density connector (SFF-8644) referred to as the Mini-SAS HD connector 6

SAS Connectivity Management Managed Connectivity Supports: Connection discovery and cable management Detects presence of passive, active and optical connections Suitable for large-scale deployments Improved Serviceability and Usability: Eliminates the need for mechanical keys and multiple skews Rapid fault isolation Minimizes configuration errors Lower Total Cost of Ownership (TCO): Improved uptime Reduced FRU inventory Configuration and service cost savings 7 7

SAS Advanced Connectivity

SAS Advanced Connectivity Superior Connections with Mini-SAS HD Double the port density & data rate (Mini-SAS limited to 6Gb/s SAS only) Internal and external solutions available Electrically improved less cross-talk, better signal/noise ratio Supports active copper and optical cabling (Mini-SAS limited to 6Gb/s SAS only) Supports SAS Connectivity Management (Unsupported with Mini-SAS) 9 9

Improved Distances Improved Distances Active copper extended to 20m; optical to 100m Enables more box-to-box, server-to-storage and rack-to-rack connections Scales SAS topology which accommodates more spindles, more storage and more capacity Greater configuration deployment flexibility 10

MultiLink SAS Background SAS performance capabilities MultiLink SAS initiative SAS Bandwidth Roadmap 11

STA Market Successes Sustained SCSI in Standard High Volume Servers Ultra160 (parallel SCSI) Ultra320 (parallel SCSI) Effective Server Transition to SAS 3Gb/s SAS 6Gb/s SAS 12Gb/s SAS (in Process) Drive Preference in External Storage Market Breadth of Supply Market Scale Host Connection into External Storage Markets Serial Architecture: Addressing; zoning, high density interconnects SAS Advanced Connectivity Roadmap

SAS Logical Abstraction Layer: Preservation and Innovation Preserves SCSI Command Set Across: Successive Product Generations Frequent Technology Perturbations Multiple Vendors Lowers System Integration Cost/Time Investment Protection: S/W, Middleware, & Enhancements Delivers Enterprise Attributes Operates over numerous transport layers ATA Packet Interface (ATAPI) USB Mass Storage Class, UAS (USB Attached SCSI) Firewire SBP-2 iscsi (SCSI over TCP/IP) Fibre Channel (FCP), FCoE Parallel SCSI Serial Attached SCSI (SAS)

SAS Performance Improvements RAID 5 Random IOPs 12Gb/s SAS (Projected) Relative Performance Ultra320 3Gb/s SAS Improved Processing Power Firmware Improvements 6Gb/s SAS Today Exceptional Gains without Exceptional Changes

SAS Backplane Controller Projections No SAS Changes 2009 2010 2011 2012 2013 Performance (4K Sequential IOPS) Additional Improvements Expected Protocol execution Application hints OS improvements Controller caching Improvements for external storage systems 80+K 3G 150+K 6G 300+K 6G 450+K 12G 6-10X performance gains in ~3 years Single-chip SAS controller performance across PCIe 900+K Feature Functionality 15

SAS/SATA SSD Market Share Enterprise Shipments (Volume) Source: IDC

Solid State Alternatives Option A: Use Existing Drive slots - High aggregate performance - Moderate performance/slot (power limited) - Hot Swap, Serviceability - High Availability (two fault domains possible) Option B: PCIe Card - High performance - No Hot Swap, difficult servicing - Availability issues (single fault domain) - Relies on application level replication - OR -

Considerations for Low-Latency Storage Devices Must Co-exist with SAS SSD Requirements Non-persistent Caching, I/O acceleration, etc. Block Storage or Memory Model Persistent - Enterprise Quality Scales, hot plug, S/W, Robust Feature Set (zoning, encryption, etc.) Multi-Vendor, technology transparent SAS functionality is the Storage Watermark Performance Determination Provisioned Power Available bandwidth Protocol latency

The Performance Myth Option B (PCIe) is often perceived as being higher performance Option A, the SAS Reality: Near equivalent access time latency (Limited Protocol Impact) Excellent IOPs and BW today, with dramatic increases expected Near Lane for Link bandwidth equivalency Power dictates performance, not protocol Number of active flash channels is limited by the power envelope Misconceptions regarding Option A performance are guided by: Existing Power Envelope (9W vs 25W) Single link vs Multi-lane Comparisons Multiple simultaneous transfers favor SAS for enterprise workloads

Latency Comparison Host Overhead PCIe Overhead Controller Overhead Flash Latency Transfer time PCIe (Option B) Small changes here have little effect on the overall latency SAS (Option A) SAS Overhead ~1-1.5 us today Decreases as processors improve OS does context switch to work on other pending tasks ~25-50 us today Increasing in future Flash generations Data ready OS does context switch back to work on returned data

Latency Comparison Option A: Flash-1(SAS) Currently shipping 6Gb/s SAS HBA Standard SAS drivers 6 SATA SSDs (SLC) HBA converts SCSI commands to SATA) Equal total capacity ~20W total power Preconditioned and in steady state Option B: Flash-2(PCIe) Currently shipping native PCIe SSD (SLC) Proprietary (non-scsi) driver Equal total capacity ~20 W total power Preconditioned and in steady state 21

Latency Comparison: Flash-1 (SAS) vs Flash-2 (PCIe) Latency dependent upon: Offered load (4K Seq Write) Queue or thread depth (multiple thread sizes) Latency measured with VDBench under Win2K8 0.9 0.8 0.7 Flash-1 Response Time -> Throughput, Win2K8 Threads 8 SAS = lower latency 0.9 0.8 0.7 Flash-2 Response Time -> Throughput, Win2K8 I/O Latency, ms per I/O 0.6 0.5 0.4 0.3 0.2 I/O Latency, ms per I/O 0.6 0.5 0.4 0.3 0.2 Threads 8 PCIe = lower latency 0.1 0.1 0.0-40,000 80,000 120,000 160,000 200,000 Measured Load, IOPs 1 Th 4K Seq Wr 4 Th 4K Seq Wr 8 Th 4K Seq Wr 16 Th 4K Seq Wr 32 Th 4K Seq Wr 64 Th 4K Seq Wr 128 Th 4K Seq Wr 0.0 0 40,000 80,000 120,000 160,000 200,000 Measured Load, IOPs 1 Th 4K Seq Wr 4 Th 4K Seq Wr 8 Th 4K Seq Wr 16 Th 4K Seq Wr 32 Th 4K Seq Wr 64 Th 4K Seq Wr 128 Th 4K Seq Wr SAS Concurrency favors enterprise workloads 22

Latency Comparison: Flash-1(SAS) vs Flash-2 (PCIe) Latency dependent upon: Offered load (64K Random Read) Queue or thread depth (multiple thread sizes) Latency measured with VDBench under Win2K8 I/O Latency, ms per I/O 8 7 6 5 4 3 2 Flash-1 Response Time -> Throughput, Win2K8 Threads 4 SAS = lower latency I/O Latency, ms per I/O 8 6 5 4 3 2 Flash-2 Response Time -> Throughput, Win2K8 Threads 4 7 PCIe = lower latency 1 1 0 0 200 400 600 800 1,000 1,200 Measured Load, MB/s 1 Th 64K Rnd Rd 4 Th 64K Rnd Rd 8 Th 64K Rnd Rd 16 Th 64K Rnd Rd 32 Th 64K Rnd Rd 64 Th 64K Rnd Rd 128 Th 64K Rnd Rd 0 0 200 400 600 800 1,000 1,200 Measured Load, MB/s 1 Th 64K Rnd Rd 4 Th 64K Rnd Rd 8 Th 64K Rnd Rd 16 Th 64K Rnd Rd 32 Th 64K Rnd Rd 64 Th 64K Rnd Rd 128 Th 64K Rnd Rd SAS Concurrency favors enterprise workloads 23

Key Comparisons Today PCIe SAS Links (BW) X4 (4x500MB/s) X1 (600MB/s) Power Available 25W 9W (2.5 ) Total Latency >26 us >26 us Multi host protocol No Yes High availability No Yes (Dual Port) Scalability Limited Excellent Robust proven protocol stack (security, encryption, end-to-end protection, zoning, distance, etc) No Yes Hot Swap serviceable No Yes Compatible with existing management SW No Yes

MultiLink SAS Initiative STA Endorsed May 2010 Defines new type of SAS Drive Slot Increased Power/slot Multiple SAS Links No Protocol Changes (Desired) Work with existing infrastructure components Options for 12Gb/s and 24Gb/s link performance

MultiLink SAS Objectives Externally-accessible backplane slot architecture for SAS drives Additional Power provisioned for each MultiLink slot Improved performance per slot for SSD drives Optional for the system developer Backward Compatible Slot Supports existing HDD & SDD drives Extends existing backplane connectors to 4 SAS Links (Multiple configuration capability) Accommodates a variety of SSD form factors and configurations No protocol changes (desired) Repackaging exercise Power management & MultiLink SAS configuration, future enhancements 26

Proposed Compatibility Solution SAS Receptacle Configuration Current 2-Port SAS Receptacle Configuration Port 2 Signal (7 Pins) Port 1 Signal (7 Pins) Port 1 Power (15 Pins) Proposed 4-Port SAS Receptacle Configuration Port 2 Signal (7 Pins) Port 3 & Port 4 Signals (13 Pins) Port 1 Signal (7 Pins) Port 1 Power (15 Pins)

MultiLink SAS Slot MultiLink SAS High performance (20+w/slot) Hot swap, serviceability High availability (2 fault domains possible) Low implementation risk: Standard SAS drivers Fully hardened protocol stack Common Management Stack Low investment (repackaging) Flexible: Independent SSDs or wide-port SSDs Able to isolate tier-tier traffic w/o accessing system memory SSD SSD SSD SSD MultiLink SAS Connector www.scsita.org 28

MultiLink SAS Roadmap: Backplane Slot Connector 1000 Legacy Slot Compatible New Slot Bandwidth (Gb/s, Full Duplex) MultiLink SAS 100 Existing Connector 24 10 6 96 384 1 3Gb/s (1x1) 6Gb/s (2x1) 12Gb/s (2x2) 24 Gb/s (2x4) www.scsita.org 29

MultiLink SAS timetable 2010 2011 2012 2013 Kick-off Validation and Proposals to T10 & SFF 12Gb/s SAS Plugfest Demos and prototypes OEM System Integration and Qualifications Refreshed server platforms New server platforms www.scsita.org 30

SAS: New Enhancements Drive Performance Gains Power & Links/Lanes determine performance SAS concurrency favors enterprise workloads Mature eco-system: in place & multi-sourced Recent Dramatic Performance Improvements: No changes to SAS standard Gains from: Firmware, CPU power, Hardware assist, etc. Further Gains: Application hints, OS streamlining, Protocol Execution, Controller caching, etc MultiLink SAS: Added performance within a standard 15mm slot An integral part of 12Gb/sec SAS deployment Sustainable time-to-market advantage (depth & breath of infrastructure) Total solution spans broad application space Any SSD/Flash storage solution MUST co-exist with SAS

Additional Info Available at: T10 (SAS specifications development) http://www.t10.org SCSI Trade Association http://www.scsita.org Serial Storage Wire) http://www.serialstoragewire.net SATA I/O http://www.sata-io.org 32