SAS & SATA Combine to Change the Storage Market Harry Mason - Director Industry Marketing, LSI Logic Marty Czekalski - Interface & Emerging Architecture Program Manager, Seagate Technology
SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced without modification The SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. 2007 Storage Networking Industry Association. All Rights Reserved. 2
Abstract SAS & SATA Combine to Change the Storage Market Serial Attached SCSI (SAS) allows systems to be built that accommodates large numbers of either SAS and/or SATA hard disk drives. This presentation, intended for OEM, System Builders and End-Users, describes the capabilities of the SAS interface, how it s designed to interoperate with SATA drives and when combined, how these technologies can be combined to deliver some very compelling storage solutions. 2007 Storage Networking Industry Association. All Rights Reserved. 3
Where do the drives Go? (by Volume) Market Snapshot 2001 and still true today 70% of Enterprise Drives SCSI DAS & P-ATA (SATA-today) 30% of Enterprise Drives FC & SCSI (+SATA today) SAN Internal Storage FC & P-ATA (SATA-today) External Storage NAS 2007 Storage Networking Industry Association. All Rights Reserved. 4
Parallel vs Serial Parallel Data Transfers Example of Signal Skew Serial Data Transfers Serial Data In Clocked Data Clock Recovery Circuit Recovered Clock All bits are aligned at transmitting device Example of Cross Talk Skew causes misalignment at the receiver Electromagnetic Coupling Serial protocol: Eliminates Signal Skew Eliminates Cross-talk Simplifies Interconnect Allows Higher Data Rate Point to Point Source: Maxtor 2007 Storage Networking Industry Association. All Rights Reserved. 5
SAS: The Evolutionary Tale. Evolution: - Replaces Ultra320 - Preserves Legacy SCSI Software - Renews the SCSI Roadmap - Continues the Serial Trend 3G 6G CPU Interface Storage 2007 Storage Networking Industry Association. All Rights Reserved. 6
Ultra320 SCSI Replacement? Preserve Legacy SCSI Customer Choice Plug Compatible Multi-protocol Cost Equivalence w/scsi Preserves 20+ Years of SCSI Middleware Small Form Factor Every-unit-Item Economics Wide-Ports Reliability Dual-ported Point-to-Point 1000 s of Connections Future Architected Scalable Performance 2007 Storage Networking Industry Association. All Rights Reserved. 7
Serial Attached SCSI Advantages Four-wire Replacement for Parallel SCSI Software compatible drop in replacement Low voltage (1600 mv max) differential signaling (8b10b encoding) Star Topology (Point-to-Point) Each device gets full bandwidth Minimum arbitration overhead SAS Attributes Extend Capabilities beyond Parallel SCSI Dual-porting 16K devices (per domain) Native support for either SATA or SAS drives Wide ports and rate matching Source Maxtor 2007 Storage Networking Industry Association. All Rights Reserved. 8 -OR - Dual Port System Backplane Single Port SAS Connector
Connecting the I/O On SAS and SATA Connectors and Cables: Support 3Gbps Speed with Headroom for 6Gbps Suitable for Both 3½ and 2½ Storage Devices Blind-Mateable Hot-Pluggable (staggered pins) Vcc Enclosure Drive Staged Power Vcc ~3msec Data Rx Tx Key Voltage Pins 3.3V 5V R 12V Gnd Gnd 2007 Storage Networking Industry Association. All Rights Reserved. 9
SAS/SATA Connector Compatibility Connector Flip Side Port B SAS Keyway SATA SATA Pluggable SAS 2007 Storage Networking Industry Association. All Rights Reserved. 10
Drives to the Enterprise (~70% Internal & ~30% External) 100% 80% SCSI SAS SAS Delivered 60% 40% Fibre Channel 20% 0% Enterprise SATA Desktop SATA Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 2001 2002 2003 2004 2005 2006 2007 2008 SAS or FC Delivered Source Maxtor 2007 Storage Networking Industry Association. All Rights Reserved. 11
SAS s Unique Attributes Performance Density Compelling Solutions Scalability 2007 Storage Networking Industry Association. All Rights Reserved. 12
SAS: Bandwidth Aggregation Performance Each SAS Link (Rx and Tx) 3Gbps 6Gbps (full-duplex) Wide Ports Combine SAS links Rx Tx 2 ports 12Gbps (full duplex) 4 ports 24Gbps (full-duplex) 2 3 4 1 4 1 2 3 Wide-Port (x4) yields 24Gbps Full Duplex! Concurrency Brings Higher Performance Multiple concurrent I/O s (lots of drives operating concurrently) 2007 Storage Networking Industry Association. All Rights Reserved. 13
SAS/SATA Performance Performance Host Side Bus MB/s PCI - 66 MHz 520 PCI -100 MHz 790 PCI -133 MHz 900 PCIe - x4 800 PCIe x8 1600 SAS Bus MB/s Drives to saturate a x4 SAS Connection SAS 2.5 19 to 23 SAS 3.5 9 to 19 SATA 2.5 23 to 32 SATA 3.5 14 to 19 X1 280 X2 560 X4 1120 2007 Storage Networking Industry Association. All Rights Reserved. 14
Enterprise Form Factor Transition Density 30 25 SAS Leads the Form Factor Transition 62% Units in Millions 20 15 10 38% 5 0 Source: Maxtor 2002 2003 2004 2005 2006 2007 2008 2.5-inch Calendar Year Combined SCSI, FC & SAS 3.5-inch 2007 Storage Networking Industry Association. All Rights Reserved. 15
Industry Moves to Higher Performance Density SAS & Small Form Factor (SFF) SFF increases density Scale & expand in same space Ideal for Blade System Deployment SFF Drives Consume 50% less Power than 3.5 counterparts Save on volatile energy costs Growth without pulling in extra power drops Lower heat loads & air-conditioning costs at equivalent performance Caution Power per rack can still increase due to density increase Higher Performance and Potentially Lower Cost Multiple concurrent I/O s (lots of drives operating concurrently) Lower TCO through common infrastructure Additional Advantages RAID 5 or 6 on a 1U server Improved Hard Disk Drive reliability SAS & SATA Drives in Common Drive Carrier 2007 Storage Networking Industry Association. All Rights Reserved. 16
Connector Types Density InfiniBand Style SAS 4X Connector ipass tm Style Mini SAS 4X Connector ipass is a Molex Trademark 2007 Storage Networking Industry Association. All Rights Reserved. 17
SAS: Improving Density and Airflow Density Up to 160 SAS Links per 1u Rack! SATA/SAS Cable VS Parallel External & Internal SAS 1.1 Mini SAS (4x & 4i) Highly Scalable Architecture Connectivity and Bandwidth Dramatically Improves Connectivity, Density & Airflow 2007 Storage Networking Industry Association. All Rights Reserved. 18
Serial Attached SCSI s Scalable Topology Scalability Hosts (Initiators) Expanders Serial Attached SCSI or SATA disk drives (Targets) 2007 Storage Networking Industry Association. All Rights Reserved. Source Maxtor 19
Cascading SAS Enclosures Scalability End Device JBOD Enclosure JBOD Enclosure End Device Server Server HBA SAS Expanders SAS Expanders HBA IN OUT IN OUT / / / = Universal Connection (required at both end points) = IN Connects to universal or OUT port = OUT Connects to Universal or IN port Pick up a SAS Integrators Guide! 2007 Storage Networking Industry Association. All Rights Reserved. 20
SAS Switches Scalability Application Servers An application of a simple SAS Expander Solves the problem of routing multiple servers to multiple independent storage devices (JBOD or RAID systems) The SAS Switch allows sharing and pooling of the storage fewer larger storage arrays Back up and upgrades simplified by fewer storage arrays 2007 Storage Networking Industry Association. All Rights Reserved. 21
Scalable, Sharable DAS SAS Value Proposition & Positioning Scalability Performance Low Cost Distance Fibre Channel X X GbE iscsi X X 10 GbE iscsi X X SAS X X Significant market segment underserved by SAN alternatives Same room, modest scale (to few 10s of server & storage endpoints) Switch-less - external DAS, shared DAS Switched - embedded (server blade; RAID front-end) or 1U, scalable, sharable DAS 2007 Storage Networking Industry Association. All Rights Reserved. 22
Solution Breath: Extending DAS Solutions Scalability Towers Rack Servers Blades JBOD s, External Storage NAS Workstations 2007 Storage Networking Industry Association. All Rights Reserved. 23
Typical Rack Solution Solutions See a total of 16 drives Green is Zone 1 4 2 8-2.5 Drives 4 2 8-2.5 Drives See a total of 20 drives Red is Zone 2 SAS Switch 4 12-3.5 Drives 2007 Storage Networking Industry Association. All Rights Reserved. 24
Application Example Solutions Blade Chassis with Blade Servers / JBOD Cluster Blade Server-to-Blade Server connections may or may not be switched Enables multi-blade servers to connect to a single RAID controller Enables multi-blade servers to connect to multiple RAID controllers Enables multi-blade servers to multi JBOD 2007 Storage Networking Industry Association. All Rights Reserved. 25
Microsoft s Project REAL Overview Solutions Based on a real customer scenario: Major US Retailer 800 stores in the United States 40,000 employees Sales and Inventory Data Warehouse at 1.5 TB (current customer DW now 4 TB) DW query & processing is about 95% sequential data Existing Footprint Proto Footprint 2007 Storage Networking Industry Association. All Rights Reserved. 26
Reference Hardware Prototype Capability, Capacity, Cost & Consumption Solutions 24+ TB Storage (64 x 400GB Seagate SATA Drives) 4-Socket Dual-Core - AMD 32 GB Memory 6 LSI SAS Controllers 4 Vitesse Expanders $2.4/GB Non-discounted 15U Rack-Mounted ~3.7 KW vs. 35 KW + for Large SMP SAN setup Total Price: $46,000 2007 Storage Networking Industry Association. All Rights Reserved. 27
Prototype Database Server Brick: Large Table Index Build Test Solutions Test Rows BI Server Time hh:mm:ss SAN Server Time hh:mm:ss Fact table Index build 35M 00:12 00:17 Select Into Query 35M 00:54 01:53 Select Into Query 204M 04:04 14:53 UNIONS 11 Tables of 204M rows, totals & inserts the results into one large inventory table that is 100 GB in size. Large range query against 70 M sales facts 204M 01:24:11 02:35:02 70M 00:56 00:53 2007 Storage Networking Industry Association. All Rights Reserved. 28
Microsoft SATA/SAS White Paper Solutions SQLIO benchmark direct connect Rich Johnson of Microsoft Server Brick Six PCI-X SAS HBAs Sequential reads: 2.2 GBs/sec Sequential writes: 2.0 GBs/sec AMD Opteron 2.2GHz 4 PCI-X 133 SAS HBA 1 PCI-X 100 SAS HBA 1 PCI-X 66 SAS HBA 64 400 GB 7200 SATA drives SAS HBA PCI-X 133 SAS HBA PCI-X 133 SAS HBA PCI-X 133 SAS HBA PCI-X 133 SAS HBA PCI-X 100 16 SATA drives 16 SATA drives 8 SATA drives 8 SATA drives 8 SATA drives SAS HBA PCI-X 66 8 SATA drives 2007 Storage Networking Industry Association. All Rights Reserved. 29
SAS Switch IDF Functional & Performance Demo Solutions SQLIO benchmark switch connect LSI end-to-end SAS storage and Intel 64-bit system, Microsoft SQL Server 2005 - Sequential reads: 3.0 GB/sec - Sequential writes: 2.6 GB/sec SAS RAID SAS RAID 12 SAS drives 16 SAS drives SAS HBA SAS HBA 12 SAS drives 16 SAS drives 16 SAS drives 2007 Storage Networking Industry Association. All Rights Reserved. 30
Benchmark Update Solutions System Components Dual-Core processors PCI-Express 2 - SAS RAID Controllers 1 - SAS Switch 82 Drives (mixture of 2.5 & 3.5 & mixture of 10 & 15K RPM) 5 JBODs - Various Suppliers Size: 15U Rack Performance SQLIO Throughput Benchmarks 64KB sequential reads of 3.2 GB/s 64KB sequential writes of 2.7 GB/s 256KB random read of 2.0 GB/s 256KB random writes of 2.1 GB/s 2007 Storage Networking Industry Association. All Rights Reserved. 31
Database Server Bricks Solutions Major shift in performance, capacity & price models for SAS/SATA SAS maximizes limited PCI-X or PCI-E slots in small 4- way servers Result: Servers & terabytes of disk storage offering mainframe speeds at up to 1/10th the cost of large SMP and SAN solutions. Direct attach SAS storage is now a low cost and viable alternative to SAN s for many data center solutions. Random IO performance incredible using direct attach SAS disk & SAS controllers. New opportunities in data warehousing, streaming video, ecommerce, data mining and OLTP. Huge mid-market potential for customers who cannot afford multi-million dollar hardware setups. Rich Johnson Business Intelligence Architect 2007 Storage Networking Industry Association. All Rights Reserved. 32 Microsoft Consulting Services
Contact Info Harry Mason Director Industry Marketing, LSI Logic President, SCSI Trade Association Email: harry.mason@lsi.com Marty Czekalski Interface & Emerging Architecture Program Manager, Seagate V. President, SCSI Trade Association Email: marty.czekalski@seagate.com T10 (Serial Attached SCSI Spec development) http://www.t10.org SCSI Trade Association http://www.scsita.org Serial Storage Wire http://www.serialstoragewire.com SATA I/O http://www.sata-io.org 2007 Storage Networking Industry Association. All Rights Reserved. 33
Q&A / Feedback Please send any questions or comments on this presentation to SNIA: tracknetworking@snia.org Many thanks to the following individuals for their contributions to this tutorial. SNIA Education Committee SCSI Trade Association (STA) SATA I/O Working Group Rich Johnson Chris Lionetti Jay Neer Tom Hammond-Doel Marty Czekalski David So Howie Goldstein Calvin Chen Bruce Grieshaber Nancy Clay 2007 Storage Networking Industry Association. All Rights Reserved. 34