Refining and redefining HPC storage

Transcription

1 Refining and redefining HPC storage

2 High-Performance Computing Demands a New Approach to HPC Storage Stick with the storage status quo and your story has only one ending more and more dollars funneling to storage and fewer and fewer left for the compute, staff and applications to solve actual problems. Research shows that storage is consuming more of overall HPC budgets. Driven by ever-increasing performance and capacity requirements, storage will account for 21 percent of HPC spend by 2021 up from just 10 percent in And the climb doesn t show any signs of stopping. Combine budget pressures with growing performance needs and it s clear legacy technologies that worked yesterday won t meet today s or tomorrow s demands. Cray ClusterStor HPC storage systems address every challenge. Purpose-engineered ClusterStor solutions balance the value equation with the right performance levels, speed, scalability, data protection and availability to fit your requirements and budget. They reduce complexity with seamless system design, easy installation, workload management and data flow. It all adds up to the industry s highest-performing and most efficient data storage platform at the lowest overall TCO. With Cray ClusterStor storage systems you get: More performance, better ROI. Enterprise-level performance with more capacity, fewer drives, less need for IT support and more data access with low overall TCO. ClusterStor technology supports the industry s fastest HPC-sustained throughput at 1.7 TB/s with data storage capacity over 80 PB while requiring fewer drives. Other vendors deliver about half the performance throughput per drive compared to ClusterStor storage. Time and money saved. The ClusterStor system is architected for efficiency: the design minimizes the amount of hardware required and then provides efficient flow among the components it does need. Starting from this foundation, Cray then builds each sytem to your specific requirements. You don t pay in lost time or money for technology and tools you don t need. Business-boosting insights. When you can make discoveries faster it gives you a competitive advantage. ClusterStor technology speeds your time to insight by eliminating maintenance issues, performance gaps, lost data, and I/O issues from mixed workloads. And you won t be slowed by scaling issues. ClusterStor systems are infinitely scalable, scaling up to 100 PB with no loss of efficiency or performance. Who s Using ClusterStor Storage? 8 of the top 20 supercomputers twice as many as the next vendor 6 out of 7 global oil and gas supermajors 8 out of the world s top 9 weather centers Over 80 universities, national labs, and multinational companies worldwide

3 The ClusterStor Difference: Performance, Manageability and Support With Cray ClusterStor HPC storage you get increased productivity and lower TCO not just from the system s 1 TB/s file system performance and minimal datacenter space, power and cooling needs but from built-in reliability and ease of management as well as Cray s expert service and support. ClusterStor systems use a holistic and vigorous integration and test validation process. Storage enclosures feature cluster in a box integration of dual high-availability object storage, metadata and management servers that are monitored and managed by the ClusterStor Manager software stack. The component-level approach creates modular building blocks for granular performance and capacity scalability while containing and managing system availability. And the design eliminates single points of failure, optimizes system availability and productivity, and reduces time to deployment. Cray provides the highest system-level integration and device-level reliability by running rigorous component, system and manufacturing test cycles. It ensures you get the best performance and out-of-the-box to production results. For added assurance, ClusterStor solutions come with a wide range of Cray-provided service and support options. ClusterStor Advantages High-performance storage for productivity-critical commercial, government, academic and technical computing data capture and analytic applications Proven success with over 1 TB/s file system performance in a single global namespace in commercial and technical computing Robust, enterprise-ready features and management tools already proven in many commercial application environments Cray disk drives, disk enclosures, object storage, metadata and Craymanagement disk drives, disk enclosures, storage, metadata and servers, solutionobject integration, system management validation testservers, and fieldsolution supportintegration, system validation test and field support Single management system that allows you to control the complete Single management system that allows you to control the hardware and software solution complete hardware and software solution Cray expertise as the only vendor to build and support an end Cray expertise vendor build community and support an endto-end solutionas forthe theonly Lustre file to system to-end solution for the Lustre file system community Two Storage Solutions, Zero Challenges Cray ClusterStor L300 All-HDD Lustre Storage System This engineered rack-scale Lustre HPC storage system achieves performance requirements with the lowest number of HDDs, enclosures and racks etc. by getting the maximum amount of performance from each storage device. Ideal for applications with large, sequential I/O workloads. ClusterStor L300N Hybrid (SSD/HDD) Storage System This flash-accelerated solution features the innovative Cray ClusterStor NXD flash accelerator software which enables it to solve the mixed I/O challenge cost effictively while shielding the application, the file system and users from complexity.

4 Cray ClusterStor L300 Storage System The Cray ClusterStor L300 storage system is an all-hdd Lustre solution. It achieves performance requirements with the lowest number of HDDs, enclosures and racks by maximizing the performance of each storage device. The use of all HDDs makes it well suited for environments using a few applications with large, sequential I/O workloads. This complete engineered rack-scale solution delivers the best performance density solution available. It provides accessible data and actionable insights, seamlessly meeting your data storage and movement needs. No single points of failure for high system-level productivity Declustered ClusterStor GridRAID for faster disk rebuild Built-in investment protection easily add performance and capacity to an existing system Preconfigured and tested for faster time to production Lustre DNE support of up to 18 metadata servers per file system for scalable metadata performance High productivity manageability integration, monitoring and reporting of key hardware and software elements Cray ClusterStor L300N Storage System The Cray ClusterStor L300N storage system is a hybrid SSD/HDD solution with flash-accelerated NXD software that solves the problem of unpredictable application performance caused by mixed I/O patterns. It redirects I/O to the appropriate storage medium while shielding the application, file system and users from complexity through transparent flash acceleration. Cray ClusterStor NXD Flash Accelerator gives you: High-availability data protection without using a non-filelocking secondary file systems or proprietary compute client software Efficient bandwidth performance acceleration through direction of large data blocks to the ClusterStor GridRAID disk pool Efficient performance by monitoring and directing I/O workloads to flash or disk storage pools Capacity for 100 percent write performance acceleration provided by flash pool data Cost-effective IOPS performance by only processing data that benefits such as small block sizes Architected, integrated and tested just like the ClusterStor L300 storage system and with an expert balance of SSD and HDD storage, the L300N solution delivers the best mixed I/O workload performance at the best value. Cray View for ClusterStor Makes Your Storage Experience Even Easier Cray View for ClusterStor is the industry s first complete Lustre storage performance analysis application. With always-on metrics you can maximize your resources, optimize system throughput, and provide users with the best results without impacting performance. All the information you need is right there at your fingertips, in a single view: Job Runtime Variability: Real-time and historical views of data to help you understand what s impacting user jobs Event Correlation: A unified system view so you can correlate events that impact performance Trend Analysis: Data-driven visualization and analysis of historical data helps for identifying trends and shaping changes to the system Alerting: Threshold engine enables customized alerts on any metric

5 Cray ClusterStor L300 Specifications File System Capacity (Raw) Scalable Storage Unit (SSU) Object Storage Servers Meta Data Management Unit (MMU) System Management Unit (SMU) Client Network Access Management Network File System Maximum Nodes SSU Drive Configuration Expansion Storage Unit Configuration Up to 4,920 TB per base rack using 10 TB SAS HDDs; up to 5,740 TB per expansion rack using 10 TB SAS HDDs Up to 6 in base rack (first); up to 7 in storage base racks (second and greater) Up to 12 in base rack (first); up to 14 in storage expansion racks (second and greater) Base configuration: high-availability server pair; 2U24 drive enclosure Expansion option: up to 8 2U24 MMUs configured with the Lustre 2.5 Distributed Namespace functionality High-availability server pair; 2U24 drive enclosure InfiniBand EDR, FDR, QDR; Ethernet 40/100, Intel Omni-Path 1 Gigabit Ethernet (dual management network with high-availability failover) Lustre supported enhancements Lustre 2.7 up to 16 billion (requires optional distributed namespace servers) 2 SSDs, RAID 1, 1+1, 82 HDDs, K RPM with ClusterStor GridRAID 82 HDDs, K RPM with ClusterStor GridRAID MMU Configuration 22 HDDs, K RPM, 5+5 SMU Configuration 7 HDDs, K RPM, 1+1 & 2+2, 1 spare, 5 HDDs, K RPM, 1+1 x2, 1 spare Cray ClusterStor L300N Specifications File System Capacity (Raw) Scalable Storage Unit (SSU) Object Storage Servers Meta Data Management Unit (MMU) System Management Unit (SMU Client Network Access Management Network File System Maximum Nodes Up to 4,920 TB per base rack using 10 TB SAS HDDs; up to 5,740 TB per expansion rack using 10 TB SAS HDDs Up to 6 in base rack (first); up to 7 in storage expansion racks (second and greater) Up to 12 in base rack (first); up to 14 in storage expansion racks (second and greater) Base configuration: high-availability server pair; 2U24 drive enclosure Expansion option: up to 8 2U24 MMUs configured with the Lustre 2.5 Distributed Namespace functionality High-availability server pair; 2U24 drive enclosure InfiniBand EDR, FDR, QDR; Ethernet 40/100, Intel Omni-Path 1 Gigabit Ethernet (dual management network with high-availability failover) Lustre supported enhancements Lustre 2.7 up to 16 billion (requires optional distributed namespace servers) SSU Drive Configuration 2 SSDs, 3.2 TB, 10 DWPD, RAID 1, HDDs, K RPM or 82 HDDs K RPM with ClusterStor GridRAID Expansion Storage Unit Configuration 82 HDDs, K RPM or 82 HDDs, K RPM with ClusterStor GridRAID MMU Configuration 22 HDDs, K RPM, 5+5 SMU Configuration 7 HDDs, K RPM, 1+1 & 2+2, 1 spare, 5 HDDs, K RPM, 1+1 x2, 1 spare Disk enclosures 80 PLUS Gold Certified power efficiency with adaptive cooling, or option for 90 PLUS Platinum Certified power efficiency with adaptive cooling technoology. Cray is registered through BSI to the international standard for environmental management systems ISO 14001:2004 and holds certificates for each of its three manufacturing location at Havant UK, Guadalajara Mexico and Seremban Malaysia. (1) Product availability and specificiations subject to change. Consult your authorized ClusterStor reseller partner or ClusterStor sales representative for details. (2) Rack configuration attributes above provide a representative example.

6 Cray Inc. 901 Fifth Avenue, Suite 1000 Seattle, WA Tel: Fax: Cray Inc. All rights reserved. Specifications are subject to change without notice. Cray and the Cray logo are registered trademarks of Cray Inc. ClusterStor is a trademark of Cray Inc. All other trademarks mentioned herein are the properties of their respective owners KL