IBM Spectrum NAS Overview

Transcription

1 Accelerate with IBM Storage: IBM Spectrum NAS Overview Apr 12, 2018 Ash Mate Chris Vollmar Norman Bogard John Sing Copyright IBM Corporation 2018.

2 Washington Systems Center - Storage Accelerate with IBM Storage Webinars The Free IBM Storage Technical Webinar Series Continues in Washington Systems Center Storage experts cover a variety of technical topics. Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome. To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an request to accelerate-join@hursley.ibm.com. Located in the Accelerate with IBM Storage Blog: Also, check out the WSC YouTube Channel here: Webinars: January 9 DS8880 Easy Tier January 17 Start 2018 Fast! What's New for Spectrum Scale V5 and ESS February 8 - VersaStack - Solutions For Fast Deployments February 16 - TS7700 R4.1 Phase 2 GUI with Live Demo February 22 - DS8880 Transparent Cloud Tiering Live Demo March 7 - Spectrum Storage Management, Control, Insights, Foundation; what s the difference? March 15 - IBM FlashSystem A9000/R and SVC Configuration Best Practices March 27 - IBM FlashSystem A9000/R Technical Update April 12 - Introducing Spectrum NAS - The Newest Member in the Spectrum Storage Family April 26 - TS7700 Grid Configuration Changes -- Joins, Merges and Removals Register Here: May 8 - DS8880 Technical Update Register Here: Questions about this webinar? Interested in follow-up? Send to: Dennis Robertson Dennis.Robertson@ibm.com IBM Washington Systems Center Copyright IBM Corporation 2018 Accelerate with IBM Storage.

3 Agenda Topic Speaker Spectrum NAS Product Announcement Spectrum NAS Architecture Overview Spectrum NAS Features & Functions Spectrum NAS Functions demo Additional Resources Conclusion & Next Steps John Sing Ash Mate Christopher Vollmar Norman Bogard Ash Mate John Sing End 3

4 IBM Spectrum NAS Product Announcement John Sing

5 Introducing IBM Spectrum NAS NEW! Addition to the Spectrum Software Defined Storage Portfolio Designed for modernizing your general purpose NAS workloads toward software defined storage Simple, easy to deploy and manage Native support of the latest specifications for NFS and SMB Software only offering - runs on storage rich commodity servers (x86)

6 IBM Spectrum NAS IBM Spectrum NAS is a software-defined storage solution that offers agility and management simplicity for networkattached storage (NAS) workloads It helps reduce capital expenditure by working with industrystandard x86 servers to form high-performance, scale-out storage clusters It includes: Protocol support (NFS, SMB) Scale-out file system Embedded operating system Intuitive Management GUI Spectrum NAS GA: March 20,

7 Driven by Data: Modernize and Transform Traditional NAS General Purpose File Software Defined NAS MODERNIZE Optimize and drive efficiencies, while continuing to deliver high levels of service delivery TRANSFORM Deliver and operate new scale out NAS infrastructure to support new Cognitive and agile workloads SAVE HERE INVEST HERE

8 IBM Spectrum NAS Scalable software-defined file storage for enterprise IT The NAS segment is 20+ years old, and enterprises depend on standard file protocols However, enterprises are looking to lower the cost of storing file data in order to invest in new workloads Easy to manage software-defined file storage for the enterprise 1. Simple to deploy and administer Deploy on bare-metal servers or VMs in 30 mins Robust and Self balancing 2. Lower cost Run on Commodity x86 servers Tailor for efficiency, performance, and protection 3. Scale-out file storage that grows with you Linear scale of performance and capacity Upgrade without downtime 4. Enterprise NAS features you need Native NFS and SMB protocols Rich NAS functions

9 IBM File and Object offerings based on Workloads and Key Requirements The right offering for the right workloads IBM Offering Spectrum Scale & ESS Spectrum NAS Cloud Object Storage Workloads Traditional HPC Big Data analytics, Technical computing, ML/DL High speed backup & restore File serving for Virtual Machines Home Directories/ General purpose file serving NAS for Microsoft Apps Archive, Content Repository & distribution Native Object Applications Key req ments High Performance; supports billions of files Simple and Native File Protocols (no open source code) Multi-site and Native Object Storage

10 Easy to Use and Manage Unconfigured servers + Spectrum NAS software Name the servers Connect to a network Management Tool Management Tool Management Tool Run server wizards Run cluster wizard Setup is complete

11 Architecture Overview Ash Mate

12 Spectrum NAS IS/IS NOT Spectrum NAS IS... NAS (NFS & SMB File Protocols) SW only Scale-out Based on storage rich servers SDS-NAS On-Premise Native NFS/SMB Symmetric architecture IS NOT Unified File, Object, Block Appliance A pair of HA controllers Based on external storage Traditional NAS Cloud Open Source (Samba/Ganesha) Asymmetric architecture

13 Spectrum NAS vs. Traditional NAS Spectrum NAS Software Defined Commodity Hardware Software-defined storage cost effectiveness Rolling, in-service upgrades Flexible, agile, on-demand scale out Easier to deploy, configure, manage, upgrade, and scale Scale out in discreet increments Low cost commodity enterprise servers, exploit fast moving technology upgrades Traditional NAS Customized Hardware Appliance Traditional cost levels Fork-lift upgrades Rigid, controller-based, hardware specific models Traditional methods for configure, manage & upgrade Add a whole array at a time, to expand Hardware vendor lock-in 13

14 Robust File System Feature set Synchronous & Asynchronous Replication for DR

15 Strong Support for Standard SMB and NFS Significant compatibility with primary file protocol specifications Support for NFSv3, NFSv4.0, NFSv4.1 and pnfs SMB is critical for Microsoft application environments Many software defined NAS and file gateways use Samba for SMB Open source SMB is lacking full coverage of SMB standard (46%)

16 Spectrum NAS is architected from ground up for cloud-scale Linear Scale-Out Tightly Integrated single software stack Node 1 Node 2 Node 3 Node n Scale Out NFS and SMB Scale Out Non-Volatile Cache Scale Out File System Scale Out Data Store True Scale-Out Symmetric Architecture: Every node has identical role No hot spots or bottlenecks Files served from cache on any node No JBODs or any external storage Min 4 nodes to form cluster Data store runs erasure coding & responsible for load balancing Self healing cluster survives node failures Scalable to 100 s of nodes 10, 40 or 100GbE private network Each node is an industry standard storage rich server with CPU, RAM, NIC, HDD/SSD, NVMeSSD Cache and SAS HBA

17 Native protocols, easy to use, self-healing and linear scaling

18 Deployment Model 4 servers to start; simply add node(s) to scale capacity and performance 4 nodes for protection against 2 drive failures, 5 nodes for protection against 2 complete node failures Add new tier with new hardware up to 5 tiers Start each tier with 4 nodes Every node has identical role; no bottleneck or hotspots Self healing cluster survives node or drive failures Non-disruptive upgrades & capacity expansion 18

19 Providing the Full Software Stack NO OPEN SOURCE NO 3PP SOFTWARE

20 Protocols All protocols implemented in C/C++ Protocols tightly integrated with the virtual file system layer Own implementation of RPC server for higher efficiency High focus on minimizing memory allocations

21 Scale-out Storage

22 Spectrum NAS Write Operation Cache Sync Support for cache mirroring Cache partners are selected at file level Supports write cache for a file on single server Supports read cache for a file on multiple servers Destage after a configurable time 22

23 File Encoding Slice x 128 KB + chk sum File1 Size 2 GB 128 KB + chk sum 128 KB + chk sum 128 KB + chk sum 128 KB + chk sum Obj 1A Size 1 GB Obj 1B Size 1 GB Slice 1A1 Slice 1B1 Slice 1A2 Slice 1B2 Slice 1A3 Slice 1B3 Size 500 MB Size 500 MB Size 500 MB Size 500 MB Size 500 MB Size 500 MB File encoding: 2+1 Extent (object) size: 1 GB

24 How is data distributed within cluster No 1-to-1 mapping of nodes Data placed based on: Free space in node Geographical position Current work load Tier policies Random

25 Virtual IP

26 What does IBM recommend? Tested Configurations Configuration 1: 8 nodes 2x Intel(R) Xeon(R) 6 core CPU 2.40GHz, 96 GB RAM (6x16GB DIMMs) 1x800 NVMeGB SATA SSD for cache 10x1TB SAS/SATA HDD for data 1x 10Gb port for mgmt, 1x 10Gb port for private, 1x 10Gb port for public Configuration 3: 8 nodes 2x Intel(R) Xeon(R) 6 core CPU 2.40GHz, 96 GB RAM (6x16GB DIMMs) 1x800 NVMeGB SATA SSD for cache 10x2TB SAS/SATA HDD for data 1x 10Gb port for mgmt, 1x 10Gb port for private, 1x 10Gb port for public Configuration 2: 5 nodes 2x Intel(R) Xeon(R) 6 core CPU 2.40GHz, 96 GB RAM (6x16GB DIMMs) 1x800 NVMeGB SATA SSD for cache 10x1TB SAS/SATA HDD for data 1x 10Gb port for mgmt, 1x 10Gb port for private, 1x 1Gb port for public Configuration 4: 8 nodes 2x Intel(R) Xeon(R) 4 core CPU 2.40GHz, 64 GB RAM (8x8GB DIMMs) 1x800 NVMeGB SATA SSD for cache 10x2TB SAS/SATA HDD for data 1x 10Gb port for mgmt, 1x 10Gb port for private, 1x 1Gb port for public

27 Recommended Node Configurations CPU Capacity Optimized 1x Intel Xeon E5-2620v4 8cores Performance Optimized 2x Intel Xeon E5-2620v4 8cores All Flash 2x Intel Xeon E5-2620v4 8cores RAM 64GB RAM DDR4; 128GB RAM DDR4; 128GB RAM DDR4; Storage 12x3.5 (6TB or 10TB) 24x2.5 SAS 10K 24 x Intel 1200GB SATA SSD Cache(R/W) HBA 1xIntel P3700/P GB NVMe 2x Intel P3700/P GB NVMe Broadcom SAS 3008 IT-mode (HBA) 3 x Intel P4800X 375GB NVMe NIC Intel X520 2x10GbE NIC SFP+ Intel X520 2x10GbE NIC SFP+ 2 x MellanoxConnectX-4 25/100GbE All Configurations require 2 switches: 1 for client connections, 1 for intra-cluster communication Spectrum NAS can run on any x86 storage rich server but the Items in purple must be the same family model/vendor as listed above (See following page)

28 Hardware Compatibility for Spectrum NAS NVMe 1. Prefer two smaller cards over one big card 2. Enterprise" grade NMVe (not "desktop" grade) 3. Endurance (DWPD) - 5 or above (close to 10 preferred) (Good experience w/ Intel Optane) HBA 1. As long as it is based on LSI based 2. All disk drives are classified as 6 Gb or better NIC 1. Any Mellanox card is fine Gb or better 3. Support IGMP multicast (There have been reported performance issues with Intel 710 Gigabit Ethernet cards) 28

29 IBM Spectrum NAS Features Christopher Vollmar

30 Management Tools GUI Out of band Windows installable Services available Real-time performance Configuration Health Logging Alerts REST API Supports administration of file shares, users, groups, ACLs, policies and manual snapshots Any node in the cluster is capable of responding to API requests 30

31 File Share Properties Properties NFS SMB Capacity Encryption Status Ability to update Properties on the fly

32 Folder Properties Core Folder Characteristics are retained under Properties SnapShots Folder Coding Capacity Number of Files Tier

33 File Policies File policy is an optional feature to automatically apply actions to selected files in a folder Policy filters include File type, age Policies apply to: Erasure encoding level, media tier, data encryption, retention and WORM New files created will inherit established policies Previously created files will have policies applied by a background, low priority task

34 File Policies and Erasure Coding Data Durability in 2 Dimensions Leverage File Coding to create policies in the same folder and apply at the File Folder level File Policy Level Create a file share with a File Coding based on initial Data Durability requirements eg 3 Copies Add a policy based on Data Durability of file types placed in the file share

35 Tiering Ability to have different performance tiers in same cluster Nodes with similar media capabilities are grouped into the same tier Five tiers available File policies are defined for files at the Folder level Tiers based on attributes filename and age

36 Snapshots Ability to create snapshots at the file level, within a folder Automatically scheduled snapshots Can be configured so that one is made hourly, daily, weekly or manually Up to 253 snapshots for each folder Target snapshots are copies that have read-only access Leverage copy-on-write capability After a file share has been configured, it can be accessed from Windows or Linux using SMB and NFS

37 Quota Management Capacity limit that restricts the use of storage Space set at the file system, folder or sub-folder Limit is specified in number of GB, TB or PB and will then apply for all users with access to the folder

38 Encryption Data at rest encryption AES 256 bit XTS File system, folder, file level One key for each file system Internal key management

39 Retention Retention period can be set To retain files for a specific time period based on either; Accessed time frame Modified time frame Can be used to remove file types or patterns to enable file screening eg Remove file types 1 day after being saved

40 Spectrum NAS WORM Files can be set read-only Users cannot edit or delete WORM protected files Administrator can delete WORM protected data

41 Replication Metro Cluster Metro Cluster (Synchronous Replication ) High-availability cluster for mission-critical data and applications Writes written synchronously to two clusters Established while Adding Nodes to Cluster Both sides should be same size Promoting a site to primary can be done from the GUI.

42 Replication Hybrid Cloud Hybrid Cloud (Asynchronous Replication) Snapshot based Continually replicate differential snapshots Provides a unified view of the file system between the local network and the second cluster Permits a common view of the file system that spans both clusters IBM Cloud available as a target site Leverage IBM Cloud Bare Metal servers** as an alternate to customer premise or MSP

43 Spectrum NAS - Multitenancy Allows multiple, separate domains and file systems spanning over one single storage cluster Each domain and file system are separated, using their own IP addresses for access, authentication mechanisms and set of protocols Provides CPU, infrastructure and storage capacity to be utilized for all the domains combined

44 IBM Spectrum NAS Demonstration Norman Bogard

45 Spectrum NAS Demonstration 1. Simplicity of deployment and administration Node installation ( File System Creation & NFS, SMB shares ( 2. Enterprise NAS Features File Policies Quota, Snapshots, Erasure Coding, Tiering 3. Scale out file storage that grows with you Node addition Rolling Upgrades 45

46 Spectrum NAS Features through the GUI GUI Out of band Windows installable Services available Real-time performance Configuration Health Logging Alerts REST API Supports administration of file shares, users, groups, ACLs, policies and manual snapshots Any node in the cluster is capable of responding to API requests

47 Spectrum NAS Node Installation Install Spectrum NAS software on Linux node Install NAS management on Windows machine, import license Discover un-configured nodes over management network Configure nodes into a cluster using NAS management software 47

48 Spectrum NAS File System Creation Wizard for file system creation Configure hostname & public IP Configure SMB & NFS protocols 48

49 Spectrum NAS Node Addition Select un-configured nodes to add into a cluster Wizard will walk user through the configuration for node addition 49

50 Spectrum NAS Rolling Upgrades Spectrum NAS supports rolling upgrades of software on the nodes in the cluster without downtime The update is performed in sequence, one node at a time to maintain resiliency level 50

51 File and Object Solutions Design Studio Tool Ash Mate

52 File and Object Solutions Design Studio Interactive tool for you and your IBM and Business Partner for sizing Unified questions to help determine what IBM solution fits best One common tool for IBM Spectrum NAS, Spectrum Scale/Elastic Storage Server, and IBM Cloud Object Storage IBM Design Thinking approach to working with you, our clients Available now for IBMers, available end of April with IBM Business Partners Link:

53 FOS Design Studio Workflow 53

54 FOS Design Studio Workflow Dashboard: Answer a few questions, responses used by the tool to automatically select product and solution template Template: View all details pre-populated, answer more questions about requirements, contacts, sites. Select options in order to complete template Design: Solution design is shown based on the inputs, including cautions and items need to be addressed Report: Generate a report summarizing requirements, solution design, any considerations, warnings or errors 54

55 Additional Resources Spectrum NAS Demo videos on YouTube: Data sheet: Product Documentation: me.html Analyst white paper:

56 Conclusion: Next Steps John Sing

57 Next Steps Questions about this webinar? Interested in follow-up? Send to: Get more information on Spectrum NAS IBM Spectrum NAS YouTube: IBM Spectrum NAS Knowledge Center: Dennis Robertson IBM Washington Systems Center Contact your IBM Account Exec / Business Partner for more information and to arrange a demonstration IBM Client Demo Center: Sign up for a free 60-day Spectrum NAS software trial Sign up for future IBM Washington Systems Center webinars: Accelerate with IBM Storage blog on IBM Developerworks: 57

58 Special Thanks Christopher Maestas, Global Solution Architect, Software Defined and Flash Solutions Ash Mate, Sr. Solutions Architect, Spectrum Storage Norman Bogard, Sr. IT Specialist, Spectrum Storage Christopher Vollmar, Storage Client Technical Architect - IBM Certified Consulting Franck Malterre, Certified Specialist, Software Defined Infrastructure Dennis Robertson, Accelerate with IBM Storage Lead

59 ibm.com/storage Thank You.