Webinar Series: Triangulate your Storage Architecture with SvSAN Caching. Luke Pruen Technical Services Director

Transcription

1 Webinar Series: Triangulate your Storage Architecture with SvSAN Caching Luke Pruen Technical Services Director

2 What can you expect from this webinar? To answer a simple question How can I create the perfect balanced storage architecture to meet my capacity, footprint and performance needs, now and in the future?

3 Introducing StorMagic What do we do? StorMagic SvSAN eliminates the need for physical SANs by exposing the storage of an industry standard server as a virtual SAN thereby dramatically reducing CAPEX and OPEX. How does SvSAN achieve this? StorMagic s virtual SAN converts the internal disk, flash and memory of industry standard servers into robust, cost effective and flexible shared-storage. Where is this most applicable? SvSAN is deployed for hyperconverged infrastructure for multi-site enterprises and SMEs and server-based storage arrays as an alternative to a traditional physical SAN.

4 Introducing StorMagic Global Customer Adoption Across Many Verticals 1 to Thousands of Sites Global Partner Network Within 72 countries, organisations depend on StorMagic for sever and storage infrastructure Retail, health, government, industrial, education, finance, pharma and many more Large and small deployments from enterprises with 1000s of sites to SMEs with a single site Wherever you are, StorMagic has resellers, integrators, and server partners to meet your needs

5 What is a Storage Array? Wikipedia Definition: A disk array is a hardware element that contains a large group of hard disk drives (HDDs). It may contain several disk drive trays and has an architecture which improves speed and increases data protection. The system is run via a storage controller, which coordinates activity within the unit.

6 Storage Array Components SAN Presentation iscsi Fibre Channel SAN Switch Fibre channel Ethernet (iscsi) Physical Storage Controller CPU Memory Dedicated Storage Hardware Enterprise Drives 10K or 15K SAS SSD Storage Controller SSD

7 Utilise industry standard server as a Virtual SAN Virtual Storage Appliance Storage Controller Hypervisor SSD SSD

8 StorMagic SvSAN: Overview SvSAN turns the internal disk, SSD and memory of industry standard servers into highly available shared storage

9 Use Cases: Hyperconverged or Server-Based Storage Array Hyperconverged (HCI) Shared storage and compute platform Custom-build and avoid appliance over-provisioning Perfect for remote, branch and private cloud services Server-Based Storage Array (Server SAN) Custom-build active/active mirrored shared storage Fraction of the cost of off-the-shelf SAN Flexibility to scale capacity and performance as needed

10 Triangulate your storage requirements: 3 Axis 10

11 Triangulate your requirements: Capacity Object: Capacity Capacity - High priority Footprint - Low priority Performance - Low priority Solution: High capacity drives SATA 7.2k rpm IOPS SAS 10k.15k rpm IOPS Low cost per GB Compromise: Performance & Footprint Require more drives to achieve performance (spindles) Larger server footprint Lower cost per GB, higher cost per IOPS 11

12 Triangulate your requirements: Footprint Object: Footprint Capacity - Low priority Footprint - High priority Performance - Low priority Solution: Smaller servers Use smaller U servers 2.5 drives Compromise: Capacity & Performance Limits the number of drive Limits performance when using spinning disks 12

13 Triangulate your requirements: Performance Object: Performance Capacity - Low priority Footprint - Low priority Performance - High priority Solution: SSD/Flash SSD/Flash 8.6k to 10 millions IOPs High cost per GB compared to magnetic Add more servers to cluster Compromise: Capacity & Resource High cost per GB Lower capacity servers???? Deduplication available but heavy on server resource 13

14 Triangulate your requirements: How to balance all 3? Priority: All high Capacity - Medium/High priority Footprint - Medium/High priority Performance Medium/High priority Priority: Two high Capacity - Low priority Footprint - High priority Performance - High priority Priority: Mixed Capacity - Medium/Low priority Footprint - High priority Performance - Medium priority 14

15 Triangulate your requirements: No compromise Object: Capacity Capacity - High priority Footprint - High priority Performance - High priority Solution: Caching Leverage high capacity SAS or SATA drive for capacity Leverage SSD/Flash & memory for performance SAS 10k.15k rpm IOPS Compromise: None 15

16 Caching: The importance of caching Virtualized environments suffer from the I/O blender effect Multiple Virtual Machines sharing a set of disks Resulting in predominantly random I/O Magnetic drives provide poor random performance SSD & Flash storage ideal for workloads but expensive Working sets of data Driven by workloads which are ever changing Refers to the amount of data most frequently accessed Always related to a time period Working sets sizes evolve as workloads change Caching Combat the I/O blender effect without the expense of all Flash or SSD Working sets of data can be identified and elevated to cache 16

17 Optimising Storage: Write Caching Stage 1 All new data written to SSD Provides low latency and high IOPs Data is marked as dirty as is has not be committed to the backing store Stage 2 The write operation is acknowledged immediately to the server/application Stage 3 The dirty data is reordered and grouped based on disk locality The data is destaged and written out the backing store sequentially as possible Stage 4 Cache is notified when data has successfully been written to backing store The data in cache is marked as clean and remains in cache until the space is required

18 Caching: Predictive read caching Intelligent read caching algorithm All read I/Os are monitored and analyzed Most frequently used data Hot data Cache tiers are populated based on access frequency Tiering RAM: Most frequently accessed data SSD/Flash: Next most frequently accessed data HDD: Infrequently accessed data Cold data Tracker Module Identifies transient data to prevent cache pollution Promotes and demotes data through tiers Intelligently adjusts tracker window to workload Sizing Assign cache sizes to meet requirements Grow caches as working sets change Use any combination of Memory, SSD/Flash and Disk

19 Caching: Read Ahead & Pinning Read-ahead mode I/O blender effect aware! Identifies sequential interleaved I/O requests Detects sequential read streams to allow read ahead Pre-fetches data into memory Data pinning mode Pin specific data/workloads in memory Delivers most efficient read performance Databases, VDI, frequently repeated operations Manage multiple pin groups 19

20 Caching: Example Platform Numbers Hardware Cisco USC C220 M3 1 x Intel Xeon CPU E GHz 22 Cores 44 Threads 128GB RAM per host 1xSSD 3 x 1.2TB 10k SAS RAID 5 Networking 2 x 1Gb NICs VM Network 2 x 10Gb direct connect, SvSAN iscsi/mirror Storage 1 x RAID5 = 3 x 1.2TB 10K SAS disks 1 x 200GB Samsung SSD 1xSSD 3x1.2TB 10k SAS RAID 5 20

21 Caching: Customer Workload Workload 12 Virtual Machines 78 applications Back up service 25,000,000 20,000,000 Block Size Distribution Read Write Read/Write % 77% 23% Hit Count 15,000,000 10,000,000 5,000,000 Writes Read Sequential % 49% 39% Average Per Day 991 GB 294 GB Average Block Size 58 KB 54 KB Average IOPS KB 2 KB 4 KB 8 KB 16 KB 32 KB 64 KB 128 KB Block Size 256 KB 512 KB 1 MB 2 MB 4 MB Throughput IOPs Locality of access IOPs Read Write Number of accesses (logarithmic scale) Thousands Read Write :39 21:25 00:11 02:57 05:43 08:29 11:15 14:01 16:47 19:33 22:19 01:05 03:51 06:37 09:23 12:09 14:55 17:41 20:27 23:13 01:59 04:45 07:31 10:17 13:03 15:49 18:35 Time of Day (UTC) 21 MB 110 GB 221 GB 332 GB 443 GB 554 GB 665 GB 776 GB 887 GB 998 GB 1.1 TB 1.2 TB 1.3 TB 1.4 TB 1.5 TB 1.6 TB 1.7 TB 1.8 TB 2.0 TB 2.1 TB 2.2 TB 2.3 TB 2.4 TB 2.5 TB 2.6 TB

22 Caching: Customer Workload Results HDD Only 1 x RAID5 = 3 x 1.2TB 10K SAS disks Total IOPS HDD & Memory 12GB of memory per host for caching 1 x RAID5 = 3 x 1.2TB 10K SAS disks HDD Only HDD & Memory HDD & SSD 1 x 200GB Samsung SSD 1 x RAID5 = 3 x 1.2TB 10K SAS disks HDD, SSD & Memory 12GB of memory per host for caching 1 x 200GB Samsung SSD 1 x RAID5 = 3 x 1.2TB 10K SAS disks HDD & SSD HDD, SSD & Memory HDD Only HDD & Memory AVG Latency (ms) HDD Only HDD & Memory HDD & SSD HDD, SSD & Memory HDD & SSD 9.37 Total IOPS AVG Latency (ms) HDD, SSD & Memory 5.21

23 Caching: Synthetic Hero Numbers HDD Config 1 x RAID5 = 3 x 1.2TB 10K SAS disks 4KB 100% RND RD 4263 IOPS Tiered Config 1 x RAID5 = 3 x 1.2TB 10K SAS disks 1 x 200GB Samsung SSD 32GB of memory per host for caching Test vsphere x Windows VMs IOmeter VMDK on VMFS Total IOPS Average Response (ms) Workload HDD Tiered HDD Tiered 4KB 100% Random Read KB 100% Random Write KB 70/30 Read Write 80% Random KB 100% Sequential Read KB 100% Sequential Write KB 100% RND WR 4KB 70/30 RD/WR 80% RND 32KB 100% SEQ RD 32KB 100% SEQ WR 4KB 100% RND RD 4KB 100% RND WR 4KB 70/30 RD/WR 80% RND 32KB 100% SEQ RD 32KB 100% SEQ WR AVG Latency (ms) HDD Tiered HDD Tiered 23

24 Triangulate your storage architecture: Light bulb moment! Significant storage options available to IT pros today. Optimal storage configurations are very hard to achieve. It starts with understanding your capacity and performance requirements. Balanced with achieving the smallest possible footprint. Don t blindly head down the path of HCI appliances or off-the-shelf SANs. Consider custom building against your exacting requirements. Leverage 3-tiered caching to meet widest set of requirements Step one - Conduct deep analysis of your IOPs and Latency requirements. Step two - Triangulate these requirements with the most optimum architecture. Step three - Deploy a solution that meets today s and tomorrow s needs.

25 Q&A and Further Information Resources: Whitepapers, datasheets, webinars/videos, case studies This webinar and whitepaper will be posted on Monday 7 th May Download your free trial of SvSAN stormagic.com/trial SvSAN Product Information Performance analytics: Service Engagement Product SvSAN Editions SvSAN license capacity License entitlement Maintenance and support Options Standard & Advanced 2, 6, 12 and unlimited TBs 2 mirrored servers Platinum - 24x7 / Gold - 9x5 - StorMagic Solutions Architect - Analyses actual workload - 100% clarity on IOPs and latency needs - Triangulate your storage architecture - 50% discount for applications received by 30/5/17 For further information, please contact: sales@stormagic.com