AI in The Data AI Centre in the Data Centre Walter Van Hoolst Technology Architect HPE Nimble Storage Walter Van Hoolst Technology Architect HPE Nimble Storage April 24, 2018 Walter.vanhoolst@hpe.com @WHoolst
We re in the third-wave of the flash revolution the New Normal 61% Have already deployed all-flash in some level and are increasing use Wave 1: Performance Wave 2: Economics Wave 3: New Normal Niche workloads Adding SSDs to arrays and Optimizing only for performance Mainstream Lower-cost SSDs and data reduction drives cost to HDD levels Flashanomics Flash by default. Moving beyond just looking at array features Source: 2017 IT Pro Research Study Sponsored by HPE
But I&O Leaders Must Look Beyond the Box Predictive Cloud Ready Timeless Predictive Analytics to anticipate and prevent issues across the infrastructure stack Ubiquitous scale with data mobility between systems, sites, and the public cloud Architectural and financial flexibility to go anywhere with futureproofed platforms and guaranteed availability
Business Impact is Severe You can t afford an app data gap Apps Loading Data
Endless Fire-fighting with Lost Nights and Weekends 1 2 3 Reacting to unexpected problems Spending countless hours interpreting graphs and logs Calling vendor support adds to the frustration Disruptions, business impact, and wasted time
There is no one cause Cross-stack Best Practices VM/Container/DB Compute Storage Related 46 % Storage 54 % Non-Storage Cross-stack Resource Contention Network Storage Cross-stack Interoperability Source: InfoSight analysis HPE customer base
Rich Telemetry Cloud Analytics Global Learning Predictive Analytics can close the app-data gap
InfoSight collects and analyzes more sensor data points every four hours, than there are stars in our galaxy >250B sensor values >2B log events >100MM configuration variables 370T Data points since 2010
Our Vision is the Autonomous Data Center Self-Driving Self-Healing Self-Optimizing Storage Servers Networking Converged Powered by HPE InfoSight: AI for the Data Center
HPE InfoSight: AI for the Data Center Collecting and Analyzing Millions of Sensors per Second Customer Impact Predictive Support Automation Proactive Management Continuous Improvement Preemptive Recommendations Cloud-Based AI Platform Predictive Analytics Engine Global Learning Recommendation Engine Cross-Stack Telemetry Compute Network Storage
Predictive Support Automation 11
See Once, Prevent for All Learning from the installed base Host, VM, network issues Interoperability issues HPE InfoSight Configuration issues Storage-related issues Not using best practices
Blacklist Updates Associated with Known Problems HPE Nimble Storage v3.2.2.0 = Blacklisted Release Release Update Path 3.1.4.0 3.2.2.0 Every array has a customized update path based on its unique configuration Every update available is safe and free of known problems 3.7.0.0
Problem Prevented Before the Customer Knew About the Issue! Issue: InfoSight detected a controller went down unexpectedly Impact None because of built-in redundancy and no single point of failure Diagnostics Proactive Analysis found a bug. Nimble engineers created the fix and pushed it out in 24 hours Prevention 40 Customers were automatically provided a nondisruptive update to avoid potential impact
InfoSight Prevented 600 Systems from Having an ESX Issue! Issue: Massive application slow-down Impact 10x lower Throughput and higher latency, rendering host unusable Diagnostics Illegal iscsi command in ESX created huge performance issue after NimbleOS upgrade. Rapidly created a workaround until the vendor fixed the bug. Prevention 600 systems that would have experienced the issue were blacklisted
Preemptive Recommendations 16
Preemptive Recommendations in Use Everyday Rerouting
Preemptive Recommendations for Your Data Center Prevent Issues Before They Occur Improve Performance Proactively Optimize Available Resources Example: Change network setting at port 3 to avoid failover issue Example: Apply QoS to vol1 to improve performance on vol2 Example: Move VM3 to Host2 as Host1 is oversubscribed Eliminating the Guesswork in Managing Infrastructure
HPE InfoSight Recommendations Go Beyond the Obvious Pareto Principle for Infrastructure Problems Simple and Common 80% of the Issues 20% of the Pain Complex and Unique 20% of the Issues 80% of the Pain Requires Analytics & Automation Easy! Requires an AI Recommendation Engine Hard! Frequency Pain Simple Types of Problems Complex
Architecting the AI Recommendation Engine AI Recommendation Engine 1 2 Predictive Models Recommendation 3 Global System Telemetry Machine-Learned PEAK Team (Data Scientists) Expert-Informed Prioritization Matrix Customer Environments (Automatic) 20
AI Recommendation Example: 1 2 3 Prediction Diagnostics Recommendation Data availability disruption due to obscure memory leak Signature matching 60+ memory allocation sensors forecasted over time, correlated across the installed base 40 Customers Received an automatic case sent to apply non-disruptive update to avoid impact
Real Benefits 22
Non-Stop Availability with InfoSight Predictive Analytics Prevent issues and avoid downtime Cross-stack rapid root cause analysis Predict future needs and simplify planning Inoculate install base once issue found Multi-tenant SaaS Portal Predictive Analytics <1 minute Issues detected before you do Measured uptime Hold time to speak to level 3 engineer Source: HPE Nimble Storage
Independent Research on the Impact of HPE InfoSight 79% lower IT OpEX 73% fewer storage trouble tickets 85% less time spent troubleshooting storage 69% faster TTR when needing Level 3 support Enterprises save time and money with HPE InfoSight
Cross-Stack Analytics for VMware Environments VMs/DBs/Apps Noisy Neighbor Determine if VMs are hogging resources from another VM Host & Memory Analytics Visibility into host CPU and memory metrics Compute Network Latency Attribution Identify root cause across host, storage, or SAN Storage Inactive VMs Visibility into inactive VMs to repurpose/reclaim resources Top Performing VMs Visibility into Top 10 VMs by IOPs and Latency
HPE InfoSight Extends to 3PAR + 3PAR Rich Telemetry Extensive data collected in every array Data collection since 2002 No need to retrofit HPE InfoSight Data Science Expertise Existing code and sophisticated models leveraged from HPE InfoSight Rapid acceleration of predictive algorithms 26
First Release of HPE InfoSight for 3PAR Available for All Customers with an Active Support Contract at No Cost Cross-Stack Analytics Global Visibility Predictive Support Foundation Cross-Stack Analytics Global Visibility Predictive Support Foundation Pinpoints bottlenecks between storage and VMs. Optimizes virtual resources Cloud-based capacity/performance analytics, health checks and best practices Analytics infrastructure and PEAK team to predict problems and automate resolution 27
HPE InfoSight: AI for the Data Center Extending HPE InfoSight Across HPE Storage Servers Networking Converged 28
HPE is providing the storage foundation for Hybrid IT Predictive Cloud Ready Timeless Predictive Analytics HPE InfoSight for HPE Nimble Storage HPE InfoSight (v1.0) for HPE 3PAR HPE Cloud Volumes HPE StoreOnce Cloud Bank Storage Scale-out file & object for cloud storage archives 99.9999% availability and data compaction guarantee SCM / NVMe Ready Consume IT Flex Capacity and HPEFS
Thank You! Any Questions? https://infosight.hpe.com http://www.hpe.com/storage/infosight Walter.vanhoolst@hpe.com @WHoolst 30