HCI2501BU Accelerating Digital Transformation with InterSystems IRIS and vsan Murray Oldfield, InterSystems Andreas Dieckow, InterSystems Christian Rauber, VMware #vmworld #HCI2501BU
Disclaimer This presentation may contain product features or functionality that are currently under development. This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new features/functionality/ technology discussed or presented, have not been determined. 2018 VMware, Inc. 2
Accelerating Digital Transformation with InterSystems IRIS and vsan Christian Rauber Andreas Dieckow Murray Oldfield
Digital Transformation Requirements Successful Digital Transformation Initiatives Require New Applications That Are Smarter Are Faster Incorporate More Data From More Sources Work Seamlessly With Existing Infrastructure Scale On Demand Are Simpler to Build and Manage
Complexity in Infrastructure
Complexity in Software
Data Platform Relational DBMS Object Store Business Intelligence Real-Time Cloud Provisioning Data Integration Application Integration Document Store Orchestration Key-Value Store Workflow In Memory DBMS Data Warehouse Natural Language Processing API Management Advanced Analytics Normalized Data Lake
InterSystems IRIS Data Platform A Unified Platform for Accelerating Digital Transformation Initiatives Multi - Model Multi - Workload Open Analytics Relational Document Multidimensional Object HTAP with Isolated Workload Processing Unique Approach to Big Data Analytics ACID Transactions + Real-Time Indexing Analytic SQL Predictive Model Business Intelligence Runtime Natural Language Processing Connector Architecture Languages and Tools Composite Business Interoperability Data Integration Process Orchestration Application Integration Flexible Cloud Hybrid On Premises Deployment Options
Customer Use Case: Finance Global investment bank with 50,000 employees and $1 trillion (USD) assets under management Replaced in-memory operational DBMS Eliminating near term and historical DWs Zero issues even during peak trading periods Traditional Siloed Architecture InterSystems IRIS A Unified Data Platform Transaction Processing Database Near Term Analytic Database InterSystems IRIS Historical Analytic Database Archive / Data Lake
Query Response Time (in ms) Big Data at Scale 9000 8000 7000 6000 5000 4000 3000 2000 1000 RESULTS Better Performance On ~10X More Data Using Less Infrastructure Zero Query Failures Query Returning 19 Rows 0 IRIS Vendor B 1 10 25 50 100 # Concurrent Users Vendor A Vendor C Query Response Time (in ms) 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 Database Configuration Days of Data Dataset Size (GB) Dataset Size (Rows) InterSystems IRIS Vendor A (In Memory DBMS) Vendor B (In Memory DBMS with Column Store) Vendor C (Column Store Data Warehouse) Query Returning 201 Rows IRIS Vendor B 1 10 25 50 100 # Concurrent Users Vendor A Vendor C 4 VMs: 8 cores, 96GB RAM, 400GB local storage 8 VMs: 16 cores, 256GB RAM, 400GB local storage 8 VMs: 16 cores, 256GB RAM, 400GB local storage 3 dedicated physical servers, each with 24 cores and 256GB RAM, 2TB shared SAN storage Query Response Time (in ms) Query Returning 600 Rows 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 1 10 25 50 100 # Concurrent Users IRIS Vendor B 135 320 2,000,000 14 33 207,400 14 33 207,400 20 47 296,200 Vendor A Vendor C Query Response Time (in ms) Query Returning 984 Rows 9000 8000 7000 6000 5000 4000 3000 2000 1000 0 1 10 25 50 100 # Concurrent Users IRIS Vendor B Vendor A Vendor C
Customer Use Case: IoT 5 th largest shipbuilder in Europe Manages 65,000 different real-time signals from a wide variety of sensors Combines real-time and non-real-time data Reduced development time for additional projects by 80% We have been able to develop a better system than anybody else in the world. It differentiates us from all competitors. In some cases we have been able to sell ships thanks specifically to our integrated ship information system; sometimes it has been more important than the ship itself.
Customer Use Case: Logistics 2 nd largest shipping company in the world Transports 12 million smart containers among 270 shipping ports worldwide InterSystems-based Track & Trace Application Provides customers with accurate, real-time visibility into location, status, expected arrival Real-time processing and analytics to route and re-route ships to ensure containers arrive on time Incorporates real-time events (weather, strikes, ) Eliminates errors and omissions in processing and documentation This unique technology is the best-kept secret in the IT industry. and the support from InterSystems is excellent. -Rumen Lilov, ebusiness Development Manager
Customer Use Case: Retail Integrates 120 subsidiaries and partners in 40 countries Backbone for 80 shopping malls selling 30,000 products Backbone for a new ecommerce channel Self service (NLP) digital help desk Automated financial reporting processes
Customer Use Case: Public Sector Automated information collection, monitoring, control and analysis of all information for local and federal police Integrated legacy policing applications Embedded database and analytics improves situational awareness and investigations Continuous operation even when disconnected All data and communications are encrypted for security 3
InterSystems IRIS Data Platform combines a transactional-analytic processing engine optimized for all types of data big, small, structured, unstructured, centralized, decentralized, historical, and real-time with native interoperability for connecting and creating business processes among disparate applications and data sources and an open analytics platform for applying real-time and batch analytics including business intelligence, predictive models, machine learning, and natural language processing.
InterSystems IRIS Technical Architecture Architecture and Benchmarks Getting the best from IRIS on vsan Simple Proof of Concepts and Deployment
IRIS vsan Production Loads Benchmark 6x Dell R640s 2x Intel 6132 2.6GHz, 672GB RAM - 28 Physical cores/host - Large VM 24 vcpu 2x disk groups per host, each disk group; - 1x NVMe for the cache tier (HGST SN260 3.2TB PCIe NVMe HHHL) - 4 x12g SAS SSDs for the capacity tier. (HGST SS300 1.9TB 12Gb SAS 2.5 ) Dual X550 10Ge NIC for vsan/vm/vmotion Single I350 1Ge NIC for ESXi management
IRIS Architecture Choices Scale UP 24 vcpu cores/host 96 GB Memory
IRIS Benchmark on vsan Scale Up - Large Database Random 8K Reads
IRIS Architecture Choices Scale Out Horizontally 24 vcpu cores/host 96 GB Memory 24 vcpu cores/host 96 GB Memory 24 vcpu cores/host 96 GB Memory
IRIS Benchmark on vsan Scale Out Throughput Application Benchmark 24 vcpu cores/host 96 GB Memory
IRIS Architecture Choices HA Mirror
IRIS Architecture Choices Sharding for SQL Queries 24 vcpu cores/host 96 GB Memory 24 vcpu cores/host 96 GB Memory 24 vcpu cores/host 96 GB Memory 24 vcpu cores/host 96 GB Memory
IRIS Benchmark on vsan Sharding Query Results Query Benchmark 24 vcpu cores/host 96 GB Memory
Is vsan Supported?
Q: Are there any Special Considerations for HCI? A:YES!
Minimum Requirements for Production IRIS on vsan Networking Must be on the HCL Compute Must be on the HCL Storage Must be on the HCL 2018 VMware, Inc. 28
Minimum Requirements for Production IRIS on vsan Networking 10 or 25Gb NIC Non-blocking switch 25GB or 100Gb networks Compute IRIS & VMware Best Practice Rules First 10% extra CPU 6-node cluster Storage IRIS Best Practice Rules First All Flash 2+ Disk Groups/host NVMe for cache tier LVM PE striping 2018 VMware, Inc. 29
Default vsan Placement vs PE Striping - Reads Your Mileage Will Vary
InterSystems Cloud Manager (ICM) for Deployment Deploys Containers (or not) Deploys to cloud and vsphere Scripting simplifies deployments An intelligent wrapper for HashiCorp Terrafom
ICM Public and Private Cloud Options
Getting the best from VMware, vsan and IRIS community.intersystems.com capacity planning and performance series index
Data Platform + HCI => Simplicity
Q & A Thank you, please complete the survey
Thank You! www.intersystems.com/iris
PLEASE FILL OUT YOUR SURVEY. Take a survey and enter a drawing for a VMware company store gift card. #vmworld #HCI2501BU
THANK YOU! #vmworld #HCI2501BU