Compute Infrastructure Management: The Future. Fred van den Bosch CTO, EVP Advanced Technology VERITAS Software Corporation

Size: px

Start display at page:

Download "Compute Infrastructure Management: The Future. Fred van den Bosch CTO, EVP Advanced Technology VERITAS Software Corporation"

Pierce Harrell
5 years ago
Views:

1 Compute Infrastructure Management: The Future Fred van den Bosch CTO, EVP Advanced Technology VERITAS Software Corporation

2 Agenda Evolving role of IT Evolution of Compute Infrastructure Management Storage Server Data Future: Business Aligned Utility Computing Role of standards

Evolving role of IT * Spend less money * Run IT as a service measurable, accountable * Adapt to business needs CEO CIO * New applications * More data * Improved availability * Better, consistent

3 Evolving role of IT * Spend less money * Run IT as a service measurable, accountable * Adapt to business needs CEO CIO * New applications * More data * Improved availability * Better, consistent service Increasingly-complex IT infrastructure IT Customers Firewall DMZ Servers Firewall Load Balancer Web Applications Databases SAN Storage Business silos Provisioned for peak Slow reaction Low utilization Service levels? Interoperability issues

4 Evolving role of IT Alignment with business needs Optimized use of human and capital resources Managed service levels Rapid deployment / reaction to changes Regulatory compliance IT as a service Accountable Measurement / reporting Chargeable

5 What s Needed : Improved Service Levels Continuous availability Protection against any mishap Human / SW errors, HW / site failures Zero-impact backup / instantaneous recovery With good response times / performance Improve utilization Manage performance

6 Capacity growing rapidly Hardware Cost Hardware Capacity

7 and modular computing & storage means (even) more components to manage Promise: reduced expenses Standardized HW components, OS and application images Granular resource allocation Floor space, power consumption More components to manage Larger clusters Compute Switch Storage

8 ...Penetrating the enterprise Firewall DMZ Servers Firewall Load Balancer Web Applications Databases SAN Storage

9 What s needed to reduce costs Hardware Cost Total Cost Management Cost Automation Simplification Interoperability Centralization (Of Mgmt) Improved Utilization * Increased Sharing * Capacity Management * Performance Optimization

10 What s Needed Business Aligned Management Products that: Understand and analyze The business operation Business processes and their resource utilization Deviations from nominal & expected behavior (business SLA) Continuously discover, protect and manage all IT resources and applications Automatically provision and deploy resources and applications, in real time and on demand Adaptive alignment of IT resources with business needs

11 Evolution of Compute Infrastructure Management

12 Adaptive Software Architecture Applications Databases, Application Servers & other middleware Application plug-ins Industry Standards Content Aware Storage Data Management Archiving Data Protection Resource Provisioning Service virtualization virtualization virtualization Network Mgt Server Mgt Storage Mgt Infrastructure plug-ins Industry Standards Storage & Compute Infrastructure Application interoperability Interoperability in heterogeneous environments: Evolving standards Hardware interoperability Networked Storage devices becoming SW platforms

13 Storage Management Applications Databases, Application Servers & other middleware Application plug-ins Industry Standards Content Aware Storage Archiving Data Protection Resource Storage Provisioning Service virtualization virtualization virtualization Network Mgt Server Mgt Storage Mgt Infrastructure plug-ins Industry Standards Classic SRM File Systems Storage Network Management Virtualization

14 Storage Network Management & Virtualization VM VM VM Storage Network Management Multi-vendor Fabric Discovery and Visualization Array, Switch and HBA Management LUN masking and zoning Critical path discovery & management, Volume Manager - virtualizes storage for applications Multi-pathing Mirror / stripe / concatenate across arrays Grow / shrink volumes,. SNM LUN s LUN s LUN s LUN s LUN LUN

15 SAN Volume Manager SAN-level Out of Band Virtualization Configuration data SVM client SVM client SVM client SAN Volume Management Manage storage as a single pool for entire SAN Provision logical volumes to servers Dynamically move data between storage servers SNM SANVM

16 SANVM Client in the Fabric Switch as a Storage Appliance Fabric-based virtualization Increasing complexity A new type of SW platform Standards required to keep this manageable SPC SANVM Configuration Data SVM Client Intelligent Switch

17 Administrator needs automated provisioning Virtualization is for applications Virtual disks: dream for applications Never break As many as you need Can grow and shrink No need to share Better performance than real disks Transparent & reliable interconnect Nightmare for administrator Configure LUN s from disks Assign to ports LUN masking & zoning (VLUN s) Configure multi-pathing Configure Volumes Different for every device / vendor Applications API s virtual disks (volumes) Automated end-to-end provisioning Multi-vendor Policy / attribute based SMI-S enabling standard

18 Server provisioning & virtualization Applications Databases, Application Servers & other middleware Application plug-ins Industry Standards Content Aware Storage virtualization Network Mgt Archiving Server Provisioning virtualization Server Mgt Data Protection virtualization Storage Mgt Infrastructure plug-ins Industry Standards Classic SRM File Systems Storage Network Management Virtualization

19 Server Virtualization Today Distributed computing Front-end processing with traffic direction Grid computing for HPC applications Clustered computing Clustering / failover Limited cluster size Parallel applications (mainly Oracle / RAC) Firewall DMZ Servers Firewall Load Balancer Web Applications Databases SAN Storage

20 Server Virtualization Future Workload management / dynamic server provisioning Distributed computing WEB services Grid computing extends to other applications (?) Clustered computing Large scale clusters More parallel applications Cluster aware applications Firewall DMZ Servers Firewall Load Balancer Web Applications Databases Dynamic Provisioning Service

21 Dynamic Server Provisioning for Automating server deployment Discovery Load golden build Provision new server Stage for repair Bare-Spare Pool Pre-staged Pool Provisioning Server Faulted Pool Production Pool

22 Automated Server Provisioning From silo-ed Servers Servers Dedicated To Applications Provisioned for peak demand per silo Low utilization Slow reaction to changing workloads

23 Automated Server Provisioning.to shared server pools Increased utilization Reduced administration Faster response to changing workloads

24 Server provisioning & availability Industry directions Highly scalable clusters (128 ->256 nodes) Automation Automated provisioning service Workload management, task management SAN-based replication Need for standards Cluster Development Provisioning

25 Data Protection Applications Databases, Application Servers & other middleware Application plug-ins Industry Standards Content Aware Storage Archiving Data Protection Resource Provisioning Service virtualization virtualization virtualization Network Mgt Server Mgt Storage Mgt Infrastructure plug-ins Industry Standards Classic SRM File Systems Storage Network Management Virtualization

26 Future Data Protection: Disk and Tape Application server / primary storage system Database File system Volume mgr Live data Roll back Logs Copy-onwrite snapshots Periodic replication Incremental backup Server-free backup Secondary storage system Increm. backup Synthetic full backup Space-optimized copies (differencing, sis, compression, ) Backup archive Tape archive Archive Mirror break-off Immediate restore Full online copy replicate updates Point-in-time restore Continuous backup

27 Towards zero-impact backup & instant restore Disk as backup medium Virtual backup Use snapshots, replication, logging, incremental backup, server-free backup to minimize impact & restore time Many different technology suppliers Standards play essential role in enabling heterogeneous solutions

28 Archiving Applications Databases, Application Servers & other middleware Application plug-ins Industry Standards Content Aware Storage Archiving Data Protection Resource Provisioning Service virtualization virtualization virtualization Network Mgt Server Mgt Storage Mgt Infrastructure plug-ins Industry Standards Classic SRM File Systems Storage Network Management Virtualization

Archiving Problem is Growing Government regulation and business necessity Archive growth outpaces storage growth More data, longer retention Expanding scope e-mail, instant messages,

29 Archiving Problem is Growing Government regulation and business necessity Archive growth outpaces storage growth More data, longer retention Expanding scope , instant messages, trader conversations Current solutions do not address Regulatory compliance Data organization and search Changing data formats Media obsolescence Multiple media types Security issues

30 Industry need: Application & media independent Archiving platform Archive Store Complies with regulatory requirements Long term preservation Regardless of media failures or obsolescence Single repository All data types: , files, databases, images, etc. All media: disk, optical, tape Extensive meta-data management Collections, versions, context, access rights, etc. Platform for application-specific archiving solutions

31 Archive Store Technology View Application-specific archiving solutions Services Exchange Notes Messaging Representation Index/Search Librarian Archive Store Common Media Manager and Device I/O Media Format Array Near-line store Optical Tape

32 The Future: Business Aligned Utility Computing

33 That s all very nice, but. Management tools are for the administrator No tie-in to business needs Required / expected service levels Required efficiencies Deviations (other than loss of availability) not found and corrected User complaints trigger action (by administrator) Alignment with business needs requires: Service Management To specify and monitor service levels Performance Management Understanding actual service levels and cause of deviations Integration of these with provisioning service Automatic (re-)provisioning of resources to best meet business objectives

34 Service Manager IT Service definition & monitoring Service Portal Service Delivery Customers IT management Status reports Trend reports Servers Network Storage SLA & ROI metrics Cost info / chargeback Event notification Customers Backup / Recovery Business Apps IT Operations Define services Define policies Disaster Recovery High Availability Planning / forecasting Service requests Change orders Customers Defined services & service levels

35 Performance Management End to end view of application / transaction performance Storage, computer, network and application monitoring URL-to-SQL-to-Storage Correlation and root cause analysis Reports & corrective action Web Server Application Database Storage Users URL HTML JPEG GIF JSP JSP EJB SERVLET JDBC SQL SQL INDEX TABLE DATAFILE LVM I/O I/O CHANNEL LUN DISK Alerts & alarms Initiate configuration changes Correlation & root cause analysis

36 Example: Application centric performance management for storage Database built & laid out I/O starts DB activity exceeds expectations Performance Mgr identifies busy index table New volume added to file system Index moved, online, to new volume Performance improves File System / Index New Volume Good response Poor response

37 Example: Dynamic Server Provisioning & workload management Traffic Director Balance Workload monitoring Web app Parallel app monitoring DB-apps Pre-staged pool Storage Network Production pool Faulted pool Manage pool of servers Automatic discovery Rapid deployment Improved utilization Manage service levels Respond to business needs

38 From administrative tools to Business Aligned Utility Computing Applications Databases, Application Servers & other middleware Performance management Application plug-ins Industry Standards Content Aware Storage Data Management Archiving Data Protection Utility Manager Provisioning Service Automatic Provisioning Service virtualization virtualization virtualization Network Mgt Server Mgt Storage Mgt Infrastructure plug-ins Industry Standards Computing Utility Service Management

39 Multi-vendor Platform Support Solaris HP/UX Windows AIX Linux Cluster Management Cluster Management Cluster Management Cluster Management Cluster Management Replication Replication Replication Replication Replication Cluster Cluster Cluster Cluster Cluster Data Protection Data Protection Data Protection Data Protection Data Protection Editions Editions Editions Editions Editions VM VM VM VM VM FS FS FS FS FS SRM SRM SRM SRM SRM Available Planned

40 The role of standards

41 Utility Computing for heterogeneous environments Most ambitious multi-vendor integration task in history Platforms, devices, databases, middleware, applications,.. Without ubiquitous adoption of an open, functional and extensible management transport the industry faces: Proprietary integration infrastructures that are costly/slow to build/maintain Vendors using access to interfaces as a competitive weapon Least common denominator functionality in overlying products Continued interoperability issues Functionality/reliability restrictions inherent to use of legacy standards (example SNMP and legacy transports)

42 The promise for storage: SMI-S Graphical User Interface Storage Resource Management Performance Capacity Planning Resource Allocation Management Frameworks Management Tools Container Management Volume Management Media Management Other Users Data Management File System Database Manager Backup & HSM Storage Management Interface Specification Physical Components Removable Media Tape Drive Disk Drive Robot Enclosure Host Bus Adapter Switch Managed Objects Logical Components Volume Clone Snapshot Media Set Zone Other

43 But new technology means new needs Utility Computing & archiving Performance monitoring Applications Databases, Application Servers & other middleware Archiving platform Resource definition & management Performance management Application plug-ins Industry Standards Content Aware Storage virtualization Network Mgt Archiving Utility Manager Automatic Provisioning Service virtualization Server Mgt Data Protection virtualization Storage Mgt Infrastructure plug-ins Industry Standards Service Management Process & service definition

44 The future IT Infrastructure Shared storage & compute fabric Efficient sharing of resources Operational Automation Managed Service Levels On demand Service Accountable and chargeable Business Aligned Utility Computing CIM ENABLED

45 Compute Infrastructure Management: The Future Fred van den Bosch CTO, EVP Advanced Technology VERITAS Software Corporation

Realizing the Promise of SANs

Business without interruption. Realizing the Promise of SANs Bill North Director, Storage Network Programs Strategic Initiatives Group VERITAS Software Education Committee Chairman Storage Network Industry