Welcome to the Hybrid world. Why did we do it?

Transcription

1 De Smet Hendrik IT Architect 14/12/2011 Welcome to the Hybrid world. Why did we do it? Prepared for GSE z/os workgroup date: 14/12/2011

2 Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. AIX* BladeCenter* DataPower* DB2* FICON* GDPS* HiperSockets IBM* IBM eserver IBM (logo)* InfiniBand* Parallel Sysplex* POWER* POWER7* PowerVM RP/SM Smarter Planet System x* System z* System z9* System z10 WebSphere* z9* z10 BC z10 EC zenterprise z/os* zseries* z/vm* z/vse * Registered trademarks of IBM Corporation The following are trademarks or registered trademarks of other companies. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license there from. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. InfiniBand is a trademark and service mark of the InfiniBand Trade Association. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-ibm products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. 2

3 Agenda Introduction The Management challenge The Technology challenge Introduction to zenterprise Conclusion 3

4 The challenge today While technology has made great strides and all platforms are more capable than ever before the demands set upon them have never been greater Workloads are more diverse and more complex The volume of data is unprecedented The sheer performance required is staggering Security and resiliency are paramount And the reality is that these demands grow exponentially as we embrace the opportunities of a smarter planet. 4

5 The demands placed on the data center have never been greater million servers worldwide 85% idle computer capacity 15% of servers run 24/7 without being actively used on a daily basis 1.2 Zetabytes (1.2 trillion gigabytes) exist in the digital universe 50% YTY growth 25% of data is unique; 75% is a copy Between 2000 and 2010 servers grew 6x ( 00-10) storage grew 69x ( 00-10) virtual machines grew 51% CAGR ( 04-10) Data centers have doubled their energy use in the past five years 18% increase in data center energy costs projected Internet connected devices growing 42% per year Since 2000 security vulnerabilities grew eightfold while IT budgets are growing less than 1% per year. 5

6 Smarter Systems for a Smarter Planet This is your battle field today Information Technology today is limited by the technology and architecture configurations available Web Servers From "Too cheap to manage" to SSL/XML Appliances System z Security/Directory Servers Application Servers Routers Switches too much to manage Firewall Servers Caching Appliances DS Servers Business Intelligence Servers File/Print Servers LAN Servers Connected Integrated Flexible, Dynamic, and Responsive Customers need better approach: The ability to manage the IT infrastructure and Business application as an integrated whole. 6

7 Remember it s ALL about the workload Subset of components that represent a specific workload Firewall Web Servers Router Database Server Storage Router Application Servers Collectively, we must understand the Physical & Logical components that make up your targeted zenterprise Workload. 7 7

8 8

9 Information Technology must transform to be Responsive, Flexible, Secure and Cost Competitive While in theory, all workloads could run on a single platform truthfully all platforms have a role to play You need the data serving strengths of the mainframe, the security, the resiliency, the scalability You need the computational strength of Power Systems, for HPC and large scale application serving You need the breadth of IBM System x, for front end applications, special function servers and a myriad of niche applications Creating a single platform infrastructure would be highly inefficient, ineffective and unsustainable in the long term 9

10 Providing Scalability Firewalls Solution: + Multiply! + Multiply! + Multiply! Parallel Sysplex Routers and Edge Servers Web Servers Application Servers How quickly can more capacity be added? 10

11 New economic model for the datacenter Management costs shift to virtualized servers WW IT Spending (US $B) $300 $250 $200 $150 $100 $50 Server Spending Management Cost Standalone Servers Management Cost Virtual Servers Power and Cooling Expense Physical Server Installed Base Virtual Server Installed Base WW Server Installed Base (Millions) $0 '96 '97 '98 '99 '00 '01 '02 '03 '04 '05 '06 '07 '08 '09 '10 '11 '12 '13 0 Source: IDC Three Data Centers One Vision?, March

12 The result on your IT budget Cost of IT: #1 People #2 Software #3 Hardware #4 Infrastrucure IT budget: 75%-85% maintenance 15%-25% new projects 12

13 Labor Cost trends to favor A Centralized Approach of Management Distributed Labor Trends Mainframe Labor Trends , , FTE/Server Decrease: 13% Server Increase: 108% 0,02 0,015 0, FTE/MIPS Decrease: 63% MIPS Increase: 164% 0,025 0,02 0,015 0,01 # of Servers - (K) Installed MIPS FTE/Server 0, FTE/Installed MIPS 0, Source: IDC, 2010 Source: Gartner, 2010 Virtualization/consolidation and structured management practices drive increases in labor productivity 13 13

14 Agenda Introduction The Management challenge The Technology challenge Introduction to zenterprise Conclusion 14

15 IBM z196 Continues the CMOS Mainframe Heritage 80-way way 5.2 GHz way 4.4 GHz MHz MHz 420 MHz 550 MHz 16-way 770 MHz 32-way 1.2 GHz 1.7 GHz G G G z z z9 EC 2008 z10 EC 2010 z196 G4 1 st full-custom CMOS S/390 G5 IEEE-standard BFP; branch target prediction G6 Copper Technology (Cu BEOL) z900 Full 64-bit z/architecture z990 Superscalar CISC pipeline z9 EC System level scaling z10 EC Architectural extensions z196 Out of order, improved superscalar, new architecture 15

16 Challenge of Technology Limits The industry is hitting fundamental physical limits: Size Speed of electromagnetic propagation Heat transfer rates Large CPU speed increases are a thing of the past, across the industry Capacity increases will increasingly come from higher n-way, more multithreading, and NUMA optimization Demand for lower latency will drive colocation of hybrid transaction processing elements Single C P U Speed In terms of size [of transistor] you can see that we're approaching the size of atoms which is a fundamental barrier,. Gordon Moore, April 2005* I/O Rate n-way C apacity Bandwidth * Techworld, Operating Systems and Servers News, 13 April zbxtllb_16

17 Microprocessor Clock Speed Trends Managing power dissipation is limiting clock speed increases Frequency Extrapolation

18 IBM System z: System Design Comparison System I/O Bandwidth 288 GB/Sec* Balanced System CPU, nway, Memory, I/O Bandwidth* GB/sec* 96 GB/sec ITR for Memory 24 GB/sec 1-way 3 TB** 1.5 TB** ~ GB 256 GB 64 GB way 32-way 54-way 64-way zenterprise GA1 z10 EC z9 EC * Servers exploit a subset of its designed I/O capability ** Up to 1 TB per LPAR 80-way Processors zseries 990 zseries 900 zenterprisetllb_18 18

19 Agenda Introduction The Management challenge The Technology challenge Introduction to zenterprise Conclusion 19

20 Smarter Systems for a Smarter Planet A Smarter Approach Blade Components Offered as Optional System z Feature(s) Web Servers Blade Racks logically extend the zcec You can Mix andzmatch System SSL/XML Appliances Routers Switches Firewall Servers (supported Blades) Security / Directory Servers Each Blade System will have an Integrated Hypervisor and fall under Unified Resource Manager control. Application Servers Caching Appliances DS Servers Application and Data Appliances Connected Integrated Flexible, Dynamic, and Responsive Aligned with Business Service Objectives File/Print Servers LAN Servers

21 IBM zenterprise System Best-in-class systems and software technologies A System of Systems that unifies IT for predictable service delivery IBM zenterprise 196 & 114 (z196 & z114) Optimized to host large-scale database, transaction, and mission-critical applications The most efficient platform for large-scale Linux consolidation Capable of massive scale-up 26 mips to 50K mips New easy-to-use z/os zenterprise Unified Resource Manager Unifies management of resources, extending IBM System z qualities of service end-to-end across workloads Provides platform, hardware and workload management zenterprise BladeCenter Extension (zbx) Selected IBM POWER7 blades and IBM System x Blades* for deploying multi-tier applications High-performance optimizers and appliances to accelerate time to insight and reduce cost Dedicated high-performance private network * All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, 21 and represents goals and objectives only.

22 A look inside the IBM zenterprise System Enabling a new dimension in application architecture System z Hardware Management Console (HMC) with Unified Resource Manager z/os System z Host z/tpf z/vse TM Linux on System z System z PR/SM z HW Resources Support Element Linux on System z z/vm Select IBM Blades Linux and Windows on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx DataPower 1 Optimizers IBM Smart Analytics Optimizer Future Offering Future Offering Private data network (IEDN) Unified Resource Manager Private Management Network INMN Private High Speed Data Network IEDN Customer Network Customer Network 1 22 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.

23 zenterprise extends Service Management for improved governance Service Management APP APP APP APP APP APP MIDDLEWARE Tivoli Space ARM Platform Management Hardware Management MULTIPLE OPERATING SYSTEMS e.g., z/os, z/tpf, z/vse, z/vm, Linux on System z AIX API Linux and Windows on System x 1 VIRTUALIZATION PR/SM, z/vm, PowerVM, System x Hypervisor URM FIRMWARE GPMP System z Power System x 1 IBM Optimizers Unified Resource Manager Focused, collaborative innovation A complete systems approach 23

24 zenterprise Value Made hardware Possible By management the Unified and Resource platform Manager management Simplified installation of hypervisors Simplified energy management Gain significant time to market with improved speed of deployment Energy cost savings Save time, cost and simplify asset management Decrease problem determination and resolution time for crossplatform resources Improve and simplify crossplatform availability procedures Enable broader and more granular view of resource consumption HMC Hypervisors Operations Networks Energy Performance Virtual Servers Allow critical workloads to receive resources and priority based on goaloriented policies established by business requirements Smart business adjustments based on workload insight Provide deep insight into how IT resources are being used Factory installed and configured network Improved network security with lower latency, less complexity, no encryption/decryption Gain flexibility, consistency and uniformity of virtualization Provide the business with faster time to market Simplified network management for applications 24

25 Putting zenterprise System to the task Operational Controls System z Hardware Management Console (HMC) with Unified Resource Manager HMC z/os System z Host z/tpf z/vse Service updates Auto-discover received at and SE sends verify out Support the contact Element blade for is IBM supported by zenterprise IBM support Linux on System z System z PR/SM z HW Resources Support Element Service updates Install Error on new POWER7 POWER7 blade blade sent over in zbx service network Updates to SEsent over service network to POWER7 blades Linux on System z z/vm and to z196 Private data network (IEDN) Select IBM Blades Linux on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx Optimizers DataPower XI50z IBM Smart Analytics Optimizer Open Storage SAN Unified Resource Private Management Network INMN Customer Network Manager Private High Speed Data Network IEDN Customer Network 25 1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.

26 Putting zenterprise System to the task Hypervisor Management and Virtual Server Management System z Hardware Management Console (HMC) with Unified Resource Manager HMC z/os System z Host User Once at a HMC new defines POWER7 blade installed a workload and virtual verified in zbx z/tpf Linux on Linux on servers, the hypervisor is shipped to z/vse System virtual z System LAN, z virtual the blade storage over the service which is network managed (INMN) as one virtualized z/vm resource System z PR/SM z HW Resources Support Element Private data network (IEDN) Select IBM Blades Linux on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx Optimizers DataPower XI50z IBM Smart Analytics Optimizer Open Storage SAN Unified Resource Private Management Network INMN Customer Network Manager Private High Speed Data Network IEDN Customer Network 26 1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.

27 Putting zenterprise System to the task Performance Management System z Hardware Management Console (HMC) with Unified Resource Manager HMC System z Host If more resources are needed, more CPU z/tpf Linux on From the can be z/os added z/vse to the System z HMC you can group define to satisfy a the business group of policy resources together System z PR/SM z HW Resources Support Element USAGE Linux on System z z/vm Select IBM Blades Linux on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx Optimizers DataPower XI50z IBM Smart Analytics Optimizer Set a performance policy for those resources Open Storage SAN Private data network (IEDN) Unified Resource Private Management Network INMN Customer Network Manager Private High Speed Data Network IEDN Customer Network 27 1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only.

28 Putting zenterprise System to the task Network Management System z Hardware Management Console (HMC) with Unified Resource Manager zbx is System z Hostinstalled z/tpf z/vse Linux on System z z/vm data (IEDN) and one for System z PR/SM z HW Resources Support Element Linux on System z z/os When the virtual server is defined communication Communication is set up Two between networks the between blade established blades and the and other one for z196 virtual is established servers - including over these those networks service on the (INMN) z196 Select IBM Blades Linux on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx Optimizers DataPower XI50z IBM Smart Analytics Optimizer Open Storage SAN HMC Private data network (IEDN) Unified Resource Private Management Network INMN Customer Network Manager Private High Speed Data Network IEDN Customer Network 28

29 System Management enriched with the interaction of URM Smarter Systems for a Smarter Planet API Tivoli monitoring, accounting, scheduling, automation, provisioning, TBSM, cloud... System z Hardware Management Console (HMC) with Unified Resource Manager TWS, TSA, System z Host Omegamon z/os z/tpf z/vse TWS SA ITM Linux on System z System z PR/SM z HW Resources Support Element TWS SA ITM Linux on System z z/vm TWS/ SA ITM Select IBM Blades TWS/ SA ITM Linux on System x 1 Blade Virtualization TWS/S A ITM AIX on POWER7 Blade Virtualization Blade HW Resources zbx DataPower 1 Optimizers IBM Smart Analytics Optimizer Future Offering Future Offering Private data network (IEDN) Customer Network Unified Resource Manager Private Management Network Private INMN High Speed Data Network IEDN Customer Network 29

30 Make A Centralized Approach even smarter with the introduction of Appliances An Appliance on zenterprise hide the complexity of: Installing the hardware Installing and configure (and maintain) the software Connect the network Test the connectivity and integration with the target platform Managed this environment 30

31 Why customers love IBM appliances 31

32 Value of DataPower/zBX Integration Blade Hardware Management Monitoring of HW for health, degraded operation Call-home for current/expected problems, automatic dispatch of CSR Consolidation/Integration of DP HW problem reporting with other problems reported in zbx Energy Monitoring and Management of DP Blades DP Firmware Load and Update Consistent change mgmt with other zenetrprise firmware mgmt Enforced restriction of firmware updates to SE userid Enhanced new firmware level testing in zbx by System z Devt/Product Engineering and built-in restrictions on number of variations supported (test and production variants) HMC Console Integration Person monitoring the z environment from an overall hardware operational perspective will see DP blades included in the picture, with associated status from a single (w/ redundancy) console Group GUI operations for functions supported on HMC (e.g. power up/quiesce/upgrade firmware for these 5 DP blades) Time synchronization with system z time via HMC/SE time server Dynamic Load Balancing (via Sysplex Distributor) Allows LB1 decision based on consolidated understanding of load on DP blades as well as associated back-end sub-systems DP Failure Recovery and Restart HMC/SE will detect and report on appliance failures and can be used to re-cycle appliance if DP built-in restart fails Periodic Backup/restore of full blade configuration (automatic on changes to config); Backup to HMC media Networking Virtual Network Provisioning Provides enforced isolation of network traffic via VLAN support 10Gb end-to-end network infrastructure Built-in network redundancy IEDN provides protected network, possibly obviating customerperceived need for encryption of last-mile flows between DP and target back-end server Monitoring and Reporting Monitoring of DP health via HMC Consolidated platform error logging across whole environment Products like ITCAM may also monitor the DP blade at a higher level... But some customers may not have or want ITCAM or equivalent, at least initially but need some monitoring

33 Introducing the WebSphere DataPower XI50z for zenterprise Enterprise Service Bus Capabilities Content-based routing data transformation Bridge between messaging protocols Direct-to-database access via XML Firewall Capabilities Access control Encryption Data validation Field-level security Web services management input HTTP Headers WS-Security Tokens WS- SecureConversatio n WS-Trust Kerberos X.509 SAML Assertion IP Address LTPA Token Custom Extract Identity HTTP MQ JMS FTP IMS LDAP System/z NSS (RACF, SAF) Tivoli Access Manager Kerberos WS-Trust Netegrity SiteMinder RADIUS SAML LTPA Verify Signature Custom Authenticate SOAP Map Identity CSV COBOL XML LDAP ActiveDirecto ry System/z NSS Tivoli Access Manager SAML XACML Custom Authorize AAA Add WS-Security Generate z/os ICRX Token Generate Kerberos Generate SAML Generate LTPA Map Tivoli Federated Identity Audit & Post-Process output Extract Resource Map Resource URL SOAP Operation HTTP Operation 33 Custom

34 IBM Smart Analytics Optimizer Capitalizing on the best of relational and columnar databases Workload optimized, appliance-like, add-on, that enables the integration of business insights into operational processes to drive winning strategies. Performance: unprecedented response times to enable 'train of thought' analyses frequently blocked by poor query performance Integration: connects to DB2 through deep integration providing transparency to all applications Self-managed workloads: queries are executed in the most efficient way Transparency: applications connected to DB2, are entirely unaware of ISAO Simplified administration: appliance-like hands-free operations, eliminating many database tuning tasks Up to 80x faster than z10 Breakthrough technology enabling new opportunities 34

35 Smarter Systems for a Smarter Planet IBM SAO V2 is called: IBM DB2 Analytics Accelerator V2 zenterprise Netezza Technology CLIENT OSA-Express3 10 GbE Primary Private Service Network 10Gb Backup Data Studio Foundation DB2 Analytics Accelerator Admin Plug-in DB2 for z/os V9 V10 IBM DB2 Analytics Accelerator BladeCenter Users/ Applications Data Warehouse application DB2 for z/os enabled for IBM DB2 Analytics Accelerator IBM DB2 Analytics Acelerator Destroying the myth that transactional and decision support workloads have to be on separate platforms 35

36 Customer Profiles for the zenterprise Hybrid Computing Environment Clients with multi-tier business applications such as SAP or Core Banking where the data base tier is DB2 for z/os and the application servers are on distributed platforms such as UNIX for the application tier and x86 for the presentation tier Clients with multi-tier business applications where the data base is Oracle on Linux for System z and the application servers are on distributed platforms Clients with a mainframe as well as a sprawl of older UNIX and NT servers Clients with a data base on DB2 for z/os and possibly data marts on distributed platforms needing to accelerate query performance Clients extending their mainframe applications to support web serving Clients implementing a Service-Oriented Architecture to extend or re-use existing mainframe assets 36

37 zenterprise in action: Smarter Applications Operational Database DB2 for z/os z/os Core logic Services CICS Transaction Server z/os Presentation service and Session Management DataPower XI50 blade ESB and Security WebSphere DataPower B2B Client System z Hardware Management Console (HMC) with Unified Resource Manager z/os System z Host z/tpf z/vse TM Linux on System z System z PR/SM z HW Resources Support Element Linux on System z z/vm Select IBM Blades Linux and Windows on System x 1 Blade Virtualization AIX on POWER7 Blade Virtualization Blade HW Resources zbx Optimizers DataPower 1 IBM Smart Analytics Optimizer Future Offering Future Offering SAO (or IDAA) Boost DW queries Private data network (IEDN) 37

38 zenterprise in action: Data Warehouse / BI on System z IBM DB2 analytics accelerator OLTP data DB2 for z/os Tools InfoSphere Warehouse -Data Warehouse Modeling DB2 for z/os DWH DB2 for z/os Tools InfoSphere Warehouse Cubing Services IMS Tools Source Systems : DB2 IMS VSAM Non IBM InfoSphere Information Server and Heritage II Tools Complete ETL Solution The Enterprise Data Warehouse Cognos 10 BI, and Cognos Now! for Linux on System z SPSS Linux z Serving Up Consolidated Enterprise BI z/os LPAR Production Data z/linux IFL Tooling z/os LPAR Warehouse Data Industry Data Models Available z/linux IFL Tooling 38

39 The IBM zenterprise System: Now extending System z cost savings and value to a new dimension Designed to meet the need of today s heterogeneous data centers Enables a mixed set of workloads to be deployed on best fit technologies Delivers lower acquisition and operating costs than a one size fits all approach Reduces risk by extending the reach of System z qualities of service Improves service through tighter integration for multi-tier workloads The ideal platform for consolidation ZSP03408-USEN-16 39

40 Questions? 40

41 41