Planning and Sizing Virtualization. Jaqui Lynch Architect, Systems Engineer Mainline Information Systems

Transcription

1 Planning and Sizing Virtualization Jaqui Lynch Architect, Systems Engineer Mainline Information Systems 1 What is a CPU Chips are dual or quad core But in IBMese cpus = way = cores = processors 1 cpu = 1 way = 1 core = 1 processor So a 3 way is 3 processoors or cores Regardless of how many sockets Vendors tend to license by cores/cpus 1

2 What is Virtualization? Being able to dynamically move resources Being able to share resources Making better use of the resources Driving utilization up Etc etc etc Some think it is 4 3 Reasons to Partition Consolidation Hosting Production and Test on same hardware Multiple Operating Systems Consolidate Applications on different time zones Complying with license agreements Flexibility and scalability Optimization of resources 4

3 Supported Operating Systems AIX 6.1 SOD for 4Q7 AIX 5.3 Enables Virtualization when on Power5 TL6 required for Power6 AIX 5. Minimum of ML4 required for Power5 TL1 required for Power6 AIX 5.1 Will not run on Power5 systems Does not support: Dynamic LPAR Memory Capacity Upgrade on Demand Dynamic Processor Sparing Dynamic CPU Guard Suse Linux, Redhat EL AS The Linux.6 kernel versions provide full virtualization support except for DLPAR memory Check required ML levels for each box Check required microcode levels on HMC, System P boxes and cards, especially fiber cards 5 3

4 Other GA dates to plan around June 1, 7 AIX 5. TL1 AIX 5.3 TL6 June 8, 7 P 57 HMC code v7 and new HMC 7314-G3 I/O drawers 5 new PCI-E adapters Shared dedicated Sept 7, 7 P5-57 upgrade to 4.gb p 57 with 1 dimm slots Sept 14, 7 Utility COD Nov 16, 7 P5-57 upgrade to 4.gb p 57 with 8 dimm slots SODs RHEL5 AIX 6.1 Hot node add Partition mobility Cold node repair Redundant SVP on P6 7 Software Make sure HMC and all boxes are at the latest microcode level Double-check supported HMC, AIX and firmware matrix System P Microcode can be found at: Latest p5 microcode is SF4-3 as of May 9, 7 P6 microcode level will be announced shortly HMC Corrective Service can be found at: Latest HMC Software version (as of May 9, 7 )is Power 4/4+ - v3v3.7 (dated Mar 6) Power5 v4r5. v5.r.1 v6.r1. V7 (n/a 5/9) Power6 (and 5 and 5+) V7 (n/a 5/9) With v7 you can use a direct web interface instead of WebSM NO support for 7315 Don t forget BIOS updates which are at the HMC locations above As of March 4 HMC maintenance is now a customer responsibility. Planning Need to keep HMC software and BIOS up to date Backups of the HMC Server and card microcode/firmware updates AIX maintenance planning All links valid as of 5/9/7 4

5 Planning Power4/4+ or AIX 5. or dedicated Each Power4/4+ LPAR must have the following 1 processor 56mb memory 1 boot disk 1 adapter to access the disk 1 Ethernet adapter to access the HMC An installation method such as NIM A means of running diagnostics The above also applies to Power5 partitions running AIX v5. ML4 or earlier versions of RHAS and SLES Also applies to dedicated LPARs 9 Planning Power5 Each Power5 LPAR running AIX v5.3 (or higher) with APV must have the following 1/1 processor 18mb memory (really needs more than this to run) 1 boot disk (virtual or real) 1 adapter to access the disk (virtual or real) 1 Ethernet adapter to access the HMC (virtual or real) An installation method such as NIM A means of running diagnostics 1 5

6 Power5 Memory In POWER5 you always have a Hypervisor Some memory is reserved for LPAR use Hypervisor - 56mb HPT (Hypervisor Page Table) Entries 1 per partition Reserves 1/64 of maximum memory setting For or more LPARS expect overhead to be at least 1gb memory Use 8% of memory as an estimate of overhead Do not forget it!!!! SPT replaces LVT tool used to get estimates for Power Planning Power6 Similar requirements to Power5 1/1 of a processor, etc Need APV to enable micro-partitioning and virtualization features Similar memory overhead PCI-E and PCI-X not interchangeable so you must know where a card is going Each CEC has 4 x PCI-E and x PCI-X I/O drawers are PCI-X P 57 all six disks on one adapter One media bay per CEC Give up a PCI-E slot if adding RIO drawers 1 6

7 Role of the HMC Required to partition any box Can use HMC to manage systems Provides a console to manage hardware Detecting, reporting and storing changes in hardware Service focal point (requires Ethernet) Vterms to partitions CuOD Virtualization The Overseer! 13 HMC versus IVM Integrated Virtualization Manager An LPAR that acts as the HMC Provides single system partitioning without a Hardware Management Console (HMC) Creates LPARs Manages virtual storage and virtual Ethernet Eliminates the need to purchase dedicated hardware console Included at no additional charge with purchase of optional Advanced POWER Virtualization feature or POWER Hypervisor and VIOS features. Limitations Must own all resources in the box All resources must therefore be controlled by VIOS Aimed at 55 and below 14 7

8 Terminology Hypervisor MicroPartitioning Shared Processor Pool Capped Uncapped Virtual Processors Entitled Capacity Virtual I/O Server Virtual Ethernet Shared Ethernet Adapter (SEA) Virtual SCSI Server 15 Planning for Virtual Virtual Ethernet Included in all Power5 systems Allows for in-memory connections between partitions Requires AIX v5.3 or Linux Up to 56 per partition Does NOT require APV All virtual servers below require the Advanced Power Virtualization feature Virtual I/O Server Provides virtual I/O sharing for shared Ethernet and virtual SCSI partitions Owns the real resources Shared Ethernet Adapter Virtual SCSI 16 8

9 More on Virtual Shared Ethernet Adapter Used to allow partitions to share a real Ethernet adapter Saves on dedicated I/O slots and adapters Virtual SCSI Server Disks on I/O server are defined as logical volumes and exported to client systems Client systems see these as SCSI disks Excellent Redbook draft Introduction to Advanced Power Virtualization SG APV Advanced Power Virtualization Feature Included on 59 and 595 Optional on all other p5 boxes Enables: MicroPartitioning Virtual I/O Server Shared Ethernet Adapter Virtual SCSI Server Partition Load Manager 18 9

10 POWER5 / 5+ virtualization architecture Workload management and provisioning Hardware Management Console* (HMC) Hypervisor Service processor AIX 5L V5.3 partitions AIX 5L kernels AIX 5L V5. Processors Memory Expansion slots Linux partitions Linux kernels Local devices and storage i5/os ** SLIC Virtual Networks Virtual Processors Virtual I/O Server VEnet VSCSI IVM* Unassigned on demand resources Virtual Storage Networks and network storage * Integrated Virtualization Manager (IVM) is disabled if HMC attached **Available on selected p5-57, p5-59 and p5-595 models 14 Micro-Partitioning Mainframe inspired technology Virtualized resources shared by multiple partitions Benefits Finer grained resource allocation More partitions (Up to 54) Higher resource utilization New partitioning model POWER Hypervisor Virtual processors Fractional processor capacity partitions Operating system optimized for Micro-Partitioning exploitation Virtual I/O 1

11 Shared processor partitions Micro-Partitioning allows for multiple partitions to share one physical processor Up to 1 partitions per physical processor Up to 54 partitions active at the same time One shared processor pool Dedicated processors are in the pool by default if their LPAR is powered off Partition s resource definition Minimum, desired, and maximum values for each resource Processor capacity (processor units) Virtual processors Capped or uncapped Capacity weight Dedicated memory Minimum of 18 MB and 16 MB increments Physical or virtual I/O resources 1 Micro-Partitioning technology Dynamic LPARs Whole Processors AIX 5L V5. Entitled capacity AIX 5L V5.3 AIX 5L V5.3 Max Min Micro-partitions Pool of 6 CPUs Linux Hypervisor AIX 5L V5.3 Linux Note: Micro-partitions are available via optional Advanced POWER Virtualization or POWER Hypervisor and VIOS features. i5/os V5R3** Micro-Partitioning technology allows each processor to be subdivided into as many as 1 virtual servers, helping to consolidate UNIX and Linux applications. Partitioning options Micro-partitions: Up to 54* Dynamic LPARs: Up to 3* Combination of both Configured via the HMC Number of logical processors Minimum/maximum Entitled capacity In units of 1/1 of a CPU Minimum 1/1 of a CPU Variable weight % share (priority) of surplus capacity Capped or uncapped partitions *on p5-59 and p5-595 ** on p5-57, p5-59, and p

12 Logical, Virtual or Real? In shared world there is no one to one relationship between real and virtual processors The dispatch unit becomes the VP 3 Math 11 and Consolidation Consolidation Issues Math 11 4 workloads A 6.3 B.7 C.48 D 4.87 Total = The proposed 8way is rated at LPARs use dedicated processors Is it big enough to run these workloads in 4 separate dedicated LPARs? NO 4 1

13 Why micropartitioning is important 8w 1.45g p65 is rperf w 1.45g p65 is 4.43 rperf So 1w is probably.1 Now back to Math 11 Wkld Rperf Processors Needed on p65 A (6.64) B.7 ( is >.1) C.48 ( is >.1) D ( is > 4.4) Total = (.1) Watch for granularity of workload 5 On Micropartitioned p5 8w 1.45g p65 was rperf 4w 1.65g p55q is.5 rperf So 1w on 55Q is probably 5.6 BUT we can use 1/1 of a processor and 1/1 increments Now back to Math 11 Wkld Rperf Processors Processors 65 55Q A B.7.45 C D Total = Watch for granularity of workload On the p5 we use fewer processors and we fit! p6 is even better! 6 13

14 Defining Processors Minimum, desired, maximum Maximum is used for DLPAR Shared or dedicated For shared: Capped Uncapped Variable capacity weight ( is default) Weight of is capped Minimum, desired and maximum Virtual Processors 7 Virtual Processors Partitions are assigned PUs (processor units) VPs are the whole number of concurrent operations Do I want my.5 as one big processor or 5 x.1 (can run 5 threads then)? VPs round up from the PU by default.5 Pus will be 1 VP.5 Pus will be 3 VPs You can define more and may want to Basically, how many physical processors do you want to spread your allocation across? This has charging implications VPs put a cap on the partition if not used correctly i.e. define.5 PU and 1 VP you can never have more than one PU even if you are uncapped Cannot exceed 1x entitlement VPs are dispatched to real processors Dispatch latency minimum is 1 millisec and max is 18 millisecs VP Folding Maximum is used by DLPAR Use commonsense when setting max VPs!!! 8 14

15 Virtual I/O Server Custom AIX v5.3 partition Commands have been customized Provides services for: Shared Ethernet Adapter Built on Virtual Ethernet Virtual SCSI Server Owns the physical resources Run if in production Can you have your cake and eat it? Can use multipath I/O Can do Etherchannels Maximum of virtual I/O slots Max of 56 VIO slots per partition Do not run other workloads here But do set tunables 9 Advanced POWER Virtualization option 1 CPU Virtual I/O server partition IVM Storage sharing Ethernet sharing Manager Server CPUs Linux Dynamically resizable 1 CPU i5/os V5R3** 4 CPUs AIX 5L V5. 6 CPUs AIX 5L V5.3 Virtual I/O paths Hypervisor PLM partitions LPAR 1 LPAR AIX 5L V5. AIX 5L V5.3 PLM agent PLM agent Hypervisor 6 CPUs Micro-Partitioning AIX 5L V5.3 Linux Linux AIX 5L V5.3 AIX 5L V5.3 Unmanaged partitions LPAR 3 Linux AIX 5L V5.3 AIX 5L V 5.3 Virtual I/O Server Shared Ethernet Shared SCSI and Fibre Channel-attached disk subsystems Supports AIX 5L V5.3 and Linux* partitions Micro-Partitioning Share processors across multiple partitions Minimum partition 1/1 th processor AIX 5L V5.3, Linux*, or i5/os** Partition Load Manager Balances processor and memory request No longer a default on P6 Managed via HMC or IVM*** * SLES 9 or RHEL AS 4 and above **Available on selected p5-57, p5-59 and p5-595 models ***IVM on p5-56q and below 5 15

16 Virtual Ethernet Enables inter-partition communication. In-memory point to point connections Physical network adapters are not needed. Similar to high-bandwidth Ethernet connections. Supports multiple protocols (IPv4, IPv6, and ICMP). No Advanced POWER Virtualization feature required. POWER5 Systems AIX 5L V5.3 or appropriate Linux level Hardware management console (HMC) 31 Virtual networking External Servers Virtual Ethernet helps reduce hardware costs by sharing LAN adapters VIOS POWER5 Server Micro-partitions VLAN 1 VLAN VLAN 3 vscsi vlan AIX 5L V5.3 Linux AIX 5L V5.3 Linux Ethernet Switch Virtual Ethernet Partition to partition communication Requires AIX 5L V5.3 and POWER5 Shared Ethernet Adapter Provides access to outside world Uses Physical Adapter in the Virtual I/O Server VLAN Virtual LAN Provide ability for one adapter to be on multiple subnets Provide isolation of communication to VLAN members Allows a single adapter to support multiple subnets Shared Ethernet Adapter Virtual Ethernet Switch POWER Hypervisor IEEE VLANS Up to 496 VLANS Up to venet adapters 1 VLANS per venet adapter 7 16

17 Virtual SCSI Allows sharing of storage devices Vital for shared processor partitions Overcomes potential limit of adapter slots due to Micro- Partitioning Allows the creation of logical partitions without the need for additional physical resources Allows attachment of previously unsupported storage solutions 33 Virtual SCSI External Storage A1 B1 A B B3 A3 B4 A4 A5 B5 VIOS owns physical disk resources LVM based storage on VIO Server Physical Storage can be SCSI or FC Local or remote Virtual I/O helps reduce hardware costs by sharing disk drives Shared Fiber Chan Adapter Shared SCSI Adapter v S C SI VIOS POWER5 Server Micro-partitions v L A N AIX 5L V5.3 Linux Virtual SCSI POWER Hypervisor AIX 5L V5.3 A1 A B1 B B3 Linux A3 Micro-partition sees disks as vscsi (Virtual SCSI) devices Virtual SCSI devices added to partition via HMC or IVM LUNs on VIOS accessed as vscsi disk VIOS must be active for client to boot Multiple LPARs can use same or different physical disk Configure as logical volume on VIOS Appear a hdisk on the micro-partition Can assign entire hdisk to a single client 9 17

18 Workload Manager Around since AIX v4.3.3 Used to control resources in one O/S instance Controls: CPU Memory I/O Bandwidth References: SG AIX 5l Workload manager Search on Jaqui Lynch There is a WLM article in there 35 Capacity on Demand for POWER5 and POWER5+ systems Capacity Upgrade on Demand Upgrade system with processors and/or memory No special contracts, no required monitoring (no ability to turn off the capacity) Purchase an activation On/Off Capacity on Demand Temporary use of requested number of processors or amount of memory Client selects the capacity and activates the resource (registered system) Capacity can be turned on and off by the client Information reported to IBM Reserve Capacity on Demand Processor resources only (processor days) Capacity can be turned on and off by the client Prepaid debit agreement Requires AIX 5L V5.3 or Linux and Advanced POWER Virtualization Trial Capacity on Demand Allow clients to test the effects of additional processors and/or memory Partial or total activation of processors and memory Resources available for fixed time Available on select models 18

19 Capacity on Demand for POWER6 systems Capacity Upgrade on Demand Upgrade system with processors and/or memory No special contracts, no required monitoring (no ability to turn off the capacity) Purchase an activation On/Off Capacity on Demand Temporary use of requested number of processors or amount of memory Client selects the capacity and activates the resource (registered system) Capacity can be turned on and off by the client Information reported to IBM Utility Capacity on Demand (3Q7) Processor resources within the Shared Processor Pool only Usage measured in processor minute increments Capacity can be turned on and off by the client Billing based on usage reported via a website interface Trial Capacity on Demand Allow clients to test the effects of additional processors and/or memory Partial or total activation of processors and memory Resources available for fixed time 37 Hints and Tips Which LPAR is your service LPAR? How will you do installs Allocate cd? NIM? Backup Methodology? Especially for HMC!! If using virtualization planning is more critical than ever Ensure Inventory scout is working on all LPARs and that VPD is being uploaded to IBM can now use Web SSL instead of dial or VPN Create a partition layout in advance Include devices, etc I/O devices are allocated at the slot level Are cards going in CEC or I/O drawer? Which I/O drawer? Affects the number of PCI-E and PCI-X adapters Boot disks I/O drawer or 14, Raid, Fiber Have VIOS control all boot disks? P6 CEC one LPAR owns all 6 disks P5 CEC 6 disks are split into x 3 packs and each trio can be owned by a different LPAR Check the number of LPARs per boot disk 3bit kernel versus 64bit kernel 3 bit supports up to 96gb memory Need 64bit kernel to have more than 96gb in an LPAR Need 64bit kernel for more than 16 processors in an LPAR Moot point as no 3 bit in AIX v6.1 anyway 38 19

20 PLANNING SHEET NOTE - NIM server will use onboard ethernets Dual port 6.53 Copper Instance Boot ram fiber ethernet VPS cpu rperf SPP VIO VIO VIO Disks 57.g p57.g CPUS BOOT ETHER SAN lp N N N N lp Y Y Y Y lp Y Y Y Y lp Y Y Y Y NIM N N N N Overhead 4 VIO Server VIO Server server Total adapters 7 Then have an additional spreadsheet that maps each lpar to adapters And I/O drawers, etc First disk on each VIO server is the VIO server rootvg, not for servicing client LPARs Documentation is critical do it ahead of time More Sizing - original Server LPAR CPUs Memory rperf AIX KVA Watts BTU/hr GB p ghz 4 way LPAR LPAR p ghz 4 way LPAR LPAR p ghz 4 way LPAR LPAR p ghz 4 way LPAR LPAR p ghz 8 way LPAR LPAR LPAR LPAR p ghz 8 way LPAR LPAR x I/O drawers rperf taken from rsperfs146.doc from IBM

21 So, let s assume we can migrate everything to AIX v5.3 and take advantage of micro-partitioning. Let s also assume we have policies in place as follows: Per LPAR x fiber cards x internal boot disks x 1/1/1 Ethernet cards 4gb memory per processor if database gb memory per processor for other In the unconsolidated environment above we would have the following: Disks 8 Fiber cards 8 Ethernet cards 8 Memory 88GB + 8% overhead = 96GB Processors 3 x 1.65ghz rperf 71.4 If we moved this to a purely AIX v5.3 environment (no VIOS) on the new p5+-57 with 1.9ghz processors using shared processors we would require the following: Disks 8 Fiber cards 8 Ethernet cards 8 Memory 88GB + 8% overhead = 96GB Processors 14 x 1.9ghz rperf NB rperf for p5 assumes SMT is turned on. If running 5. or without SMT then divide the number by 1.3 Given the architecture of the 57 we would have the ability to boot 8 LPARs of our total 14 from 3- packs in the CECs. So we would need additional I/O drawers for the other 6. The 57 also provides only 4 PCI-X slots total so an additional 3 slots would be needed in I/O drawers. A 7311-D I/O drawer provides 7 PCI-X slots and x 6-packs for disk. So we would need a total of 5 x I/O drawers to support the necessary cards. 3 of the I/O drawers would also each have 4 disks ( per 6-pack) to support the final 6 lpars boot disks Environmentals on the new configuration would look like this: Servers KVA Watts BTU/HR OLD 9.4 8,58 8, way 1.9g , 17,748 5x7311-D 1.8 1,7 5,85 TOTAL 7.7 6,9 3,553 SAVINGS ,68 5,96 1

22 Adding VIOS LPAR Fiber Ethernet Disks Uses Disk Fiber Ethernet OLD Old VIO? NEW NEW NEW LPAR1 y LPAR y LPAR3 y LPAR4 y LPAR5 y LPAR6 y LPAR7 y LPAR8 y LPAR9 n LPAR1 n LPAR11 n LPAR1 n LPAR13 n LPAR14 n VIOS (uses 3gb) y Savings over old Saves slots and can Reduce by I/O drawers Note assumes VIO servers booting from internal disk and providing client boot disks from SAN Sizing thoughts Correct amount of processor power Balanced memory, processor and I/O Min, desired and max settings and their effect on system overhead Memory overhead for page tables, TCE, etc Shared or dedicated processors Capped or uncapped If uncapped number of virtual processors Expect to safely support 3 LPARs booting from a 146gb disk through a VIO server Don t forget to add disk for LPAR data for clients 44

23 Ethernet See chapter 6 of SG redbook Advanced POWER Virtualization on IBM Eserver p5 Servers: Architecture and Performance Considerations for information on Vlan benchmark results with different processing power and mtu sizes Short summary MTU=15 needs 1 x 1.65ghz processor per gigabit adapter to drive the adapter fully MTU=9 needs about half a processor Has calculators in there for sizing for SEA 51mb memory is fine if only SEA as buffers and data structures are fairly small Other Memory Needs (P6) Each active ethernet port 1MB So quadport on base is 48MB overhead 45 Virtual SCSI See chapter 6.8 of SG redbook Short summary A little extra latency using virtual scsi (.3 to.6 ms per I/O) Memory allocation is critical For large I/O configurations and high data rates VIOS may need 1gb Processor allocation is critical has calculations for processors needed depending on workload 46 3

24 Other sizing Workload estimator Used to size servers with one or more workloads System Planning Tool Virtual I/O Server Sizing Guidelines Whitepaper Covers for ethernet: Proper sizing of the Virtual I/O server Threading or non-threading of the Shared Ethernet Separate micro-partitions for the Virtual I/O server Other k.htm m SPT 1 4

25 SPT SPT 3 5

26 SPT4 Maximums 54 partitions per server or 1 * # processors (whichever is smaller) HMC 3 servers/54 partitions 64 Virtual processors per partition 56 Virtual Ethernet adapters per partition 1 VLANs per VE adapter 16 VEs per physical adapter (SEA) with 1 VLANS per 5 6

27 LPAR Notes Power5 Max LPARS = 1x #processors Only Power5 or 5+ on the same HMC if at v6 Current 731 HMC can be upgraded to v7 to add Power6 support All use 19 racks but very specific power needs p5-5 and p5-55 Only 7311-D I/O drawer supported Comes with 1 x 4pack internal another can be added P5-56Q Similar to p5-57 but no I/O drawers, uses quadcore and only modules p5-57 (each 4-way) x 3 packs of disk internal (on separate SCSI buses) Supports x LPARs without extra SCSI cards 7311-D I/O drawer has x 6 packs SCSI cards needed and must be in slots 4 and 7 P5s Require AIX v5. ML4 at a minimum 53 LPAR Notes Power6 Max LPARS = 1x #processors Power5, 5+ and 6 on the same HMC (731 v7 or 74) 7315 HMC not supported Requires HMC code v7 Can use new Web interface All use 19 racks but very specific power needs p6-57 (each 4-way) 1 x 6 packs of disk internal (on one SCSI bus per six-pack) 1 x media bay per Supports 1 x LPAR without extra SCSI cards Supports 7311-D, 7311-D11 RIO drawers but you have to give up a PCI-E slot 7311-D I/O drawer has x 6 packs SCSI cards needed and must be in slots 4 and 7 Supports new G3 drawer without using a PCI-E slot To get redundancy you must have 3 x FC 565 power regulators per CEC P6 requires AIX v5. TL1 or AIX v5.3 TL6 or an enabled version of Linux 54 7

28 55 IVE Notes Adapter ties directly into GX Bus No Hot Swap No Swap Out for Different Port Types (1GbE, etc.) Not Supported for Partition Mobility, except when assigned to VIOS Option 1 on Previous Chart Partition performance is the same as a real adapter No VIOS Overhead Intra-partition performance may be better than using Virtual Ethernet 56 8

29 Planned Live Partition Mobility with POWER6 Allows migration of a running LPAR to another physical server Reduce impact of planned outages Relocate workloads to enable growth Provision new technology with no disruption to service Save energy by moving workloads off underutilized servers Movement to a different server with no loss of service Virtualized Virtualized SAN SAN and and Network Network Infrastructure Infrastructure 57 Partition Mobility Pre-Reqs All Systems in a Migration Set must be managed by the same HMC HMC will have orchestration code to control migration function All Systems in a Migration Set must be on the same subnet. All Systems in a Migration Set must be SAN connected to shared physical disk no VIOS LVM-based disks. ALL I/O must be shared/virtualized. Any dedicated I/O adapters must be deallocated prior to migration. Systems must be firmware compatible (within one release) 58 9

30 Partition Mobility Other Considerations Intended Use: Workload Consolidation Workload Balancing Workload Migration to Newer Systems Planned CEC outages for maintenance Unplanned CEC outages where error conditions are picked up ahead of time. What it is not: A Replacement for HACMP or other clustering. Not automatic LPARs cannot be migrated from failed CECs Failed OS s cannot be migrated Long Distance Support Not Available in First Release 59 POWER6 Rollout Other Random Items AIX Version 6.1 Open Beta Starts July/August 7 Open to everyone P5 / p5+ Upgrades to POWER6 have a lot of rules/regulations and varying dates of availability. Note new Service Stategies for both AIX (5.3 TL6) and Firmware Starting with TL6 support will last for years on single TL. New hardware support will no longer be tied to a TL. This is it. Service Agent is required on POWER6 systems and will be part of CE Installation Look at Tivoli and IBM Director for Comprehensive Systems Management Performance and Capacity ITM Keeping Track of Everything TADDM / CCMDB 6 3

31 Tools lparstat h percentage spent in Hypervisor and number of Hcalls lparstat i Info on entitled capacity, setup info, etc mpstat s SMT info mpstat d Detailed affinity and migration statistics sar P ALL topas L nmon Note you can t chargeback by processor or %user anymore as you will see 61 Traps for Young Players Under-sizing VIOS Over-committing boot disks Forgetting Memory and processor Overhead Planning for what should and should not be virtualized Misunderstanding needs Workload Granularity Undersizing memory and overhead Hypervisor I/O drawers, etc VIOS requirements Setting maximums Chargeback and capacity planning may need to be changed 6 31

32 References IBM Redbooks These are updated regularly SG4-794 Advanced Power Virtualization on IBM p5 servers Introduction and Basic Configuration SG Advanced Power Virtualization on IBM p5 servers Architecture and Performance Considerations SG Virtualization and Clustering Best Practices Red piece 4194 Advanced Power Virtualization Best Practices Red piece 44 APV VIOS Deployment Examples The Complete Partitioning Guide for IBM eserver System P Servers System P LPAR Planning Redpiece Logical Partition Security in the IBM eserver pseries 69 Technical Overview Redbooks for p5, p55 and p57, etc SG Partitioning Implementation on p5 and Openpower Servers eserver Magazine Several articles focused on Virtualization Find more on Mainline at: 63 Questions? 64 3