Using Advanced Features on Cisco UCS Dan Hanson, Technical Marketing Manager, Data Center Group 2
UCS Bundled Upgrades Useful for Staging, Labs, and Non Productions This does a very quick fast upgrade with internal coordination No need to step through component level upgrades Complete UCS system outage (not the server, but I/O) is tradeoff 3
Checking Firmware Conformance To Ensure the Servers and Infrastructure Firmware are all at a consistent version This is a very useful method to check and ensure firmware interrelations are at supported level This is one of the most key items with customer cases Infrastructure Check B and C package Check 4
Port Channels within UCS System For Balance and Availability Port Channels on Gen 2 HW 62xx, 22xx, VIC 12xx Between Gen2 HW we can channel, otherwise discreet links that use pinning VIC 12xx to IOM 22xx This will always channel from the server to the IOM (5 tuple) Not user configurable IOM 22xx to FI 62xx This can be configured per the drawing when chassis acknowledged 5
UCS 62xx Fabric Interconnect and Unified Ports Can modify the Ethernet and/or FC port types in blocks via slider Reboot required today
Fabric Hot Spot Monitoring and Reporting/Alerting Internal Fabric Hot Spots of periodic saturation (set measurement to 30s interval) Uplink periodic saturation reporting from the UCS side to the Data Center
Fabric Hot Spot Monitoring and Reporting/Alerting Internal Fabric Hot Spots of periodic saturation (set measurement to 30s interval) Uplink periodic saturation reporting from the UCS side
Fabric Monitoring and Reporting/Alerting Create alerts based on these hot spots of congestion Syslog of this Alerts to external systems
Schedules / Maintenance Policies Schedule definition for one time vs. recurring
Schedules / Maintenance Policies Assigning a schedule to a maintenance policy Pending Changes will fire, but no PNUOS activity
Smart Call Home Call Home for defined events Mail events to TAC, and customer help desk Can define the priority at which to send messages Not 1:1 Alerts to Call Home events, what would we want?
Smart Call Home Profiles for whom to alert
Smart Call Home Enable/Disable Policies System Inventory to TAC
UCS v2.x and Segmented Layer 2 Networks LAN 2 VLAN List Uplink Group Server Interface List UCS Fabric Interconnects LAN 1 LAN 3 UCS Forwarding Boundary 10,11,12 E1/1,E1/2 Blade1 NIC0 & NIC1, Blade 2 NIC0 20,21,22 E1/10,E1/11 None Chassis (1-20) Adapter s Fabric Extender Fabric Extender 30,31,32 E1/20,E1/21 Blade 2 NIC1, Blade 3 NIC0 & NIC1 Adapter Adapter Adapter 501 FC0,FC1 Blade 1 vhba0, Blade 2 vhba0 Half Width Blade Network1 Half Width Blade Network1,3 Half Width Blade Network3
UCS v2.x and Segmented Layer 2 Networks Mapping VLANs to Uplinks Uplink ports or channels Pinning within a group of ports VLAN Pruning to match G port
vnic vnic vnic vnic Fabric Failover Fabric Failover at Adapter Level LAN SAN A SAN B ~1s mapping No OS teaming/bonding drivers Always recommend unless HW cannot support, or Virtualization host Using this? UCS Fabric Interconnects Chassis VIC or Menlo Fabric Extender Fabric Extender Adapter Adapter Half Width Blade Half Width Blade
vnic vnic vnic vnic Traffic Uplink Balancing Multiple uplinks from UCS fabric LAN SAN A SAN B Port Channels or Discrete links (no MCEC) System evaluates link loads and re-balances based on numbers of VIFs mapped Run every 300s UCS Fabric Interconnects Chassis Fabric Extender Fabric Extender VIC or Menlo Adapter Adapter Half Width Blade Half Width Blade
vnic Templates Catalogs of Adapters with allowed networks Updating Templates in most cases (to easily add VLANs to multiple servers in UCS)
vhba Templates Catalogs of HBA s with allowed storage fabrics Updating Templates in most cases
Updating SP Templates Updating SP Templates to make mass changes Maintenance Policies block any outage-forcing events Audit for conformance to approved template
Server Pre-Provisioning WWPN Export for zoning Install Server to LUN, then archive until chosen HW arrives Can create complete server infrastructures right away, only wait on HW as final close
Server Pools and Qualification Policies Pool servers by location Pool servers within a chassis or between them Blade or Rack
Server Pools and Qualification Policies Can qualify server by attributes prior to adding to pool Can qualify server within given pools by attributes within the Service Profile
De-commission of Server in Pool for in-hours maintenance Hardware Failure/Issue of a Server in a Pool If blade is in a given pool it can be decommissioned and the service profile will automatically move to next server in pool Check against server pool qualification policy prior to moving Ensures very short recovery time, later forensic analysis Instead of off-hours troubleshooting, decommissioned servers can be examined and/or replaced during business hours on weekly/monthly basis On site facilities personnel can replace decommissioned hardware Reduce rolls of IT professionals to remote DCs -Allow facilities professionals ability To swap equipment in-hours
Common Sparing with Organizations Pools of objects are created within a given organization MAC WWNN WWPN UUID Etc. Name of pool is the key when we are utilizing via the profile If pool is exhausted then UCS recursively looks up to parent organization until root If pool with same name exists, that resource will be used This applies also to pools of servers themselves UCS can then support a common spare set of servers even with different attributes (as qualification policies will ensure service level) Organizations can then back-fill the server blades that were used
Fiber Channel Port Channel and Trunking Put multiple ports in a port channel to MDS Can handle individual link loss without new FLOGI or reliance on multipathing SW Can handle multiple VSANs on trunked ports
Blade and Rack Management Integrated Blade and Rack Management and Training Profiles can be applied to both/either PCIe Slots now open, more DAS, etc. FEX with 2232 on v2.0(2)
Bandwidth (Gbps) VMDirectPath 2 and ESXi5.0 12 Temporary transition from VMDP to standard I/O 10 8 6 vmotion to secondary host 4 2 0 0 10 20 30 40 50 60 70 Time (sec) 8GB VM, sending UDP stream using pckgen (1500MTU) UCS B200 blades with UCS VIC card vsphere technology preview
Easy VM-FEX Tool Tool to simplify the administrative setup between UCS, vcenter, ESX hosts (v4.1 and 5.0) On CDN
Easy VM-FEX and SPAN, Counters, Security, etc. Ethernet Uplink Ports 7 8 5 6 Fiber Channel Uplink Ports 1 2 Fiber Channel Uplink Ports 1 2 Ethernet Uplink Ports 5 6 7 8 Mgmt Uplink 0 UCS Fabric Interconnect A (port profiles) Virtual Interface Control Logic VN Tag @ 10Gbe UCS Fabric Interconnect B (port profiles) Virtual Interface Control Logic Mgmt Uplink 0 Internal Connections 1 2 3 4 5 6 1 UCS 6x00 Physical Ports 2 3 4 5 6 UCS 6x00 Physical Ports Chassis IOM Ports Server Ports 1 2 3 4 Chassis IO Module A 1 2 3 4 5 6 7 8 vcenter Controlled interfaces on VMs with forwarding rules enforced on dynamic adapters and signaled on Private Interfaces 1 2 3 4 Chassis IO Module B Chassis IOM Ports 1 2 3 4 5 6 7 8 Server Ports Cisco Adapter 0 1 VIC CPU CIMC KVM etc.
Easy VM-FEX and SPAN, Counters, Security, etc. Mgmt Uplink 0 VM-FEX veth10 Ethernet Uplink Ports 7 Server Ports 8 Chassis IOM Ports Cisco Adapter 5 6 1 2 Fiber Channel Uplink Ports UCS Fabric Interconnect A (port profiles) veth3 veth4 vfc0 vfc1 veth3 veth4 veth10 3 4 Chassis IO Module A 1 2 3 4 5 6 7 8 1 2 Virtual Interface Control Logic VN Tag @ 10Gbe Internal Connections 1 2 3 4 5 6 1 UCS 6x00 Physical Ports vcenter Controlled interfaces on VMs with forwarding rules enforced on dynamic adapters and signaled on Private Interfaces 1 2 0 1 VIC CPU Fiber Channel Uplink Ports 1 2 Virtual Interface Control Logic 2 3 4 5 6 3 4 Chassis IO Module B Ethernet Uplink Ports UCS Fabric Interconnect B (port profiles) 1 2 3 4 5 6 7 8 5 6 UCS 6x00 Physical Ports Chassis IOM Ports 7 8 Server Ports Attempts by Guest OS to improperly mark traffic blocked Mgmt Uplink 0 vhba0 HBA 0 ESX 4.0u1+ vnic1(s) CIMC KVM etc. d-vnic3 ESX Kernel Pass Through Module Kernel d-vnic4 Service Console vnic2(s) vhba1 HBA 1
Easy VM-FEX and SPAN, Counters, Security, etc. Mgmt Uplink 0 VM-FEX veth10 Server Ports veth1 veth2 veth3 veth4 vfc0 vfc1 veth1 veth2 veth3 veth4 veth10 Chassis IOM Ports 1 2 Fiber Channel Uplink Ports 7 8 5 6 1 2 UCS Fabric Interconnect A (port profiles) Cisco Adapter 3 4 Virtual Interface Control Logic Chassis IO Module A 1 2 3 4 5 6 7 8 VN Tag @ 10Gbe Internal Connections 1 2 3 4 5 6 1 UCS 6x00 Physical Ports vcenter Controlled interfaces on VMs with forwarding rules enforced on dynamic adapters and signaled on Private Interfaces 1 2 0 1 VIC CPU Fiber Channel Uplink Ports 1 2 UCS Fabric Interconnect B (port profiles) Virtual Interface Control Logic 2 3 4 5 6 3 4 Chassis IO Module B 1 2 3 4 5 6 7 8 5 6 UCS 6x00 Physical Ports Chassis IOM Ports 7 8 Server Ports Attempts by Guest OS to improperly mark traffic blocked 0 Mgmt Uplink vhba0 HBA 0 ESX 4.0u1+ CIMC vnic1(s) d-vnic1 d-vnic2 KVM etc. d-vnic3 d-vnic4 vnic2(s) ESX Kernel Pass Through Module Kernel Service Console vhba1 HBA 1
Easy VM-FEX and SPAN, Counters, Security, etc. Set SPAN destination on UCS port Analyze traffic directly on VM vnic in either direction
Advanced Features Recommended Viewing UCS Advantage Videos on YouTube www.youtube.com/ciscodatacenter Playlist UCS Technical Videos http://www.youtube.com/ciscodatacenter#p/c/f04a2c6aa04df055 Overview Cisco UCS Advantage http://www.youtube.com/watch?v=iw4zhxijppu 35
Advanced Features Recommended Viewing Category Title URL UCS server Service Profiles and Templates http://www.youtube.com/watch?v=jw-ytvn75r0 UCS server Organizations and Roles http://www.youtube.com/watch?v=tb-l0zv3if UCS server Extended Memory Technology http://www.youtube.com/watch?v=ks3ehprcvdo UCS server Server Pre-Provisioning http://www.youtube.com/watch?v=o7buee3hnpe UCS server BIOS Policies http://www.youtube.com/watch?v=pr6eptc9jxq UCS server RAID Policies http://www.youtube.com/watch?v=vcs56wjuwui UCS server Firmware Policies http://www.youtube.com/watch?v=vjj8xz0nqi4 UCS server Server Pools and Qualification Policies http://www.youtube.com/watch?v=ktw7m3t-vow UCS server Maintenance Policies http://www.youtube.com/watch?v=qqtlm98ngti UCS server High Availability During Upgrades http://www.youtube.com/watch?v=57hxmgn88ha UCS server Monitoring with BMC BPPM http://www.youtube.com/watch?v=mdoezf7tm5e UCS server Microsoft Hyper-V on UCS http://www.youtube.com/watch?v=g3x_yoyk-fo 36
Advanced Features Recommended Viewing Category Title URL UCS I/O Adapter Templates http://www.youtube.com/watch?v=kpven3dhfom UCS I/O Network Interface Virtualization http://www.youtube.com/watch?v=njjbceblxvc UCS I/O Adapter Fabric Failover http://www.youtube.com/watch?v=tlu8rsq6t_m UCS I/O Extend the Network to the Virtual Machine http://www.youtube.com/watch?v=ylizxq18yxe UCS I/O Traffic Analysis of All Servers http://www.youtube.com/watch?v=phtdxy_8zdg UCS I/O Ethernet Switching Modes http://www.youtube.com/watch?v=rox8mrn66um UCS I/O Fibre Channel and Switch Modes http://www.youtube.com/watch?v=vsetsgoyyco UCS I/O FC Port Channels and Trunking http://www.youtube.com/watch?v=ppzkpgurtxc 37
Advanced Features Recommended Viewing Category Title URL UCS Infrastructure UCS Infrastructure UCS Infrastructure UCS Infrastructure UCS Infrastructure UCS Infrastructure Lights-Out Management Easy VM-FEX Deployment Server Power Grouping Blade and Rack-Mount Management Manager Platform Emulator Cisco Developer Network and Sandbox http://www.youtube.com/watch?v=qeo1d_1vtxs http://www.youtube.com/watch?v=0aauj80cnvg http://www.youtube.com/watch?v=egofe33yod8 http://www.youtube.com/watch?v=aosx4ymioho http://www.youtube.com/watch?v=znnrs2e0wvk http://www.youtube.com/watch?v=syhl6saiwew 38
Complete Your Online Session Evaluation Give us your feedback and you could win fabulous prizes. Winners announced daily. Receive 20 Passport points for each session evaluation you complete. Complete your session evaluation online now (open a browser through our wireless network to access our portal) or visit one of the Internet stations throughout the Convention Center. Don t forget to activate your Cisco Live Virtual account for access to all session material, communities, and on-demand and live activities throughout the year. Activate your account at the Cisco booth in the World of Solutions or visit www.ciscolive.com. 39
Final Thoughts Get hands-on experience with the Walk-in Labs located in World of Solutions, booth 1042 Come see demos of many key solutions and products in the main Cisco booth 2924 Visit www.ciscolive365.com after the event for updated PDFs, ondemand session videos, networking, and more! Follow Cisco Live! using social media: Facebook: https://www.facebook.com/ciscoliveus Twitter: https://twitter.com/#!/ciscolive LinkedIn Group: http://linkd.in/ciscoli 40
BRKCOM-2005