Hyper-V Performance Troubleshooting

Transcription

1

2 Hyper-V Performance Troubleshooting Jan Marek Microsoft MVP MCC MCT MCSE MCSD Head of CDM & KPCS CZ

3 Host (Hardware) Latest BIOS/UEFI Hardware Power Profile and OS Power Options HyperThreading? Latest NICs firmware and drivers (but test, test and test!) Do not disable VMQ TCP Chimney Offload is not supported on teamed (sw) NICs Enable Jumbo Frames for CSV, iscsi and LM networks Disable Non-iSCSI communication types on iscsi NICs

4 Host (Hardware) Don t use NIC teaming for iscsi NICs use MPIO NIC teaming inside guest OS (sw-dep) should use SR- IOV NICs Use 4k native disks Use ReFS file system for drives hosting VHD(X) or use 64k allocation unit size (NTFS) for drives hosting VHD(X) Use auto-size for Page File Do NOT use MemoryReserve reg key

5 Host (OS) Use Core Installation (..Nano?) Windows Update + Hotfixes Configure Defender! Antivirus Exclusions &

6 Host (Hyper-V) Only Hyper-V role Avoid multiple Virtual Network Switches (use VLANs) Do NOT share adapter with physical OS NIC Teams vs. SET Do NOT leave Hyper-V Manager running use remoting use PoSh Remoting/Direct Leave Host NUMA enabled in most cases

7 DEMO CPU

8 Virtual Machine Supported Guest OS on Hyper-V 2016

9 Virtual Machine Supported Guest OS on Windows 10 Hyper-V

10 Virtual Machine Dynamic Memory hour 2 hours High Weight 3 hours 4 hours 5 hours 6 hours 7 hours Minimum Demand Assigned 8 hours hour 2 hours Low Weight 3 hours 4 hours 5 hours 6 hours 7 hours Minimum Demand Assigned 8 hours

11 DEMO Memory

12 Virtual Machine Use Legacy Network Adapter only for PXE boot (Gen 1) Remove unused vdevices (Gen 1) Parent Partition Driver VSP VMbu s SYNTHETIC LEGACY VM hypervisor hardware

13 What is this?

14 Intel = Legacy Network Adapter

15 DEMO Network

16 Virtual Machine Use Generation 2 for Windows Guest

17 Virtual Machine Use Generation 2 for Linux Guest

18 Emulated vs. Synthetic Generation 1 VM Generation 2 VM

19 Virtual Machine Install or Update Integration Services via Windows Update Leave VM on logon screen + disable screen saver Do NOT use VMconnect as a standard to connect to VM Disable background activities inside the VM: SuperFetch Windows Search Scheduled Tasks (Defrag, ) Aero (optimize for performance)

20 Virtual Machine Avoid using DHCP Guard and Router Guard ~ Performance Don t forget to turn off Port Mirroring after use

21 VM Storage Avoid Checkpoints Use Production Checkpoints Avoid vide for data disks (Gen 1) Use VHDX (instead of VHD or PT) Fixed VHDs are recommended Dynamic VHDXs are recommended (?, let s talk ) Use Virtual HBAs only if needed Use Storage QoS Use BitLocker (Key Storage Providers, vtpm) (?, let s talk..)

22 Tweaking for IOPS AKA Hyper-V storage NUMA I/O Each channel can send SCSI interrupts to multiple processors concurrently Adding more channels adds IOPS potential Hyper-V caps number of channels based on number of virtual processors vcpu Count Default Channels Maximum Channels Modify the guest OS registry: HKLM\System\CurrentControlSet\Enum\VMBUS\{deviceid}\{instanceid}\Devic e Parameters\StorChannel\ChannelCount

23 Tweaking for IOPS All VM files stored on flash-based storage SMB 3.0, SMB Direct, Scale-Out File Server Configured 1 virtual SCSI controller in the VM 16 x 127 GB fixed VHDX files Increased the storage channels from 1 to 4 Disabled the Hyper-V I/O Balancer on the host HKLM\SYSTEM\CurrentControlSet\Control\StorVSP\IOBalance\E nabled:0 Ran IOMETER with 16 threads on 16 targets

24 VM Storage Configure Advanced I/O balancer only if needed (reg) HKLM\System\CurrentControlSet\Services\StorVsp\ \IOBalance_Enabled HKLM\System\CurrentControlSet\Services\StorVsp\ \IOBalance_KeepHwBusyLatencyTarget_Microseconds - how much work, represented by a latency value, the balancer allows to be issued to the hardware before throttling to provide better balance - default is 83ms HKLM\System\CurrentControlSet\Services\StorVsp\ \IOBalance_AllowedPercentOverheadDueToFlowSwitching - how much work the balancer issues from a virtual machine before switching to another virtual machine - default is 8%

25 Storage QoS Manageable on a per VHD/X basis Configured in VM settings Maximum IOPS: A hard cap on how much IOPS a VHD/X can consume Automatically enforced Minimum IOPS: Not enforced Advisory service Get-VMHardDiskDrive -VMName SQLIO -ControllerType SCSI ` - ControllerLocation 0 -ControllerNumber 1 FL ID

26 Storage QoS Components

27 DEMO Storage

28 Storage QoS Configuration

29 Storage QoS Events

30 Storage QoS Experience

31

32 Performance Best Practices Summary 1/2 Physical Server High Performance Mode Latest Updates, Hotfixes, Drivers and Firmware Use GEN2 VMs Do not mix legacy and native VMs on the same host Use Synthetic Hardware as much as possible (i.e. avoid IDE) Limit resources (Storage QoS, Network Bandwidth, ) Use 4k native phys. disks, use 64k allocation unit size on NTFS Enable Jumbo Frames for iscsi, CSV and LM networks Use RDMA & SR-IOV

33 Performance Best Practices Summary 2/2 Configure Antivirus exclusions Use and configure (v)numa Install and Update IS Leave VM on logon screen + disable screen saver + do not use VMConnect Disable background activities inside a VM Use Fixed VHD(X)

34 Performance Monitoring Principles Always check supported configuration first (example: 2vCPUs for WS2003) When there s a perf issue, it s time to implement best practices Application Best Practices as well! Do not blame wrong software components/features (example: Dedupe) Troubleshoot performance even on a healthy system Do not monitor the performance from the inside of guest VM Never use Windows Task Manager Always use Hypervisor Performance Counters

35 Performance Monitoring Tools Free VM Resource Metering Microsoft Performance Monitor (PERFMON) Windows Performance Analyzer (part of Windows ADK/SDK) Performance Analysis of Logs (PAL) Microsoft Operations Management Suite (OMS) ATOM Paid System Center 2016 Operations Manager System Center 2016 Virtual Machine Manager Microsoft Operations Management Suite (OMS) ATOM

36

37

38

39

40

41 Thank you!