It s. slow! SQL Saturday. Copyright Heraflux Technologies. Do not redistribute or copy as your own. 1. Database. Firewall Load Balancer.

Transcription

1 App request Web Server Firewall Load Balancer Web Server App Server Report Server Desktop App Desktop App Desktop App Desktop App Web Server Database It s FG1 FG2 Log MDF NDF NDF NDF LDF SQL Server Instance E: F: G: L: slow! Windows Operating System SCSI Controller SCSI Controller Queue Queue Virtualization Hypervisor vdisk vdisk1 vdisk2 vdisk3 HBA pswitch SAN Controller Disk Pool Heraflux Technologies redistribute or copy as your own. 1

2 @kleegeek davidklee.net heraflux.com linkedin.com/in/davidaklee Specialties / Focus Areas / Passions: Performance Tuning & Troubleshooting Virtualization Cloud Enablement Infrastructure Architecture Health & Efficiency Capacity Management Founder & Chief Architect Heraflux Technologies 3 Everything is a system Performance is subjective Ongoing metric collection Data load for analysis Analysis steps Heraflux Technologies 4 redistribute or copy as your own. 2

3 A whole which cannot be divided into independent parts. Dr. Russell Ackoff YouTube: bit.ly/1ixmzug Any part change will have an impact on the system Heraflux Technologies 5 App 2 App 1 Database 1 Database 2 2% CPU 1% Memory Database 3 3% CPU 9% Memory App 3 SQL Server Instance Windows Server OS Heraflux Technologies 6 redistribute or copy as your own. 3

4 Query 1 Query 2.1% CPU 12 Executions per minute Query 3 4.2% CPU 2 Executions per minute Query 4 6.1% CPU 4, Disk Reads per Exec 2864 Executions per minute Database 1 Heraflux Technologies 7 VM VM VM VM VM VM VM Host VM Host Shared Storage Heraflux Technologies 8 redistribute or copy as your own. 4

5 Top 1 I/O consuming queries? High CPU consuming database? Runtime variability? with most severe memory pressure? Resource contention inside instance Impact of noisy neighbor? Impact of system backups on the system? Heraflux Technologies 9 Application SQL Server SQL Server Instance Interconnects Operating System Virtualization Physical Server Storage Networking Heraflux Technologies 1 redistribute or copy as your own. 5

6 Completely subjective until you make it objective. No more arguments. Numbers drive the investigation. Heraflux Technologies 11 Repeatable process to determine raw performance of a task Benchmarks can affect the system performance When to benchmark? What to benchmark? Infrastructure speeds Relative SQL Server instance performance Known task / process / job performance Long-running query performance Anything else that you can measure that matters to you! Heraflux Technologies redistribute or copy as your own. 6

7 Performance metrics Windows OS SQL Server Instance SQL Server Databases Virtualization host Instance & Database Long running queries Index usage Task / job runtimes Infrastructure Heraflux Technologies 13 Collect raw data and analyze yourself Averages of averages of averages Perfmon how-to guide Download at hfxte.ch/perfmon 5-minute interval if routine 15-second interval if troubleshooting performance Heraflux Technologies 14 redistribute or copy as your own. 7

8 Heraflux Technologies 15 6% CPU consumption average? But I have 32 CPUs! Granularity matters! Heraflux Technologies 16 redistribute or copy as your own. 8

9 SQL Saturday SERVER A - CPU CONSUMPTION SystemCPUConsumption UserCPUConsumption 35 3 Percent Consumed Minute of Day 16 pcpus Present Heraflux Technologies 17 SERVER A - CPU Consumption by vcpu CPU CPU1 CPU1 CPU11 CPU12 CPU13 CPU14 CPU15 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 16 pcpus Present Heraflux Technologies redistribute or copy as your own. 18 9

10 SQL Saturday SERVER B - CPU CONSUMPTION SystemCPUConsumption UserCPUConsumption Percent Consumed Minute of Day 16 pcpus Present Heraflux Technologies 19 SERVER B - CPU Consumption by vcpu NUMA Imbalance CPU CPU1 CPU1 CPU11 CPU12 CPU13 CPU14 CPU15 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 16 pcpus Present Heraflux Technologies redistribute or copy as your own. 2 1

11 Load the Perfmon data into SQL Server relog logfile.blg f csv o logfile.csv (Can use OC, but is a pain) CSVtoSQL PoSH Download free at bit.ly/1zf3ocr Midnight As DIY Reporting Code: bit.ly/1tyl4jb How-To: bit.ly/1ctt52w Heraflux Technologies 21 Test raw performance SQLIO Deprecated! DiskSpd Batch hfxte.ch/diskspd Collect metrics: I/Os per second (IOPs) Latency (ms) Throughput (MB/s) Ceiling vs. Steady State MB/S (THROUGHPUT) DiskSpd - MB/s WORKER THREADS PER CPU RAND R SEQ R RAND W SEQ W Heraflux Technologies 22 redistribute or copy as your own. 11

12 6 Perfmon IOPs - Business Day 15 Min Average : :45 1:3 2:15 3: 3:45 4:3 5:15 6: 6:45 7:3 8:15 9: 9:45 1:3 11:15 12: 12:45 13:3 14:15 15: 15:45 16:3 17:15 18: 18:45 19:3 2:15 21: 21:45 22:3 23:15 CounterMax CounterMin CounterAvg MaxVal Heraflux Technologies 23 Heraflux Technologies 24 redistribute or copy as your own. 12

13 Heraflux Technologies 25 Heraflux Technologies 26 redistribute or copy as your own. 13

14 Infinite possibilities of SQL Server diagnostics Glenn Berry Diagnostic Queries sqlskills.com/blogs/glenn/category/dmv-queries/ Heraflux Technologies 27 SQL Server file latency collector Available at hfxte.ch/sqllc Sample disk latency as SQL Server sees it Compare against Windows Perfmon results Hotspots within engine? Heraflux Technologies 28 redistribute or copy as your own. 14

15 Heraflux Technologies 29 On-going sampling Periodic analysis Full workload replay Synthetic hammerdb, dvdstore Real-world Profiler + ostress Distributed Replay Third-party Heraflux Technologies 3 redistribute or copy as your own. 15

16 @kleegeek davidklee.net heraflux.com linkedin.com/in/davidaklee Heraflux Technologies 31 redistribute or copy as your own. 16