SQL Server 2016 R Integration for database administrators

Transcription

1 SQL Server 2016 R Integration for database administrators What can DBA gain by using R Integration for SQL Server 2016? Tomaž Kaštrun 20.Jänner, 2017

2 Our Sponsors

3 About BI Developer and data analyst (SQL Server, SAS, R, Python, C#, SAP, SPSS) 15years experience with MSSQL Server 15years experience data analysis and DM Working: Spar ICS Austria, Spar Slovenija MVP, MCT, MCPT, MCSE SQL Frequent community speaker at SQL and Microsoft events Blogger, Avid Coffee drinker, Bicycle junkie

4 Agenda Quick guide on R Integration DBA Baseline Workload Measuring Using R statistics

5 Analytical barriers Common Challenges Addressing Challanges with R from Microsoft

6 What is R? A Language Platform A Community and a system

7 Power of R: R Language + Packages R is an open source (GNU) version of the S language developed by John Chambers et al. at Bell Labs in 80 s History of R R was initially written in early 1990 s by Robert Gentleman and Ross Ihaka then with the Statistics Department of the University of Auckland R is administered and controlled by the R Foundation Microsoft is founding member and Platinum Sponsor of R Consortium R Reference Card from CRAN

8 R: The #1 software for Advanced Analytics R Usage Growth Rexer Data Miner Survey, Language Popularity IEEE Spectrum Top Programming Languages, % of analytic professionals report using R 36% select R as their primary tool

9 What are common DBA tasks? Daily, Weekly, Monthly Checklist Performance baselines and bechmarks for activity comparison Testing and validating Performance analysis and tuning Data pushes and chages (patch, rollout, upgrade) Reviews and improvement

10 Why analyze? We analyze constantnly E.g.: looking at job history is analyzing the behaviour of job execution Troubleshooting Performance leaks and problems Monitoring SLA

11 Baseline We establish what is normal describing the performance at normal conditions Serves as a control group for comparison Monitoring Troubleshooting

12 -> How to collect? Which information to collect How to collect With what frequency Where to save Who will need collected data How will it analyzed.

13 -> What information to collect? Information collected -> Analyzing afforded General information System information Hardware information SQL Server information Configurable parameters Query related information Database related information Load related information.

14 Typical business cycles (by hour) Database Request for different business vertical ERP Warehouse Bakery WEB site

15 Workload What determined the load on SQL Server Can we link what caused the workload; source_problem -> workload -> effect Query stats DMV sys.dm_exec_query_stats I/O Reads Writes CPU Execution coutns

16 Workload Execution plans Identifying problematic queries, procedures, functions Missing indexes, heap tables Application usage problems

17 Measuring Gathering data from different tables Having baseline and workloads to understand what out of ordinary has happend Using simple to multivariate statistics and R Visualization will help

18 -> how to measure Use different tools (SQL Server, Nexus, Profiler, PS, ) Have some common measures (time,tasks, ) Additional stats Visualization will help

19 Samples

20 Different perspective

21 Data Insights

22 Clustering query statistics

23 DNA of your session with Query Store Stats

24 Monitoring monitoring system Predicted values Actual values Client happened reported happened reported ,

25 Elasticity of database growth

26 Predicting Ticketing system Problem: tickets not closed within agreed time Extracting data from ticketing system (PS) Keep only structured data and eventually structured data Weighting data Random forest (turned out as best solution) SLA and solving time, easier focus on critical tickets

27 Code and Demos Trivial problem heap tables Query Executions Job Executions Extended events (XE) Powershell with Performance Counters Query Store Disk space usage + prediction

28 Q&A Demo data and SQL/R Code:

29 How did you like it? Please give us feedback! to the event: to me as a speaker:

30 Ressources SQL Server 2016 in 15 Minuten SQL PASS Austria Homepage SQL PASS Austria Meeting Archive

31 Thank You!