Manohar Punna. Azure Database Migration Choosing the Right Tier

Size: px

Start display at page:

Download "Manohar Punna. Azure Database Migration Choosing the Right Tier"

Loraine Conley
5 years ago
Views:

1 Manohar Punna Azure Database Migration Choosing the Right Tier

2 Thank you to our sponsors:

3 Evaluations: Please complete the evaluation forms for each session you attend. You received these in your welcome pack first thing this morning from registration. Please put them in the evaluations box on your wait out after this session. There are evaluation prizes at the end of the day for completed evaluation forms.

4 Manohar Punna Blogger, Speaker, Mentor Community Enthusiast and Data Platform MVP. Microsoft Data Platform Consultant at LobsterPot Solutions. Authored One DMV a Day Series Wrote 80 blogs in 80 days. Website: Speaker at SQLBits, SSGAS, SQL Server Day, Data Platform Day, SQL Saturdays. President at DataPlatformGeeks Data Platform Summit

5 Agenda SQL Server on a VM - IaaS Azure SQL Database - PaaS Elastic Pools Service Tiers Resource Utilization Collections Choosing the Right Tier - Analysis

6 SQL Server on Microsoft Azure

7 SQL Server on a Azure VM - IaaS Features Infrastructure as a Service Hardware and OS maintained by Microsoft SQL Server license included BYOL Suitability Straight forward / hybrid migrations with minimal changes Resources to maintain the VM and SQL instance Highly customizable with full admin rights Highly suitable for enterprise and hybrid applications Customizable HA and DR solution

8 Azure SQL Database - PaaS Features Platform as a Service/ Database as a Service Hardware, OS and SQL administration maintained by Microsoft Automated backups, geo-redundancy Suitability Focus on application layer New applications, SaaS providers Up to 4 TB databases with scale-out option Single database / non OS dependent applications

9 Azure Managed Instance - PaaS Features Platform as a Service Hardware, OS and SQL administration maintained by Microsoft Automated backups, geo-redundancy Suitability List and shift. Introduced Database Migration Service to automate migration. Applications need Instance level features cross database querying, SQL Agent, SQL CLR etc. Currently in private preview.

10 Elastic Pools Limitation of SQL DB Over allocation / scattered usage of resources Monitoring challenges Elastic Pools Resources shared between multiple databases Limit resources for each database

11 Service Tiers Single Database Clear differentiation between different service tiers. Relatively easy to move between different service tiers. Tier Group Tier StartDTU EndDTU TierSort Basic B Standard S Standard S Standard S Standard S Premium P Premium P Premium P Premium P Premium P Premium P

12 Service Tiers Elastic Pool Four service tiers with different DTU levels. Easy to change DTU levels in a pool Moving databases between tiers needs moving between pool ElasticTier start edtu end edtu Max DBs Max edtus / database Max storage price per hour Basic GB $0.14 Basic GB $0.28 Basic GB $0.57 Basic GB $0.85 Basic GB $1.13 Basic GB $2.28 Basic GB $3.41 Basic GB $4.55 Standard GB $0.22 Standard GB $0.43 Standard GB $0.87 Standard GB $1.29 Standard GB $1.71 Standard GB $3.41 Standard TB $5.12 Standard TB $6.84 Standard TB $8.55 Standard TB $10.69 Standard TB $12.82 Premium GB $1.32 Premium GB $2.64 Premium GB $5.29 Premium GB $10.58 Premium GB $15.87 Premium GB $21.16 Premium GB $26.45 Premium GB $31.73 Premium GB $37.02 Premium GB $42.32

13 DTU Calculator Perfmon counter collection Powershell and command line exe. CPU IOPS disk reads and writes Log Bytes Flushed Ideal for single database on single instance DTUs are calculated based on maximum of DTUs needed for each metric in a single set. (Max of DTU calculated for CPU or IOPS or Log Bytes Flushed)

DTU Calculator Collect CPU Database CPU usage CPU usage for each database cannot be tracked accurately. The closest is cumulative usage of CPU for the database from Glenn Berry s Diagnostic Queries.

14 DTU Calculator Collect CPU Database CPU usage CPU usage for each database cannot be tracked accurately. The closest is cumulative usage of CPU for the database from Glenn Berry s Diagnostic Queries. Collect average at regular intervals. For every second, collect at 5 sec interval and consider average for every 1 sec. Queries removed from cache. This is just the % out of total SQL Server CPU usage.

15 DTU Calculator Collect CPU Instance CPU usage Step 1 Process(sqlservr) - % Processor Time Sum of (% cpu on each core). Step 2 (Process(sqlservr) - % Processor Time)/No. of cores Multiple instances? Step 3 Sqlservr, sqlservr#1, sqlservr#2 Registry hack - KB

16 DTU Calculator Collect IOPS Cumulative IO stats from sys.dm_io_virtual_file_stats Similar to CPU collect samples, get the difference and calculate the average across intervals.

17 DTU Calculator Collect Log Bytes Flushed/Sec Log Bytes Flushed counter - easiest to collect Databases Log Bytes Flushed/sec can be collected for each database.

18 DTU Calculator Reverse engineering on DTU Calculator Cores considered only for CPU DTUs Cores DTU for 100% CPU Utilized CPU % Calculated DTU Log Bytes Flushed Basic 256 KB, Standard 1.3 MB Premium > 1.3 MB 1 DTU = (B)5 KB, (S)16 KB, (P)24 KB Log Bytes Flushed (MB) DTU IOPS Basic 16, Standard 158, Premium > DTU = (B)3.2, (S)Variable for standard(s0, S1, ), (P)12.8 IOPS DTU

19 DTU Analysis The graphs from the DTU Calculator are basic Need more insights into the whole story. DEMO - Power BI to the rescue Three-sigma rule Normal distribution 68, 95, 99.7 Non-normal distribution 88.8 % fall in 3 standard deviations

20 The Real World Always rely on direct testing on Azure. Create a copy of the database in Azure IaaS or PaaS. Replay the workload using load and performance testing tools. Time vs Contention End of the day cost to migrate and run on Azure. Remember you still need someone who breathes data a Data Professional

21 Questions: Please make sure you visit our fantastic

Successfully migrate existing databases to Azure SQL Database. John Sterrett Principal Consultant

Successfully migrate existing databases to Azure SQL Database John Sterrett Principal Consultant Common Migration failures Plan Test Execute Manage Free Reference Material Videos, Reference Links, Tips,