Automating Azure Analysis Services

Size: px

Start display at page:

Download "Automating Azure Analysis Services"

Eric Williamson
5 years ago
Views:

1 Automating Azure Analysis Services Greg Galloway 5/19/2018 Page 1

2 Is This Even Possible? How do you schedule a refresh of the data in your Azure Analysis Services model? How do you pause the server on the weekends? Better yet, how can you pause it when the last user disconnects and start it automatically when the first user connects in the morning? How do you scale to meet peak demand each day? How can Azure Analysis Services load balance across servers in multiple countries so that the user connects to the geographically closest server? How do you extend your on-premises SSAS solution into Azure Analysis Services? Page 2

3 Code Samples and Resources Page 3

Azure Analysis Services Architecture Authentication Cloud data

Query Azure Analysis Services Azure Active Directory Cloud

Model Gateway Power BI Embedded On-premises data sources

SQL Server Other data sources Direct Query Visual Studio Excel

4 Azure Analysis Services Architecture Authentication Cloud data sources Azure SQL Server Database Other data sources Direct Query Azure Analysis Services Azure Active Directory Cloud visualization tools Power BI Azure SQL Data Warehouse Cached Model Gateway Power BI Embedded On-premises data sources Development and management tools On-premises visualization tools SQL Server Other data sources Direct Query Visual Studio Excel Oracle, Teradata Cached Model Management Studio Power BI Desktop Page 4 Third party BI tools

5 Automation Samples from the Community Process model from Azure Data Factory v2 using Logic Apps by Jorg Klein Processing model from Azure Data Factory using custom.net activity running on Azure Batch Scale, pause and resume on a schedule with Azure Automation by Rui Romano Processing from PowerShell by Christian Wade Processing with Azure Functions timers by Orsolya Gal Note: Consumption Plan has 5 minute limit, but App Service Plan does not have a limit Automated Partition Management in C# or Azure Functions by Christian Wade Page 5

6 Azure Automation to Pause if No Queries Runs on a schedule Authenticates with the Azure Automation RunAs account Confirms your Azure AS server is running Installs ADOMD.NET v15 from NuGet Runs a DISCOVER_SESSIONS DMV to determine if any queries are running If no queries are running it pauses Azure Analysis Services code sample Page 6

7 Resuming it from Azure Data Factory Get access token from AAD app, check if Azure AS is running, if paused then resume it, loop until it is resumed code sample Uses ADFv2 built in activities (no dependency on Azure Logic Apps or Azure Batch to run custom.net code) Page 7

8 Processing Models from Azure Data Factory Get access token, start processing async, lookup refreshid, loop until done, throw error if failed code sample Uses ADFv2 built in activities (no dependency on Azure Logic Apps or Azure Batch to run custom.net code) Page 8

9 Connect to Geographically Nearest Azure AS User connects to link://gregazureas.trafficmanager.net/ or link://myvanityurl.com/ and Azure Traffic Manager resolves the DNS to the nearest web app. Web app returns asazure://<region>.asazure.windows.net/<server> Azure South Central US Region Azure Japan East Region Page 9

Connect to Geographically Nearest Azure AS Notes Azure Web App doesn t support Traffic Manager until Standard pricing tier link:// syntax for SSAS server name connection string requires HTTPS under

10 Connect to Geographically Nearest Azure AS Notes Azure Web App doesn t support Traffic Manager until Standard pricing tier link:// syntax for SSAS server name connection string requires HTTPS under the covers. Buy a SSL cert (or in a test environment use free Let s Encrypt cert). At night in Asia, pause the Japan web app and Azure AS instance and Traffic Manager sends all users to South Central US Blog post describing solution in full Page 10

11 Auto Start When First User Connects Azure Web app starts Azure AS if it s not running then redirects user to Azure AS Excel uses ODC file SSMS uses link:// Don t use in production code sample Page 11

12 Backup SSAS and Restore to Azure AS Backup SSAS database on local instance Upload to blob storage, retaining X days of backups code sample Restore to Azure AS.\BackupSsasRestoreAzureAS.ps1 -Instance TABULAR -Database 'Sales,Inventory' -CleanupTimeHours 48 -storageaccount storageaccthere -storagekey 'base64==' -blobcontainer containername -BlobRetentionDays 7 -AzureASServer asazure://<region>.asazure.windows.net/<server> -aadappid <clientid> -aadappsecret '<secret> -BackupFilePassword passwordhere Page 12

$mdschema_measures') At AZUREAS; code sample Process the model in Azure AS in SQL: Exec (' { "refresh": { "type": "full", "objects": [ { "database":$

13 SQL Server Linked Server to Azure AS Execute a DMV, DAX, or MDX query inside SQL Server: Exec ('select * from $system.mdschema_measures') At AZUREAS; code sample Process the model in Azure AS in SQL: Exec (' { "refresh": { "type": "full", "objects": [ { "database": "MyDatabase" } ] } } ') At AZUREAS; Page 13

14 Processing in SSIS C# script task Authenticate with username/password or AAD app code sample Page 14

15 Page 15

Developing Microsoft Azure Solutions (70-532) Syllabus

Developing Microsoft Azure Solutions (70-532) Syllabus Cloud Computing Introduction What is Cloud Computing Cloud Characteristics Cloud Computing Service Models Deployment Models in Cloud Computing Advantages