Azure Webinar. Resilient Solutions March Sander van den Hoven Principal Technical Evangelist Microsoft

Size: px

Start display at page:

Download "Azure Webinar. Resilient Solutions March Sander van den Hoven Principal Technical Evangelist Microsoft"

Franklin Day
6 years ago
Views:

1 Azure Webinar Resilient Solutions March 2017 Sander van den Hoven Principal Technical Evangelist Microsoft 1

2 What is resilience? Client Client API FrontEnd Client Client Client Loadbalancer API FrontEnd Loadbalancer Processing Processing Processing Data routing Client API FrontEnd Data Data Data Client Be resilient to: Hardware failure Network failure Patching failure OS failures Hosting platform failures Upgrading failures Human errors Cascading errors sync sync 2

3 How to achive resilience High availability (HA) The ability of the application to keep running in a healthy state, without significant downtime. By "healthy state," we mean the application is responsive, and users can connect to the application and interact with it. Disaster recovery (DR) The ability to recover from rare but major incidents: Nontransient, wide-scale failures, such as service disruption that affects an entire region. Disaster recovery includes data backup and archiving, and may include manual interventions, such as restoring a database from backup 3

4 How resilient do you want to be? Risk = Chance Occurrence * Impact Define Risk Define Chance Occurrence Define Impact Decide if this is a risk you can take. RTO, Recovery Time Objective How long can you stay offline? SLA Downtime per week Downtime per month Downtime per year 99% 1.68 hours 7.2 hours 3.65 days 99.9% 10.1 minutes 43.2 minutes 8.76 hours 99.95% 5 minutes 21.6 minutes 4.38 hours 99.99% 1.01 minutes 4.32 minutes minutes % 6 seconds 25.9 seconds 5.26 minutes RPO, Recovery Time Objective How much data loss do you accept? None 5 minutes 1 hours 1 day 4

5 Resiliency solutions Backup & Recovery Resilient Architecture Duplicate and Failover Resilient Software Patterns Monitoring and automation 5

6 Azure Resiliency Solutions Azure Traffic Manager Azure Storage Azure Backup Managed Disks StoreSimple High Available SQL Server High Available DocumentDB Azure Site Recovery services 6

Security & Management Azure services for resilient solutions Hybrid Cloud Security Center Portal Azure Active Directory Azure AD B2C Multi-Factor Authentication Media Services API Management Logic

Database SQL Data Warehouse Redis Cache Storage Tables DocumentDB Cognitive Services Bot Framework Cortana Azure Search Azure AD Health Monitoring AD Privileged Identity Management Domain Services

7 Security & Management Azure services for resilient solutions Hybrid Cloud Security Center Portal Azure Active Directory Azure AD B2C Multi-Factor Authentication Media Services API Management Logic Apps Media Analytics BizTalk Services Service Bus Content Delivery Network Web Apps API Apps Service Fabric Mobile Apps Cloud Services Notification Hubs Functions SQL Database SQL Server Stretch Database SQL Data Warehouse Redis Cache Storage Tables DocumentDB Cognitive Services Bot Framework Cortana Azure Search Azure AD Health Monitoring AD Privileged Identity Management Domain Services Backup Automation Operational Analytics Scheduler Key Vault Store/ Marketplace VM Image Gallery & VM Depot Container Service Batch VM Scale Sets RemoteApp Visual Studio VS Team Services Application Insights Mobile Engagement Xamarin HockeyApp Infrastructure Services HDInsight IoT Hub Data Catalog Event Hubs Machine Learning Data Lake Analytics Service Data Factory Stream Analytics Data Lake Store Power BI Embedded Import/Export Azure Site Recovery StorSimple 7

9 A: www-contoso.trafficmgr.com 9

Geo-redundant storage (GRS) replicated 3 times primary region, and 3 times in a secondary region (>300 km)

11 Azure Storage Storage Redundancy Locally redundant storage (LRS) replicated three times within a single data center in a single region Zone-redundant storage (ZRS) replicated three times across 2/3 facilities (DC), in 1 or 2 regions Geo-redundant storage (GRS) replicated 3 times primary region, and 3 times in a secondary region (>300 km) Read-access geo-redundant storage (RA-GRS) GRS + Read Access 11

12 Backup solutions Physical Virtual Hybrid Cloud Cloud On-premises built and managed infrastructure 12

13 How does Azure Backup Server work 1. Sign up 2. Install Azure Backup Server software 4. Back up encrypted data Azure Backup Server (Windows Server 2012) 5. Recover to the same or a different server 13

14 Azure Backup - Central Management from Azure File Server MABS/SCDPM MARS NATIVE CLOUD EXTENSIONS Agents No Agents, No infrastructure 14

15 Managed Disks & VM Availability High Availability Storage isolation of VM Availability Set VM FDs align with Managed Disk FDs Availability Set Simple Mgmt. and Security Disks managed by Azure, no direct public access Disks as logical top-level resource; Disk level RBAC VM-1 VM-2 VM-3 VM-N Scale Enables scaling free of storage account limitations VM Scale Set (VMSS) support MDisk 1 MDisk 2 MDisk 3 MDisk N High Availability Simple Mgmt. and Security Storage isolation of VM Availability Set VM FDs align with Managed Disk FDs Disks managed by Azure, no direct public access Disks as logical top-level resource; Disk level RBAC Storage Accounts Storage Accounts Storage Accounts Azure Managed Scale Enables scaling free of storage account limitations VM Scale Set (VMSS) support Storage Scale Unit A Storage Scale Unit B Storage Scale Unit X 15

16 StorSimple Storage Today Microsoft Azure StorSimple Primary Storage Archival Storage Manage data growth Simplify data protection Disk-based Backup Microsoft Azure Remote Replication StorSimple Accelerate disaster recovery Increase IT agility to meet business needs Tape backup and DR

17 Traditional Storage vs. StorSimple Traditional Storage + Data Protection Architecture StorSimple Cloud-integrated Storage Servers Disk Array (Double if Replicated) Backup Software / Media Server Primary Volume Snapshot Disk Backup/ VTL (double if replicated) Servers Primary Volume Local Snapshot Encryption Appliance Physical Tape Infrastructure Offsite Vault Cloud Snapshots To Nearby Cloud Storage Service Region Cloud Clones To Remote Cloud Storage Region for DR 17

18 High Available SQL On-Premises to Cloud Always On Mirror Log Shipping Back 18 Up

available For successful disaster recovery

19 High Available SQLServer on VM in Azure Always On Back Up Log Shipping not available For successful disaster recovery of your databases with Log Shipping, you should also install a replica domain controller at the disaster recovery site. This is not possible because an active directory domain cannot span multiple datacenters. Mirror 19

20 Fully managed Cloud SQL database service Built for SaaS and Enterprise applications Predictable performance & pricing 99.99% availability built-in Geo-replication and restore services for data protection Secure and compliant for your sensitive data Fully compatible with SQL Server 2014 databases

21 Availability - Replicas Enable Database High Availability T-SQL Query Single Logical Database DB Majority quorum up to 4 replicas Transparent automatic failover Uptime SLA of 99.99% Zero user or admin config Ack Read Write Ack P Ack P P S S S Write Write Reads are completed at the primary S S S Writes are replicated to secondaries 21

22 Active geo-replication Self-service activation in Premium/Standard/Basic Create up to 4 readable secondaries Replicate to any Azure region Geo-replicated database Automatic transactional data replication, asynchronous REST API, PowerShell or Azure Portal Up to 4 secondaries 22

23 Multi-Region Scenario 1 All traffic goes through the primary Azure region Application is deployed in primary region only Web App Use Active geo replication to protect database(s) Geo Replication Primary SQL DB replica Secondary SQL DB replica Primary Azure region Secondary Azure region 23

24 Multi-Region Scenario 1 Failover When primary database is offline, user controls failover of SQL database to secondary region. Application needs to change connection string to point to the new primary database in secondary region Web App Possible performance degradation due to latency between two regions Geo Replication Old primary SQL DB replica New primary SQL DB replica Primary Azure region Secondary Azure region 24

25 3 Multi-Region Scenario DNS Priority routing 2 Traffic Manager Deployment of application in two regions (secondary region deployment could be offline or only small size to save cost) Use Traffic Manager with Priority policy to direct traffic to primary region Web App Web App Use Active geo replication to protect database(s) Geo Replication Primary SQL DB replica Secondary SQL DB replica Primary Azure region Secondary Azure region 25

26 3 Multi-Region Scenario 2 Failover 1 4 DNS Priority routing 2 Traffic Manager When disaster hits primary region, TM would redirect traffic to application deployed in secondary region. User controlled failover of Sql database. Web App Web App Entire stack of application and SQL database resides in one region all the time Geo Replication Old primary SQL DB replica New primary SQL DB replica Primary Azure region Secondary Azure region 26

27 3 Multi-Region Scenario DNS Performance routing 2 Traffic Manager Deployment of application in two regions: active-active in both regions Use TM with performance routing policy to direct traffic to local region with lowest latency. Web App writes writes Web App Cross region writes to maintain same set of data in both regions. More complex design. Optional or no geo replication for Sql database(s) Regional SQL DB 1 Primary Azure region Regional SQL DB 2 Secondary Azure region 27

28 3 Multi-Region Scenario 3 Failover 1 4 DNS Performance routing 2 Traffic Manager When disaster hits one region, TM would direct all traffic to application deployed in the other region. No need to failover database(s) Web App writes writes Web App Entire stack of application and SQL database resides in one region all the time Regional SQL DB 1 Regional SQL DB 2 Primary Azure region Secondary Azure region 28

29 DocumentDB/NoSQK with Geo replication Consistency levels Choose region in code Ability to set read location in application Ability to switch write location in case of disaster 29

30 Azure Site Recovery: The Complete Migration & Disaster Recovery Solution Private cloud to Azure Public cloud to Azure Windows Any OS Linux 30

31 Replication & Migration of workloads Heterogeneous Platform Support Cloud 1 st Service Physical Servers Virtual Machines Migration Replication DR Service Cloud Storage Datacenter Extension A true Public Cloud DR Service is ondemand, heterogeneous, and automated. Data Replication forms a constant connection to the Public Cloud. Your data can become usable on demand for Recovery, Testing, or Migration. SQL Replication requirement list here Hyper-V requirement list here VMware/Physical requirements here On Demand Infrastructure for a variety of uses

32 Resilient Software Patterns Circuit Breaker Pattern Compensating Transaction Pattern Leader Election Pattern Retry Pattern Scheduler Agent Supervisor Pattern 32

33 Other techniques Azure Service Bus & Queuing Caching with Redis Azure Health Monitoring Azure App Insight 33

Vishesh Oberoi Seth Reid Technical Evangelist, Microsoft Software Developer, Intergen

Vishesh Oberoi Seth Reid Technical Evangelist, Microsoft Software Developer, Intergen Vishesh Oberoi Technical Evangelist, Microsoft VishO@microsoft.com @ovishesh Seth Reid Software Developer, Intergen contact@sethreid.co.nz @sethreidnz Vishesh Oberoi Technical Evangelist, Microsoft VishO@microsoft.com