ArcGIS Enterprise: Cloud Operations using Amazon Web Services. Mark Carlson Cherry Lin

Transcription

1 ArcGIS Enterprise: Cloud Operations using Amazon Web Services Mark Carlson Cherry Lin

2 Quick Survey Your role in your organization Already a cloud user Running Esri deployment on AWS Consider yourself knowledgeable of AWS

3 Agenda Getting Started ArcGIS Enterprise on AWS Offerings - AMIs & Deployment Tools - Support for Native Cloud Storage - Upgrade Your Deployments Case Study - Approach - Enterprise GIS Environment designed to Best Practices - Components / Target Architecture - Operational Practices - Deployments - Costs - Monitoring - License Updates - Upgrades

4 Getting Started

5 ArcGIS Enterprise Support for Cloud Providers

6 ArcGIS Enterprise Special Tooling Cloud deployments Amazon Web Services Microsoft Azure

7 ArcGIS Enterprise ArcGIS Web Adaptor Portal for ArcGIS Portal ArcGIS Web Adaptor Hosting Server GIS Server GeoEvent Server Image Server GeoAnalytics Server ArcGIS Enterprise = ArcGIS Web Adaptor + Portal for ArcGI S + ArcGIS Server + ArcGIS Data Store ArcGIS Data Store (relational + tile cache) Data Store Data Store GIS Server Image Server GeoEvent Server GeoAnalytics Server

8 Before Starting On-premise Esri authorization files Domain_name for your application SSL Certificate for your domain Esri software setups Infrastructure Machines/VMs/Networks Web Servers and/or Load Balancer File Server Data storage/database... AWS Esri authorization files Domain_name for your application SSL Certificate for your domain AWS Account

9 Start Deployment On-premise Some knowledge about your infrastructure Manually run setups/configurations on all machines or Deployment automation AWS Some knowledge about AWS Esri CloudFormation template One deployment for different patterns Scripting tools, python or powershell Esri ArcGIS Cloud Builder CLI for AWS Customization AMIs CloudFormation Templates

10 ArcGIS Enterprise Offerings

11 AMIs Windows with SQL Server Express Ubuntu with Postgresql Available in GovCloud Region

12 Esri Cloud Formation Templates ArcGIS Web Adaptor Portal for ArcGIS ArcGIS Web Adaptor Hosting Server ArcGIS Data Store (relational + tile cache) GIS Server Image Server GeoEvent Server GeoAnalytics Server

13 Native to AWS Tools AWS Tools for Windows PowerShell Esri-provided sample scripts Android ios Java JavaScript.NET Node.js PHP Python (boto) Ruby Xamarin AWS CLI AWS Toolkit for Eclipse AWS Toolkit for Visual Studio AWS Tools for Windows PowerShell

14 Provided by Esri CF templates Esri ArcGIS Server Docker through AWS ECS - New at Stop/Start the whole stack (Lambda function) Remotely Applying Esri patches through AWS Run command tool - Windows starting at Ubuntu starting at 10.6

15 Deployment Tools - Cloud Builder Command Line Interface for AWS New at 10.6 One Run to Deploy ArcGIS Enterprise - Base + Federated Servers - Define in a json file Prepare your deployment

16 Cloud Formation Templates VS. Cloud Builder CLI Highly Customizable One Run Deployment Power Simplicity

17 Demo Deploy using ArcGIS Enterprise Command Line Interface for AWS

18

19 Cloud Storage Support ArcGIS Server config-store: DynamoDB & S3 Portal content store: S3 Cloud Storage in Server Manager: S3 Caching: S3 Consumption: Generation: 10.6 ArcGIS Spatial Temporal DataStore backups: S3. New at 10.6 Webgisdr backups: to S3 GeoAnalytics Data Input : S3 All Regions At at 10.6 User-defined S3 compatible storage

20 Case Study

21 Environment Requirements Deploy an ArcGIS Platform in AWS - Includes the following server roles: - General purpose GIS Server site - GeoEvent - GeoAnalytics Server site - RasterAnalytics Server site Use ArcGIS Monitor to monitor platform Develop a plan for License Updates Develop a plan for future upgrades

22 Environment Best Practices Enterprise GIS environment designed to best practices - Automation - Efficiency, Consistency, Productivity - Environment Isolation - Reliability and Availability - High Availability and Disaster Recovery - Workload Separation

23 Checklist Architecture Deployment Capacity Planning Manage Costs - Environment Availability Monitor Update Licenses Upgrade

24 Architecture ArcGIS **NEED TO PERFORM CAPACITY PLANNING TO DESIGN PROPER ARCHITECTURE ArcGIS Base Enterprise ArcGIS Server Site GeoEvent GeoAnalytics Image Server Site

25 Architecture ArcGIS **NEED TO PERFORM CAPACITY PLANNING TO DESIGN PROPER ARCHITECTURE ArcGIS Base Enterprise arn:aws:acm:us-west-2:*******:certificate/*********** SG SG Server Site SG - GE SG GA Site SG Image Site ArcGIS Server Site AZ M1 M2 M3 M4 M5 M7 M8 M9 M11 M12 M14 Subnet1 primary fileserver primary fileserver primary fileserver GeoEvent1 AZ M6 M10 M13 GeoAnalytics Subnet2 secondary secondary secondary Image Server Site

26 Architecture Operating System $$ $

27 Architecture Operating System $$ $

28 Architecture Operating System $$ $

29 Architecture Deployment Manage Costs - Environment Availability Monitor Update Licenses Upgrade

30 Operational Practices Deployments

31 Operational Practices Deployments Create/Validate AWS S3 Bucket with necessary files - Portal license file - Server license file - Optional server roles: GeoAnalytics, GeoEvent, Image - SSL Certificate file Create VPC - AWS CLI PREP - CloudFormation Template Allocate Elastic IP addresses - Update DNS Entries with Cname Create Load-Balancer - Import/Validate the SSL Certificate exists in the Certificate Manager for the AWS Region - Use Load-Balancer Template - Update DNS Entries with Cname

32 Operational Practices Deployments

33 Operational Practices Deployments

34 Operational Practices Deployments

35 Operational Practices Deployments

36 Operational Practices Deployments

37 Operational Practices Deployments ArcGIS Enterprise Cloud Builder CLI for AWS

38 Operational Practices Deployments ArcGIS Enterprise Cloud Builder CLI for AWS

39 Operational Practices Deployments ArcGIS Enterprise Cloud Builder CLI for AWS DeployFiles Environment1 Environment2 Environment Notes & commands JSON Environment parameters for CREATE

40 Operational Practices Deployments

41 Operational Practices Deployments JSON

42 Operational Practices Deployments JSON

43 Operational Practices Deployments JSON CLI

44 Operational Practices Deployments JSON

45 Operational Practices Deployments JSON

46 Operational Practices Deployments

47 Operational Practices Deployments

48 Operational Practices Deployments

49 Operational Practices Deployments

50 Operational Practices Deployments

51 Operational Practices Deployments

52 Operational Practices Deployments

53 Architecture Deployment Manage Costs - Environment Availability Monitor Update Licenses Upgrade

54 Operational Practices Environment Availability Task Scheduler.bat file CLI rem BaseEnterprise aws ec2 --region us-west-2 start-instances --instance-ids i-0xxxxxax rem FileServers aws ec2 --region us-west-2 start-instances --instance-ids i-1xxxxxbx rem Spatiotemporal aws ec2 --region us-west-2 start-instances --instance-ids i-2xxxxxcx timeout /t 240 rem Server Primary aws ec2 --region us-west-2 start-instances --instance-ids i-3xxxxxdx timeout /t 240 rem Server Secondary aws ec2 --region us-west-2 start-instances --instance-ids i-4xxxxxex timeout /t 240 PowerShell $smtpserver = " -smtp.us-west-2.amazonaws.com" $smtpport = 587 $username =??????????????????" $password =??????????????????" $from = myname@domain.com" $to = toname@domain.com" $bcc = bccname@domain.com" $subject = "Test with PowerShell" $body = "This is a test sending with using PowerShell. The ztest Task Scheduler ran. myname@domain.com" $smtp = new-object Net.Mail.SmtpClient($smtpServer, $smtpport) $smtp.enablessl = $true $smtp.credentials = new-object Net.NetworkCredential($username, $password) $msg = new-object Net.Mail.MailMessage $msg.from = $from $msg.to.add($to) $msg.bcc.add($bcc) $msg.subject = $subject $msg.body = $body $smtp.send($msg)

55 Operational Practices Environment Availability AWS Lambda Amazon CloudWatch EC2-START EC2-STOP

56 Operational Practices Environment Availability AWS Lambda Amazon CloudWatch

57 Architecture Deployment Manage Costs - Environment Availability Monitor Update Licenses Upgrade

58 Operational Practices Monitoring

59 Operational Practices Monitoring Not just system monitoring but Service performance!

60 Operational Practices Monitoring

61 Operational Practices Monitoring

62 Operational Practices Monitoring

63 Architecture Deployment Manage Costs - Environment Availability Monitor Update Licenses Upgrade

64 Operational Practices License Updates / Apply Patches

65 Architecture Deployment Manage Costs - Environment Availability Monitor Update Licenses Upgrade

66 Operational Practices Upgrades DNS Env. A Current Env. B New Release DUPLICATE Seamless The url for the end user never changes.

67 Operational Practices Upgrades arn:aws:acm:us-west-2:*******:certificate/*********** SG SG Server Site SG - GE SG GA Site SG Image Site AZ M1 M2 M3 M4 M5 M7 M8 M9 M11 M12 M14 Subnet1 primary fileserver primary fileserver primary fileserver AZ M6 M10 M13 Subnet2 secondary secondary secondary

68 Operational Practices Upgrades AZ Subnet1 AZ Subnet2

69 Operational Practices Upgrades DUPLICATE AZ AZ Subnet1 Subnet1 AZ AZ Subnet2 Subnet2 Set to Read-Only Instances need to retain Private IP addresses

70 Operational Practices Upgrades UPGRADE AZ AZ Subnet1 Subnet1 AZ AZ Subnet2 Subnet2 Update Host file PrivateIP = URL Subnet3

71 Operational Practices Upgrades AZ AZ Subnet1 Subnet1 AZ AZ Subnet2 Subnet2 Update DNS to new site

72 Please Take Our Survey! Download the Esri Events app and find your event Select the session you attended Scroll down to the Feedback section Complete Answers, add a Comment, and Select Submit

73