Manage AWS Services. Cost, Security, Best Practice and Troubleshooting. Principal Software Engineer. September 2017 Washington, DC

Size: px

Start display at page:

Download "Manage AWS Services. Cost, Security, Best Practice and Troubleshooting. Principal Software Engineer. September 2017 Washington, DC"

Elvin Fitzgerald
6 years ago
Views:

1 Manage AWS Services Cost, Security, Best Practice and Troubleshooting Elias Haddad Peter Chen Principal Product Manager Principal Software Engineer September 2017 Washington, DC

2 Agenda Challenges in Managing Enterprise Level AWS Services Get Data In AWS Add-on Data Analysis and Visualization AWS App Case Study Q & A

3 Challenges in Managing Enterprise Level AWS Services Cost Optimization Multi accounts Budget planning RI planning Cost forecasting Anomaly detection Smart alerting

4 Challenges in Managing Enterprise Level AWS Services Cost Optimization Security Strategy Access monitoring API call monitoring User management Anomaly detection Smart alerting

5 Challenges in Managing Enterprise Level AWS Services Cost Optimization Security Strategy Best Practice Config Rule Inspector EC2 ELB EBS EIP SG IAM

6 Challenges in Managing Enterprise Level AWS Services Cost Optimization Security Strategy Best Practice Troubleshooting Change management Network topology Association analysis

7 Splunk Solution AWS App & Add-on EC2 S3 Explore Dashboard Alert Analyze EMR Kinesis ELB RDS CF SNS API Gateway Redshift Splunk App for AWS Splunk Add-on for AWS CloudFront Lambda CloudWatch VPC Config CloudTrail IAM R53

8 Get Data In

9 AWS Add-on Get Data In Multi accounts Assume Role High throughput Real-time collection Distributed job Scale out Easy configuration Health Monitoring... Config CloudWatch Kinesis SQS CloudTrail Billing S3 More

10 Key New Features in AWS Add-on 4.3 and 4.4 New Input: SQS-Based S3 CloudTrail AccessLogs Config PlainText S3 Event Notification Higher throughput Real-time ingestion SQS Fail over DLQ Cost efficient High availability Batch Process Adaptable Downloader Pluggable Decoder Scale out capability

11 Key New Features in AWS Add-on 4.3 and 4.4 Trouble Shooting: Health Dashboard

12 Key New Features in AWS Add-on 4.3 and 4.4 Easier Configuration: New Designed Configuration GUI

Best Practice of Get Data In Example 1: Get CloudTrail Data of

account delivery Centralized account SQS-Based S3 Input

1 Bucket 2 S3 event notification Forwarder 2 Splunk Add-on for

13 Best Practice of Get Data In Example 1: Get CloudTrail Data of Hundreds Accounts in Real-time Account 1 CloudTrail Files Cross account delivery Centralized account SQS-Based S3 Input Forwarder 1 Splunk Add-on for AWS Account 2 Account 3 S3 Bucket 1 Bucket 2 S3 event notification Forwarder 2 Splunk Add-on for AWS Index Cluster Bucket 3 SQS Forwarder 3 Account 100 Splunk Add-on for AWS

14 Best Practice of Get Data In Example 2: Get Data More Securely EC2 with Instance Role AssumeRole Account 1 Config CloudWatch CloudTrail Splunk Account 2 Kinesis SQS Billing Account 3 S3 Config Rule Inspector

15 Data Analysis and Visualization

AWS App Data Analysis and Visualization Dashboard Network Topology Overlay Layers Change Playback Timeline Real-time Status Security Strategy Forecast Analysis RI

16 AWS App Data Analysis and Visualization Dashboard Network Topology Overlay Layers Change Playback Timeline Real-time Status Security Strategy Forecast Analysis RI Planning Anomaly Detection Smart Alerting Best Practice Data Transformation Report Saved Search Acceleration Lookup Data Models Summary Search Acceleration Machine Learning

17 Key New Features in AWS App 5.1 Reserved Instance Inventory and Planner Add support of Instance Size Flexibility Region 4x large AZ 1 AZ 2 AZ 1 AZ 2 nano Units 32x large AZ Scope Regional Benefit Instance Size Flexibility

18 Key New Features in AWS App 5.1 Reserved Instance Inventory and Planner Add support of Instance Size Flexibility

19 Key New Features in AWS App 5.1 Reserved Instance Inventory and Planner Add support of Platform and Tenancy in RI planer Support window selection in RI Planer

20 Key New Features in AWS App 5.1 Anomaly Detection Modular Visualization

21 Key New Features in AWS App 5.1 Dedicated Dashboard for Anomaly Detection Manage anomaly detection jobs Manage alerts View anomalies detected

22 Key New Features in AWS App 5.1 More Insights IAM EIP ELB COST OPTIMIZING SECURITY EC2 PERFORMANCE EBS SG FAULT TOLERANCE

23 Key New Features in AWS App 5.1 Decoupled Dependency of AWS Add-on Search Head Splunk App for AWS Not available in hybrid environment Not able to connect multiple forwarders Forwarder Splunk Add-on for AWS Forwarder Splunk Add-on for AWS

24 Key New Features in AWS App 5.1 Decoupled Dependency of AWS Add-on Search Head Splunk App for AWS Indexer Cluster Summary Index Accounts Info Inputs Info Forwarder Splunk Add-on for AWS Forwarder Splunk Add-on for AWS

25 Typical Use Cases

Report Detailed Billing Report Budget planning and tracing

26 Use Case Manage Billing Report 3 kinds of reports, different granularity CloudWatch Estimated Cost Monthly Report Detailed Billing Report Budget planning and tracing Cost analysis on different grouping rules Cost analysis on customized tags

historical data Based on forecasting Based on adjusted forecasting

27 Case Study Optimize Reserved Instance Statistics of RI Distribution & utilization Detail information Best purchase plan of RI Based on historical data Based on forecasting Based on adjusted forecasting Support 3 payment options Support Regional RI Support Size Flexibility

28 Case Study Topology Interactive network topology Interactive IAM association presenting Export to picture Multiple overlays Playback of changes

29 Case Study Anomaly Detection Custom visualization on any time chart Number of instance launched daily Amount of money spent daily Native support of alerting , SNS, ServiceNow

30 Q&A

31 2017 SPLUNK INC. Thank You Don't forget to rate this session in the.conf2017 mobile app

AWS Agility + Splunk Visibility = Cloud Success. Splunk App for AWS Demo. Laura Ripans, AWS Alliance Manager

AWS Agility + Splunk Visibility = Cloud Success Splunk App for AWS Demo Laura Ripans, AWS Alliance Manager Disruptive innovation and business transformation starts with data I HAVE BEEN GIVEN AN AWS ACCOUNT!!!