Energy Management with AWS Kyle Hart and Nandakumar Sreenivasan Amazon Web Services August [XX], 2017 Tampa Convention Center Tampa, Florida
What is Cloud? The NIST Definition Broad Network Access On-Demand Self Service Resource Pooling Rapid Elasticity Measured Service Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, tablets, laptops, and workstations). A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service provider. The provider s computing resources are pooled to serve multiple consumers using a multitenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand. Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly outward and inward commensurate with demand. To the consumer, the capabilities available for provisioning often appear to be unlimited and can be appropriated in any quantity at any time. Cloud systems automatically control and optimize resource use by leveraging a metering capability appropriate to the type of service. Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and consumer. Private?? X X? Commercial Energy Exchange: Connect Collaborate Conserve
Benefits of the AWS Cloud? Move from operational to variable cost Lower variable cost than most companies can achieve No need to guess capacity Agility, speed & innovation Remove undifferentiated heavy lifting Go global in minutes Energy Exchange: Connect Collaborate Conserve
AWS Global Infrastructure 16 Regions 42 Availability Zones 73 Edge Locations Energy Exchange: Connect Collaborate Conserve
Long-term commitment to achieve 100% RENEWABLE ENERGY 5 Energy Exchange: Connect Collaborate Conserve
Energy Exchange: Connect Collaborate Conserve
Energy Exchange: Connect Collaborate Conserve
Energy Exchange: Connect Collaborate Conserve
A M A Z O N W I N D F A R M F O W L E R R I D G E A M A Z O N S O L A R F A R M E A S T A M A Z O N W I N D F A R M U S E A S T A M A Z O N W I N D F A R M U S C E N T R A L A M A Z O N W I N D F A R M U S C E N T R A L 2 A M A Z O N S O L A R F A R M U S E A S T 2 A M A Z O N S O L A R F A R M U S E A S T 3 A M A Z O N S O L A R F A R M U S E A S T 4 A M A Z O N S O L A R F A R M U S E A S T 5 A M A Z O N S O L A R F A R M U S E A S T 6 Energy Exchange: Connect Collaborate Conserve
AWS Projects bring online 907MW of new renewable generation Energy Exchange: Connect Collaborate Conserve
Energy Exchange: Connect Collaborate Conserve
Power Consumption with AWS On average, customers consume 77% fewer servers Cloud customers consume 84% less power Cloud customers reduce carbon emissions by 88% vs traditional data center https://aws.amazon.com/blogs/a ws/cloud-computing-serverutilization-the-environment/ 12 Energy Exchange: Connect Collaborate Conserve
AWS: Comprehensive Infrastructure Services Platform with 90+ services TECHNICAL & BUSINESS SUPPORT Support Professional Services Partner Ecosystem Training & Certification Solutions Architects HYBRID ARCHITECTURE Integrated Networking Direct Connect Identity Federation Integrated App Deployments Business Apps ANALYTICS Data Warehousing Business Intelligence Hadoop/ Spark Streaming Data Analysis Streaming Data Collection Machine Learning Elastic Search Identity Management Business Intelligence APP SERVICES Queuing & Notifications Workflow Search Email Transcoding Access Control DevOps Tools Key Management & Storage MOBILE SERVICES API Gateway Identity Sync Mobile Analytics Single Integrated Console Push Notifications MARKETPLACE Security SECURITY & COMPLIANCE Monitoring & Logs DEVELOPMENT & OPERATIONS One-click App Deployment DevOps Resource Management Application Lifecycle Management Containers Triggers Resource Templates Configuration Compliance Networking Web application firewall Databases IoT Rules Engine Device Shadows Device SDKs Device Gateway Registry Assessment and reporting Storage ENTERPRISE APPS Virtual Desktops Sharing & Collaboration Corporate Email Backup Resource & Usage Auditing Account Management Data Backups Compute VMs, Auto-scaling, & Load Balancing Storage Object, Blocks, Archival, Import/Export CORE SERVICES CDN Databases Relational, NoSQL, Caching, Migration Networking VPC, DX, DNS Security & Pricing Reports Integrated Resource Management Regions INFRASTRUCTURE Availability Zones Points of Presence Energy Exchange: Connect Collaborate Conserve
Three pillars of IoT Things Sense & Act Cloud Storage & Compute Intelligence Insights & Logic Action
AWS IoT Starting in the cloud AWS Services Messages Things Sense & Act Authentication & Authorization Cloud Messages Storage Device & Compute Gateway Action Intelligence Insights & Logic Action Applications Device State Registry AWS IoT API
AWS IoT Strengths Focus on Security, End to End It s a Serverless, managed service Built on modern architecture: messages, events, rules, functions at scale Any Chipset Any Operating System Protocol Agnostic Cost follows usage Front door to all of AWS
Most machine data never reaches the cloud Medical equipment Industrial machinery Extreme environments
Why this problem isn t going away Law of physics Law of economics Law of the land
Cloud AWS Greengrass AWS Greengrass extends AWS onto your devices, so they can act locally on the data they generate, while still taking advantage of the cloud.
AWS IoT Going to the edge Introducing AWS Greengrass AWS Services Messages Messages Messages Action Action Authentication Authentication Device & Authorization & Authorization Gateway Device Gateway Security Applications Device State Registry Device State AWS IoT API
Benefits of AWS Greengrass Respond to local events quickly Operate offline Simplified device programming Reduce the cost of IoT applications
AWS IoT Intelligence in the cloud AWS Services Things Sense & Act Messages Authentication & Authorization Messages Device Gateway Action Applications Intelligence Insights & Logic Action Device State Registry AWS IoT API
AWS IoT Getting smarter Data driven decisions, value from insights Rules engine integration of Dashboards Amazon Machine Learning (AML) AWS ElasticSearch & Kibana (ELK) Intelligence Insights & Logic Action
Our Full IoT Platform Is All Of AWS Big Data & Analytics Amazon Athena Amazon EMR Amazon Kinesis Amazon Redshift AI Services Amazon Lex Amazon Machine Amazon Polly Amazon Learning Rekognition Applications Amazon API Gateway AWS Lambda Amazon ElastiCache Amazon DynamoDB
Amazon Kinesis Streams Build your own data streaming applications Easy administration: Simply create a new stream, and set the desired level of capacity with shards. Scale to match your data throughput rate and volume. Build real-time applications: Perform continual processing on streaming big data using Kinesis Client Library (KCL), Apache Spark/Storm, AWS Lambda, and more. Low cost: Cost-efficient for workloads of any scale.
Amazon Kinesis Firehose Load massive volumes of streaming data into Amazon S3, Redshift and Elasticsearch Capture and submit streaming data Firehose loads streaming data continuously into Amazon S3, Redshift and Elasticsearch Analyze streaming data using your favorite BI tools Zero administration: Capture and deliver streaming data into Amazon S3, Amazon Redshift, and other destinations without writing an application or managing infrastructure. Direct-to-data store integration: Batch, compress, and encrypt streaming data for delivery into data destinations in as little as 60 secs using simple configurations. Seamless elasticity: Seamlessly scales to match data throughput w/o intervention Serverless ETL using AWS Lambda - Firehose can invoke your Lambda function to transform incoming source data.
Amazon Kinesis Firehose vs. Amazon Kinesis Streams Amazon Kinesis Streams is for use cases that require custom processing, per incoming record, with sub-1 second processing latency, and a choice of stream processing frameworks. Amazon Kinesis Firehose is for use cases that require zero administration, ability to use existing analytics tools based on Amazon S3, Amazon Redshift and Amazon Elasticsearch, and a data latency of 60 seconds or higher.
Device Connection Combining power of AWS IoT & Alexa Alexa - With the Alexa Skills Kit, you can easily build and add your own skills to Alexa. AWS IoT manages the connection devices and integration with ASK, as well as other backend systems and companion apps. Build skills for Alexa using AWS Lambda. Simply write the code using and upload it as a Lambda function. IoT Apps, Back End System, Big Data, Machine Learning, Storage Voice Control AWS IoT Lambda Alexa Skills Kit Amazon Echo Companion Apps Alexa Voice Service brings voicepowered experiences to any connected devices. Alexa Voice Services
Amazon Lex, Amazon Polly Build conversational apps
Problem To Solve: Next Generation Smart Meters Leveraging AWS IoT for connecting millions of smart meters and exposing their data to several applications running in AWS Includes C3 IoT for grid monitoring, fraud detection, and energy maintenance.