Azure as The Internet for Things

Transcription

1 Azure as The Internet for Things WAZUG NL October 27 th Valery Jacobs

2 Links mentioned/requested during the session: (Home base for Microsoft IoT content & W10 IoT Core) (for ordering devices, sensors and a whole lot more) (local web shop for IoT stuff)

3 The four eras of computing 1960s 1980s 2000s 2020s Mainframe era PC era Mobility era IoT era one computer thousands of users one computer one user several computers one user many computers one to many users

4 Smart Products Grid Renewables Oil/Gas/Coal Recovery and Distribution Points of Sale Restaurants Hotels Fuel Stations Patients Clinics Hospitals Nursing Homes Mobile Care Safety Security Comfort Lighting Automation Manufacturing Integration and Automation Remote Servicing Predictive and Reactive Maintenance Water Waste Pollution Control Fire Emergency Public Safety Law Enforcement Letters Packages Containers Tanks Bulkware Games Events Sports Television Streaming Traffic Buses Cars Trucks Trains Vessels Aircraft Bikes Smart Energy Smart Retail Smart Mobility Smart Logistics Smart Factory Smart Cities Smart Entertainment Smart Healthcare Smart Building Home

5

6

7

8

9

10

11

12 IoT Architecture

13 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

14 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

15

16 Windows 10 IoT Core

17 Demo:Windows 10 IoT quick peek

18 Azure IoT Starter Kits

19 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

20 IOT SECURITY 2000 Sewage treatment plant release ¼ million gallons of raw sewage 2003 Slammer Worm disables Nuclear power plant Sobig virus shuts down train signaling in the US Alarm failure causes power loss, impacting 50M people DaimlerChrysler plants shutdown due to Zotob Worm year old hacks tram system 12 injuries 2009 Faulty sensor causes Metro collision fatal 2010 Stuxnet disrupts 14 plants including uranium enrichment facility Attacks on energy grids 2014 Hackers attack German steel mill melt down 2015 Consumers get both baked and frozen due to faulty thermostats 2016 more to come

21 Threat possibilities T,I,D S,T,R,I,D,E T,I,D S,T,R,I,D,E Spoofing Tampering Repudiation Information Disclosure Denial of Service Elevation of Privilege Operator S,R IoT Backend IoT Device T,I,D T,I,D T,I,D T,I,D Configuration T,R,I,D

22 Demo: Shameless Shodan

23 TPM (Trusted Platform Module) Generate, store, use, and protect cryptographic keys Keeps private part of key pairs away from your/others code and OS memory Supported on: Windows 10 Windows 10 Mobile Windows Server 2016 Windows 10 IoT Core (IoT Core) Rpi 2/3 only support TPM emulator

24 Blockchain & IoT? Central Ledger Distributed Ledger Trust one Trust none

25 Tangle = Blockchain without blocks nor chain Directed Acyclic Graph - Scalable No transaction fees

26 Protocols AMQP (Advanced Message Queuing Protocol) reliability & interoperability binary wire protocol extensible

27 Protocols MQTT (Message Queue Telemetry Transport) simplicity, less features ideal for smaller devices and low bandwidth widely adopted

28 + Azure 12 byte messages < 140 per day Multi year battery life KMs of range <10$ per device 7 million devices deployed today

29

30 DEMO: Coverage check

31 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

32 Gateway topology

33 Fog computing AKA Edge computing Data handling/analytics/intelligence at the edge (in the field) IoT Gateway SDK IoT Protocol Gateway SDK Open Fog Consortium

34 Azure IoT Gateway SDK Connectivity bridge Protocol bridge Security bridge Device proxy

35 Azure IoT Gateway SDK Can run in the cloud (VM, Role, Service Fabric, etc.) Can run on-premises in a gateway device Linux, Windows, where C runs.

36 Azure IoT Gateway Architecture On-prem gateway Local file Properties Properties IoT Hub Content Content Out-of-the-box Modules or Custom (Today) BLE (Bluetooth Low Energy) Module Logger Module Identity Map Module IoT Hub Module Sample (today) Simulated Device Module Hello World Module Future Azure IoT Modules OPC-UA Modbus BACnet Filter (ASA)

37 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

38 IoT Hub IoT Hub D2C send endpoint C2D queue endpoint IoT Hub File Upload D2C receive endpoint Event processing (hot and cold path) device Device id C2D send endpoint Device Device IoT Device management Twin Msg feedback and monitoring endpoint Device business logic, Connectivity monitoring Field GW / Cloud GW Device IoT Hub management Device identity management Device provisioning and management

39 IoT Hub vs Event Hubs Area IoT Hub Event Hubs Comm. pattern D2C + C2D D2C (and other event ingress) Protocol MQTT, AMQP (WS), HTTP/1, Azure IoT Protocol Gateway AMQP (WS), HTTP/1 Security Per device key or X509 certificate SAS, No per device cred. or antispoofing included Monitoring Event subscriptions Only aggregate metrics Scale SDK Millions simultaneously connected devices 5000 AMQP connections. Partition support.net, C (AMQP, HTTP send) File upload File notification endpoint Claim check pattern + provided storage key

40 IoT Hub vs Event Hubs Area IoT Hub Event Hubs Comm. pattern D2C + C2D D2C (and other event ingress) Protocol MQTT, AMQP (WS), HTTP/1, Azure IoT Protocol Gateway AMQP (WS), HTTP/1 Security Per device key or X509 certificate SAS, No per device cred. or antispoofing included Monitoring Event subscriptions Only aggregate metrics Scale SDK FOR IOT DEVICE CONNECTIVITY SCENARIO s Millions simultaneously connected devices FOR MASSIVE EVENT INGRESS IN INTER & INTRA DATACENTER SCENARIO s 5000 AMQP connections. Partition support.net, C (AMQP, HTTP send) File upload File notification endpoint Claim check pattern + provided storage key COMPLEMENTARY TO

41 DEMO: Azure IoT Hub

42 1 MB/Min/Unit 280 Msg/Min/Unit 16 MB/Min/Unit 4k Msg/Min/Unit 814 MB/Min/Unit 208k Msg/Min/Unit

43

44

45 IoT Hub High Availability & Disaster Recovery Self-initiated RTO of 2-26 hours RPO on CName loss, Identity Registry (5min), Unread messages, C2D (5min) Regional failover practice: Provision 2 nd IoT Hub in secondary region Implement concierge service

46 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Concierge Service

47 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Concierge Service

48 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Concierge Service

49 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device Registry sync Device C Secondary IoT Hub Concierge Service

50 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Concierge Service

51 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Concierge Service

52 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device Registry sync Device C Secondary IoT Hub Concierge Service

53 IoT Hub HA Concierge Service Device A Primary IoT Hub Device B Device C Secondary IoT Hub Azure Traffic Manager Concierge Service Concierge Service

54 IoT Hub HA Concierge Service Device A Primary IoT Hub Back-end logic Device B Device C Secondary IoT Hub Idem potency Tolerance for out-of-date state Azure Traffic Manager Concierge Service Concierge Service

55 Replace or decommission devices after failure, upgrade cycle or service lifetime RETIRE PLAN Group devices and control access according to your organization's needs Monitor device inventory, health & security while providing proactive remediation of issues MONITOR CONFIGURE PROVISION Securely authenticate devices, on-board for management and provision for service Provide updates, configuration & applications to assign the purpose of each device

56 Device app Read, receive change notifications Read, write IoT Hub Device twin Tags Properties Desired Reported Back end Read, write Read, write Read

57

58 IoT SDKs Device Device Custom Protocols AMQP, MQTT, HTTPS Custom Cloud Gateway (Cloud Service, VM) Cloud protocol gateway sample Management app Device registry Monitoring Send commands IoT Hub service SDK Applications: - Companion apps - Dashboards - Controllers - IoT Hub device SDK Device IoT Hub CoAP, AllJoyn, OPC, Device Field Gateway IoT Hub Gateway SDK AMQP, MQTT, HTTPS Device CoAP, AllJoyn, OPC, Device Field Gateway OPC, HTTP, CoAP, VPN/ExpressRoute Cloud protocol gateway sample Custom Cloud Gateway (Cloud Service, VM) Management app - Device registry - Monitoring - Send commands IoT Hub service SDK Your code Azure IoT open source code

59 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

60 Azure Stream Analytics

61 Azure Stream Analytics Can pump data out of an Event Hub, IoT Hub or Blob storage Query output options: SQL DB Blob Storage Table Storage Event Hub SB Queue & Topic DocumentDB Power BI Data Lake Store

62 Azure Stream Analytics 1 MB/s per streaming unit 50 SU s per job (or more via support) Can combine multiple Event Hubs SQL-like query language

63 Azure Stream Analytics Feature parity in new portal Improved debug experience

64

65 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

66

67 Cortana Intelligence Suite Data Sources Information Management Big Data Stores Machine Learning and Analytics Intelligence People Data Factory Data Lake Store Machine Learning Cognitive Services Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Apps Event Hubs & IoT Hub HDInsight (Hadoop and Spark) Cortana Apps Mobile Stream Analytics Bots Dashboards & Visualizations Sensors and devices Power BI Automated Systems Data Intelligence Action

68 Cortana Intelligence

69

70 Next gen. computing for next gen. AI CPU GPU FPGA HPU NSP Central Processing Unit: Fixed architecture Generic applications Limited performance Graphical Processing Unit: Fixed architecture Fast in specific tasks Field Programmable Gate Array: Programmable CPU Can be VERY fast Holographic Processing Unit: Senses our environment Renders holograms on top of it Nurosynaptic Processors : Learns Understands

71 Neurosynaptic benchmark NSPs 1 million 90 million 50 billion 100 billion 300 billion

72 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

73

74

75 Data Workshops Aka.ms/bringyourowndata

76 Session scope Device Network Gateway Endpoint / Buffer Hot - path Big Data Insights & Visualization Fix / Act / Integrate Cold - path Machine learning

77 Azure IoT Suite Sample of a complete IoT solution Meant to kick-start YOUR IoT project Big footprint by default, tunable in every way Code on GitHub

78 Azure IoT Suite

79

80 THANK YOU! VALERY

81 Azure Data Lake (Store, HDInsight, Analytics) ADL Analytics ADL HDInsight Compute U-SQL Hive Hive YARN Data WebHDFS Store

82 HDINSIGHT WITH SPARK

83

84

85 Machine Learning

86

87 POWER BI

88