5 reasons I am excited about IoT and Cortana Analytics

Transcription

1 5 reasons I am excited about IoT and Cortana Analytics Iman Eftekhari b-imefte@microsoft.com i.e@agilebi.com.au

2 Iman Eftekhari BI Consultant and Agile Coach Microsoft P-TSP Data Analytics MCSE (BI), MCITP (BI), Certified Scrum Professional, Co-founder of Agile BI consulting in Australia Co-organiser of the SYBIS and Modern Excel and Power BI User Groups Worked on DW/BI projects for more than 40 clients including banks, health, and the public sector in different countries Blog Twitter LinkedIn Website

3 More about me

4 Sponsors

5

6 Internet of Things

7 Internet of Things (IoT) Internet of Things (IoT), describes a world in which objects that form part of our everyday lives can communicate through various networks, including the Internet. There will be a global system of interconnected computer networks, sensors, actuators, and devices all using the Internet, this has so much potential to change our lives. Slide 7

8 Examples Wake up to the smell of freshly brewed coffee with IoT No more groggy mornings, with IoT you are guaranteed a better nights sleep Slide 8

9 Create the Internet of Your Things Microsoft's vision for IoT

10 So this is why I am excited about IoT

11 1, 2, 3, 4, 5

12 IoT devices are now cheaper, better and easier to work with

13 Even kids can do IoT projects now!

14 IoT devices are now cheaper, better and easier to work with

15 1, 2, 3, 4, 5

16 IoT can utilise the power of analytics on the cloud Cortana Analytics

17

18 Cortana Analytics Suite Transform data into intelligent action Business apps People Custom apps Sensors and devices Cortana Analytics Automated Systems DATA INTELLIGENCE ACTION

19 Cortana Analytics Suite Transform data into intelligent action DATA INTELLIGENCE ACTION

20 Cortana Analytics scenarios EXAMPLE SOLUTIONS

21 1, 2, 3, 4, 5

22 Vendors alliance and collaboration on IoT

23 Microsoft + Particle new integration for the Internet of Things Microsoft and Particle announced a collaboration focused on enabling customers to rapidly develop connected Internet of Things (IoT) devices.

24 Microsoft + Particle new integration for the Internet of Things

25 1, 2, 3, 4, 5

26 Microsoft IoT ConnectTheDots.io is an open source project created by Microsoft Open Technologies to help you connect your devices with Microsoft Azure, and to implement IoT solutions. Slide 28

27 1, 2, 3, 4, 5

28 Sky is your limit! Unlimited opportunities No need to be a programmer or a hardware expert

29 It is time for a smarter home & office Slide 31

30 Denmark is a leader

31

32 Scenario Many companies leave their lights on overnight. This my be due to a; Diffusion of responsibility Lack of individual motivation Forgetfulness Slide 34

33 Save Money and the Environment There is 8-15 hours per day of electricity wasted excluding weekends due to lighting Between ~2000 and ~4000 electricity hours wasted per lightbulb per year Lighting and office equipment produces a lot of heat and can account for up to 15% of the companies air conditioning costs Slide 35

34 Our Experiment With a basic motion sensor set up and connected to a Raspberry Pi 2 we were able to stream in real time to Microsoft Azure how many people per hour entered our office. Slide 36

35 Data Flow

36 What Do You Need? Software 1. Microsoft Azure subscription 2. Visual Studio 2013 Hardware 1. Raspberry pi 2 2. Motion sensor 3. Power adapter

37 How Does It Work? Device basics 1. Sensor sends the data to Raspberry Pi 2. Raspberry Pi receives the JSON string 3. Raspberry Pi packages the strings into AMQP message and sends it to Azure Event Hub Devices and Gateway 1. Sending data from the sensor to the gateway (Raspberry Pi), using a device protocol adapter to implement any transport 2. The adapter collect data from the device and enqueuer them to the gateway for upload to the cloud Slide 40

38 IoT Project Set-up Step 1 Clone or copy the project to your machine 1. Go to 2. Download the project Slide 41

39 IoT Project Set-up Step 1

40 IoT Project Set-up Step 2 Create Azure resources for IOT infrastructure Create Events Hub Slide 43

41 IoT Project Set-up Step 2 Slide 44

42 Cortana Analytics Suite DATA INTELLIGENCE ACTION

43 IoT Project Set-up Step 3 Device setup 1. Connect the devices Raspberry PI Arduino Motion Sensor 2. Configuration of devices Slide 46

44 IoT Project Set-up Step 3 Slide 47

45 IoT Project Set-up Step 4 Sample website deployment: publishing a website 1. Configure web.config 2. Publish the Azure website 3. Websockets settings 4. Running the site Slide 48

46 Cortana Analytics Suite DATA INTELLIGENCE ACTION

47 IoT Project Set-up Step 5 Stream Analytics integration: configuring Stream Analytics to send alerts and averages to the sample website / Power BI 1. Create a new Azure Stream Analytics job Create an input Create a query Create an output Start the job Slide 50

48 Azure Stream Analytics is cool! Real-time Analytics Intake millions of events per second (up to 1 GB/s) Low processing latency, auto adaptive (sub-second to seconds) Correlate between different streams, or with reference data Find patterns or lack of patterns in data in real-time

49 Azure Stream Analytics Monitoring and troubleshooting of solution Develop solutions and infrastructure for increasing scale with business growth Develop solutions to manage resiliency, such as infrastructure failures Develop solutions to integrate with other components like ML, BI etc Develop solution (code) for ingress, processing and egress Infrastructure Procure and setup Focus on building solutions not on solution infrastructure and get there faster

50 SAQL & Hopping Windows A 10-second Hopping Window with a 5-second Hop Every 5 seconds give me the count of tweets over the last 10 seconds SELECT Topic, Count(*) AS TotalTweets FROM TwitterStream TIMESTAMP BY CreatedAt GROUP BY Topic, HoppingWindow(second, 10, 5)

51 Scaling using Partitions Partitioning allows for parallel execution over scaled-out resources SELECT Count(*) AS Count, Topic FROM TwitterStream PARTITION BY PartitionId GROUP BY TumblingWindow(minute, 3), Topic, PartitionId Event Hub Query Result 1 Query Result 2 Query Result 3

52 Azure ML and Stream Analytics are now integrated Azure ML can publish web endpoints for operationalized models Azure Stream Analytics can bind custom function names to such web endpoints Example: apply bound function event-by-event SELECT text, sentiment(text) AS score FROM mystream sentiment mapped to endpoint/api key

53 Cortana Analytics Suite DATA INTELLIGENCE ACTION

54 IoT Project Set-up Step 6 Slide 58

55 IoT Project Set-up Step 6 Power BI can be used to analyse the captured data Power BI can evaluate and compare the number of times the sensor was triggered Power BI supports real time streaming through Azure Stream Analytics Slide 59

56 Cortana Analytics Suite DATA INTELLIGENCE ACTION

57 Conclusions With Microsoft IoT it was easy to set up and deploy a connected device and stream the data to Azure. Possible applications include a motion tracking system that will be able to; Turn off lights and computers in all unoccupied rooms Turn down the air-conditioning Restore all light and power when the first person arrives in the morning Slide 62

58

59 Future of IoT IoT is already transforming the way we work, live, and interact with our world, with estimates showing that in five years we can expect to see over 25 billion connected things. Microsoft The Industrial Internet of Things will transform companies and countries, opening up a new era of economic growth and competitiveness. Accenture

60