##SQLSatMadrid. Project [Vélib by Cortana]

Size: px

Start display at page:

Download "##SQLSatMadrid. Project [Vélib by Cortana]"

Alaina Strickland
5 years ago
Views:

1 Project [Vélib by Cortana]

2 BIG Thanks to SQLSatMadrid Sponsors

3 Speakers

4 Agenda Presentation of the Project Cortana Intelligent Suite Creation of the architecture

5 Purpose of the Project Get a descriptive analysis in real time of the Vélib. Provide predictive analysis to predict the availability of the number of bike and stations available.

6 Objectives of the solution Users Bikes Stations

7 1500 Per bikes

8 Transform data into intelligent actions

9 [Vélib by Cortana] - Architecture Data flow Processing 1 min Cloud service

10 API JCDecaux

11 Azure Cloud Service

12 [Vélib by Cortana] - Architecture Data flow Processing 1 min Cloud service Azure Event Hub

13 Azure Event Hub

14 [Vélib by Cortana] - Architecture Data flow SQL Database Processing 1 min 5 min Cloud service Azure Event Hub Azure Stream Analytics Power BI

Azure Stream Analytics Processing continuous data Collecting millions of events per second Built-in Scalable solution Transform, enrich, temporal operations Detecting patterns and anomalies Data flow

15 Azure Stream Analytics Processing continuous data Collecting millions of events per second Built-in Scalable solution Transform, enrich, temporal operations Detecting patterns and anomalies Data flow correlated with baseline data PCs/ Laptops POS Terminals Self Checkout Stations Smart Phones Kiosks Slates/ Tablets Point of Service Devices Automation Devices Servers Digital Signs Logic Controllers ATM Security Thin Clients Remote Medical Monitors Vending Machines Handhelds Kinect Specialized Devices Diagnostic Equipment

16 Azure Stream Analytics

17 Lambda Architecture Retrieving data from stations that follow two processes: A stream will be processed in real time A stream will be stored to be processed and analyzed

18 Azure SQL Database

19 [Vélib by Cortana] - Architecture Azure Machine Learning Data flow SQL Database Processing 1 min 5 min 1 heure Cloud service Azure Event Hub Azure Stream Analytics Power BI

20 Exploratory Data Analysis

22 Model Architecture Raw Training set Statistical features Mean Standard deviation Variance Skewness Kurtosis Min Max Cumulative frequency Median absolute deviation Temporal features Forecast horizon Hour Minutes day month Lag t-1 à t-4 Distirbuted lag model 1st & 2 nd order derivative Moving average exponentially weighted moving average Learner Decision Forest regression Cross validation hyper Parameters optimisation Output

23 [Vélib by Cortana] - Architecture Azure Data Factory Azure Machine Learning Data flow SQL Database Processing 1 min 5 min Cloud service Azure Event Hub Azure Stream Analytics Power BI

24 Azure Data Factory

25 [Vélib by Cortana] - Architecture Azure Data Factory Azure Machine Learning Data flow SQL Database Processing 1 min 5 min Cloud service Azure Event Hub Azure Stream Analytics Cortana Power BI

26 Power BI

27 Cortana Cortana understands and shows the state of stations for now and for the following hour : «Prévisions pour la station madeleine» «Forecasts for the station madeleine» «Mostrar próxima disponibilidad en Madeleine»

28 [Vélib by Cortana] - Architecture Azure Data Factory Azure Machine Learning Data flow SQL Database Processing 1 min 5 min Bots Cloud service Azure Event Hub Azure Stream Analytics Cortana Power BI

29 Cortana Intelligence Suite Data Sources Information Management Data Factory Big Data Stores Data Lake Store Machine Learning and Analytics Machine Learning on the shelf Intelligence Cognitive Services People Apps Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Bots Data Sensors and devices Stream Analytics Dashboards & Visualizations Power BI Automated Systems Data Intelligence Action

30 Bot Framework logic Web service LUIS

31 Bot Connector Your bot

32 Language Understanding Intelligent Service Reduce labeling effort with interactive featuring Seamless integration to Speech API Deploy using just a few examples with active learning Supports 5 languages (English, Chinese, Italian, French, Spanish)

33 { } entities : [ { entity : flight_delays, type : Topic } ], intents : [ { intent : FindNews, score : }, { intent : None, score : }, { intent : ReadNews, score : }, { intent : ShareNews, score : E-06 } ]

34 Gracias, Merci, Thank You! Gracias a los organizadores Alias : velibteam@microsoft.com Links :

Cortana Intelligence Suite; Where the Magic Happens

Cortana Intelligence Suite; Where the Magic Happens Reza Rad, Leila Etaati #509 Brisbane 2016 About Us Reza Rad Leila Etaati MVP BI Consultant and Trainer Author of Books Speaker in conferences; PASS Summit,