Heute in der Suppenküche: Cognitive Services Allerlei

Size: px

Start display at page:

Download "Heute in der Suppenküche: Cognitive Services Allerlei"

Anis Sims
5 years ago
Views:

1 Heute in der Suppenküche: Cognitive Services Allerlei Marcel Tilly Microsoft Constantin Kostja Klein Freudenberg

2 Our Sponsors

3 What product is Joe most likely to buy?

4 Will Sarah come back to shop with us next month?

5 How do they feel about my products?

6 Characteristics of an Intelligent App How the user sees it Personalized, friendly, approachable, natural Predictive, current, and familiar Always available, always contextual What it means for you as a Dev Facial recognition, emotion detection Text and speech interactions 360 awareness of the user Changes in real-time based on user action and new external data Predictive models based on user context to anticipate actions Robust information management required Experiences delivered across all form factors and a wide variety of interaction models (e.g. touch, speech, text) Distributed support, massive scale, elasticity

Microsoft s history in Artificial Intelligence 1995 1996 2002 2011 2014 2015 Today Microsoft BOB, the first Microsoft personal assistant Grammar checker in Office 97 Handwriting recognition in

7 Microsoft s history in Artificial Intelligence Today Microsoft BOB, the first Microsoft personal assistant Grammar checker in Office 97 Handwriting recognition in Windows XP Face recognition and image stitching in Windows Live Photo Gallery Natural language understanding in Skype Translator & Cortana Device face authentication in Windows Hello Microsoft Cognitive Services & Cortana Intelligence Suite Satya Nadella Microsoft CEO I believe over the next decade computing will become even more ubiquitous and intelligence will become ambient.

8 Cortana Intelligence Suite TRANSFORM DATA INTO INTELLIGENT ACTION Data Sources Information Management Big Data Stores Machine Learning and Analytics Intelligence People Data Factory Data Lake Store Machine Learning Cognitive Services Data Catalog SQL Data Warehouse Data Lake Analytics Bot Framework Web Apps Event Hubs HDInsight (Hadoop and Spark) Cortana Apps Mobile Stream Analytics Bots Dashboards & Visualizations Sensors and devices Power BI Automated Systems Data Intelligence Action

9 Cognitive Services Give your solutions a human side

13 Search APIs

16 Language understanding intelligent service Reduce labeling effort with interactive featuring Use visualizations to gauge performance and improvements Leverage speech recognition with seamless integration Deploy using just a few examples with active learning

17 Language understanding models

19 OCR Face LUIS Linguistics Vision Recommendations

20 Bot Framework Preview

21 BOT

22 MyTrainingLog BOT Use Cases Easy way to add new training data via Skype (and other communication channel) Easy way to ask for training data via Skype Easy way to get a summary of last week

23 3 Demo: Bot LUIS Azure Functions 2 Bot Framework LUIS Azure Function 1 connect 4 call Skype Slack WebChat SMS

Azure Functions Azure Functions Process events with

js, F#, Python, PHP, Batch and more Easily schedule

24 Azure Functions Azure Functions Process events with Serverless code. Make composing Cloud Apps insanely easy Develop Functions in C#, Node.js, F#, Python, PHP, Batch and more Easily schedule event-driven tasks across services Expose Functions as HTTP API endpoints Scale Functions based on customer demand Easily integrate with Logic Apps

25 1 My Azure Function Create a new function (WebHook C#) Configure data connection via Function app settings Add new file project.json and paste Implement your code: public static async Task<HttpResponseMessage> Run (HttpRequestMessage req, TraceWriter log) { } Save & test

2 Configure LUIS Go to: https://www.luis.

26 2 Configure LUIS Go to: Create a new app Go to Preview Add intents & entities Bind your actions to intents Action fulfillment

27 3 Setup the BOT Go to: Register a new bot Name Bot handle Description (Why is this mandatory?) Massaging endpoint (-> copy from LUIS!) AppID Publisher Profile ( -> super important!!!!) SAVE Test connection Select && configure channels Skype

28 4 Go back to LUIS! Go to publish! Enable Bot Framework Make sure the AppID is set correctly! Ignore privacy DONE! (well, hopefully)

29 Try it! Add a new entry: Today 30 km on bike for about 60 min Get some logs: Get last 10 trainings Get last training Get some summary: Summary of last week

Save the Dates! PASS Camp 2016-06. to 09.

30 Save the Dates! PASS Camp to 09. December 2016 SQL Konferenz to 16. February 2017

31 FRAGEN???

32 How did you like it? Please give feedback to the event: to me as a speaker:

##SQLSatMadrid. Project [Vélib by Cortana]

##SQLSatMadrid. Project [Vélib by Cortana] Project [Vélib by Cortana] BIG Thanks to SQLSatMadrid Sponsors Speakers Agenda Presentation of the Project Cortana Intelligent Suite Creation of the architecture Purpose of the Project Get a descriptive