Create Natural User Interfaces with the Intel RealSense SDK Beta 2014

Transcription

1 Create Natural User Interfaces with the Intel RealSense SDK Beta 2014

2 The Intel RealSense SDK Free Tools and APIs for building natural user interfaces. Public Beta for Windows available Q Accessible for beginners. Open and extensible for experts. Support for Windows 8.1 today. Android support coming. Reach a broad-base of customers by writing apps for the Intel RealSense 3D Camera. Stand out in a crowded market. Delight your customers. Works with languages, frameworks, and game engines you already use 2

3 The Intel RealSense SDK understands 4 basic types of input Use standalone or in combination Categories of Input Capabilities Features Hands Hand and Finger Tracking Gesture Recognition Hands Face Face Detection and Tracking Face Speech 22-point Hand and Finger Tracking 9 static and dynamic mid-air gestures Speech Speech Recognition Command and Control Dictation Multiple Face Detection and tracking 78-point Landmark Detection (facial features) Emotion Recognition (7 emotions, coming post-beta) Face Recognition (Coming post-beta) Text to Speech Environment 3D Scanning Environment Segmentation Augmented Reality Background Removal 3D Object / Face 2D/3D Object Tracking Scene Perception (coming post-beta) 3

4 The Developer Kit When we roll out the public beta SDK in Q3 of 2014, we ll release a developer kit to help you get started Kit includes The Intel RealSense SDK Beta for Windows Peripheral depth camera Full VGA depth resolution 1080p RGB camera meter range USB 3.0 interface Requires 4 th generation Intel Core processor (or later) Available for purchase at intel.com/software/realsense 4

5 What Kinds of Applications can Intel RealSense Technology Enable? Capture and Share Immersive Collaboration/Creation Innovate on top of our application come Gaming Learning and and Play up with Edutainment the Interact Naturally categories. YOU will next big thing 5

6 SDK Supported Features Required Hardware A system with a minimum of a 4th generation Intel Core processor (codenamed Haswell), either IA-32 or Intel 64, with integrated depth camera Required OS Supported Programming Languages Supported IDE Supported Development Tools Microsoft* Windows 8.1 OS (32- and 64-bit) Microsoft* Windows 8.1 Metro (coming soon) C++, C#, JavaScript, Java (JDK 1.7.0_11 or later for face, voice, and gesture) Microsoft* Visual Studio C with service pack 1 or newer Eclipse.org IDE -Microsoft*.NET 4.0 Framework for C# development -Unity* PRO or later for Unity game development -Processing* or later for Processing framework development -Havok* Vision SDK or later for Havok Vision SDK development -Intel Media SDK Intel SDK for OpenCL Applications 2013 * Other names and brands may be claimed as the property of others 6

7 Additional SDK Features Input Device Manager Multiple applications can access data from the Camera simultaneously Multi-Mode Support Power Management State Support multiple usage modes within a single app (e.g. finger tracking + speech + face tracking) or between apps Apps can manage battery life Extensible Framework Privacy Notification Tool Developers can plug in their own algorithms. New usage modes can be added. New devices can be supported. Notifies user when camera is turned on by an app 7

8 Web / HTML5 Web Socket Communication :4181 SDK Local Web-Socket Server Intel RealSense SDK runtime Internet Browser Unity Web Player App HTML5 / JavaScript Operating System Trigger face and gesture events, just like in C# applications Switch to the web player platform for deployment Gestures and Facial Analysis Unity* Web Player games HTML5 / JavaScript (interactive websites) 8 * Other names and brands may be claimed as the property of others 8

9 Unity* Productivity Extension A set of scripts that provides configurable actions/rules based on the capabilities provided in the SDK. Programming: Associate your game objects with the action scripts. Programming: Create rules. Associate your game objects with rules. Drag and drop programming Write less code! * Other names and brands may be claimed as the property of others 9

10 Q&A 10

11 Backup 11

12 The Intel Perceptual Computing SDK 2013 was Finger/Hand Tracking Facial Analysis Background Subtraction Speech Recognition Coming in 2014! Intel RealSense SDK Evolved & enhanced algorithms Depth camera integrated in OEM devices 3D Scanning Depth-enhanced Augmented Reality And more. Make your apps immersive, intuitive and engaging with Intel RealSense Technology Free download at software.intel.com/realsense All products, software, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.

13 What s New in the Intel RealSense SDK 2014? 3D Scanning 3D Augmented Reality 3D Hand Skeleton Grammar for Speech Intel RealSense SDK 2014 Enhanced Hand/Finger tracking 3D Facial Analysis Next Generation Integrated Depth Camera Windows* 8.1 Desktop & Metro* Gesture Authoring Tool Unity* ToolKit Perceptual Productivity Extensions 13

14 Enabling the broad ecosystem through contests and investments Ecosystem Activities Intel Perceptual Computing SDK 2013 has been downloaded more than 35,000 times Submissions from 17 countries Contest winners including 25+ scaling apps UX Documentation, Tools, Samples, and Tutorials Webinars Virtual Application Engineer Sessions RealSense labs at tradeshows Worldwide Hackathons RealSense Resource Center Forums App Discovery Portal Contest Part 2 Intel RealSense Online Developer Resource center 14

15 15