3D MACHINE VISION PLATFORM

Transcription

1 3D MACHINE VISION PLATFORM

2 AGENDA Company Overview Market Positioning Product Portfolio Applications 2

3

4 History & Business Model LIPS was founded in 2013 by a team consisting of research scholars from CSAIL, MIT. Positioned as 3D Machine Vision Platform provider offering: 3D depth cameras based on ToF, Structured Light, and Active Stereo technologies Standard recognition middleware Standard solutions Customized camera design, middleware, and total solution projects for developers and marketers worldwide 4

5 Organization

6 Core Competency 3D Depth Camera Middleware Algorithm Patents Teams First LIPS ToF camera successfully brought to market in 2016 that effectively creates a 3D Machine Vision Platform that help shorten customer product s time to market Hard-to-achieve high-entrybarrier and seamless integration of OP, ME, EE, and Software Strong and efficient SCM and OEM partnership in Taiwan Small size, low cost, and MP ready Customizable Deep learning AI framework Parallel processing (OpenCL, CUDA, FPGA) Machine vision recognition algorithms Applications Approved: USA x 2, China x 2, Taiwan x 5 Pending: USA x 6, China x 5, Taiwan x 2 MIT CSAIL lab scholars Members of the teams from veterans in Optical, ME, EE, and Software industries 5 Ph.D. in special optics and machine vision 6

7 Technology Platform Architecture (3 rd party applications) (3 rd party middleware) Gesture Recognition Applications (other Middleware) OpenNI User Tracker Hand Tracker (3 rd party plugins) LIPS Host Post Processing and Optimization (Windows, Linux, Android, and Mac) LIPSedge Series Depth Cameras 7

8 Technology Patented Automatic Calibration 8

9 Worldwide Distribution of Customers 9

10 10

11 Overall Market Technology Host Verticals Stereo Standalone Professional Automotive Structured Light Laptop/Computer Robotics active Time of Flight Smartphone 3D Metrology Active Stereo Tablet Retail Security Healthcare 3D Scanning/Printing Grow at CAGR 48% over the next decade to reach approximately $64.5 billion by 2025 Gaming AR/VR 11

12 3D Machine Vision Ecosystem Application Solutions Tier 3 Middleware (facial, gesture, SLAM, metrology ) Depth Camera Tier 2 Tier 1 Vision Platform 12

13 LIPS in the Ecosystem 3rd Party Solutions LIPS Solutions Tier 3 3rd Party Middleware LIPS Middleware (facial, gesture, SLAM,metrology ) Tier 2 Vision Platform Tier 1 13

14 Target Markets Features Verticals vs Applications US$100+ price range vs US$20,000 Short-to-mid sensing range (0.2~10m) Indoor, outdoor, and low/no-light conditions Small-sized or embedded system Medical/Healthcare Factory Automation Logistics Retail Fashion Security Fall Detetion elderly care Gesture/Posture Control v 3D Scan intraoral, dental v body scan for virtual fitting room 3D Metrology v v AGV/Robotic Navigation v v v People Counting v v Face Recognition v v 14

15 The art of seamless integration between OP,ME,EE, and Software 15

16 LIPSedge Series Depth Cameras ToF AT (Cyclone V based) FoV 74 o x 58 o x 88 o 640x480@30fps 190x50x56mm w/o IMU ToF DL FoV 75.4 o x 60.2 o x 88 o 640x480@60fps 113x37x26mm w/o IMU ToF M3 FoV 74.1 o x 57.5 o x 92 o 80x60@120fps 37x28x15mm w/ IMU Active Stereo M5 FoV 60 o x 47 o 640x480@60fps 70x15x5mm w/ IMU * Depth cameras models are categorized by technologies it s based on * ToF stands for Time of Flight. Active Stereo is a hybrid design of structured light and stereo technologies. * AT is a standalone model that doesn t require a host. 16

17 LIPS 3D Vision Middleware 3/6 3D Dimensioning Windows, Linux 3D Metrology middleware currently offers automatic measurement over L-W-H sizes of cuboid-shape object typically cardboard boxes. Automatically measures the sizes of box in rectangular cuboid under the following conditions: Max Measuring Size (L x W x H): 1500 x 1500 x 1500 (mm) Min Measuring Size (L x W x H): 200 x 200 x 200 (mm) Shape: Cuboid Distance Tolerance: Optimal measuring distance ±20% Measuring Accuracy: ±5% Measuring Latency: <0.5 Sec Box tagging People Counting Windows, Linux People counting can differ dramatically in the way how people is to be counted as to from what angle the depth camera is mounted. Functions: Can detect multiple people (i.e. overlapping at the detection section) at the same time walking at both direction at normal walking speed across vertical detection cross section. Can detect adults or kids (i.e. of different heights) Can count the amount of leaving event and entering event. Count accuracy (recall rate): 90% Driver Fatigue Detection Windows, Linux It analyzes facial features including closing both eye lids and/or head s forward pitch angle greater than pre-defined degree for a pre-defined length of seconds, that signifies fatigue. Functions: Can detect the fatigue related feature include: eyes closing, nodding and yawning. Can calculate the level of fatigue and sends notification event. 17

18 LIPS 3D Vision Middleware 6/6 Hand Gesture Windows, Linux This middleware captures detected hand s various gestures moving in a relatively natural motion. Motions: Swipe left Swipe right Swipe up Swipe down Push forward Finger count Detection range: 0.5~2 meters (initial detection range, once detected can be tracked up to 4 meters) Hand gestures sensitivity configurable at middleware level User Tracking Windows, Linux, Android Full-body user tracking can uniquely segment and track multiple users as well as the motion of the detected body skeletons. Functions: Full-body user tracking with 19 specific skeleton joints. Reliably up to 10 user segmentations/2 user skeletons under Windows, 5 user segmentations/2 user skeletons under Linux or Android. Facial Detection Windows, Linux (Intel, ARM) Facial recognition includes identity, gender, age, liveness, and face s pitch/yaw/roll angles. Functions: Can extract 47 facial landmarks. Can detect identity, gender, and age group (kids, young adult, adult, senior) Face properties include: liveness, face s pitch/yaw/roll angles, face ROI. (NOTE: Fee-based Android solution available on a separate NRE term) 18

19 LIPS ADAS Solution CVBS x 4 F LR R RR 3.5mm Audio 2D Recognition Processor (PD,VD,LDWS) USB 3 Control Bus LIPS 3D Camera 3D Camera Control Bus Video 3D Recognition Processor Host FPGA GPU/Parallel Processing/Neural Network For 3D-Vision Based ADAS Processing Video HDMI CAN Bus 19

20 LIPS 3D Scan Solution 20

21 Your Applications Consumer Robot Cleaner Home Robot AR/VR Gesture Control ADAS & ITS People Counting Factory Automation Healthcare AGV Robotic Arm 3D Dimensioning Elderly Fall Detection 21

22 THANK YOU! LIPS Corporation 22