A FULL-COLOR SINGLE-CHIP-DLP PROJECTOR WITH AN EMBEDDED 2400-FPS HOMOGRAPHY WARPING ENGINE
|
|
|
- Ralph Warren
- 5 years ago
- Views:
Transcription
1 A FULL-COLOR SINGLE-CHIP-DLP PROJECTOR WITH AN EMBEDDED 2400-FPS HOMOGRAPHY WARPING ENGINE Shingo Kagami, Koichi Hashimoto Tohoku University 2018 SIGGRAPH. All Rights Reserved
2 Photography & Recording Encouraged 2018 SIGGRAPH. All Rights Reserved 1
3 MOTIVATION Make every surface around you a display augmented-reality user interfaces media art installations stabilized projection by handheld projectors projector camera Key Challenge: How to achieve low latency 2018 SIGGRAPH. All Rights Reserved 2
4 SEE OUR E-TECH BOOTH 2018 SIGGRAPH. All Rights Reserved 3
5 OUTLINE Motivation Low-Latency Vision and Projection Our Approach for Low-Latency Projection Hardware Implementation Color Representation Results 2018 SIGGRAPH. All Rights Reserved 4
6 LOW-LATENCY VISION AND PROJECTION High-speed real-time-streaming cameras have already become commodity Lightweight fast visual processing algorithms are readily available projector camera [Kagami+, SII2016] Then, what about projection? 2018 SIGGRAPH. All Rights Reserved 5
7 DLP PROJECTORS Digital Micromirror Devices (DMD) switches at up to tens of thousands of fps binary pattern is displayed at a time instant SIGGRAPH. All Rights Reserved 6
8 GRAY-LEVEL IMAGES COMPOSED OF BINARY PATTERNS space Original Video Sequence video frame time time Standard DLP Representation (decomposed into bit planes) observer A number of binary patterns are time-integrated by human vision 2018 SIGGRAPH. All Rights Reserved 7
9 HOW TO ACHIEVE HIGH FRAME RATE Combine with intensity modulation of light sources 8-bit monochrome image represented by (at least) 8 binary frames 3 times more for RGB color images relative intensity of light sources bit plane index time 2018 SIGGRAPH. All Rights Reserved 8
10 POSSIBLE APPROACHES FOR LOW-LATENCY MOTION-ADAPTIVE PROJECTION video-rate input fast pan/tilt mirrors output image normal projectors can be used X limited motion DoF [Okumura+, ICME 2012] high-frame-rate input output image high versatility X high data generation/transfer cost [Watanabe+, IDW 2015] video-rate input output image fast motion command Our Approach [Kagami+, SIGGRAPH Asia 2015 E-tech] 2018 SIGGRAPH. All Rights Reserved 9
11 OUR APPROACH input video video frame time motion command (e.g. rotation angle) time standard DLP representation (adapt to motion only at the video rate) proposed approach (adapt to motion at the binary pattern rate) 2018 SIGGRAPH. All Rights Reserved 10
12 WHAT HAPPENS IN THE OBSERVER S EYES? space space time time observer observer Direction of integration in time-space becomes changed 2018 SIGGRAPH. All Rights Reserved 11
13 RELATED WORK (FOUND IN HMD LITERATURE) Low-latency DMD-based HMD: Maintain ideal target gray-level image at high rate Residual error image toward the ideal one is binarized and presented [Zheng+, ISMAR2014] Or, ideal image is binarized with random threshold [Lincoln+, TVCG 2016] Microsoft Hololens: RGB color fields are sequentially post-warped by newest motion sensor readings [Klein, ISMAR2017 plenary] Decomposition into binary patterns does not take place (since LCoS is used) 2018 SIGGRAPH. All Rights Reserved 12
14 HARDWARE IMPLEMENTATION Our previous prototype [Kagami+, 2015] New prototype DLP7000 Based on Texas Instruments DLP Discovery 4100 Non-modulated white LED Custom controller board Intensity-modulated RGB LED 2018 SIGGRAPH. All Rights Reserved 13
15 HARDWARE IMPLEMENTATION USB HDMI video buffer sequence inst. Registers (homography matrix) homography warping pipelines DMD chipset LEDs and Drivers video-rate input stored in SDRAM storage or streamed via HDMI output image Homography warping parameters (any perspective mapping from plane to plane) SDRAM XILINX Kintex-7 FPGA (XC7K325T) 2740 transforms/s for 1024x768 binary image 2018 SIGGRAPH. All Rights Reserved 14
16 relative intensity DISCUSSION ON COLOR REPRESENTATION 3-bit RGB with 21 binary patterns bit plane index 8-bit RGB with 24 binary patterns bit plane index time [binary frames] time [binary frames] longer sequence needed for more bit depths lower utilization of light 2018 SIGGRAPH. All Rights Reserved 15
17 DESIGN TRADEOFFS binary pattern period: should be short for more color depths with better light utilization should be long for cheaper DMD employed or for small data bandwidth video frame period: should be long for more color depths with better light utilization should be short for quick motion adaptability, if video frame period equals to the unit time for motion adaptation binary pattern period video frame period 2018 SIGGRAPH. All Rights Reserved 16
18 OUR REPRESENTATION FOR 8-BIT RGB bit plane index * This diagram ignores bit splitting and color interleaving relative intensity of light sources 405 us 23 ms With our approach, video frame period and unit time for motion adaptation are independent But the frame period should be short enough to avoid flicker perception 2018 SIGGRAPH. All Rights Reserved 17
19 PROJECTION RESULTS How 24-bpp color image is represented recognized as an external monitor by Windows PC 2018 SIGGRAPH. All Rights Reserved 18
![around 400 fps) See [Kagami+, SIGGRAPH Asia 2015] for](/docs-images/90/103887098/images/20-2.jpg "the detailed algorithm 2018 SIGGRAPH.")
20 PROOF-OF-CONCEPT DEMO: TRACKING PROJECTION ONTO A MOVING SURFACE Basler aca USB-3 camera (run at around 400 fps) See [Kagami+, SIGGRAPH Asia 2015] for the detailed algorithm 2018 SIGGRAPH. All Rights Reserved 19
21 PROOF-OF-CONCEPT DEMO: WARPED PROJECTION BY HAND GESTURE Leap Motion sensor (run at around 200 fps) 2018 SIGGRAPH. All Rights Reserved 20
22 SUMMARY A full-color projector with low-latency motion adaptability per-bitplane warping approach color representation in single-chip-dlp configuration Limitations Warping functions are hard-wired Brighter LEDs should be used for real applications Future work Extending warping functions (e.g. for multiple polygons) User tests for image quality and latency perception Tell us how we did! Complete the Survey by Navigating to this session in the app, Scrolling to the bottom of the screen, and Answering less than 5 questions 2018 SIGGRAPH. All Rights Reserved 21
PRODUCT GUIDE. SuperSpeed DLP V-Modules. World Leader in DLP Light Exploration. A TyRex Technology Family Company
A TyRex Technology Family Company SuperSpeed DLP V-Modules PRODUCT GUIDE World Leader in DLP Light Exploration Digital Light Innovations (512) 617-4700 dlinnovations.com SuperSpeed DLP V-Modules DLi is
Augmenting Reality with Projected Interactive Displays
Augmenting Reality with Projected Interactive Displays Claudio Pinhanez IBM T.J. Watson Research Center, P.O. Box 218 Yorktown Heights, N.Y. 10598, USA Abstract. This paper examines a steerable projection
Active Stereo Vision. COMP 4900D Winter 2012 Gerhard Roth
Active Stereo Vision COMP 4900D Winter 2012 Gerhard Roth Why active sensors? Project our own texture using light (usually laser) This simplifies correspondence problem (much easier) Pluses Can handle different
Small-form Spatially Augmented Reality on the Jetson TX1
Small-form Spatially Augmented Reality on the Jetson TX1 Rahul Prabala Stanford University rprabala@stanford.edu Abstract This paper demonstrates a small-form projector-camera system built from the Intel
Reduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems
Reduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems Angelo A. Beltran Jr. 1, Christian Deus T. Cayao 2, Jay-K V. Delicana 3, Benjamin B. Agraan
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily
Overview. Augmented reality and applications Marker-based augmented reality. Camera model. Binary markers Textured planar markers
Augmented reality Overview Augmented reality and applications Marker-based augmented reality Binary markers Textured planar markers Camera model Homography Direct Linear Transformation What is augmented
Outline. Introduction System Overview Camera Calibration Marker Tracking Pose Estimation of Markers Conclusion. Media IC & System Lab Po-Chen Wu 2
Outline Introduction System Overview Camera Calibration Marker Tracking Pose Estimation of Markers Conclusion Media IC & System Lab Po-Chen Wu 2 Outline Introduction System Overview Camera Calibration
Accelerating Implementation of Low Power Artificial Intelligence at the Edge
Accelerating Implementation of Low Power Artificial Intelligence at the Edge A Lattice Semiconductor White Paper November 2018 The emergence of smart factories, cities, homes and mobile are driving shifts
3,000-fps 3-D Shape Measurement Using a High-Speed Camera-Projector System
Proceedings of the 2007 IEEE/RSJ International onference on Intelligent Robots and Systems San Diego, A, USA, Oct 29 - Nov 2, 2007 ThB1.4 3,000-fps 3-D Shape Measurement Using a High-Speed amera-projector
Estimating the surface normal of artwork using a DLP projector
Estimating the surface normal of artwork using a DLP projector KOICHI TAKASE 1 AND ROY S. BERNS 2 1 TOPPAN Printing co., ltd. 2 Munsell Color Science Laboratory, Rochester Institute of Technology Summary:
3DCITY. Spatial Mapping and Holographic Tools for 3D Data Acquisition and Visualization of Underground Infrastructure Networks
3DCITY Spatial Mapping and Holographic Tools for 3D Data Acquisition and Visualization of Underground Infrastructure Networks CONTENT 1. 3DCITY Project 2. Geolocation 3. Spatial Mapping 4. MR Visualization
Shape and deformation measurements by high-resolution fringe projection methods February 2018
Shape and deformation measurements by high-resolution fringe projection methods February 2018 Outline Motivation System setup Principles of operation Calibration Applications Conclusions & Future work
Mysteries of Parameterizing Camera Motion - Part 1
Mysteries of Parameterizing Camera Motion - Part 1 Instructor - Simon Lucey 16-623 - Advanced Computer Vision Apps Today Motivation SO(3) Convex? Exponential Maps SL(3) Group. Adapted from: Computer vision:
What have we leaned so far?
What have we leaned so far? Camera structure Eye structure Project 1: High Dynamic Range Imaging What have we learned so far? Image Filtering Image Warping Camera Projection Model Project 2: Panoramic
FPGA BASED OBJECT TRACKING SYSTEM PROJECT APPROVAL
FPGA BASED OBJECT TRACKING SYSTEM PROJECT APPROVAL Design of Embedded System Advanced Course-EDA385 Department of Computer Science, Lund University Submitted By HARSHAVARDHAN KITTUR aso10hki@student.lu.se
Supplementary materials of Multispectral imaging using a single bucket detector
Supplementary materials of Multispectral imaging using a single bucket detector Liheng Bian 1, Jinli Suo 1,, Guohai Situ 2, Ziwei Li 1, Jingtao Fan 1, Feng Chen 1 and Qionghai Dai 1 1 Department of Automation,
Photoshop PSD Export. Basic Tab. Click here to expand Table of Contents... Basic Tab Additional Shading Tab Material Tab Motion Tab Geometry Tab
Photoshop PSD Export Click here to expand Table of Contents... Basic Tab Additional Shading Tab Material Tab Motion Tab Geometry Tab The Photoshop PSD Export image filter is an image saver masquerading
3D graphics, raster and colors CS312 Fall 2010
Computer Graphics 3D graphics, raster and colors CS312 Fall 2010 Shift in CG Application Markets 1989-2000 2000 1989 3D Graphics Object description 3D graphics model Visualization 2D projection that simulates
Steerable Interfaces for Pervasive Computing Spaces
Steerable Interfaces for Pervasive Computing Spaces Gopal Pingali Claudio Pinhanez,, Anthony Levas,, Rick Kjeldsen,, Mark Podlaseck,, Han Chen, Noi Sukaviriya IBM T.J. Watson Research Center Hawthorne,
Positional tracking for VR/AR using Stereo Vision. Edwin AZZAM, CTO Stereolabs
Positional tracking for VR/AR using Stereo Vision Edwin AZZAM, CTO Stereolabs Outside-in Positional Tracking Lighthouse laser system HTC Vive IR LED constellation tracking system Oculus Rift ifixit Inside-out
Visual Tracking (1) Tracking of Feature Points and Planar Rigid Objects
Intelligent Control Systems Visual Tracking (1) Tracking of Feature Points and Planar Rigid Objects Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
ENDOCAM. The Future is Logic
ENDOCAM The Future is Logic New perspectives in Vision ENDOCAM Logic HD combines flexibility and versatility in a unique dimension. Sharpen your focus for brilliant images and a lot of smart options. The
Head Mounted Display Optics I!
! Head Mounted Display Optics I! Gordon Wetzstein! Stanford University! EE 267 Virtual Reality! Lecture 7! stanford.edu/class/ee267/!! ! Logistics! HW3 is probably the longest homework, so get started
Interaction Using Nearby-and-Far Projection Surfaces with a Body-Worn ProCam System
Interaction Using Nearby-and-Far Projection Surfaces with a Body-Worn ProCam System Takeshi Kurata 1 Nobuchika Sakata 13 Masakatsu Kourogi 1 Takashi Okuma 1 Yuichi Ohta 2 1 AIST, Japan 2 University of
All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them.
![All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them.](/thumbs/91/106597332.jpg "All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them.")
All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them. - Aristotle University of Texas at Arlington Introduction
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence
Visual Tracking (1) Feature Point Tracking and Block Matching
Intelligent Control Systems Visual Tracking (1) Feature Point Tracking and Block Matching Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting R. Maier 1,2, K. Kim 1, D. Cremers 2, J. Kautz 1, M. Nießner 2,3 Fusion Ours 1
FRED Display Application Note
FRED Display Application Note Most displays consist of several optical components. The most important component is the source of light that illuminates the display. All displays need a mechanism to send
Prasanna Krishnaswamy Intel Platform Architect. Imaging Systems Design for Mixed Reality Scenarios
Prasanna Krishnaswamy Platform Architect Imaging Systems Design for Mixed Reality Scenarios Agenda Mixed Reality (MR) Introduction Key Use Cases MR System Design Overview Imaging Sensors for MR Use Case
Remote Reality Demonstration
Remote Reality Demonstration Terrance E. Boult EECS Dept., 19 Memorial Drive West Lehigh Univ., Bethlehem, PA 18015 tboult@eecs.lehigh.edu Fax: 610 758 6279 Contact Author: T.Boult Submission category:
Multimedia Technology CHAPTER 4. Video and Animation
CHAPTER 4 Video and Animation - Both video and animation give us a sense of motion. They exploit some properties of human eye s ability of viewing pictures. - Motion video is the element of multimedia
Specifying Complex Scenes
Transformations Specifying Complex Scenes (x,y,z) (r x,r y,r z ) 2 (,,) Specifying Complex Scenes Absolute position is not very natural Need a way to describe relative relationship: The lego is on top
Embedded Vision Solutions
FLEXIBLE SOLUTIONS FOR EMBEDDED VISION PROCESSING AT THE EDGE Embedded Vision Solutions Embedded vision offers a promising future with many exciting new applications entering the market. These systems
Visual SLAM. An Overview. L. Freda. ALCOR Lab DIAG University of Rome La Sapienza. May 3, 2016
An Overview L. Freda ALCOR Lab DIAG University of Rome La Sapienza May 3, 2016 L. Freda (University of Rome La Sapienza ) Visual SLAM May 3, 2016 1 / 39 Outline 1 Introduction What is SLAM Motivations
MPI Optical Solutions
MPI Optical Solutions MPI is working closely with leading optical suppliers to develop and optimize dedicated microscope solutions. This provides leading edge on-wafer observation and navigation. The selected
Project report Augmented reality with ARToolKit
Project report Augmented reality with ARToolKit FMA175 Image Analysis, Project Mathematical Sciences, Lund Institute of Technology Supervisor: Petter Strandmark Fredrik Larsson (dt07fl2@student.lth.se)
Agenda. DLP 3D scanning Introduction DLP 3D scanning SDK Introduction Advance features for existing SDK
Agenda DLP 3D scanning Introduction DLP 3D scanning SDK Introduction Advance features for existing SDK Increasing scanning speed from 20Hz to 400Hz Improve the lost point cloud 3D Machine Vision Applications:
3D Time-of-Flight Image Sensor Solutions for Mobile Devices
3D Time-of-Flight Image Sensor Solutions for Mobile Devices SEMICON Europa 2015 Imaging Conference Bernd Buxbaum 2015 pmdtechnologies gmbh c o n f i d e n t i a l Content Introduction Motivation for 3D
Scene Modeling for a Single View
Scene Modeling for a Single View René MAGRITTE Portrait d'edward James with a lot of slides stolen from Steve Seitz and David Brogan, 15-463: Computational Photography Alexei Efros, CMU, Fall 2005 Classes
Handheld Augmented Reality. Reto Lindegger
Handheld Augmented Reality Reto Lindegger lreto@ethz.ch 1 AUGMENTED REALITY 2 A Definition Three important characteristics: Combines real and virtual environment Interactive in real-time Registered in
3D Shape and Indirect Appearance By Structured Light Transport
3D Shape and Indirect Appearance By Structured Light Transport CVPR 2014 - Best paper honorable mention Matthew O Toole, John Mather, Kiriakos N. Kutulakos Department of Computer Science University of
Designing a Self-Calibrating Pipeline for Projection Mapping Application. Kevin Wright Kevin Moule
Designing a Self-Calibrating Pipeline for Projection Mapping Application Kevin Wright Kevin Moule 2 Who we are Kevin Wright Director of the Application Software group at Christie responsible for developing
Servosila Robotic Heads
Servosila Robotic Heads www.servosila.com TABLE OF CONTENTS SERVOSILA ROBOTIC HEADS 2 SOFTWARE-DEFINED FUNCTIONS OF THE ROBOTIC HEADS 2 SPECIFICATIONS: ROBOTIC HEADS 4 DIMENSIONS OF ROBOTIC HEAD 5 DIMENSIONS
Scene Modeling for a Single View
Scene Modeling for a Single View René MAGRITTE Portrait d'edward James with a lot of slides stolen from Steve Seitz and David Brogan, Breaking out of 2D now we are ready to break out of 2D And enter the
Pin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Example of SLAM for AR Taken from:
Time-of-flight basics
Contents 1. Introduction... 2 2. Glossary of Terms... 3 3. Recovering phase from cross-correlation... 4 4. Time-of-flight operating principle: the lock-in amplifier... 6 5. The time-of-flight sensor pixel...
TAGARNO. TAGARNO MEDTECH 320 when quality is paramount
TAGARNO when quality is paramount 2 when quality is paramount when quality is paramount Image Capture on SD card Non-contact Measurements Display of Magnification Degree Split Screen Function Training
/10/$ IEEE 4048
21 IEEE International onference on Robotics and Automation Anchorage onvention District May 3-8, 21, Anchorage, Alaska, USA 978-1-4244-54-4/1/$26. 21 IEEE 448 Fig. 2: Example keyframes of the teabox object.
Multiple View Geometry
Multiple View Geometry Martin Quinn with a lot of slides stolen from Steve Seitz and Jianbo Shi 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 Our Goal The Plenoptic Function P(θ,φ,λ,t,V
Computer Graphics. Chapter 1 (Related to Introduction to Computer Graphics Using Java 2D and 3D)
Computer Graphics Chapter 1 (Related to Introduction to Computer Graphics Using Java 2D and 3D) Introduction Applications of Computer Graphics: 1) Display of Information 2) Design 3) Simulation 4) User
MR-Mirror: A Complex of Real and Virtual Mirrors
MR-Mirror: A Complex of Real and Virtual Mirrors Hideaki Sato 1, Itaru Kitahara 1, and Yuichi Ohta 1 1 Department of Intelligent Interaction Technologies, Graduate School of Systems and Information Engineering,
DPM Demo Kit User s Manual Version: dpm_dk_um_1_0_1.doc
DPM Demo Kit User s Manual Version: 1.0.1 dpm_dk_um_1_0_1.doc 1 INTRODUCTION... 3 2 INSTALLATION... 5 2.1 HARDWARE DELIVERABLES... 5 2.2 SOFTWARE... 5 2.3 CONFIGURATION DATA... 5 2.4 DIRECTORY STRUCTURE...
Seeing the world through a depth-sensing camera
Seeing the world through a depth-sensing camera Copyright 2014 pabr@pabr.org All rights reserved. In this project we attach a depth-sensing camera to a head-mounted stereoscopic display (think: Kinect
Short Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
Visual Tracking (1) Pixel-intensity-based methods
Intelligent Control Systems Visual Tracking (1) Pixel-intensity-based methods Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
FOREGROUND DETECTION ON DEPTH MAPS USING SKELETAL REPRESENTATION OF OBJECT SILHOUETTES
FOREGROUND DETECTION ON DEPTH MAPS USING SKELETAL REPRESENTATION OF OBJECT SILHOUETTES D. Beloborodov a, L. Mestetskiy a a Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University,
Advanced Computer Graphics Transformations. Matthias Teschner
Advanced Computer Graphics Transformations Matthias Teschner Motivation Transformations are used To convert between arbitrary spaces, e.g. world space and other spaces, such as object space, camera space
Addressing High Precision Automated Optical Inspection Challenges with Unique 3D Technology Solution
Addressing High Precision Automated Optical Inspection Challenges with Unique 3D Technology Solution John Hoffman CyberOptics Corporation jhoffman@cyberoptics.com Outline/Agenda Phase Profilometry SMT
A Qualitative Analysis of 3D Display Technology
A Qualitative Analysis of 3D Display Technology Nicholas Blackhawk, Shane Nelson, and Mary Scaramuzza Computer Science St. Olaf College 1500 St. Olaf Ave Northfield, MN 55057 scaramum@stolaf.edu Abstract
Contents Introduction Sparse Feature Extraction and Matching
Contents 1 Introduction 1 1.1 Motivation........................ 1 1.2 Image Domain Warping................. 4 1.3 Thesis Overview..................... 8 1.4 Prior Work........................ 10 1.5 Contributions.......................
Towards a Proximal Resource-based Architecture to Support Augmented Reality Applications. Cynthia Taylor, Joe Pasquale UC San Diego
Towards a Proximal Resource-based Architecture to Support Augmented Reality Applications Cynthia Taylor, Joe Pasquale UC San Diego 1 Background and Motivation Small Devices Big Applications Thin Clients
Deep-Pipelined FPGA Implementation of Ellipse Estimation for Eye Tracking
Deep-Pipelined FPGA Implementation of Ellipse Estimation for Eye Tracking Keisuke Dohi, Yuma Hatanaka, Kazuhiro Negi, Yuichiro Shibata, Kiyoshi Oguri Graduate school of engineering, Nagasaki University,
Monocular Visual Odometry
Elective in Robotics coordinator: Prof. Giuseppe Oriolo Monocular Visual Odometry (slides prepared by Luca Ricci) Monocular vs. Stereo: eamples from Nature Predator Predators eyes face forward. The field
Vision Review: Image Formation. Course web page:
Vision Review: Image Formation Course web page: www.cis.udel.edu/~cer/arv September 10, 2002 Announcements Lecture on Thursday will be about Matlab; next Tuesday will be Image Processing The dates some
CSE 4392/5369. Dr. Gian Luca Mariottini, Ph.D.
University of Texas at Arlington CSE 4392/5369 Introduction to Vision Sensing Dr. Gian Luca Mariottini, Ph.D. Department of Computer Science and Engineering University of Texas at Arlington WEB : http://ranger.uta.edu/~gianluca
CIS 580, Machine Perception, Spring 2015 Homework 1 Due: :59AM
CIS 580, Machine Perception, Spring 2015 Homework 1 Due: 2015.02.09. 11:59AM Instructions. Submit your answers in PDF form to Canvas. This is an individual assignment. 1 Camera Model, Focal Length and
Stereo and Epipolar geometry
Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka
Single Camera Calibration
Single Camera Calibration using Partially Visible Calibration Objects Based on Random Dots Marker Tracking Algorithm *Yuji Oyamada1,2, Pascal Fallavollita2, and Nassir Navab2 1. Keio University, Japan
Project 2 due today Project 3 out today. Readings Szeliski, Chapter 10 (through 10.5)
Announcements Stereo Project 2 due today Project 3 out today Single image stereogram, by Niklas Een Readings Szeliski, Chapter 10 (through 10.5) Public Library, Stereoscopic Looking Room, Chicago, by Phillips,
HD Ready and LED technology - amazing colour reproduction and long-life
ML750ST Short throw LED projector HD Ready and LED technology - amazing colour reproduction and long-life Great connectivity - MHL, HDMI and optional wireless PC free viewing - native office viewer, built-in
Simplify System Complexity
1 2 Simplify System Complexity With the new high-performance CompactRIO controller Arun Veeramani Senior Program Manager National Instruments NI CompactRIO The Worlds Only Software Designed Controller
CS 4204 Computer Graphics
CS 4204 Computer Graphics 3D Viewing and Projection Yong Cao Virginia Tech Objective We will develop methods to camera through scenes. We will develop mathematical tools to handle perspective projection.
Virtual Reality for Human Computer Interaction
Virtual Reality for Human Computer Interaction Appearance: Lighting Representation of Light and Color Do we need to represent all I! to represent a color C(I)? No we can approximate using a three-color
High-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond
High-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond New generation of interfaces Instead of interacting through indirect input devices (mice and keyboard), the user is interacting
Mobile Influenced Markets Evolution of Camera and Display Uses
Tom Watzka Satwant Singh Mobile Influenced Markets Evolution of Camera and Display Uses Lattice MIPI D-PHY Applications The PC industry created demand in adjacent markets such as test equipment, POS terminals,
Project 3 code & artifact due Tuesday Final project proposals due noon Wed (by ) Readings Szeliski, Chapter 10 (through 10.5)
Announcements Project 3 code & artifact due Tuesday Final project proposals due noon Wed (by email) One-page writeup (from project web page), specifying:» Your team members» Project goals. Be specific.
ASYNCHRONOUS SHADERS WHITE PAPER 0
ASYNCHRONOUS SHADERS WHITE PAPER 0 INTRODUCTION GPU technology is constantly evolving to deliver more performance with lower cost and lower power consumption. Transistor scaling and Moore s Law have helped
Lecture 19: Depth Cameras. Visual Computing Systems CMU , Fall 2013
Lecture 19: Depth Cameras Visual Computing Systems Continuing theme: computational photography Cameras capture light, then extensive processing produces the desired image Today: - Capturing scene depth
3D Editing System for Captured Real Scenes
3D Editing System for Captured Real Scenes Inwoo Ha, Yong Beom Lee and James D.K. Kim Samsung Advanced Institute of Technology, Youngin, South Korea E-mail: {iw.ha, leey, jamesdk.kim}@samsung.com Tel:
Deep Learning for Virtual Shopping. Dr. Jürgen Sturm Group Leader RGB-D
Deep Learning for Virtual Shopping Dr. Jürgen Sturm Group Leader RGB-D metaio GmbH Augmented Reality with the Metaio SDK: IKEA Catalogue App Metaio: Augmented Reality Metaio SDK for ios, Android and Windows
calibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
High Performance Computing on GPUs using NVIDIA CUDA
High Performance Computing on GPUs using NVIDIA CUDA Slides include some material from GPGPU tutorial at SIGGRAPH2007: http://www.gpgpu.org/s2007 1 Outline Motivation Stream programming Simplified HW and
Segmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
The NAO Robot, a case of study Robotics Franchi Alessio Mauro
The NAO Robot, a case of study Robotics 2013-2014 Franchi Alessio Mauro alessiomauro.franchi@polimi.it Who am I? Franchi Alessio Mauro Master Degree in Computer Science Engineer at Politecnico of Milan
Massively Parallel Computing on Silicon: SIMD Implementations. V.M.. Brea Univ. of Santiago de Compostela Spain
Massively Parallel Computing on Silicon: SIMD Implementations V.M.. Brea Univ. of Santiago de Compostela Spain GOAL Give an overview on the state-of of-the- art of Digital on-chip CMOS SIMD Solutions,
INTRODUCING THE CODEBIT!
GETTING STARTED Downloading the littlebits Code Kit app STEP 1 Download and open the littlebits Code Kit app at littlebits.com/code-kit-app STEP 2 Click the pink open blank canvas button to start writing
Models and Architectures. Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico
Models and Architectures Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico 1 Objectives Learn the basic design of a graphics system Introduce
CSE 527: Introduction to Computer Vision
CSE 527: Introduction to Computer Vision Week 10 Class 2: Visual Odometry November 2nd, 2017 Today Visual Odometry Intro Algorithm SLAM Visual Odometry Input Output Images, Video Camera trajectory, motion
CSE 527: Introduction to Computer Vision
CSE 527: Introduction to Computer Vision Week 5 - Class 1: Matching, Stitching, Registration September 26th, 2017 ??? Recap Today Feature Matching Image Alignment Panoramas HW2! Feature Matches Feature
LUMS Mine Detector Project
LUMS Mine Detector Project Using visual information to control a robot (Hutchinson et al. 1996). Vision may or may not be used in the feedback loop. Visual (image based) features such as points, lines
Graphics Hardware and Display Devices
Graphics Hardware and Display Devices CSE328 Lectures Graphics/Visualization Hardware Many graphics/visualization algorithms can be implemented efficiently and inexpensively in hardware Facilitates interactive
PART IV: RS & the Kinect
Computer Vision on Rolling Shutter Cameras PART IV: RS & the Kinect Per-Erik Forssén, Erik Ringaby, Johan Hedborg Computer Vision Laboratory Dept. of Electrical Engineering Linköping University Tutorial
Other approaches to obtaining 3D structure
Other approaches to obtaining 3D structure Active stereo with structured light Project structured light patterns onto the object simplifies the correspondence problem Allows us to use only one camera camera
NVIDIA nforce IGP TwinBank Memory Architecture
NVIDIA nforce IGP TwinBank Memory Architecture I. Memory Bandwidth and Capacity There s Never Enough With the recent advances in PC technologies, including high-speed processors, large broadband pipelines,
Introduction to Computer Graphics with WebGL
Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science Laboratory University of New Mexico Models and Architectures
Select Your Sensor. Select Your Interface. Get The Perfect Fit
THE IMAGE YOU WANT, THE WAY YOU WANT PicSight marks an all new approach for industrial cameras. You take control! Choose your very own industrial camera to match your needs. Pick your image characteristics
Mobile Point Fusion. Real-time 3d surface reconstruction out of depth images on a mobile platform
Mobile Point Fusion Real-time 3d surface reconstruction out of depth images on a mobile platform Aaron Wetzler Presenting: Daniel Ben-Hoda Supervisors: Prof. Ron Kimmel Gal Kamar Yaron Honen Supported
CSc Topics in Computer Graphics 3D Photography
CSc 83010 Topics in Computer Graphics 3D Photography Tuesdays 11:45-1:45 1:45 Room 3305 Ioannis Stamos istamos@hunter.cuny.edu Office: 1090F, Hunter North (Entrance at 69 th bw/ / Park and Lexington Avenues)