CSE 165: 3D User Interaction

Similar documents
CSE 165: 3D User Interaction. Lecture #6: Selection Part 2

CSE 165: 3D User Interaction. Lecture #5: Selection

Augmented Reality. Integrating Computer Graphics with Computer Vision Mihran Tuceryan. August 16, 1998 ICPR 98 1

10/29/2010. Rendering techniques. Global Illumination. Local Illumination methods. Today : Global Illumination Modules and Methods

Prof. Feng Liu. Fall /17/2016

(a, b) x y r. For this problem, is a point in the - coordinate plane and is a positive number.

Goal. Rendering Complex Scenes on Mobile Terminals or on the web. Rendering on Mobile Terminals. Rendering on Mobile Terminals. Walking through images

Computer Graphics and Animation 3-Viewing

Positioning of a robot based on binocular vision for hand / foot fusion Long Han

17/5/2009. Introduction

ANNOUNCEMENT. LECTURE 25 Spherical Refracting Surfaces

Illumination methods for optical wear detection

Journal of World s Electrical Engineering and Technology J. World. Elect. Eng. Tech. 1(1): 12-16, 2012

Topological Characteristic of Wireless Network

2. PROPELLER GEOMETRY

2D Transformations. Why Transformations. Translation 4/17/2009

EYE DIRECTION BY STEREO IMAGE PROCESSING USING CORNEAL REFLECTION ON AN IRIS

A Haptic-Assisted Guidance System for Navigating Volumetric Data Sets

5. Geometric Transformations and Projections

Color Correction Using 3D Multiview Geometry

Monte Carlo Techniques for Rendering

THE SOLID IMAGE: a new concept and its applications

Lecture 3: Rendering Equation

Segmentation of Casting Defects in X-Ray Images Based on Fractal Dimension

Haptic Glove. Chan-Su Lee. Abstract. This is a final report for the DIMACS grant of student-initiated project. I implemented Boundary

Development and Analysis of a Real-Time Human Motion Tracking System

Lecture # 04. Image Enhancement in Spatial Domain

Haptic Simulation of a Tool In Contact With a Nonlinear Deformable Body

Image Enhancement in the Spatial Domain. Spatial Domain

Output Primitives. Ellipse Drawing

A modal estimation based multitype sensor placement method

4.2. Co-terminal and Related Angles. Investigate

Derivation of the Nodal Forces Equivalent to Uniform Pressure for Quadratic Isoparametric Elements RAWB, Last Update: 30 September 2008

Topic -3 Image Enhancement

3D Reconstruction from 360 x 360 Mosaics 1

Pointing: Image-Plane The Kids in the Hall

Adaptation of Motion Capture Data of Human Arms to a Humanoid Robot Using Optimization

Several algorithms exist to extract edges from point. system. the line is computed using a least squares method.

View Synthesis using Depth Map for 3D Video

A Novel Image-Based Rendering System With A Longitudinally Aligned Camera Array

A Mathematical Implementation of a Global Human Walking Model with Real-Time Kinematic Personification by Boulic, Thalmann and Thalmann.

A Novel Automatic White Balance Method For Digital Still Cameras

Accurate Diffraction Efficiency Control for Multiplexed Volume Holographic Gratings. Xuliang Han, Gicherl Kim, and Ray T. Chen

9/5/2018. Physics colloquium today -- 9/05/2018 PHY 711 Fall Lecture /05/2018 PHY 711 Fall Lecture 4 3

Cellular Neural Network Based PTV

Space-variant image sampling for foveation

All lengths in meters. E = = 7800 kg/m 3

9-2. Camera Calibration Method for Far Range Stereovision Sensors Used in Vehicles. Tiberiu Marita, Florin Oniga, Sergiu Nedevschi

Scaling Location-based Services with Dynamically Composed Location Index

Optical Flow for Large Motion Using Gradient Technique

ADDING REALISM TO SOURCE CHARACTERIZATION USING A GENETIC ALGORITHM

Dense pointclouds from combined nadir and oblique imagery by object-based semi-global multi-image matching

Fifth Wheel Modelling and Testing

Visual Servoing from Deep Neural Networks

ISyE 4256 Industrial Robotic Applications

Massachusetts Institute of Technology Department of Mechanical Engineering

Extended Perspective Shadow Maps (XPSM) Vladislav Gusev, ,

Hand Tracking and Gesture Recognition for Human-Computer Interaction

An Assessment of the Efficiency of Close-Range Photogrammetry for Developing a Photo-Based Scanning Systeminthe Shams Tabrizi Minaret in Khoy City

3D inspection system for manufactured machine parts

Numerical Analysis on the Oil Pumping Process for Reciprocating Compressors Considering Biphasic Flow

Conservation Law of Centrifugal Force and Mechanism of Energy Transfer Caused in Turbomachinery

Structured Light Stereoscopic Imaging with Dynamic Pseudo-random Patterns

Coordinate Systems. Ioannis Rekleitis

Visually Believable Explosions in Real Time

Frequency Domain Approach for Face Recognition Using Optical Vanderlugt Filters

Information Retrieval. CS630 Representing and Accessing Digital Information. IR Basics. User Task. Basic IR Processes

Toward Computing an Optimal Trajectory for an Environment-Oriented Unmanned Aerial Vehicle (UAV) under Uncertainty

t [ Background removed

Lecture 9: Other Applications of CNNs

= dv 3V (r + a 1) 3 r 3 f(r) = 1. = ( (r + r 2

An Unsupervised Segmentation Framework For Texture Image Queries

3D Interaction Techniques for Virtual Environments: Selection and Manipulation. Doug A. Bowman

A Minutiae-based Fingerprint Matching Algorithm Using Phase Correlation

POMDP: Introduction to Partially Observable Markov Decision Processes Hossein Kamalzadeh, Michael Hahsler

Ego-Motion Estimation on Range Images using High-Order Polynomial Expansion

Lecture Topics ECE 341. Lecture # 12. Control Signals. Control Signals for Datapath. Basic Processing Unit. Pipelining

Improved Fourier-transform profilometry

3D Hand Trajectory Segmentation by Curvatures and Hand Orientation for Classification through a Probabilistic Approach

Physical simulation for animation

Motion Estimation. Yao Wang Tandon School of Engineering, New York University

ERSO - Acquisition, Reconstruction and Simulation of Real Objects 1

CS-184: Computer Graphics. Today. Lecture #5: 3D Transformations and Rotations. Transformations in 3D Rotations

Threat assessment for avoiding collisions with turning vehicles

Lecture 27: Voronoi Diagrams

Automatically Testing Interacting Software Components

CS 450: COMPUTER GRAPHICS RASTERIZING CONICS SPRING 2016 DR. MICHAEL J. REALE

A New and Efficient 2D Collision Detection Method Based on Contact Theory Xiaolong CHENG, Jun XIAO a, Ying WANG, Qinghai MIAO, Jian XUE

Also available at ISSN (printed edn.), ISSN (electronic edn.) ARS MATHEMATICA CONTEMPORANEA 3 (2010)

Introduction to Medical Imaging. Cone-Beam CT. Introduction. Available cone-beam reconstruction methods: Our discussion:

ME 210 Applied Mathematics for Mechanical Engineers

A Memory Efficient Array Architecture for Real-Time Motion Estimation

Detection and tracking of ships using a stereo vision system

Any modern computer system will incorporate (at least) two levels of storage:

MULTI-TEMPORAL AND MULTI-SENSOR IMAGE MATCHING BASED ON LOCAL FREQUENCY INFORMATION

Environment Mapping. Overview

Stereo and 3D Reconstruction

Experiments of low-cost INS/GPS Navigation platform based on PC104

LINE-BASED REFERENCING BETWEEN IMAGES AND LASER SCANNER DATA FOR IMAGE-BASED POINT CLOUD INTERPRETATION IN A CAD-ENVIRONMENT

INTERACTIVE RELATIVE ORIENTATION BETWEEN TERRESTRIAL IMAGES AND AIRBORNE LASER SCANNING DATA

Transcription:

CSE 165: 3D Use Inteaction Lectue #6: Selection Instucto: Jugen Schulze, Ph.D.

2 Announcements Homewok Assignment #2 Due Fiday, Januay 23 d at 1:00pm

3

4 Selection and Manipulation

5 Why ae Selection and Manipulation Impotant? Majo methods of inteaction with physical envionments vitual envionments Affect the quality of entie 3D inteface Design of 3D manipulation techniques is difficult

6 Selection vs. Manipulation Selection: specifying one o moe objects fom a set Manipulation: modifying object popeties (position, oientation, scale, shape, colo, textue, behavio, etc.)

7 Goals of Selection Indicate action on object Quey object Make object active Tavel to object location Set up manipulation

8 Selection Pefomance Vaiables affecting use pefomance Object distance fom use Object size Density of objects in aea Pesence of occluding objects

9 Canonical Paametes Selection distance and diection to taget taget size density of objects aound the taget numbe of tagets to be selected taget occlusion Manipulation Positioning distance/diection to initial position distance/diection to taget position tanslation distance equied pecision of positioning Rotation distance to taget initial oientation final oientation amount of otation

10 Input Device Paametes Numbe of contol dimensions Contol integation: how many DOF ae contolled simultaneously Foce vs. position contol (elative vs. absolute location) Fom facto: impact on accuacy Senso attached to hand Senso olled with finges

11 Technique Classification by Metapho Manipulation techniques Egocentic metapho Vitual pointe metapho Ray-casting Two-handed pointing Flashlight Image plane Diect manipulation Classical vitual hand Go-Go Hybid techniques HOMER Exocentic metapho Wold-in-miniatue Scaled-wold gab Hybid techniques Voodoo Dolls

12 Isomophic vs. Non-Isomophic View Isomophic Geometical on-to-one coespondence between hand motions in physical and vitual wolds Natual inteactions Non-Isomophic Magic vitual tools (lase beams, ubbe ams, etc.)

13 Ray-Casting Use points at objects with vitual ay Ray defines and visualizes pointing diection Fist intesected object is selected p( α) = h + α p h = 3D position of vitual hand p = ay attached to h 0 < α < detemined by fist object intesection

14 Two-Handed Pointing Ray casting with 2 hands Moe contol Distance between hands contols length Allows pointing at things behind othe things p( α) = h + α ( h 0 < α < is fixed h h l l = 3D position of = 3D position of h l ) left hand ight hand

15 Flashlight Soft selection technique Does not need pecision Conic selection volume Tip of cone in wand Cone diection detemined by wand diection Fixed cone size If multiple objects in cone Object close to cente line of cone is selected If multiple objects ae equally close to cente line: select object close to device

16 Selection by Dwell Time Use points at object with any technique Vitual pointe Eye gaze Action is tiggeed afte dwell time theshold is exceeded Woks without physical buttons

17 Vitual Hand Select and manipulate diectly with hand Hand epesented as 3D cuso Intesection between cuso and object indicates selection p p p v v = α p, R, R v, R = R = position and oientation of = position and oientation of α = fixed scaling facto v eal hand hand in VE

18 Go-Go By Poupyev, 1996 Am-extension technique Touch objects to select, like simple vitual hand Non-linea mapping between physical and vitual hand position Requies toso position v Local and distant egions v whee = length of R = length of R D, α ae constants if if D D = v F= ( F )( = ) = 2 2 + α+ ( α( D ) Dothewise ) whee = length of R = length of R v D, α ae constants v v

19 Wold-in-Miniatue (WIM) By Stoakley, 1995 Dollhouse wold held in use s hand Miniatue objects can be manipulated diectly Moving miniatue objects affects full-scale objects Can also be used fo navigation

20 HOMER Hand-Centeed Object Manipulation Extending Ray-Casting By Bowman/Hodges, 1997 Select: ay-casting Manipulate: hand-centeed Time 1.0 m 2.0 m 0.3 m 0.6 m toso physical hand toso physical hand

21 Image Plane Techniques Requie only 2 DOF Selection based on 2D pojections Use vitual image plane in font of use Dependent on head/eye position Faming Lifting Palms Head- Cushe Sticky Finge

22 Scaled-Wold Gab By Mine et al., 1997 Often used with occlusion At selection, scale wold down so that vitual hand touches selected object Use initially does not notice a change in the image, until head o hand is moved

23 Voodoo Dolls Piece et al. 1999 Two-handed technique Builds upon image plane and WIM techniques Developed fo pinch gloves Requies finge pose tacking Ceates copies of objects (dolls) fo manipulation Non-dominant hand: stationay fame of efeence Dominant hand: defines position and oientation

24 Foced Pespective Museum of Simulation Technology http://www.youtube.com/watch?v=hofll06 X16c