Another Look at Camera Control

Transcription

1 Another Look at Camera Control Karan Singh, Cindy Grimm, Nisha Sudarsanan Media and Machines Lab Department of Computer Science and Engineering Washington University in St. Louis University of Toronto 1

2 What is camera control? Manipulation of camera parameters Projection of 3D geometry into 2D plane Applications Interactively navigate around a scene (games) Create a fixed camera path (movies) Use different viewpoints to understand structure (visualization) Take pictures 2 Cameras

3 Cameras in different fields Computer graphics From, at, up, field of view View matrix Position Look Vector θ W Width An Heig Aspe θ H Near Distance Far Distance 3 Cameras

4 Cameras in different fields (cont.) Film, photography Camera is physical object Describe movement of camera itself Dolly in/out, tilt, pan, roll Zoom in/out Graphics systems use same vocabulary Through-the-lens Exterior views Camera-centric Reposition the camera Object-centric Reposition the camera relative to an object 4 Cameras

5 Cameras in different fields (cont.) Mathematics 4X4 matrix 11 degrees of freedom Computer vision Straight lines to straight lines 3X4 matrix Don t keep depth Graphics maps 11 dof to useful parameters J. C. Michener, I. B. Carlbom, Natural and efficient viewing parameters, SIGGRAPH 80 Six extrinsic parameters (position, orientation) 5 intrinsic parameters (center-of-projection, focal length, skew, aspect ratio) 5 Cameras

6 Cameras in different fields (cont.) Artists have a qualitative vocabulary Describe relationship of camera to object in the scene Vanishing point Perspective effects One point Horizon line Two point Three point 6 Cameras

7 Goals Visualization of camera parameters in the 2D image E.g., feed back on perspective distortion Manipulate current projection New position indicates desired projection change Changes appropriate camera parameters May change multiple parameters Minimal mouse, keyboard use Current approaches use entire right button Click-through interface 7 Cameras

8 Related work Original camera paper J. C. Michener, I. B. Carlbom, Natural and efficient viewing parameters, SIGGRAPH 80 Trackball manipulation Michael Chen, S. Joy Mountford, and Abigail Sellen, A Study in Interactive 3D Rotation using 2D Input Devices, SIGGRAPH K. Henriksen, J. Sporring, and K. Hornbaek Virtual trackballs revisited, IEEE TVCG 8 Cameras

9 Related work Through-the-lens camera control Use image constraints to change camera parameters Not very stable Jim Blinn, Where am I? What am I Looking at?, IEEE CG&A, 1988 Michael Gleicher and Andrew Witkin, Through-the-lens camera control, SIGGRAPH 92 9 Cameras

10 The IBar A cube centered along the look vector Changing the rendering of the cube changes the camera in a corresponding way Different segments move limbs simultaneously Cyan = top and bottom left limbs Red = left and right bottom limbs Rendering of cube reflects projection parameters 10 Cameras

11 Demo (traditional) Rotate left-right up-down spin Allows framing Pan (camera-centric) Pan (object-centric) Dolly in and out Zoom (camera-centric) Zoom (object-centric) 11 Cameras

12 Demo (Perspective change) Dolly + zoom Dolly in and out Center of projection (horizontal vertical) 12 Cameras

13 Demo (Just Weird) Skew Aspect ratio 13 Cameras

14 Camera- versus object-centric Camera-centric Allows framing of objects Position cube in relation to scene Object-centric Traditional camera-moves-with-mouse Nice to have both Map different limbs E.g., zoom using the left handle is cameracentric, the right handle is object-centric 14 Cameras

15 Some implementation details Camera parameters T Eye position L Look vector V Up vector W,H width, height f focal length u 0,v 0 center of projection d distance to object V W v 0 u0 T L f H R V f d H θ T L 15 Cameras

16 Drawing the IBar Cube edge is centered on look vector Adjust for center of projection Size of cube adjusted so is always s c high on screen s I I I t tl = dh / f r = T + dl + su v = I + s sv m c v = I s sr + s m t c 0 c r R + v sl v 0 r sv 16 Cameras

17 Drawing the IBar (cont.) Draw horizontal bar at horizon line t p 1 p 2 1-t 17 Cameras

18 Drawing the IBar (cont.) Feedback IBar highlights when mouse is over active part Indicate selected segment with circle 18 Cameras

19 Manipulating the IBar Relative, not absolute Determine which limb, and which segment selected Determine ratio/percentage moved Change corresponding parameter(s) by ratio E.g., Multiply zoom by ratio of length change Pan by mouse movement s = dh / T = T + f sv x r R + sv y r V 19 Cameras

20 Manipulating the IBar Limb movement constrained to vertical (or horizontal) Shift key unconstrains Left-right movement rotates up or down Up-down movement changes center of projection Pan unconstrained Shift key constrains Stem Shift chooses aspect ratio or skew 20 Cameras

21 Dolly plus zoom Changing parameters Calculate dolly in simultaneously Find zoom that keeps everything at a distance d away the same size Center of projection Translate in reverse direction 21 Cameras

22 Camera- versus object-centric Camera-centric Render cube with new camera, scene with original camera Object-centric Render both cube and scene with new camera Changing parameters Invert operation (i.e., pan in the opposite direction) 22 Cameras

23 Centering the IBar on an object Allows rotation around arbitrary point User selects point p in scene Determines d Render at p I m = p + r dl + su r R 0 + v 0 r sv Rotation Translate p to origin (and camera) Rotate Translate back 23 Cameras

24 In practice In use in short animated film, Ryan Used for dramatic perspective changes 24 Cameras

25 Summary Visualization of COP, horizon line, perspective distortion Also at arbitrary points in the scene One mouse button for all 11 parameters Shift key chooses less-common action Click through interface Toggle key for disabling Usable perspective manipulation Simultaneous editing of parameters 25 Cameras

26 Drawbacks Remembering which parameters go where Visual clutter User study comparing IBar to Maya camera Primary conclusion: camera manipulation is hard for both naïve and knowledgeable users Unable to manipulate camera to match a target scene IBar helped people to learn camera manipulation 26 Cameras

27 Future work Reducing number of parameters on widget Multiple widgets, quick swap between them Similar handles Pre-viewing of manipulation effects What does this handle do? Bookmarking and camera paths Visualizing in scene May be out of scene 27 Cameras