Graphics, Vision, HCI. K.P. Chan Wenping Wang Li-Yi Wei Kenneth Wong Yizhou Yu

Size: px
Start display at page:

Download "Graphics, Vision, HCI. K.P. Chan Wenping Wang Li-Yi Wei Kenneth Wong Yizhou Yu"

Transcription

1 Graphics, Vision, HCI K.P. Chan Wenping Wang Li-Yi Wei Kenneth Wong Yizhou Yu

2 Li-Yi Wei Background Stanford (95-01), NVIDIA (01-05), MSR (05-11) Research Nominal: Graphics, HCI, parallelism Actual: Computing natural repetitions (Computer science is about repetitions) Can work on almost anything + have fun I tailor projects for individual students (so they also have fun)

3 Computing natural repetitions data driven (non-parametric) auto texture synthesis parallelism inverse synthesis graphics motion texture blue noise element texture HDR edit interact HCI parallel random Parallel Poisson differential analysis procedural (parametric) revision control

4 Discrete element textures [Ma et al. SIGGRAPH 2011] exemplar synthesis domain output

5 SIGGRAPH The coolest (& ass kicking) venue in graphics Each paper can be worth a PhD thesis (Just in case you don t know) HKU has 4 papers in SIGGRAPH 2012 So we are awesome (in addition to have fun)

6 input output

7 input output

8 input output

9

10 Yizhou Yu Background Berkeley (PhD 2000), UIUC ( ) Research Graphics, vision, image processing Computational Photography Computer Animation Geometry Processing Medical Imaging Video Analytics

11 Deformation transfer for real time cloth animation [SIGGRAPH 2010] Deformation Transformer

12 Motivation Real-Time Cloth Animation Video games, virtual fashion, etc. The Problem Real-time performance on high-resolution models PDE Integration, Collision resolution. Final Fantasy XIII Nurien

13 Hybrid Approach : Overview Simulate low-res cloth on the GPU Rely on a data-driven model to transform the low-res simulation into a high-res animation Deformation Transformer

14 An Example High-Res Dress: 27K Triangles, Low-Res Dress: 200 Triangles Frame Rate: 261

15 Data-Driven Image Color Theme Enhancement [SIGGRAPH Asia 2010] Photo Reuse: how to edit a photograph to enhance a desired color impression by exploiting prior knowledge extracted from an existing photo collection? Waiting for the right season and illumination could be extremely time-consuming! source image nostalgic lively

16 Our Goal Image Color Theme Enhancement desolate Input Image lively

17 Results happy sad Input Images spring in the air peaceful

18 Wenping Wang Background Alberta (PhD 1992), Department Head Research Computer graphics Geometry Processing Computational geometry Architectural Design Scientific Visualization

19 SIGGRAPH 2006

20 SIGGRAPH 2007

21 SIGGRAPH 2008

22 SIGGRAPH 2008

23 Kwan-Yee Kenneth Wong Background Cambridge (PhD 2001) Research 3D modeling Video surveillance Image processing Pattern recognition

24 3D Model Reconstruction Robust recovery of shapes with unknown topology from the dual space (PAMI 2007) contour generator silhouette N

25 3D Model Reconstruction Robust recovery of shapes with unknown topology from the dual space (PAMI 2007) tangent operation tangent operation original surface dual surface original surface

26 3D Model Reconstruction Robust recovery of shapes with unknown topology from the dual space (PAMI 2007)

27 Eye Gaze Tracking Reconstruction of display and eyes from a single image (CVPR 2010) 27

28 Eye Gaze Tracking Reconstruction of display and eyes from a single image (CVPR 2010) 28

29 Kwok-Ping Chan Background HKU (PhD 1989) Research To apply various Machine Learning methods on Pattern Recognitions, such as facial expression recognition. Study on Cross Domain Learning where the training and the testing domain are not the same.

30 Facial Expression Recognition Goal: to recognize one of the seven basic facial expressions:

31 Methods Dynamic Bayesian Network Discriminative Hidden Markov Models Discriminative Temporal Topic Models Given an image sequence of facial expression, we compute the probability of each expression using the above techniques.

32 Examples: Smile with blinking eyes: From input, produce output similar to input arbitrary size Key Publication: CVPR 2009

The Future of Natural User Interaction

The Future of Natural User Interaction The Future of Natural User Interaction NUI: a great new discipline in the making Baining Guo Microsoft Research Asia Kinect from Insiders Perspective An interview with Kinect contributors Kinect from

More information

Synthesizing Realistic Facial Expressions from Photographs

Synthesizing Realistic Facial Expressions from Photographs Synthesizing Realistic Facial Expressions from Photographs 1998 F. Pighin, J Hecker, D. Lischinskiy, R. Szeliskiz and D. H. Salesin University of Washington, The Hebrew University Microsoft Research 1

More information

Making Machines See. Roberto Cipolla Department of Engineering. Research team

Making Machines See. Roberto Cipolla Department of Engineering. Research team Making Machines See Roberto Cipolla Department of Engineering Research team http://www.eng.cam.ac.uk/~cipolla/people.html Cognitive Systems Engineering Cognitive Systems Engineering Introduction Making

More information

Physics-based Vision: an Introduction

Physics-based Vision: an Introduction Physics-based Vision: an Introduction Robby Tan ANU/NICTA (Vision Science, Technology and Applications) PhD from The University of Tokyo, 2004 1 What is Physics-based? An approach that is principally concerned

More information

GAN Related Works. CVPR 2018 & Selective Works in ICML and NIPS. Zhifei Zhang

GAN Related Works. CVPR 2018 & Selective Works in ICML and NIPS. Zhifei Zhang GAN Related Works CVPR 2018 & Selective Works in ICML and NIPS Zhifei Zhang Generative Adversarial Networks (GANs) 9/12/2018 2 Generative Adversarial Networks (GANs) Feedforward Backpropagation Real? z

More information

Human Upper Body Pose Estimation in Static Images

Human Upper Body Pose Estimation in Static Images 1. Research Team Human Upper Body Pose Estimation in Static Images Project Leader: Graduate Students: Prof. Isaac Cohen, Computer Science Mun Wai Lee 2. Statement of Project Goals This goal of this project

More information

A Survey of Light Source Detection Methods

A Survey of Light Source Detection Methods A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light

More information

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science. Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Statistical Models for Shape and Appearance Note some material for these slides came from Algorithms

More information

TOOLS FOR ANALYZING SHAPES OF CURVES AND SURFACES. ANUJ SRIVASTAVA Department of Statistics Florida State University

TOOLS FOR ANALYZING SHAPES OF CURVES AND SURFACES. ANUJ SRIVASTAVA Department of Statistics Florida State University TOOLS FOR ANALYZING SHAPES OF CURVES AND SURFACES ANUJ SRIVASTAVA Department of Statistics Florida State University 1 MURI: INTGERATED FUSION AND SENSOR MANAGEMENT FOR ATE Innovative Front-End Processing

More information

Faces and Image-Based Lighting

Faces and Image-Based Lighting Announcements Faces and Image-Based Lighting Project #3 artifacts voting Final project: Demo on 6/25 (Wednesday) 13:30pm in this room Reports and videos due on 6/26 (Thursday) 11:59pm Digital Visual Effects,

More information

Deformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video

Deformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video Deformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video Shohei NOBUHARA Takashi MATSUYAMA Graduate School of Informatics, Kyoto University Sakyo, Kyoto, 606-8501,

More information

Image-Based Deformation of Objects in Real Scenes

Image-Based Deformation of Objects in Real Scenes Image-Based Deformation of Objects in Real Scenes Han-Vit Chung and In-Kwon Lee Dept. of Computer Science, Yonsei University sharpguy@cs.yonsei.ac.kr, iklee@yonsei.ac.kr Abstract. We present a new method

More information

Visualizing Flow Fields by Perceptual Motion

Visualizing Flow Fields by Perceptual Motion Visualizing Flow Fields by Perceptual Motion Li-Yi Wei Wei-Chao Chen Abstract Visualizing flow fields has a wide variety of applications in scientific simulation and computer graphics. Existing approaches

More information

Computer Graphics Disciplines. Grading. Textbooks. Course Overview. Assignment Policies. Computer Graphics Goals I

Computer Graphics Disciplines. Grading. Textbooks. Course Overview. Assignment Policies. Computer Graphics Goals I CSCI 480 Computer Graphics Lecture 1 Course Overview January 10, 2011 Jernej Barbic University of Southern California Administrative Issues Modeling Animation Rendering OpenGL Programming Course Information

More information

AUTOMATIC VIDEO INDEXING

AUTOMATIC VIDEO INDEXING AUTOMATIC VIDEO INDEXING Itxaso Bustos Maite Frutos TABLE OF CONTENTS Introduction Methods Key-frame extraction Automatic visual indexing Shot boundary detection Video OCR Index in motion Image processing

More information

Data-Driven Face Modeling and Animation

Data-Driven Face Modeling and Animation 1. Research Team Data-Driven Face Modeling and Animation Project Leader: Post Doc(s): Graduate Students: Undergraduate Students: Prof. Ulrich Neumann, IMSC and Computer Science John P. Lewis Zhigang Deng,

More information

3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images

3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images 3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images presented by Tran Cong Thien Qui PhD Candidate School of Computer Engineering & Institute for Media Innovation Supervisor:

More information

Speech Driven Synthesis of Talking Head Sequences

Speech Driven Synthesis of Talking Head Sequences 3D Image Analysis and Synthesis, pp. 5-56, Erlangen, November 997. Speech Driven Synthesis of Talking Head Sequences Peter Eisert, Subhasis Chaudhuri,andBerndGirod Telecommunications Laboratory, University

More information

IMAGINE Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments

IMAGINE Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments IMAGINE Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments 1 2 A Computer Graphics group 3D modeling, Animation, Cinematography A pluridiscilinary team Marie-Paule Cani

More information

Tiled Texture Synthesis

Tiled Texture Synthesis International Journal of Information & Computation Technology. ISSN 0974-2239 Volume 4, Number 16 (2014), pp. 1667-1672 International Research Publications House http://www. irphouse.com Tiled Texture

More information

Multiple View Geometry

Multiple View Geometry Multiple View Geometry Martin Quinn with a lot of slides stolen from Steve Seitz and Jianbo Shi 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 Our Goal The Plenoptic Function P(θ,φ,λ,t,V

More information

Recovering light directions and camera poses from a single sphere.

Recovering light directions and camera poses from a single sphere. Title Recovering light directions and camera poses from a single sphere Author(s) Wong, KYK; Schnieders, D; Li, S Citation The 10th European Conference on Computer Vision (ECCV 2008), Marseille, France,

More information

The Role of Manifold Learning in Human Motion Analysis

The Role of Manifold Learning in Human Motion Analysis The Role of Manifold Learning in Human Motion Analysis Ahmed Elgammal and Chan Su Lee Department of Computer Science, Rutgers University, Piscataway, NJ, USA {elgammal,chansu}@cs.rutgers.edu Abstract.

More information

Siggraph Full-Day Course #26. Real-Time Shadowing Techniques

Siggraph Full-Day Course #26. Real-Time Shadowing Techniques Siggraph 2004 Full-Day Course #26 Real-Time Shadowing Techniques Course Title Real-Time Shadowing Techniques Category Rendering Real-Time or for Games Presentation Venue Session Room Summary Statement

More information

Simulation in Computer Graphics. Introduction. Matthias Teschner. Computer Science Department University of Freiburg

Simulation in Computer Graphics. Introduction. Matthias Teschner. Computer Science Department University of Freiburg Simulation in Computer Graphics Introduction Matthias Teschner Computer Science Department University of Freiburg Contact Matthias Teschner Computer Graphics University of Freiburg Georges-Koehler-Allee

More information

Chapter 7. Conclusions and Future Work

Chapter 7. Conclusions and Future Work Chapter 7 Conclusions and Future Work In this dissertation, we have presented a new way of analyzing a basic building block in computer graphics rendering algorithms the computational interaction between

More information

Abstract We present a system which automatically generates a 3D face model from a single frontal image of a face. Our system consists of two component

Abstract We present a system which automatically generates a 3D face model from a single frontal image of a face. Our system consists of two component A Fully Automatic System To Model Faces From a Single Image Zicheng Liu Microsoft Research August 2003 Technical Report MSR-TR-2003-55 Microsoft Research Microsoft Corporation One Microsoft Way Redmond,

More information

Dr. Ulas Bagci

Dr. Ulas Bagci Lecture 9: Deformable Models and Segmentation CAP-Computer Vision Lecture 9-Deformable Models and Segmentation Dr. Ulas Bagci bagci@ucf.edu Lecture 9: Deformable Models and Segmentation Motivation A limitation

More information

3D Editing System for Captured Real Scenes

3D Editing System for Captured Real Scenes 3D Editing System for Captured Real Scenes Inwoo Ha, Yong Beom Lee and James D.K. Kim Samsung Advanced Institute of Technology, Youngin, South Korea E-mail: {iw.ha, leey, jamesdk.kim}@samsung.com Tel:

More information

Human Motion Synthesis by Motion Manifold Learning and Motion Primitive Segmentation

Human Motion Synthesis by Motion Manifold Learning and Motion Primitive Segmentation Human Motion Synthesis by Motion Manifold Learning and Motion Primitive Segmentation Chan-Su Lee and Ahmed Elgammal Rutgers University, Piscataway, NJ, USA {chansu, elgammal}@cs.rutgers.edu Abstract. We

More information

3D Shape Analysis with Multi-view Convolutional Networks. Evangelos Kalogerakis

3D Shape Analysis with Multi-view Convolutional Networks. Evangelos Kalogerakis 3D Shape Analysis with Multi-view Convolutional Networks Evangelos Kalogerakis 3D model repositories [3D Warehouse - video] 3D geometry acquisition [KinectFusion - video] 3D shapes come in various flavors

More information

Computer Vision, CS766. Staff. Instructor: Li Zhang TA: Jake Rosin

Computer Vision, CS766. Staff. Instructor: Li Zhang TA: Jake Rosin Computer Vision, CS766 Staff Instructor: Li Zhang lizhang@cs.wisc.edu TA: Jake Rosin rosin@cs.wisc.edu Today Introduction Administrative Stuff Overview of the Course About Me Li Zhang ( 张力 ) Last name

More information

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting R. Maier 1,2, K. Kim 1, D. Cremers 2, J. Kautz 1, M. Nießner 2,3 Fusion Ours 1

More information

Why study Computer Vision?

Why study Computer Vision? Computer Vision Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications building representations of the 3D world from pictures automated surveillance

More information

Course Producer. Prerequisites. Textbooks. Academic integrity. Grading. Ming Chen. Same office hours as TA. The Hobbit: The Desolation of Smaug (2013)

Course Producer. Prerequisites. Textbooks. Academic integrity. Grading. Ming Chen. Same office hours as TA. The Hobbit: The Desolation of Smaug (2013) CSCI 420 Computer Graphics Lecture 1 Course Information On-Line Course Overview http://www-bcf.usc.edu/~jbarbic/cs420-s18/ Administrative Issues Modeling Animation Rendering OpenGL Programming [Angel Ch.

More information

HUMAN S FACIAL PARTS EXTRACTION TO RECOGNIZE FACIAL EXPRESSION

HUMAN S FACIAL PARTS EXTRACTION TO RECOGNIZE FACIAL EXPRESSION HUMAN S FACIAL PARTS EXTRACTION TO RECOGNIZE FACIAL EXPRESSION Dipankar Das Department of Information and Communication Engineering, University of Rajshahi, Rajshahi-6205, Bangladesh ABSTRACT Real-time

More information

Jinwei Gu. Ph.D. in Computer Science Dissertation: Measurement, Modeling, and Synthesis of Time-Varying Appearance of Natural

Jinwei Gu. Ph.D. in Computer Science Dissertation: Measurement, Modeling, and Synthesis of Time-Varying Appearance of Natural Jinwei Gu CONTACT Department of Computer Science Mobile: (917) 292-9361 450 Computer Science Bldg. Phone: (212)-939-7091 (office) Columbia University Fax: (212) 666-0140 500 West 120 Street New York, NY

More information

Review. Stephen J. Guy

Review. Stephen J. Guy Review Stephen J. Guy Overview Pixar short Review last class Review course Area of Graphics Image Processing Rendering Modeling Animation Misc Area of Graphics Image Processing Rendering Modeling Animation

More information

Light source estimation using feature points from specular highlights and cast shadows

Light source estimation using feature points from specular highlights and cast shadows Vol. 11(13), pp. 168-177, 16 July, 2016 DOI: 10.5897/IJPS2015.4274 Article Number: F492B6D59616 ISSN 1992-1950 Copyright 2016 Author(s) retain the copyright of this article http://www.academicjournals.org/ijps

More information

Human Body Shape Deformation from. Front and Side Images

Human Body Shape Deformation from. Front and Side Images Human Body Shape Deformation from Front and Side Images Yueh-Ling Lin 1 and Mao-Jiun J. Wang 2 Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan

More information

12/3/2009. What is Computer Vision? Applications. Application: Assisted driving Pedestrian and car detection. Application: Improving online search

12/3/2009. What is Computer Vision? Applications. Application: Assisted driving Pedestrian and car detection. Application: Improving online search Introduction to Artificial Intelligence V22.0472-001 Fall 2009 Lecture 26: Computer Vision Rob Fergus Dept of Computer Science, Courant Institute, NYU Slides from Andrew Zisserman What is Computer Vision?

More information

Introduction to Computer Graphics. Image Processing (1) June 8, 2017 Kenshi Takayama

Introduction to Computer Graphics. Image Processing (1) June 8, 2017 Kenshi Takayama Introduction to Computer Graphics Image Processing (1) June 8, 2017 Kenshi Takayama Today s topics Edge-aware image processing Gradient-domain image processing 2 Image smoothing using Gaussian Filter Smoothness

More information

Cloth Simulation on the GPU. Cyril Zeller NVIDIA Corporation

Cloth Simulation on the GPU. Cyril Zeller NVIDIA Corporation Cloth Simulation on the GPU Cyril Zeller NVIDIA Corporation Overview A method to simulate cloth on any GPU supporting Shader Model 3 (Quadro FX 4500, 4400, 3400, 1400, 540, GeForce 6 and above) Takes advantage

More information

CS559: Computer Graphics. Lecture 1 Introduction Li Zhang University of Wisconsin, Madison

CS559: Computer Graphics. Lecture 1 Introduction Li Zhang University of Wisconsin, Madison CS559: Computer Graphics Lecture 1 Introduction Li Zhang University of Wisconsin, Madison Today Introduction to Computer Graphics Course Overview What is Computer Graphics Using computers to generate and

More information

Computer Animation Visualization. Lecture 5. Facial animation

Computer Animation Visualization. Lecture 5. Facial animation Computer Animation Visualization Lecture 5 Facial animation Taku Komura Facial Animation The face is deformable Need to decide how all the vertices on the surface shall move Manually create them Muscle-based

More information

What have we leaned so far?

What have we leaned so far? What have we leaned so far? Camera structure Eye structure Project 1: High Dynamic Range Imaging What have we learned so far? Image Filtering Image Warping Camera Projection Model Project 2: Panoramic

More information

Dynamic Human Shape Description and Characterization

Dynamic Human Shape Description and Characterization Dynamic Human Shape Description and Characterization Z. Cheng*, S. Mosher, Jeanne Smith H. Cheng, and K. Robinette Infoscitex Corporation, Dayton, Ohio, USA 711 th Human Performance Wing, Air Force Research

More information

Motion Texture. Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays. 1. Introduction

Motion Texture. Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays. 1. Introduction Motion Texture Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays 1. Introduction Motion capture data is often used in movies and video games because it is able to realistically depict human

More information

A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions

A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions Jack Tumblin EECS, Northwestern University The Bilateral Filter As Simple as Weights from two Gaussian Functions; Has

More information

Introduction to Computer Graphics. Animation (2) May 26, 2016 Kenshi Takayama

Introduction to Computer Graphics. Animation (2) May 26, 2016 Kenshi Takayama Introduction to Computer Graphics Animation (2) May 26, 2016 Kenshi Takayama Physically-based deformations 2 Simple example: single mass & spring in 1D Mass m, position x, spring coefficient k, rest length

More information

Shape of Things to Come: Next-Gen Physics Deep Dive

Shape of Things to Come: Next-Gen Physics Deep Dive Shape of Things to Come: Next-Gen Physics Deep Dive Jean Pierre Bordes NVIDIA Corporation Free PhysX on CUDA PhysX by NVIDIA since March 2008 PhysX on CUDA available: August 2008 GPU PhysX in Games Physical

More information

Multi-view stereo. Many slides adapted from S. Seitz

Multi-view stereo. Many slides adapted from S. Seitz Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window

More information

Computer Vision at Cambridge: Reconstruction,Registration and Recognition

Computer Vision at Cambridge: Reconstruction,Registration and Recognition Computer Vision at Cambridge: Reconstruction,Registration and Recognition Roberto Cipolla Research team http://www.eng.cam.ac.uk/~cipolla/people.html Cognitive Systems Engineering Cognitive Systems Engineering

More information

Shape modeling Modeling technique Shape representation! 3D Graphics Modeling Techniques

Shape modeling Modeling technique Shape representation! 3D Graphics   Modeling Techniques D Graphics http://chamilo2.grenet.fr/inp/courses/ensimag4mmgd6/ Shape Modeling technique Shape representation! Part : Basic techniques. Projective rendering pipeline 2. Procedural Modeling techniques Shape

More information

Algorithms for 3D Isometric Shape Correspondence

Algorithms for 3D Isometric Shape Correspondence Algorithms for 3D Isometric Shape Correspondence Yusuf Sahillioğlu Computer Eng. Dept., Koç University, Istanbul, Turkey (PhD) Computer Eng. Dept., METU, Ankara, Turkey (Asst. Prof.) 2 / 53 Problem Definition

More information

Geometric Registration for Deformable Shapes 1.1 Introduction

Geometric Registration for Deformable Shapes 1.1 Introduction Geometric Registration for Deformable Shapes 1.1 Introduction Overview Data Sources and Applications Problem Statement Overview Presenters Will Chang University of California at San Diego, USA Hao Li ETH

More information

A Study on Different Challenges in Facial Recognition Methods

A Study on Different Challenges in Facial Recognition Methods Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 6, June 2015, pg.521

More information

Video based Animation Synthesis with the Essential Graph. Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes

Video based Animation Synthesis with the Essential Graph. Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes Video based Animation Synthesis with the Essential Graph Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes Goal Given a set of 4D models, how to generate realistic motion from user specified

More information

A Robust Facial Feature Point Tracker using Graphical Models

A Robust Facial Feature Point Tracker using Graphical Models A Robust Facial Feature Point Tracker using Graphical Models Serhan Coşar, Müjdat Çetin, Aytül Erçil Sabancı University Faculty of Engineering and Natural Sciences Orhanlı- Tuzla, 34956 İstanbul, TURKEY

More information

A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction

A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical

More information

Assoc. Prof. Yusuf Sahillioğlu

Assoc. Prof. Yusuf Sahillioğlu Assoc. Prof. Yusuf Sahillioğlu Middle East Technical University (METU) Computer Engineering Dept. Universiteler Mah. Dumlupinar Blv. No:1 Ankara 06800 Turkey Phone: +90 312 210 5563 Fax: +90 312 210 5544

More information

Simulation in Computer Graphics. Deformable Objects. Matthias Teschner. Computer Science Department University of Freiburg

Simulation in Computer Graphics. Deformable Objects. Matthias Teschner. Computer Science Department University of Freiburg Simulation in Computer Graphics Deformable Objects Matthias Teschner Computer Science Department University of Freiburg Outline introduction forces performance collision handling visualization University

More information

Topics to be Covered in the Rest of the Semester. CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester

Topics to be Covered in the Rest of the Semester. CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester Topics to be Covered in the Rest of the Semester CSci 4968 and 6270 Computational Vision Lecture 15 Overview of Remainder of the Semester Charles Stewart Department of Computer Science Rensselaer Polytechnic

More information

Lecture 10: Multi view geometry

Lecture 10: Multi view geometry Lecture 10: Multi view geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Stereo vision Correspondence problem (Problem Set 2 (Q3)) Active stereo vision systems Structure from

More information

Why study Computer Vision?

Why study Computer Vision? Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications building representations of the 3D world from pictures automated surveillance (who s doing what)

More information

Physical based Rigging

Physical based Rigging Physical based Rigging Dinghuang Ji Introduction Computer animation has been a popular research topic since 1970s, when the first parametric facial model is proposed[0]. In the recent few years, a lot

More information

Silhouette-based Multiple-View Camera Calibration

Silhouette-based Multiple-View Camera Calibration Silhouette-based Multiple-View Camera Calibration Prashant Ramanathan, Eckehard Steinbach, and Bernd Girod Information Systems Laboratory, Electrical Engineering Department, Stanford University Stanford,

More information

Geometry of Multiple views

Geometry of Multiple views 1 Geometry of Multiple views CS 554 Computer Vision Pinar Duygulu Bilkent University 2 Multiple views Despite the wealth of information contained in a a photograph, the depth of a scene point along the

More information

Technical Papers November 2017 Bangkok Int'l Trade & Exhibition Centre (BITEC)

Technical Papers November 2017 Bangkok Int'l Trade & Exhibition Centre (BITEC) Session: Form, Furniture and Fashion Date/Time: 28 November 2017, 09:00am - 10:45am Position-Based Tensegrity Design Material-Minimizing Forms and Structures Reconfigurable Interlocking Furniture Fabricable

More information

An Algorithm based on SURF and LBP approach for Facial Expression Recognition

An Algorithm based on SURF and LBP approach for Facial Expression Recognition ISSN: 2454-2377, An Algorithm based on SURF and LBP approach for Facial Expression Recognition Neha Sahu 1*, Chhavi Sharma 2, Hitesh Yadav 3 1 Assistant Professor, CSE/IT, The North Cap University, Gurgaon,

More information

Isophote-Based Interpolation

Isophote-Based Interpolation Isophote-Based Interpolation Bryan S. Morse and Duane Schwartzwald Department of Computer Science, Brigham Young University 3361 TMCB, Provo, UT 84602 {morse,duane}@cs.byu.edu Abstract Standard methods

More information

Dense 3D Modelling and Monocular Reconstruction of Deformable Objects

Dense 3D Modelling and Monocular Reconstruction of Deformable Objects Dense 3D Modelling and Monocular Reconstruction of Deformable Objects Anastasios (Tassos) Roussos Lecturer in Computer Science, University of Exeter Research Associate, Imperial College London Overview

More information

Deformation Transfer for Triangle Meshes

Deformation Transfer for Triangle Meshes Deformation Transfer for Triangle Meshes a Paper (SIGGRAPH 2004) by Robert W. Sumner & Jovan Popovic presented by Roni Oeschger Deformation Transfer Source deformed Target deformed 1 Outline of my presentation

More information

Compressive Sensing: Opportunities and Perils for Computer Vision

Compressive Sensing: Opportunities and Perils for Computer Vision Compressive Sensing: Opportunities and Perils for Computer Vision Rama Chellappa And Volkan Cevher (Rice) Joint work with Aswin C. Sankaranarayanan Dikpal Reddy Dr. Ashok Veeraraghavan (MERL) Prof. Rich

More information

Generalized Principal Component Analysis CVPR 2007

Generalized Principal Component Analysis CVPR 2007 Generalized Principal Component Analysis Tutorial @ CVPR 2007 Yi Ma ECE Department University of Illinois Urbana Champaign René Vidal Center for Imaging Science Institute for Computational Medicine Johns

More information

CSCI-6962 Advanced Computer Graphics

CSCI-6962 Advanced Computer Graphics Luxo Jr. CSCI-6962 Advanced Computer Graphics Pixar Animation Studios, 1986 Director: John Lasseter CSCI-6962 Advanced Computer Graphics Cutler 2 Plan Introduction Overview of the Semester Administrivia

More information

Accurate 3D Face and Body Modeling from a Single Fixed Kinect

Accurate 3D Face and Body Modeling from a Single Fixed Kinect Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this

More information

Finally: Motion and tracking. Motion 4/20/2011. CS 376 Lecture 24 Motion 1. Video. Uses of motion. Motion parallax. Motion field

Finally: Motion and tracking. Motion 4/20/2011. CS 376 Lecture 24 Motion 1. Video. Uses of motion. Motion parallax. Motion field Finally: Motion and tracking Tracking objects, video analysis, low level motion Motion Wed, April 20 Kristen Grauman UT-Austin Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys, and S. Lazebnik

More information

Evolution of Imaging Technology in Computer Graphics. Related Areas

Evolution of Imaging Technology in Computer Graphics. Related Areas Evolution of Imaging Technology in Computer Graphics Jonas Gomes Rio de Janeiro http://www.visgraf.impa.br Image computation Related Areas 1 Related Areas An integrated view Problems on the frontiers Graphical

More information

Topics in Computer Animation

Topics in Computer Animation Topics in Computer Animation Animation Techniques Artist Driven animation The artist draws some frames (keyframing) Usually in 2D The computer generates intermediate frames using interpolation The old

More information

Classification of Upper and Lower Face Action Units and Facial Expressions using Hybrid Tracking System and Probabilistic Neural Networks

Classification of Upper and Lower Face Action Units and Facial Expressions using Hybrid Tracking System and Probabilistic Neural Networks Classification of Upper and Lower Face Action Units and Facial Expressions using Hybrid Tracking System and Probabilistic Neural Networks HADI SEYEDARABI*, WON-SOOK LEE**, ALI AGHAGOLZADEH* AND SOHRAB

More information

CSE 5559 Computational Topology: Theory, algorithms, and applications to data analysis. Lecture 0: Introduction. Instructor: Yusu Wang

CSE 5559 Computational Topology: Theory, algorithms, and applications to data analysis. Lecture 0: Introduction. Instructor: Yusu Wang CSE 5559 Computational Topology: Theory, algorithms, and applications to data analysis Lecture 0: Introduction Instructor: Yusu Wang Lecture 0: Introduction What is topology Why should we be interested

More information

Eye tracking by image processing for helping disabled people. Alireza Rahimpour

Eye tracking by image processing for helping disabled people. Alireza Rahimpour An Introduction to: Eye tracking by image processing for helping disabled people Alireza Rahimpour arahimpo@utk.edu Fall 2012 1 Eye tracking system: Nowadays eye gaze tracking has wide range of applications

More information

Recap: Features and filters. Recap: Grouping & fitting. Now: Multiple views 10/29/2008. Epipolar geometry & stereo vision. Why multiple views?

Recap: Features and filters. Recap: Grouping & fitting. Now: Multiple views 10/29/2008. Epipolar geometry & stereo vision. Why multiple views? Recap: Features and filters Epipolar geometry & stereo vision Tuesday, Oct 21 Kristen Grauman UT-Austin Transforming and describing images; textures, colors, edges Recap: Grouping & fitting Now: Multiple

More information

CSE 167: Introduction to Computer Graphics. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013

CSE 167: Introduction to Computer Graphics. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013 CSE 167: Introduction to Computer Graphics Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013 Today Course organization Course overview 2 Course Staff Instructor Jürgen Schulze,

More information

MANMOHAN CHANDRAKER. NEC Labs America N Wolfe Rd, Ste SW3-350 Cupertino, CA 95014

MANMOHAN CHANDRAKER. NEC Labs America N Wolfe Rd, Ste SW3-350 Cupertino, CA 95014 MANMOHAN CHANDRAKER NEC Labs America 10080 N Wolfe Rd, Ste SW3-350 Cupertino, CA 95014 Phone: (858) 401-0407 Email: manu@nec-labs.com Web: http://www.nec-labs.com/~manu EDUCATION 2003 2009 University of

More information

CS5620 Intro to Computer Graphics

CS5620 Intro to Computer Graphics CS 5620 Fall 2015 www.youtube.com/watch?v=hjhic0mt4ts 3 Computer Graphics Synthesis of static/dynamic 2D images from 3D geometry using computers Teaching Staff Lecturer: Prof. Craig Gotsman Class: Mon

More information

22 October, 2012 MVA ENS Cachan. Lecture 5: Introduction to generative models Iasonas Kokkinos

22 October, 2012 MVA ENS Cachan. Lecture 5: Introduction to generative models Iasonas Kokkinos Machine Learning for Computer Vision 1 22 October, 2012 MVA ENS Cachan Lecture 5: Introduction to generative models Iasonas Kokkinos Iasonas.kokkinos@ecp.fr Center for Visual Computing Ecole Centrale Paris

More information

Extracting Surface Representations From Rim Curves

Extracting Surface Representations From Rim Curves Extracting Surface Representations From Rim Curves Hai Chen 1, Kwan-Yee K. Wong 2, Chen Liang 2, and Yue Chen 1 1 College of Software Technology, Zhejiang University, Hangzhou, Zhejiang, China 310027 chenhai@gmail.com

More information

Real-Time Shape Editing using Radial Basis Functions

Real-Time Shape Editing using Radial Basis Functions Real-Time Shape Editing using Radial Basis Functions, Leif Kobbelt RWTH Aachen Boundary Constraint Modeling Prescribe irregular constraints Vertex positions Constrained energy minimization Optimal fairness

More information

Image Morphing. Application: Movie Special Effects. Application: Registration /Alignment. Image Cross-Dissolve

Image Morphing. Application: Movie Special Effects. Application: Registration /Alignment. Image Cross-Dissolve Image Morphing Application: Movie Special Effects Morphing is turning one image into another (through a seamless transition) First movies with morphing Willow, 1988 Indiana Jones and the Last Crusade,

More information

Multi-View Stereo for Community Photo Collections Michael Goesele, et al, ICCV Venus de Milo

Multi-View Stereo for Community Photo Collections Michael Goesele, et al, ICCV Venus de Milo Vision Sensing Multi-View Stereo for Community Photo Collections Michael Goesele, et al, ICCV 2007 Venus de Milo The Digital Michelangelo Project, Stanford How to sense 3D very accurately? How to sense

More information

Combined Shape Analysis of Human Poses and Motion Units for Action Segmentation and Recognition

Combined Shape Analysis of Human Poses and Motion Units for Action Segmentation and Recognition Combined Shape Analysis of Human Poses and Motion Units for Action Segmentation and Recognition Maxime Devanne 1,2, Hazem Wannous 1, Stefano Berretti 2, Pietro Pala 2, Mohamed Daoudi 1, and Alberto Del

More information

Image Processing Pipeline for Facial Expression Recognition under Variable Lighting

Image Processing Pipeline for Facial Expression Recognition under Variable Lighting Image Processing Pipeline for Facial Expression Recognition under Variable Lighting Ralph Ma, Amr Mohamed ralphma@stanford.edu, amr1@stanford.edu Abstract Much research has been done in the field of automated

More information

http://miccom-center.org Topic: Continuum-Particle Simulation Software (COPSS-Hydrodynamics) Presenter: Jiyuan Li, The University of Chicago 2017 Summer School 1 What is Continuum-Particle Simulation?

More information

A Fast and Stable Approach for Restoration of Warped Document Images

A Fast and Stable Approach for Restoration of Warped Document Images A Fast and Stable Approach for Restoration of Warped Document Images Kok Beng Chua, Li Zhang, Yu Zhang and Chew Lim Tan School of Computing, National University of Singapore 3 Science Drive 2, Singapore

More information

Derivative Delay Embedding: Online Modeling of Streaming Time Series

Derivative Delay Embedding: Online Modeling of Streaming Time Series Derivative Delay Embedding: Online Modeling of Streaming Time Series Zhifei Zhang (PhD student), Yang Song, Wei Wang, and Hairong Qi Department of Electrical Engineering & Computer Science Outline 1. Challenges

More information

3/1/2010. Acceleration Techniques V1.2. Goals. Overview. Based on slides from Celine Loscos (v1.0)

3/1/2010. Acceleration Techniques V1.2. Goals. Overview. Based on slides from Celine Loscos (v1.0) Acceleration Techniques V1.2 Anthony Steed Based on slides from Celine Loscos (v1.0) Goals Although processor can now deal with many polygons (millions), the size of the models for application keeps on

More information

Animating Characters in Pictures

Animating Characters in Pictures Animating Characters in Pictures Shih-Chiang Dai jeffrey@cmlab.csie.ntu.edu.tw Chun-Tse Hsiao hsiaochm@cmlab.csie.ntu.edu.tw Bing-Yu Chen robin@ntu.edu.tw ABSTRACT Animating pictures is an interesting

More information

Interactive Deformation with Triangles

Interactive Deformation with Triangles Interactive Deformation with Triangles James Dean Palmer and Ergun Akleman Visualization Sciences Program Texas A&M University Jianer Chen Department of Computer Science Texas A&M University Abstract In

More information