Texture. CS 419 Slides by Ali Farhadi

Size: px
Start display at page:

Download "Texture. CS 419 Slides by Ali Farhadi"

Transcription

1 Texture CS 419 Slides by Ali Farhadi

2 What is a Texture?

3 Texture Spectrum Steven Li, James Hays, Chenyu Wu, Vivek Kwatra, and Yanxi Liu, CVPR 06

4 Texture scandals!!

5

6 Two crucial algorithmic points Nearest neighbors again and again and again Dynamic programming likely new; we ll use this again, too

7 Texture Synthesis Efros & Leung ICCV99

8 How to paint this pixel?? p Input texture Efros & Leung ICCV99

9 Ask Neighbors p p What is the conditional probability distribution of p, given it s neighbors? Efros & Leung ICCV99

10 Input image Don t bother to model the distribution It s already there, in the image Efros & Leung ICCV99

11 Efros & Leung Algorithm non-parametric sampling p Synthesizing a pixel Input image Efros & Leung ICCV99

12 Concerns Distance metric Neighborhood size Order to paint

13 Distance metric Normalized sum of squared distances Not all the neighbors worth the same Gaussian mask Preserve the local structure Pick among reasonably similar neighborhoods

14 Neighborhood size input Efros & Leung ICCV99

15 Varying Window Size Increasing window size Efros & Leung ICCV99

16 The Order matters

17 Some Results Efros & Leung ICCV99

18 More Results Efros & Leung ICCV99

19 french canvas More Results rafia weave Efros & Leung ICCV99

20 wood More Results granite Efros & Leung ICCV99

21 white bread More Results brick wall Efros & Leung ICCV99

22 Growing Regions Hole Filling Efros & Leung ICCV99

23 Hole Filling Efros & Leung ICCV99

24 Extrapolation Efros & Leung ICCV99

25 Failure Cases Growing garbage Verbatim copying Efros & Leung ICCV99

26 Pros and Cons Very simple Easy to implement Promising results Very sloooooooowwwwwww Idea: Patches instead of pixels

27 Patch based non-parametric sampling B Synthesizing a block Input image Observation neighbouring pixels are highly correlated Idea: unit of synthesis = block Efros & Freeman SIGGRAPH01

28 block Input texture B1 B2 B1 B2 B1 B2 Random placement of blocks Neighboring blocks constrained by overlap Minimal error boundary cut Efros & Freeman SIGGRAPH01

29 overlapping blocks Minimal error boundary vertical boundary _ 2 = overlap error min. error boundary Efros & Freeman SIGGRAPH01

30 Dynamic Programming S T

31 Dynamic Programming S T

32 B1 B2 B1 B2 B1 B2 Random placement of blocks Neighboring blocks constrained by overlap Minimal error boundary cut Efros & Freeman SIGGRAPH01

33 More Results Efros & Freeman SIGGRAPH01

34 More Results Efros & Freeman SIGGRAPH01

35 Efros & Freeman SIGGRAPH01

36 Efros & Freeman SIGGRAPH01

37 Efros & Freeman SIGGRAPH01

38 Efros & Freeman SIGGRAPH01

39 Failures Efros & Freeman SIGGRAPH01

40 Texture Transfer Take the texture from on object and paint it on another object + = Decomposing shape and texture Very challenging Walk around Add some constraint to the search Efros & Freeman SIGGRAPH01

41 Source Texture Destination Source Map Destination Map

42

43 Texture Transfer + = Efros & Freeman SIGGRAPH01

44 + = Efros & Freeman SIGGRAPH01

45 Efros & Freeman SIGGRAPH01

46 parmesan + = rice + = Efros & Freeman SIGGRAPH01

47 Image Analogies? Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

48 Image Analogies Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

49 Image Analogies Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

50 Image Analogies Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

51 Training Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

52 :: : B B Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

53 Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

54 :: : B B Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

55 Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

56 Learn to Blur Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

57 Texture by Numbers Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

58 Colorization Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

59 Super-resolution A A Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

60 Super-resolution (result!) B B Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

61 Training images Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

62 Hertzman, Jacobs, Oliver, Curless, and Salesin, SIGGRAPH01

63 Nearest Neighbor search The core of most of the patch based methods Very slow Smarter neighborhood search Barnes et.al. SIGGRAPH09

64 Applications Barnes et.al. SIGGRAPH09

65 Inpainting Criminisi et.al. CVPR03

66 Inpainting Barnes et.al. SIGGRAPH09

67 Retargeting Avidan, Shamir, SIGGRAPH07

68 Retargeting Seam removal Scaling Cropping Avidan, Shamir, SIGGRAPH07

69 Retargeting Avidan, Shamir, SIGGRAPH07

70 Avidan, Shamir, SIGGRAPH07

71 Retargeting Barnes et.al. SIGGRAPH09

72 Retargeting Barnes et.al. SIGGRAPH09

73 Local scale editing Barnes et.al. SIGGRAPH09

74 reshuffling Barnes et.al. SIGGRAPH09

75 Barnes et.al. SIGGRAPH09

Texture Synthesis. Darren Green (

Texture Synthesis. Darren Green ( Texture Synthesis Darren Green (www.darrensworld.com) 15-463: Computational Photography Alexei Efros, CMU, Fall 2006 Texture Texture depicts spatially repeating patterns Many natural phenomena are textures

More information

Texture Synthesis. Darren Green (

Texture Synthesis. Darren Green ( Texture Synthesis Darren Green (www.darrensworld.com) 15-463: Computational Photography Alexei Efros, CMU, Fall 2005 Texture Texture depicts spatially repeating patterns Many natural phenomena are textures

More information

More details on presentations

More details on presentations More details on presentations Aim to speak for ~50 min (after 15 min review, leaving 10 min for discussions) Try to plan discussion topics It s fine to steal slides from the Web, but be sure to acknowledge

More information

Lecture 6: Texture. Tuesday, Sept 18

Lecture 6: Texture. Tuesday, Sept 18 Lecture 6: Texture Tuesday, Sept 18 Graduate students Problem set 1 extension ideas Chamfer matching Hierarchy of shape prototypes, search over translations Comparisons with Hausdorff distance, L1 on

More information

Data-driven methods: Video & Texture. A.A. Efros

Data-driven methods: Video & Texture. A.A. Efros Data-driven methods: Video & Texture A.A. Efros 15-463: Computational Photography Alexei Efros, CMU, Fall 2010 Michel Gondry train video http://youtube.com/watch?v=ques1bwvxga Weather Forecasting for Dummies

More information

Texture Synthesis and Manipulation Project Proposal. Douglas Lanman EN 256: Computer Vision 19 October 2006

Texture Synthesis and Manipulation Project Proposal. Douglas Lanman EN 256: Computer Vision 19 October 2006 Texture Synthesis and Manipulation Project Proposal Douglas Lanman EN 256: Computer Vision 19 October 2006 1 Outline Introduction to Texture Synthesis Previous Work Project Goals and Timeline Douglas Lanman

More information

Admin. Data driven methods. Overview. Overview. Parametric model of image patches. Data driven (Non parametric) Approach 3/31/2008

Admin. Data driven methods. Overview. Overview. Parametric model of image patches. Data driven (Non parametric) Approach 3/31/2008 Admin Office hours straight after class today Data driven methods Assignment 3 out, due in 2 weeks Lecture 8 Projects.. Overview Overview Texture synthesis Quilting Image Analogies Super resolution Scene

More information

Data-driven methods: Video & Texture. A.A. Efros

Data-driven methods: Video & Texture. A.A. Efros Data-driven methods: Video & Texture A.A. Efros CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2014 Michel Gondry train video http://www.youtube.com/watch?v=0s43iwbf0um

More information

Texture. The Challenge. Texture Synthesis. Statistical modeling of texture. Some History. COS526: Advanced Computer Graphics

Texture. The Challenge. Texture Synthesis. Statistical modeling of texture. Some History. COS526: Advanced Computer Graphics COS526: Advanced Computer Graphics Tom Funkhouser Fall 2010 Texture Texture is stuff (as opposed to things ) Characterized by spatially repeating patterns Texture lacks the full range of complexity of

More information

Texture April 17 th, 2018

Texture April 17 th, 2018 Texture April 17 th, 2018 Yong Jae Lee UC Davis Announcements PS1 out today Due 5/2 nd, 11:59 pm start early! 2 Review: last time Edge detection: Filter for gradient Threshold gradient magnitude, thin

More information

Image Composition. COS 526 Princeton University

Image Composition. COS 526 Princeton University Image Composition COS 526 Princeton University Modeled after lecture by Alexei Efros. Slides by Efros, Durand, Freeman, Hays, Fergus, Lazebnik, Agarwala, Shamir, and Perez. Image Composition Jurassic Park

More information

Topics. Image Processing Techniques and Smart Image Manipulation. Texture Synthesis. Topics. Markov Chain. Weather Forecasting for Dummies

Topics. Image Processing Techniques and Smart Image Manipulation. Texture Synthesis. Topics. Markov Chain. Weather Forecasting for Dummies Image Processing Techniques and Smart Image Manipulation Maneesh Agrawala Topics Texture Synthesis High Dynamic Range Imaging Bilateral Filter Gradient-Domain Techniques Matting Graph-Cut Optimization

More information

CSCI 1290: Comp Photo

CSCI 1290: Comp Photo CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. Smartphone news Qualcomm Snapdragon 675 just

More information

Announcements. Texture. Review: last time. Texture 9/15/2009. Write your CS login ID on the pset hardcopy. Tuesday, Sept 15 Kristen Grauman UT-Austin

Announcements. Texture. Review: last time. Texture 9/15/2009. Write your CS login ID on the pset hardcopy. Tuesday, Sept 15 Kristen Grauman UT-Austin Announcements Texture Write your CS login ID on the pset hardcopy Tuesday, Sept 5 Kristen Grauman UT-Austin Review: last time Edge detection: Filter for gradient Threshold gradient magnitude, thin Texture

More information

Texture April 14 th, 2015

Texture April 14 th, 2015 Texture April 14 th, 2015 Yong Jae Lee UC Davis Announcements PS1 out today due 4/29 th, 11:59 pm start early! 2 Review: last time Edge detection: Filter for gradient Threshold gradient magnitude, thin

More information

Texture. Announcements. Markov Chains. Modeling Texture. Guest lecture next Tuesday. Evals at the end of class today

Texture. Announcements. Markov Chains. Modeling Texture. Guest lecture next Tuesday. Evals at the end of class today Announcements Guest lecture next Tuesday Dan Goldman: CV in special effects held in Allen Center (room TBA) Evals at the end of class today Texture Today s Reading Alexei A. Efros and Thomas K. Leung,

More information

Announcements. Texture. Review. Today: Texture 9/14/2015. Reminder: A1 due this Friday. Tues, Sept 15. Kristen Grauman UT Austin

Announcements. Texture. Review. Today: Texture 9/14/2015. Reminder: A1 due this Friday. Tues, Sept 15. Kristen Grauman UT Austin Announcements Reminder: A due this Friday Texture Tues, Sept 5 Kristen Grauman UT Austin Review Edge detection: Filter for gradient Threshold gradient magnitude, thin Today: Texture Chamfer matching to

More information

Texture. COS 429 Princeton University

Texture. COS 429 Princeton University Texture COS 429 Princeton University Texture What is a texture? Antonio Torralba Texture What is a texture? Antonio Torralba Texture What is a texture? Antonio Torralba Texture Texture is stochastic and

More information

+ = The Goal of Texture Synthesis. Image Quilting for Texture Synthesis & Transfer. The Challenge. Texture Synthesis for Graphics

+ = The Goal of Texture Synthesis. Image Quilting for Texture Synthesis & Transfer. The Challenge. Texture Synthesis for Graphics Image Quilting for Texture Synthesis & Transfer Alexei Efros (UC Berkeley) Bill Freeman (MERL) The Goal of Texture Synthesis True (infinite) texture input image SYNTHESIS generated image Given a finite

More information

Texture. Texture. 2) Synthesis. Objectives: 1) Discrimination/Analysis

Texture. Texture. 2) Synthesis. Objectives: 1) Discrimination/Analysis Texture Texture D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Key issue: How do we represent texture? Topics: Texture segmentation Texture-based matching Texture

More information

PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing

PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing Barnes et al. In SIGGRAPH 2009 발표이성호 2009 년 12 월 3 일 Introduction Image retargeting Resized to a new aspect ratio [Rubinstein

More information

Median filter. Non-linear filtering example. Degraded image. Radius 1 median filter. Today

Median filter. Non-linear filtering example. Degraded image. Radius 1 median filter. Today Today Non-linear filtering example Median filter Replace each pixel by the median over N pixels (5 pixels, for these examples). Generalizes to rank order filters. In: In: 5-pixel neighborhood Out: Out:

More information

Non-linear filtering example

Non-linear filtering example Today Non-linear filtering example Median filter Replace each pixel by the median over N pixels (5 pixels, for these examples). Generalizes to rank order filters. In: In: 5-pixel neighborhood Out: Out:

More information

An Improved Texture Synthesis Algorithm Using Morphological Processing with Image Analogy

An Improved Texture Synthesis Algorithm Using Morphological Processing with Image Analogy An Improved Texture Synthesis Algorithm Using Morphological Processing with Image Analogy Jiang Ni Henry Schneiderman CMU-RI-TR-04-52 October 2004 Robotics Institute Carnegie Mellon University Pittsburgh,

More information

Motion Texture. Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays. 1. Introduction

Motion Texture. Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays. 1. Introduction Motion Texture Harriet Pashley Advisor: Yanxi Liu Ph.D. Student: James Hays 1. Introduction Motion capture data is often used in movies and video games because it is able to realistically depict human

More information

Texture Synthesis. Fourier Transform. F(ω) f(x) To understand frequency ω let s reparametrize the signal by ω: Fourier Transform

Texture Synthesis. Fourier Transform. F(ω) f(x) To understand frequency ω let s reparametrize the signal by ω: Fourier Transform Texture Synthesis Image Manipulation and Computational Photography CS294-69 Fall 2011 Maneesh Agrawala [Some slides from James Hays, Derek Hoiem, Alexei Efros and Fredo Durand] Fourier Transform To understand

More information

Object Removal Using Exemplar-Based Inpainting

Object Removal Using Exemplar-Based Inpainting CS766 Prof. Dyer Object Removal Using Exemplar-Based Inpainting Ye Hong University of Wisconsin-Madison Fall, 2004 Abstract Two commonly used approaches to fill the gaps after objects are removed from

More information

Today: non-linear filters, and uses for the filters and representations from last time. Review pyramid representations Non-linear filtering Textures

Today: non-linear filters, and uses for the filters and representations from last time. Review pyramid representations Non-linear filtering Textures 1 Today: non-linear filters, and uses for the filters and representations from last time Review pyramid representations Non-linear filtering Textures 2 Reading Related to today s lecture: Chapter 9, Forsyth&Ponce..

More information

Volume Editor. Hans Weghorn Faculty of Mechatronics BA-University of Cooperative Education, Stuttgart Germany

Volume Editor. Hans Weghorn Faculty of Mechatronics BA-University of Cooperative Education, Stuttgart Germany Volume Editor Hans Weghorn Faculty of Mechatronics BA-University of Cooperative Education, Stuttgart Germany Proceedings of the 4 th Annual Meeting on Information Technology and Computer Science ITCS,

More information

Texture Synthesis. Michael Kazhdan ( /657)

Texture Synthesis. Michael Kazhdan ( /657) Texture Synthesis Michael Kazhdan (601.457/657) An Image Synthesizer. Perlin, 1985 Texture Synthesis by Non-Parametric Sampling. Efros and Leung, 1999 Image Quilting for Texture Synthesis and Transfer.

More information

Texture and Other Uses of Filters

Texture and Other Uses of Filters CS 1699: Intro to Computer Vision Texture and Other Uses of Filters Prof. Adriana Kovashka University of Pittsburgh September 10, 2015 Slides from Kristen Grauman (12-52) and Derek Hoiem (54-83) Plan for

More information

A Comparison Study of Four Texture Synthesis Algorithms on Regular and Near-regular Textures

A Comparison Study of Four Texture Synthesis Algorithms on Regular and Near-regular Textures A Comparison Study of Four Texture Synthesis Algorithms on Regular and Near-regular Textures Wen-Chieh Lin James H. Hays Chenyu Wu Vivek Kwatra Yanxi Liu CMU-RI-TR-04-01 January 2004 School of Computer

More information

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Texture

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Texture Texture D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Texture Key issue: How do we represent texture? Topics: Texture segmentation Texture-based matching Texture

More information

Automatic Generation of An Infinite Panorama

Automatic Generation of An Infinite Panorama Automatic Generation of An Infinite Panorama Lisa H. Chan Alexei A. Efros Carnegie Mellon University Original Image Scene Matches Output Image Figure 1: Given an input image, scene matching from a large

More information

Rectangling Panoramic Images via Warping

Rectangling Panoramic Images via Warping Rectangling Panoramic Images via Warping Kaiming He Microsoft Research Asia Huiwen Chang Tsinghua University Jian Sun Microsoft Research Asia Introduction Panoramas are irregular Introduction Panoramas

More information

Shift-Map Image Editing

Shift-Map Image Editing Shift-Map Image Editing Yael Pritch Eitam Kav-Venaki Shmuel Peleg School of Computer Science and Engineering The Hebrew University of Jerusalem 91904 Jerusalem, Israel Abstract Geometric rearrangement

More information

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC)

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Texture D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Previously Edges, contours, feature points, patches (templates) Color features Useful for matching, recognizing

More information

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Previously

Texture. D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Previously Texture D. Forsythe and J. Ponce Computer Vision modern approach Chapter 9 (Slides D. Lowe, UBC) Previously Edges, contours, feature points, patches (templates) Color features Useful for matching, recognizing

More information

Seam-Carving. Michael Rubinstein MIT. and Content-driven Retargeting of Images (and Video) Some slides borrowed from Ariel Shamir and Shai Avidan

Seam-Carving. Michael Rubinstein MIT. and Content-driven Retargeting of Images (and Video) Some slides borrowed from Ariel Shamir and Shai Avidan Seam-Carving and Content-driven Retargeting of Images (and Video) Michael Rubinstein MIT Some slides borrowed from Ariel Shamir and Shai Avidan Display Devices Content Retargeting PC iphone Page Layout

More information

Tiled Texture Synthesis

Tiled Texture Synthesis International Journal of Information & Computation Technology. ISSN 0974-2239 Volume 4, Number 16 (2014), pp. 1667-1672 International Research Publications House http://www. irphouse.com Tiled Texture

More information

ABSTRACT Departures from a regular texture pattern can happen in many different dimensions. Previous related work has focused on faithful texture synt

ABSTRACT Departures from a regular texture pattern can happen in many different dimensions. Previous related work has focused on faithful texture synt Deformable Texture: the Irregular-Regular-Irregular Cycle Yanxi Liu and Wen-Chieh Lin CMU-RI-TR-03-26 The Robotics Institute Carnegie Mellon University Pittsburgh, PA 15213 cfl2003 Carnegie Mellon University

More information

I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University. Computer Vision: 6. Texture

I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University. Computer Vision: 6. Texture I Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University Computer Vision: 6. Texture Objective Key issue: How do we represent texture? Topics: Texture analysis Texture synthesis Shape

More information

Single Image Super-resolution. Slides from Libin Geoffrey Sun and James Hays

Single Image Super-resolution. Slides from Libin Geoffrey Sun and James Hays Single Image Super-resolution Slides from Libin Geoffrey Sun and James Hays Cs129 Computational Photography James Hays, Brown, fall 2012 Types of Super-resolution Multi-image (sub-pixel registration) Single-image

More information

Alignment and Mosaicing of Non-Overlapping Images

Alignment and Mosaicing of Non-Overlapping Images Alignment and Mosaicing of Non-Overlapping Images Yair Poleg Shmuel Peleg School of Computer Science and Engineering The Hebrew University of Jerusalem Jerusalem, Israel Abstract Image alignment and mosaicing

More information

Final Exam Schedule. Final exam has been scheduled. 12:30 pm 3:00 pm, May 7. Location: INNOVA It will cover all the topics discussed in class

Final Exam Schedule. Final exam has been scheduled. 12:30 pm 3:00 pm, May 7. Location: INNOVA It will cover all the topics discussed in class Final Exam Schedule Final exam has been scheduled 12:30 pm 3:00 pm, May 7 Location: INNOVA 1400 It will cover all the topics discussed in class One page double-sided cheat sheet is allowed A calculator

More information

IMA Preprint Series # 2016

IMA Preprint Series # 2016 VIDEO INPAINTING OF OCCLUDING AND OCCLUDED OBJECTS By Kedar A. Patwardhan Guillermo Sapiro and Marcelo Bertalmio IMA Preprint Series # 2016 ( January 2005 ) INSTITUTE FOR MATHEMATICS AND ITS APPLICATIONS

More information

Super-Resolution-based Inpainting

Super-Resolution-based Inpainting Super-Resolution-based Inpainting Olivier Le Meur and Christine Guillemot University of Rennes 1, France; INRIA Rennes, France olemeur@irisa.fr, christine.guillemot@inria.fr Abstract. This paper introduces

More information

Texture Synthesis and Image Inpainting for Video Compression Project Report for CSE-252C

Texture Synthesis and Image Inpainting for Video Compression Project Report for CSE-252C Texture Synthesis and Image Inpainting for Video Compression Project Report for CSE-252C Sanjeev Kumar Abstract In this report we investigate the application of texture synthesis and image inpainting techniques

More information

Light Field Occlusion Removal

Light Field Occlusion Removal Light Field Occlusion Removal Shannon Kao Stanford University kaos@stanford.edu Figure 1: Occlusion removal pipeline. The input image (left) is part of a focal stack representing a light field. Each image

More information

Image Inpainting. Seunghoon Park Microsoft Research Asia Visual Computing 06/30/2011

Image Inpainting. Seunghoon Park Microsoft Research Asia Visual Computing 06/30/2011 Image Inpainting Seunghoon Park Microsoft Research Asia Visual Computing 06/30/2011 Contents Background Previous works Two papers Space-Time Completion of Video (PAMI 07)*1+ PatchMatch: A Randomized Correspondence

More information

Texture Synthesis by Non-parametric Sampling

Texture Synthesis by Non-parametric Sampling Texture Synthesis by Non-parametric Sampling Alexei A. Efros and Thomas K. Leung Computer Science Division University of California, Berkeley Berkeley, CA 94720-1776, U.S.A. fefros,leungtg@cs.berkeley.edu

More information

3D Object Repair Using 2D Algorithms

3D Object Repair Using 2D Algorithms 3D Object Repair Using D Algorithms Pavlos Stavrou 1, Pavlos Mavridis 1, Georgios Papaioannou, Georgios Passalis 1 and Theoharis Theoharis 1 1 National Kapodistrian University of Athens, Department of

More information

Targil 10 : Why Mosaic? Why is this a challenge? Exposure differences Scene illumination Miss-registration Moving objects

Targil 10 : Why Mosaic? Why is this a challenge? Exposure differences Scene illumination Miss-registration Moving objects Why Mosaic? Are you getting the whole picture? Compact Camera FOV = 5 x 35 Targil : Panoramas - Stitching and Blending Some slides from Alexei Efros 2 Slide from Brown & Lowe Why Mosaic? Are you getting

More information

Image Blending and Compositing NASA

Image Blending and Compositing NASA Image Blending and Compositing NASA CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2016 Image Compositing Compositing Procedure 1. Extract Sprites (e.g using Intelligent

More information

Recap from Monday. Frequency domain analytical tool computational shortcut compression tool

Recap from Monday. Frequency domain analytical tool computational shortcut compression tool Recap from Monday Frequency domain analytical tool computational shortcut compression tool Fourier Transform in 2d in Matlab, check out: imagesc(log(abs(fftshift(fft2(im))))); Image Blending (Szeliski

More information

Helsinki University of Technology Telecommunications Software and Multimedia Laboratory T Seminar on computer graphics Spring 2004

Helsinki University of Technology Telecommunications Software and Multimedia Laboratory T Seminar on computer graphics Spring 2004 Helsinki University of Technology 29.3.2004 Telecommunications Software and Multimedia Laboratory T-111.500 Seminar on computer graphics Spring 2004 Image Analogies Jari Huttunen 48120P Image Analogies

More information

SYMMETRY-BASED COMPLETION

SYMMETRY-BASED COMPLETION SYMMETRY-BASED COMPLETION Thiago Pereira 1 Renato Paes Leme 2 Luiz Velho 1 Thomas Lewiner 3 1 Visgraf, IMPA 2 Computer Science, Cornell 3 Matmidia, PUC Rio Keywords: Abstract: Image completion, Inpainting,

More information

VDoi: / abstract This paper presents a new randomized algorithm for quickly

VDoi: / abstract This paper presents a new randomized algorithm for quickly vdoi:10.1145/2018396.2018421 The PatchMatch Randomized Matching Algorithm for Image Manipulation By Connelly Barnes, Dan B Goldman, Eli Shechtman, and Adam Finkelstein Abstract This paper presents a new

More information

Review. Stephen J. Guy

Review. Stephen J. Guy Review Stephen J. Guy Overview Pixar short Review last class Review course Area of Graphics Image Processing Rendering Modeling Animation Misc Area of Graphics Image Processing Rendering Modeling Animation

More information

Image gradients and edges April 11 th, 2017

Image gradients and edges April 11 th, 2017 4//27 Image gradients and edges April th, 27 Yong Jae Lee UC Davis PS due this Friday Announcements Questions? 2 Last time Image formation Linear filters and convolution useful for Image smoothing, removing

More information

Image gradients and edges April 10 th, 2018

Image gradients and edges April 10 th, 2018 Image gradients and edges April th, 28 Yong Jae Lee UC Davis PS due this Friday Announcements Questions? 2 Last time Image formation Linear filters and convolution useful for Image smoothing, removing

More information

Problem Set 4. Assigned: March 23, 2006 Due: April 17, (6.882) Belief Propagation for Segmentation

Problem Set 4. Assigned: March 23, 2006 Due: April 17, (6.882) Belief Propagation for Segmentation 6.098/6.882 Computational Photography 1 Problem Set 4 Assigned: March 23, 2006 Due: April 17, 2006 Problem 1 (6.882) Belief Propagation for Segmentation In this problem you will set-up a Markov Random

More information

Detail Preserving Shape Deformation in Image Editing

Detail Preserving Shape Deformation in Image Editing Detail Preserving Shape Deformation in Image Editing Hui Fang Google, Inc. John C. Hart University of Illinois, Urbana-Champaign (e) Figure 1: The deformation of a source image, described by tracing and

More information

Figure 1: A sampler of different types of textures. Figure 2: Left: An irregular texture overlaid with its lattice. Right: its near-regular counterpar

Figure 1: A sampler of different types of textures. Figure 2: Left: An irregular texture overlaid with its lattice. Right: its near-regular counterpar Deformable Texture: the Irregular-Regular-Irregular Cycle Yanxi Liu and Wen-Chieh Lin The Robotics Institute, Carnegie Mellon University, 5000 Forbes Ave. Pittsburgh, PA 15213 fyanxi,wcling@cs.cmu.edu

More information

Segmentation by Example

Segmentation by Example Segmentation by Example Sameer Agarwal and Serge Belongie Department of Computer Science and Engineering University of California, San Diego La Jolla, CA 92093, USA {sagarwal,sjb}@cs.ucsd.edu Abstract

More information

Detail Preserving Shape Deformation in Image Editing

Detail Preserving Shape Deformation in Image Editing Detail Preserving Shape Deformation in Image Editing Hui Fang Google, Inc. (a) John C. Hart University of Illinois, Urbana-Champaign (c) (b) (d) (e) Figure 1: The deformation of a source image (a), described

More information

3D Object Repair Using 2D Algorithms

3D Object Repair Using 2D Algorithms 3D Object Repair Using D Algorithms Pavlos Stavrou 1,*, Pavlos Mavridis 1, Georgios Papaioannou, Georgios Passalis 1, and Theoharis Theoharis 1 1 National Kapodistrian University of Athens, Department

More information

Pattern-based Texture Metamorphosis

Pattern-based Texture Metamorphosis Pattern-based Texture Metamorphosis Ziqiang Liu Ce Liu Heung-Yeung Shum Yizhou Yu Microsoft Research Asia Zhejiang University University of Illinois at Urbana-Champaign zqliu@msrchina.research.microsoft.com

More information

Image Resizing Based on Gradient Vector Flow Analysis

Image Resizing Based on Gradient Vector Flow Analysis Image Resizing Based on Gradient Vector Flow Analysis Sebastiano Battiato battiato@dmi.unict.it Giovanni Puglisi puglisi@dmi.unict.it Giovanni Maria Farinella gfarinellao@dmi.unict.it Daniele Ravì rav@dmi.unict.it

More information

Constrained Texture Synthesis via Energy Minimization

Constrained Texture Synthesis via Energy Minimization To appear in IEEE TVCG 1 Constrained Texture Synthesis via Energy Minimization Ganesh Ramanarayanan and Kavita Bala, Member, IEEE Department of Computer Science, Cornell University Abstract This paper

More information

Multi-view stereo. Many slides adapted from S. Seitz

Multi-view stereo. Many slides adapted from S. Seitz Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window

More information

Image Texture Tiling. Philip Reasa, Daniel Konen, Ben Mackenthun. December 18, 2013

Image Texture Tiling. Philip Reasa, Daniel Konen, Ben Mackenthun. December 18, 2013 Image Texture Tiling Philip Reasa, Daniel Konen, Ben Mackenthun December 18, 2013 Contents Abstract 2 Introduction 3 I Motivation......................................... 3 II Problem Statement.....................................

More information

Hole Filling Through Photomontage

Hole Filling Through Photomontage Hole Filling Through Photomontage Marta Wilczkowiak, Gabriel J. Brostow, Ben Tordoff, and Roberto Cipolla Department of Engineering, University of Cambridge, CB2 1PZ, U.K. http://mi.eng.cam.ac.uk/research/projects/holefilling/

More information

Supplementary Materials for. A Common Framework for Interactive Texture Transfer

Supplementary Materials for. A Common Framework for Interactive Texture Transfer Supplementary Materials for A Common Framework for Interactive Texture Transfer Yifang Men, Zhouhui Lian, Yingmin Tang, Jianguo Xiao Institute of Computer Science and Technology, Peking University, China

More information

Image Analogies for Visual Domain Adaptation

Image Analogies for Visual Domain Adaptation Image Analogies for Visual Domain Adaptation Jeff Donahue UC Berkeley EECS jdonahue@eecs.berkeley.edu Abstract In usual approaches to visual domain adaptation, algorithms are used to infer a common domain

More information

Deep Learning for Visual Manipulation and Synthesis

Deep Learning for Visual Manipulation and Synthesis Deep Learning for Visual Manipulation and Synthesis Jun-Yan Zhu 朱俊彦 UC Berkeley 2017/01/11 @ VALSE What is visual manipulation? Image Editing Program input photo User Input result Desired output: stay

More information

Opportunities of Scale

Opportunities of Scale Opportunities of Scale 11/07/17 Computational Photography Derek Hoiem, University of Illinois Most slides from Alyosha Efros Graphic from Antonio Torralba Today s class Opportunities of Scale: Data-driven

More information

Universiteit Leiden Opleiding Informatica

Universiteit Leiden Opleiding Informatica Internal Report 2012-2013-09 June 2013 Universiteit Leiden Opleiding Informatica Evaluation of Image Quilting algorithms Pepijn van Heiningen BACHELOR THESIS Leiden Institute of Advanced Computer Science

More information

CS 534: Computer Vision Texture

CS 534: Computer Vision Texture CS 534: Computer Vision Texture Spring 2004 Ahmed Elgammal Dept of Computer Science CS 534 Ahmed Elgammal Texture - 1 Outlines Finding templates by convolution What is Texture Co-occurrence matrecis for

More information

technique: seam carving Image and Video Processing Chapter 9

technique: seam carving Image and Video Processing Chapter 9 Chapter 9 Seam Carving for Images and Videos Distributed Algorithms for 2 Introduction Goals Enhance the visual content of images Adapted images should look natural Most relevant content should be clearly

More information

Image gradients and edges

Image gradients and edges Image gradients and edges April 7 th, 2015 Yong Jae Lee UC Davis Announcements PS0 due this Friday Questions? 2 Last time Image formation Linear filters and convolution useful for Image smoothing, removing

More information

Image Inpainting by Hyperbolic Selection of Pixels for Two Dimensional Bicubic Interpolations

Image Inpainting by Hyperbolic Selection of Pixels for Two Dimensional Bicubic Interpolations Image Inpainting by Hyperbolic Selection of Pixels for Two Dimensional Bicubic Interpolations Mehran Motmaen motmaen73@gmail.com Majid Mohrekesh mmohrekesh@yahoo.com Mojtaba Akbari mojtaba.akbari@ec.iut.ac.ir

More information

Scaled representations

Scaled representations Scaled representations Big bars (resp. spots, hands, etc.) and little bars are both interesting Stripes and hairs, say Inefficient to detect big bars with big filters And there is superfluous detail in

More information

The Development of a Fragment-Based Image Completion Plug-in for the GIMP

The Development of a Fragment-Based Image Completion Plug-in for the GIMP The Development of a Fragment-Based Image Completion Plug-in for the GIMP Cathy Irwin Supervisors: Shaun Bangay and Adele Lobb Abstract Recent developments in the field of image manipulation and restoration

More information

Towards Real-Time Texture Synthesis with the Jump Map

Towards Real-Time Texture Synthesis with the Jump Map Thirteenth Eurographics Workshop on Rendering (2002) P. Debevec and S. Gibson (Editors) Towards Real-Time Texture Synthesis with the Jump Map Steve Zelinka and Michael Garland Department of Computer Science,

More information

Space-Time Scene Manifolds

Space-Time Scene Manifolds Space-Time Scene Manifolds Y. Wexler D. Simakov Dept. of Computer Science and Applied Math The Weizmann Institute of Science Rehovot, 76100 Israel Abstract Non-Linear Scene Manifold Space-Time volume The

More information

Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune

Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune Face sketch photo synthesis Shweta Gandhi, Dr.D.M.Yadav JSPM S Bhivarabai sawant Institute of technology & research Electronics and telecom.dept, Wagholi, Pune Abstract Face sketch to photo synthesis has

More information

CS 534: Computer Vision Texture

CS 534: Computer Vision Texture CS 534: Computer Vision Texture Ahmed Elgammal Dept of Computer Science CS 534 Texture - 1 Outlines Finding templates by convolution What is Texture Co-occurrence matrices for texture Spatial Filtering

More information

Removing pedestrians from Google Street View images

Removing pedestrians from Google Street View images Removing pedestrians from Google Street View images Arturo Flores and Serge Belongie Department of Computer Science and Engineering University of California, San Diego {aflores,sjb}@cs.ucsd.edu Abstract

More information

IMAGE COMPLETION BY SPATIAL-CONTEXTUAL CORRELATION FRAMEWORK USING AUTOMATIC AND SEMI-AUTOMATIC SELECTION OF HOLE REGION

IMAGE COMPLETION BY SPATIAL-CONTEXTUAL CORRELATION FRAMEWORK USING AUTOMATIC AND SEMI-AUTOMATIC SELECTION OF HOLE REGION D BEULAH DAVID AND DORAI RANGASWAMY: IMAGE COMPLETION BY SPATIAL-CONTEXTUAL CORRELATION FRAMEWORK USING AUTOMATIC AND SEMI- AUTOMATIC SELECTION OF HOLE REGION DOI: 10.21917/ijivp.2015.0159 IMAGE COMPLETION

More information

Image Restoration using Multiresolution Texture Synthesis and Image Inpainting

Image Restoration using Multiresolution Texture Synthesis and Image Inpainting Image Restoration using Multiresolution Texture Synthesis and Image Inpainting Hitoshi Yamauchi, Jörg Haber, and Hans-Peter Seidel Max-Planck-Institut für Informatik, Saarbrücken, Germany E-mail: {hitoshi,haberj,hpseidel}@mpi-sb.mpg.de

More information

CS448f: Image Processing For Photography and Vision. Graph Cuts

CS448f: Image Processing For Photography and Vision. Graph Cuts CS448f: Image Processing For Photography and Vision Graph Cuts Seam Carving Video Make images smaller by removing seams Seam = connected path of pixels from top to bottom or left edge to right edge Don

More information

CS4442/9542b Artificial Intelligence II prof. Olga Veksler

CS4442/9542b Artificial Intelligence II prof. Olga Veksler CS4442/9542b Artificial Intelligence II prof. Olga Veksler Lecture 8 Computer Vision Introduction, Filtering Some slides from: D. Jacobs, D. Lowe, S. Seitz, A.Efros, X. Li, R. Fergus, J. Hayes, S. Lazebnik,

More information

A Review on Image InpaintingTechniques and Its analysis Indraja Mali 1, Saumya Saxena 2,Padmaja Desai 3,Ajay Gite 4

A Review on Image InpaintingTechniques and Its analysis Indraja Mali 1, Saumya Saxena 2,Padmaja Desai 3,Ajay Gite 4 RESEARCH ARTICLE OPEN ACCESS A Review on Image InpaintingTechniques and Its analysis Indraja Mali 1, Saumya Saxena 2,Padmaja Desai 3,Ajay Gite 4 1,2,3,4 (Computer Science, Savitribai Phule Pune University,Pune)

More information

Requesting changes to the grades, please write to me in an with descriptions. Move my office hours to the morning. 11am - 12:30pm Thursdays

Requesting changes to the grades, please write to me in an  with descriptions. Move my office hours to the morning. 11am - 12:30pm Thursdays Lab1 graded. Requesting changes to the grades, please write to me in an email with descriptions. Move my office hours to the morning. 11am - 12:30pm Thursdays Internet-scale texture synthesis With slides

More information

CS4442/9542b Artificial Intelligence II prof. Olga Veksler

CS4442/9542b Artificial Intelligence II prof. Olga Veksler CS4442/9542b Artificial Intelligence II prof. Olga Veksler Lecture 2 Computer Vision Introduction, Filtering Some slides from: D. Jacobs, D. Lowe, S. Seitz, A.Efros, X. Li, R. Fergus, J. Hayes, S. Lazebnik,

More information

ISSN: (Online) Volume 2, Issue 5, May 2014 International Journal of Advance Research in Computer Science and Management Studies

ISSN: (Online) Volume 2, Issue 5, May 2014 International Journal of Advance Research in Computer Science and Management Studies ISSN: 2321-7782 (Online) Volume 2, Issue 5, May 2014 International Journal of Advance Research in Computer Science and Management Studies Research Article / Survey Paper / Case Study Available online at:

More information

Fast Texture Transfer

Fast Texture Transfer Nonphotorealistic Rendering Fast Texture Transfer Michael Ashikhmin Stony Brook University In many applications it s useful to have the ability to create a texture of arbitrary size given a small input

More information

Shape Preserving RGB-D Depth Map Restoration

Shape Preserving RGB-D Depth Map Restoration Shape Preserving RGB-D Depth Map Restoration Wei Liu 1, Haoyang Xue 1, Yun Gu 1, Qiang Wu 2, Jie Yang 1, and Nikola Kasabov 3 1 The Key Laboratory of Ministry of Education for System Control and Information

More information

Stereoscopic Image Inpainting using scene geometry

Stereoscopic Image Inpainting using scene geometry Stereoscopic Image Inpainting using scene geometry Alexandre Hervieu, Nicolas Papadakis, Aurélie Bugeau, Pau Gargallo I Piracés, Vicent Caselles To cite this version: Alexandre Hervieu, Nicolas Papadakis,

More information