Mech 296: Vision for Robotic Applications
|
|
- Franklin Riley
- 5 years ago
- Views:
Transcription
1 Mech 296: Vision for Robotic Applications Lecture 2: Color Imaging 2. Terminology from Last Week Data Files ASCII (Text): Data file is human readable Ex: Note: characters may be removed when transferring files from one machine to another Binary: Data file is machine readable Ex: FZn Image Pixel Values Binary (Black or White): Image pixels have one of two values, or Grayscale (Monochrome): Images pixels have one of many values, commonly Color: Images pixels are described by a vector (i.e. RGB), each element of which takes many values 2.2
2 Color Video Previously we have considered monochrome video gxy (, ) Today, we will add new vision modalities to our imaging processing toolbox: color gxy (, ) = gred ( xy, ) ggreen( xy, ) gblue ( xy, ) Background Reading: Forsythe & Ponce, Chapter Color: Physics vs. Perception EM Waves from NASA: Primary Colors from Wikipedia:
3 Imaging Systems Cameras and other imaging systems are designed to reproduce human perception They don t reproduce the full scene, They only capture what humans perceive Engineering a digital camera requires a careful balance of physics and perception 2.5 Human Vision Radiometry Eye Perception Natural Scene Human 2.6 3
4 Imaging System Radiometry Image Capture Screen Eye Image Encoding Computer Voltage Conversion Perception Natural Scene Camera Computer Monitor Human 2.7 Color Reproduction Natural Light Screen Eye Eye Trichromacy In color matching experiments, a minimum of three weighted primary colors (of different frequencies: λ,λ 2,λ 3 ) are needed to match a test light (at λ 4 ) Grassman s Laws, from psychology. Test lights sum: A combination of two test lights can be matched by summing the weighted primaries associated with each individual test light 2. Transitivity: If two test lights are represented by the same set of weighted primaries, then they are the same frequency 3. Scaling: If a test light is made brighter by a factor k, then the primary weights must also be scaled by k to provide a match In short, the human response to light is linear 2.8 4
5 Physiological Basis Cone Transfer Functions In Human eye, there are three types of cones, with sensitivity peaks for short, medium and long wavelength light. Each type of cone has a transfer function, p, which relates the measured energy, E, to the incident energy, E i : E = p( λ) E i ( λ) pshort ( λ) p( λ) = pmed ( λ) plong ( λ) pshort ( λ ) pmed ( λ ) plong ( λ) Wavelength, λ (nm) Data Source: Physiological Basis Cone Transfer Functions Short Short Wavelength Cone Medium Wavelength Cone Long Wavelength Cone.996 p( λ B ) = p( λ G ) = p( λ R ) =..995 Primaries: λ B = nm λ G = nm λ R = nm 5
6 Trichromacy: Forming a Basis Transfer function vectors for (almost) any three colors form a basis Nothing special about R,G,B as primaries Can obtain complete basis for all colors, as long as the p vectors are linearly independent Can express any other transfer function vector as a linear combination of the basis vectors (i.e. the primaries, R,G & B) The f vector is the weight vector for the linear combination P= p( λr) p( λg) p( λb) = p( λ) = Pf( λ) Weight Vectors vs. Transfer Functions The human color response may be expressed equivalently as. A set of cone transfer functions, p 2. Given a set of primaries, as a set of weighting functions, f This is useful, because computer displays can only produce three primary colors (RGB) f P p( λ) ( λ ) = 2.2 6
7 RGB Weights Problem: Some of the weights are negative Negative weights are not realizable by an RGB monitor (energy > ) Not all colors visible by humans can be represented by an RGB monitor! Current TV development: use 5 color projection to extend realizable color set Red Green Blue Wavelength, λ (nm) Data Source: Mixtures of Colors A typical object scatters a spectral range of colors The spectrum of a color mixture, S(λ), is the incoming energy, E i, per unit wavelength of the incident radiation The measured energy, E, equals the incident energy, E i, weighted by the transfer function, p E = S( λ ) p( λ) dλ and p( λ ) = Pf ( λ ) Λ: Visible Spectrum A modified set of RGB weights, f, is defined for the mixture If a computer monitor uses these weights, a human viewer will perceive a color mixture, rather than a pure color f ' = S λ f( λ) dλ Λ: Visible Spectrum f ' = P E ( ) S de i dλ ( λ ) = ( λ ) These f values are what we manipulate in the computer, almost 7
8 Imaging System Radiometry Image Capture Screen Eye Image Encoding Computer Voltage Conversion Perception Natural Scene Camera Computer Monitor Human 2.5 Image Capture Like human eye, most cameras use three receptor types Camera receptors have different transfer functions than the cones in the human eye p ( λ) p = Pf ( λ) camera human Fuji:
9 Designing Camera Color Response Ideally, the color transfer functions for the camera could be related to the human color response by a linear transform The basis for the set of functions defined over the visible spectrum is infinite in size (i.e. Fourier Series). Thus the linear transformation, A, between the camera and human color representations is only an approximation; however it is a good approximation Cone Transfer Functions Wavelength, λ (nm) p ( λ) = A p ( λ) = A Pf( λ) camera LSQ human LSQ 2.7 RGB Weights Scale with Energy Key point: Values expressed in RGB colorspace are linearly related to the energy received at each camera pixel (i.e. the ratio of R : G : B is the spectrum, S, is scaled by a constant) ( λ ) = ( λ ) S ks Energy received is integral over spectrum of incident light E = S p d = ke camera Λ: Visible Spectrum ( λ) camera ( λ) λ E = S pcamera d Λ: Visible Spectrum ( λ ) ( λ) λ The RGB weights, f, are linearly related to the received energy at the camera f ' = kp A E f' = P A E The weights, f, scale with the brightness of the incoming energy spectrum, S; in this sense the RGB unit vector describes color, the RGB magnitude describes total energy content f ' = kf ' camera 2.8 9
10 Imaging System Radiometry Image Capture Screen Eye Image Encoding Computer Voltage Conversion Perception Natural Scene Camera Computer Monitor Human 2.9 Gamma Encoding Energy Levels The RGB values stored in a computer do not represent energy Rather the RGB levels in a computer image correspond to levels of human perception RGB levels encoded to equal voltage commands for a Cathode Ray Tube (CRT) monitor This CRT conversion curve is close to the curve for human brightness perception The gamma (γ) correction is the key parameter in this map f g Energy weights measured by camera perception encoded weights used in computer Note: here and in the rest of this document, the prime ( ) will be dropped from the spectral mixture weights, f, which equal the RGB energies measured by the camera
11 Image Encoding The CRT conversion is performed on a normalized scale, where f max is the saturation point for human vision and g max is the upper limit for g (i.e. 255 for a one byte value) / γ f f.99.99, >.8 g fmax fmax = gmax f f 4.5,.8 fmax fmax γ = 2.22 g/g max f/f max 2.2 CRT Conversion In principle, the CRT conversion simply inverts the mapping used in image encoding The standard gamma is γ =2.22 This is the γ for good visibility in dim background light For televisions and computer monitors, gamma is increased to provide better visibility in daylight (γ = ) Some computers make other adjustments to the gamma mapping (i.e. Macintosh) Some manufacturers quote γ without including an offset term this may cause substantial variation in quoted gamma, as low as.5 or as high as 3.5 f/f max g/g max 2.22
12 Brightness Level Perception Human perception of brightness is also nonlinear with the energy of the incoming signal In fact, the conversion curve for human perception is very close to that for CRT voltage conversion This is the real reason we continue to use the CRT-based standard, even as display technologies evolve Humans can perceive about 64 distinct levels across brightness (g/g max ) By discretizing with 256 brightness levels, can achieve smooth gradations of brightness, with no noticeable jumps If we discretized linearly in f/f max, we would need 2 4 discrete levels g/g max Human Perception CRT Conversion f/f max 2.23 In the computer, the RGB levels, g, correspond to human perception, which is nonlinearly related to the energy measured from the incoming spectrum Radiometry Image Capture Screen Eye Image Encoding Computer Voltage Conversion Perception Natural Scene Camera Computer Monitor Human f/f max f/f max g/g max g/g max f/f max g/g max
13 Radiometry Radiometry analyzes geometry of light rays We will examine radiometry only briefly, noting its impact on light intensity (energy in visual spectrum) For Lambertian objects (those with a dull surface finish), radiometry causes. Strong brightness variations over the object surface 2. Minimal color differences over the object surface The same observations are true for light sources (i.e an LED on a robot) For these reasons, color may be a more useful than grayscale information in segmenting a target 2.25 Radiometry - Sources Source effects Propagation Effect (r 2 Falloff): Energy is conserved over a spherical shell propagating outward from the light source. The energy per unit area drops off as the inverse of the radius from the light source to the camera (direct rays), from the light source to a surface (indirect rays), and from the surface to the camera (indirect rays) Source Directionality: Spot lighting (which uses a reflector or lens to orient the light rays) has directionality. An objects area is foreshortened, so that it has a smaller effective area, if it is tilted away from the light s direction of travel Occlusion and Shadow: The direct light path between the source and an object in the environment may be blocked (occluded) by some obstacle. In this case, the light that arrives at the object surface comes from a different source, from secondary bounce (i.e. reflected from a wall), or from wave effects (which are not modeled by radiometry) Color: Different types of sources (incandescent and fluroescent lights, for instance) emit light with different color spectra
14 Radiometry - Surfaces Surface effects Absorption: A fraction of the incoming light is absorbed. This fraction, which depends on wavelength, gives the object color. Scattering: The remainder of the energy is scattered or specularly reflected back toward an object. The ratio of the outgoing to incoming light is expressed by the bidirectional reflectance distribution function (BRDF), ρ In general ρ is a function of surface location, x, light wavelength, λ, and the angles of the incoming and outgoing rays, relative to the surface. Lambertian surfaces scatter radiation diffusely, uniformly in all directions. Matte surfaces are approximately Lambertian with, ρ a function of x and λ only (i.e. the color at a point on the object) Specularly reflective surfaces act like mirrors. For these surfaces, ρ is independent of wavelength, λ, but highly dependent on incoming and outgoing angles Most object lie in between these extremes and can be modeled with a ρ consisting of the summation of two terms, one a diffuse Lambertian term and the other a specular reflection term Radiometry Camera θ Camera Effects Lens and Aperture Size: The bigger the lens and aperture, the greater the light energy acquired. Automatic Gain Control: Camera electronics may adjust image brightness to reduce saturation at the high or low end. Vignetting: Multiple lenses are generally used for focus and zoom. These systems capture less energy for rays at large angles from the camera centerline. Thin Lens Radiometry: The direction of the incoming light ray and the orientation of the source and camera relative to that ray cause foreshortening (i.e. a reduction of the source and receiver areas in the orientation of the traveling ray). Images are less bright away from the camera centerline
15 Radiometry Surface Model Lumped radiometry model for surface Spectral energy at a pixel, S(λ), is the sum of a diffuse term, a spectral term, and an interreflection term S( λ) = k S ( λ) + k S ( λ) + i( λ) d d s s S(λ): Spectral energy measured at a pixel S d (λ): Energy spectrum for diffuse scattering, depends on on S s (λ) and ρ(λ) k d : Diffuse spectrum scaling due to geometry & hardware S s (λ): Energy spectrum for light source k s : Spectral reflection scaling term to geometry & hardware i(λ): Interreflections and secondary effects (neglect) ρ(λ): Wavelength sensitivity for Lambertian BRDF 2.29 Representation of an Object in RGB Space Further Simplify Model Assume the surface is Lambertian and illuminated by a single type of lighting. Neglect the interreflection term, which is small Consider RGB color cube Under these conditions, the color of an object s surface is uniform (same spectrum everywhere), but scaled by the brightness coefficient, k. Thus the RGB energy vector is linear. f = kf S( λ) = k S ( λ) d if d ( λ ) = ( λ ) S ks 2.3 5
16 Simplified Object Model in RGB Space Thus the pixels for our simplified diffuse surface should lie on a line For RGB energy values, f(λ), the line passes through zero For perceptual RGB values, g(λ), the line need not pass through zero Pixels associated with a point source of light (i.e. an LED) should display a similar, linear behavior Blue Blue Red Red.8.8 f = kf.5.5 Green Green g = kg + g 2.3 Including Specularities Specularities (highlights) are local phenomena, so k d S d is approximately constant over the area of the reflection S( λ) = k S ( λ) + k S ( λ) d d s s Blue Each specularity adds an offshoot from the RGB line which defines the observed object Red.8.5 Green
17 Including Saturation At edges of the color cube (in shadows and in areas of strong lighting), one or more of the color channels may saturate Blue Red.8.5 Green 2.33 Using Real Data RGB Plot B R.8 With real image Multiple light sources Some surface specularity at all points Sample noise Linear Trend Still Evident G 7
18 Using Real Data RGB Plot B R.8.5 G Example 2: Top surface of binder exhibits spectral reflection (daylight) 2.35 Using Real Data RGB Plot B R.8 Example 3: Manila envelope shows strong brightness variations part of the folders are in shadow.5 G
19 Threshold Color Segmentation Only two color components need to be considered, if brightness is excluded In order to remove brightness variations, fit a line to object pixel data then measure the perpendicular distance of points from the line fit Establish a threshold cutoff on the perpendicular distance: if RGB distance is below threshold, include pixels in segment g = gred ggreen g g is perception-based RGB vector blue gred () g () green gblue() Robj =, Gobj, B = obj = g red ( N) ggreen ( N) gblue( N) G = c R + c obj LSQ obj LSQ obj 2 B = dr + d obj 2 R obj, G obj, B obj are vectors of RGB data for all pixels ( : N) in a patch associated with some object The line fit for the RGB data comprises four unknown parameters Matlab Implementation Line Fit When there are more equations than unknowns, there is no exact solution for the system of equations The least-squares approach minimizes error to give a good approximate solution Left Divide (\): Matlab implements least-squares as a left divide. For the system Ax=b, type x=a\b to obtain the least squares solution, x Gobj = Robj c LSQ B obj = Robj d LSQ For the current problem, solve these two sets of linear equations
20 Perpendicular Distance Before finding the perpendicular distance of the data from the line fit, it is first necessary to remove the offset term For the nth pixel, the offset vector, v, is formed from the nth RGB vector, g, and the offset terms (c 2, d 2 ) vn ( ) = gn ( ) c d To find the perpendicular distance, we next remove the component of v parallel to the line fit. The parallel component of the error is obtained by a dot product. v ( n) = v lˆ [ ] 2 2 The l-vector is the unit vector parallel to the line fit lˆ = l /( l l) 2 where l = [ c d ] Subtracting the parallel component, v, from v gives the error perpendicular to the line fit, e e ( n) = vv ( n)ˆ l Perpendicular Distance Norm 2 Orthogonal coordinates 5 The perpendicular distance may be computed using any suitable norm. -norm: diamond 2-norm: circle infinity-norm: square To perform thresholdbased color segmentation, choose a norm and a threshold. All points with an error norm below the threshold are included in the segment e ( n) Threshold < Orthogonal coordinates Orthogonal coordinates e e 2 e
21 B Real-Time Coding For real-time image processing using Matlab, computational time is important Tip : Avoid for loops they make Matlab run slowly (the projection algorithm, for example, can be implemented in Matlab without using any loops) Tip 2: An image may contain thousands or millions of data points. To keep the operation count low, use simple operations when possible (i.e. the infinity norm runs faster than the one norm, which runs faster than the two norm) You can test your timing in Matlab using the tic and toc commans 2.4 Color Segmentation - Example RGB Plot 2 Orthogonal coordinates Human Segmentation R.8.5 G Automated Segmentation
22 Special Case Limited Variations in Luminance If the luminance (perceived brightness) is limited to a small range of k values, then it may be possible to segment directly in RGB space, without first subtracting off the brightness component In this case simply apply the norm threshold directly in RGB space -norm: octahedron 2-norm: sphere infinity-norm: cube 2.43 Example Special Case RGB Plot B R.8.5 G
23 Other Color Spaces Not all systems work with the RGB color format Other commonly used systems Linear Transformations of RGB CIE (Commission International d Eclairage) XYZ System used for color comparison; has negative primaries so all weights, f, are positive. applycform: matlab conversion for device independent color spaces (such as CIE-XYZ) CMY (Cyan-Mauve-Yellow) used for absorptive pigments (i.e. inkjet printer) YIQ (Luminance, Chrominance) used for television signals (i.e. NTSC format) rgb2ntsc: matlab conversion of image into YIQ color space Nonlinear Transformations HSV (Hue, Saturation, Value) formalizes notion of a color wheel; uses stretched polar coordinates about a brightness axis (R+G+B)/3, using energy-based RGB coordinates rgb2hsv: matlab conversion of image into YIQ color space 2.45 Summary In computer vision, color values reflect:. Technology tuned to human perception (trichromacy) 2. Physics (radiometry) Diffuse scatters (i.e. matte objects) appear as lines in RGB color space Color based segmentation performs best, in general, if brightness is removed prior to color comparison
Color and Shading. Color. Shapiro and Stockman, Chapter 6. Color and Machine Vision. Color and Perception
Color and Shading Color Shapiro and Stockman, Chapter 6 Color is an important factor for for human perception for object and material identification, even time of day. Color perception depends upon both
More informationLecture 1 Image Formation.
Lecture 1 Image Formation peimt@bit.edu.cn 1 Part 3 Color 2 Color v The light coming out of sources or reflected from surfaces has more or less energy at different wavelengths v The visual system responds
More informationAnnouncements. Lighting. Camera s sensor. HW1 has been posted See links on web page for readings on color. Intro Computer Vision.
Announcements HW1 has been posted See links on web page for readings on color. Introduction to Computer Vision CSE 152 Lecture 6 Deviations from the lens model Deviations from this ideal are aberrations
More informationIntroduction to color science
Introduction to color science Trichromacy Spectral matching functions CIE XYZ color system xy-chromaticity diagram Color gamut Color temperature Color balancing algorithms Digital Image Processing: Bernd
More informationCSE 167: Lecture #7: Color and Shading. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2011
CSE 167: Introduction to Computer Graphics Lecture #7: Color and Shading Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2011 Announcements Homework project #3 due this Friday,
More informationColour Reading: Chapter 6. Black body radiators
Colour Reading: Chapter 6 Light is produced in different amounts at different wavelengths by each light source Light is differentially reflected at each wavelength, which gives objects their natural colours
More informationAnnouncements. Camera Calibration. Thin Lens: Image of Point. Limits for pinhole cameras. f O Z
Announcements Introduction to Computer Vision CSE 152 Lecture 5 Assignment 1 has been posted. See links on web page for reading Irfanview: http://www.irfanview.com/ is a good windows utility for manipulating
More informationCMSC427 Shading Intro. Credit: slides from Dr. Zwicker
CMSC427 Shading Intro Credit: slides from Dr. Zwicker 2 Today Shading Introduction Radiometry & BRDFs Local shading models Light sources Shading strategies Shading Compute interaction of light with surfaces
More informationCSE 167: Introduction to Computer Graphics Lecture #6: Colors. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013
CSE 167: Introduction to Computer Graphics Lecture #6: Colors Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013 Announcements Homework project #3 due this Friday, October 18
More informationECE-161C Color. Nuno Vasconcelos ECE Department, UCSD (with thanks to David Forsyth)
ECE-6C Color Nuno Vasconcelos ECE Department, UCSD (with thanks to David Forsyth) Color so far we have talked about geometry where is a 3D point map mapped into, in terms of image coordinates? perspective
More informationUnderstanding Variability
Understanding Variability Why so different? Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic aberration, radial distortion
More information(0, 1, 1) (0, 1, 1) (0, 1, 0) What is light? What is color? Terminology
lecture 23 (0, 1, 1) (0, 0, 0) (0, 0, 1) (0, 1, 1) (1, 1, 1) (1, 1, 0) (0, 1, 0) hue - which ''? saturation - how pure? luminance (value) - intensity What is light? What is? Light consists of electromagnetic
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 20: Light, reflectance and photometric stereo Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Properties
More informationCSE 167: Introduction to Computer Graphics Lecture #6: Lights. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2016
CSE 167: Introduction to Computer Graphics Lecture #6: Lights Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2016 Announcements Thursday in class: midterm #1 Closed book Material
More informationLecture 22: Basic Image Formation CAP 5415
Lecture 22: Basic Image Formation CAP 5415 Today We've talked about the geometry of scenes and how that affects the image We haven't talked about light yet Today, we will talk about image formation and
More informationLighting. Camera s sensor. Lambertian Surface BRDF
Lighting Introduction to Computer Vision CSE 152 Lecture 6 Special light sources Point sources Distant point sources Strip sources Area sources Common to think of lighting at infinity (a function on the
More informationIllumination and Shading
Illumination and Shading Light sources emit intensity: assigns intensity to each wavelength of light Humans perceive as a colour - navy blue, light green, etc. Exeriments show that there are distinct I
More informationDigital Image Processing COSC 6380/4393. Lecture 19 Mar 26 th, 2019 Pranav Mantini
Digital Image Processing COSC 6380/4393 Lecture 19 Mar 26 th, 2019 Pranav Mantini What is color? Color is a psychological property of our visual experiences when we look at objects and lights, not a physical
More informationColor to Binary Vision. The assignment Irfanview: A good utility Two parts: More challenging (Extra Credit) Lighting.
Announcements Color to Binary Vision CSE 90-B Lecture 5 First assignment was available last Thursday Use whatever language you want. Link to matlab resources from web page Always check web page for updates
More informationToday. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models
Computergrafik Matthias Zwicker Universität Bern Herbst 2009 Today Introduction Local shading models Light sources strategies Compute interaction of light with surfaces Requires simulation of physics Global
More informationAll forms of EM waves travel at the speed of light in a vacuum = 3.00 x 10 8 m/s This speed is constant in air as well
Pre AP Physics Light & Optics Chapters 14-16 Light is an electromagnetic wave Electromagnetic waves: Oscillating electric and magnetic fields that are perpendicular to the direction the wave moves Difference
More informationVisualisatie BMT. Rendering. Arjan Kok
Visualisatie BMT Rendering Arjan Kok a.j.f.kok@tue.nl 1 Lecture overview Color Rendering Illumination 2 Visualization pipeline Raw Data Data Enrichment/Enhancement Derived Data Visualization Mapping Abstract
More informationReading. 2. Color. Emission spectra. The radiant energy spectrum. Watt, Chapter 15.
Reading Watt, Chapter 15. Brian Wandell. Foundations of Vision. Chapter 4. Sinauer Associates, Sunderland, MA, pp. 69-97, 1995. 2. Color 1 2 The radiant energy spectrum We can think of light as waves,
More informationLecture 12 Color model and color image processing
Lecture 12 Color model and color image processing Color fundamentals Color models Pseudo color image Full color image processing Color fundamental The color that humans perceived in an object are determined
More informationCS635 Spring Department of Computer Science Purdue University
Color and Perception CS635 Spring 2010 Daniel G Aliaga Daniel G. Aliaga Department of Computer Science Purdue University Elements of Color Perception 2 Elements of Color Physics: Illumination Electromagnetic
More informationCENG 477 Introduction to Computer Graphics. Ray Tracing: Shading
CENG 477 Introduction to Computer Graphics Ray Tracing: Shading Last Week Until now we learned: How to create the primary rays from the given camera and image plane parameters How to intersect these rays
More informationColor. Reading: Optional reading: Chapter 6, Forsyth & Ponce. Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this.
Today Color Reading: Chapter 6, Forsyth & Ponce Optional reading: Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this. Feb. 17, 2005 MIT 6.869 Prof. Freeman Why does
More informationVisible Color. 700 (red) 580 (yellow) 520 (green)
Color Theory Physical Color Visible energy - small portion of the electro-magnetic spectrum Pure monochromatic colors are found at wavelengths between 380nm (violet) and 780nm (red) 380 780 Color Theory
More informationLecture 15: Shading-I. CITS3003 Graphics & Animation
Lecture 15: Shading-I CITS3003 Graphics & Animation E. Angel and D. Shreiner: Interactive Computer Graphics 6E Addison-Wesley 2012 Objectives Learn that with appropriate shading so objects appear as threedimensional
More informationImage Formation. Camera trial #1. Pinhole camera. What is an Image? Light and the EM spectrum The H.V.S. and Color Perception
Image Formation Light and the EM spectrum The H.V.S. and Color Perception What is an Image? An image is a projection of a 3D scene into a 2D projection plane. An image can be defined as a 2 variable function
More informationPhysical Color. Color Theory - Center for Graphics and Geometric Computing, Technion 2
Color Theory Physical Color Visible energy - small portion of the electro-magnetic spectrum Pure monochromatic colors are found at wavelengths between 380nm (violet) and 780nm (red) 380 780 Color Theory
More informationCapturing light. Source: A. Efros
Capturing light Source: A. Efros Review Pinhole projection models What are vanishing points and vanishing lines? What is orthographic projection? How can we approximate orthographic projection? Lenses
More informationComputer Graphics (CS 4731) Lecture 16: Lighting, Shading and Materials (Part 1)
Computer Graphics (CS 4731) Lecture 16: Lighting, Shading and Materials (Part 1) Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Why do we need Lighting & shading? Sphere
More informationToday. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models
Computergrafik Thomas Buchberger, Matthias Zwicker Universität Bern Herbst 2008 Today Introduction Local shading models Light sources strategies Compute interaction of light with surfaces Requires simulation
More informationColor and Light CSCI 4229/5229 Computer Graphics Fall 2016
Color and Light CSCI 4229/5229 Computer Graphics Fall 2016 Solar Spectrum Human Trichromatic Color Perception Color Blindness Present to some degree in 8% of males and about 0.5% of females due to mutation
More informationLight Transport Baoquan Chen 2017
Light Transport 1 Physics of Light and Color It s all electromagnetic (EM) radiation Different colors correspond to radiation of different wavelengths Intensity of each wavelength specified by amplitude
More informationComputer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model
Computer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Why do we need Lighting
More informationWhy does a visual system need color? Color. Why does a visual system need color? (an incomplete list ) Lecture outline. Reading: Optional reading:
Today Color Why does a visual system need color? Reading: Chapter 6, Optional reading: Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this. Feb. 17, 2005 MIT 6.869 Prof.
More informationCSE 681 Illumination and Phong Shading
CSE 681 Illumination and Phong Shading Physics tells us What is Light? We don t see objects, we see light reflected off of objects Light is a particle and a wave The frequency of light What is Color? Our
More informationIntroduction. Lighting model Light reflection model Local illumination model Reflectance model BRDF
Shading Introduction Affine transformations help us to place objects into a scene. Before creating images of these objects, we ll look at models for how light interacts with their surfaces. Such a model
More informationLecture 4 Image Enhancement in Spatial Domain
Digital Image Processing Lecture 4 Image Enhancement in Spatial Domain Fall 2010 2 domains Spatial Domain : (image plane) Techniques are based on direct manipulation of pixels in an image Frequency Domain
More informationCS5620 Intro to Computer Graphics
So Far wireframe hidden surfaces Next step 1 2 Light! Need to understand: How lighting works Types of lights Types of surfaces How shading works Shading algorithms What s Missing? Lighting vs. Shading
More informationComputer Graphics. Bing-Yu Chen National Taiwan University The University of Tokyo
Computer Graphics Bing-Yu Chen National Taiwan University The University of Tokyo Introduction The Graphics Process Color Models Triangle Meshes The Rendering Pipeline 1 What is Computer Graphics? modeling
More informationSpectral Color and Radiometry
Spectral Color and Radiometry Louis Feng April 13, 2004 April 13, 2004 Realistic Image Synthesis (Spring 2004) 1 Topics Spectral Color Light and Color Spectrum Spectral Power Distribution Spectral Color
More informationWhat is it? How does it work? How do we use it?
What is it? How does it work? How do we use it? Dual Nature http://www.youtube.com/watch?v=dfpeprq7ogc o Electromagnetic Waves display wave behavior o Created by oscillating electric and magnetic fields
More informationThe Elements of Colour
Color science 1 The Elements of Colour Perceived light of different wavelengths is in approximately equal weights achromatic.
More informationIllumination & Shading: Part 1
Illumination & Shading: Part 1 Light Sources Empirical Illumination Shading Local vs Global Illumination Lecture 10 Comp 236 Spring 2005 Computer Graphics Jargon: Illumination Models Illumination - the
More informationColor. making some recognition problems easy. is 400nm (blue) to 700 nm (red) more; ex. X-rays, infrared, radio waves. n Used heavily in human vision
Color n Used heavily in human vision n Color is a pixel property, making some recognition problems easy n Visible spectrum for humans is 400nm (blue) to 700 nm (red) n Machines can see much more; ex. X-rays,
More informationComputer Vision. The image formation process
Computer Vision The image formation process Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2016/2017 The image
More informationFall 2015 Dr. Michael J. Reale
CS 490: Computer Vision Color Theory: Color Models Fall 2015 Dr. Michael J. Reale Color Models Different ways to model color: XYZ CIE standard RB Additive Primaries Monitors, video cameras, etc. CMY/CMYK
More informationChapter 5 Extraction of color and texture Comunicação Visual Interactiva. image labeled by cluster index
Chapter 5 Extraction of color and texture Comunicação Visual Interactiva image labeled by cluster index Color images Many images obtained with CCD are in color. This issue raises the following issue ->
More informationImage Formation. Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico
Image Formation Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico 1 Objectives Fundamental imaging notions Physical basis for image formation
More informationCS5670: Computer Vision
CS5670: Computer Vision Noah Snavely Light & Perception Announcements Quiz on Tuesday Project 3 code due Monday, April 17, by 11:59pm artifact due Wednesday, April 19, by 11:59pm Can we determine shape
More informationLight. Properties of light. What is light? Today What is light? How do we measure it? How does light propagate? How does light interact with matter?
Light Properties of light Today What is light? How do we measure it? How does light propagate? How does light interact with matter? by Ted Adelson Readings Andrew Glassner, Principles of Digital Image
More informationTopic 9: Lighting & Reflection models 9/10/2016. Spot the differences. Terminology. Two Components of Illumination. Ambient Light Source
Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport
More informationPaths, diffuse interreflections, caching and radiometry. D.A. Forsyth
Paths, diffuse interreflections, caching and radiometry D.A. Forsyth How we got here We want to render diffuse interreflections strategy: compute approximation B-hat, then gather B = E +(ρk)e +(ρk)( ˆB
More informationTopic 9: Lighting & Reflection models. Lighting & reflection The Phong reflection model diffuse component ambient component specular component
Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 21: Light, reflectance and photometric stereo Announcements Final projects Midterm reports due November 24 (next Tuesday) by 11:59pm (upload to CMS) State the
More informationGlobal Illumination CS334. Daniel G. Aliaga Department of Computer Science Purdue University
Global Illumination CS334 Daniel G. Aliaga Department of Computer Science Purdue University Recall: Lighting and Shading Light sources Point light Models an omnidirectional light source (e.g., a bulb)
More informationVirtual Reality for Human Computer Interaction
Virtual Reality for Human Computer Interaction Appearance: Lighting Representation of Light and Color Do we need to represent all I! to represent a color C(I)? No we can approximate using a three-color
More informationComputer Graphics MTAT Raimond Tunnel
Computer Graphics MTAT.03.015 Raimond Tunnel The Road So Far... Last week This week Color What is color? Color We represent color values with 3 channels: Red Green Blue Color We represent color values
More informationIllumination. The slides combine material from Andy van Dam, Spike Hughes, Travis Webb and Lyn Fong
INTRODUCTION TO COMPUTER GRAPHIC S Illumination The slides combine material from Andy van Dam, Spike Hughes, Travis Webb and Lyn Fong Andries van Dam October 29, 2009 Illumination Models 1/30 Outline Physical
More informationINFOGR Computer Graphics. J. Bikker - April-July Lecture 10: Shading Models. Welcome!
INFOGR Computer Graphics J. Bikker - April-July 2016 - Lecture 10: Shading Models Welcome! Today s Agenda: Introduction Light Transport Materials Sensors Shading INFOGR Lecture 10 Shading Models 3 Introduction
More informationCS130 : Computer Graphics Lecture 8: Lighting and Shading. Tamar Shinar Computer Science & Engineering UC Riverside
CS130 : Computer Graphics Lecture 8: Lighting and Shading Tamar Shinar Computer Science & Engineering UC Riverside Why we need shading Suppose we build a model of a sphere using many polygons and color
More informationspecular diffuse reflection.
Lesson 8 Light and Optics The Nature of Light Properties of Light: Reflection Refraction Interference Diffraction Polarization Dispersion and Prisms Total Internal Reflection Huygens s Principle The Nature
More informationAnnouncements. Radiometry and Sources, Shadows, and Shading
Announcements Radiometry and Sources, Shadows, and Shading CSE 252A Lecture 6 Instructor office hours This week only: Thursday, 3:45 PM-4:45 PM Tuesdays 6:30 PM-7:30 PM Library (for now) Homework 1 is
More informationLecture 11. Color. UW CSE vision faculty
Lecture 11 Color UW CSE vision faculty Starting Point: What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power (watts) λ is wavelength Perceiving
More informationIllumination in Computer Graphics
Illumination in Computer Graphics Ann McNamara Illumination in Computer Graphics Definition of light sources. Analysis of interaction between light and objects in a scene. Rendering images that are faithful
More informationw Foley, Section16.1 Reading
Shading w Foley, Section16.1 Reading Introduction So far, we ve talked exclusively about geometry. w What is the shape of an object? w How do I place it in a virtual 3D space? w How do I know which pixels
More informationShading I Computer Graphics I, Fall 2008
Shading I 1 Objectives Learn to shade objects ==> images appear threedimensional Introduce types of light-material interactions Build simple reflection model Phong model Can be used with real time graphics
More informationIntroduction to Computer Graphics with WebGL
Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science Laboratory University of New Mexico Image Formation
More informationSimple Lighting/Illumination Models
Simple Lighting/Illumination Models Scene rendered using direct lighting only Photograph Scene rendered using a physically-based global illumination model with manual tuning of colors (Frederic Drago and
More informationIntroduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation
Introduction CMPSCI 591A/691A CMPSCI 570/670 Image Formation Lecture Outline Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic
More informationColor and Light. CSCI 4229/5229 Computer Graphics Summer 2008
Color and Light CSCI 4229/5229 Computer Graphics Summer 2008 Solar Spectrum Human Trichromatic Color Perception Are A and B the same? Color perception is relative Transmission,Absorption&Reflection Light
More informationDigital Image Processing
Digital Image Processing 7. Color Transforms 15110191 Keuyhong Cho Non-linear Color Space Reflect human eye s characters 1) Use uniform color space 2) Set distance of color space has same ratio difference
More informationWhat is color? What do we mean by: Color of an object Color of a light Subjective color impression. Are all these notions the same?
What is color? What do we mean by: Color of an object Color of a light Subjective color impression. Are all these notions the same? Wavelengths of light striking the eye are not sufficient or necessary
More informationReading. Shading. An abundance of photons. Introduction. Required: Angel , 6.5, Optional: Angel 6.4 OpenGL red book, chapter 5.
Reading Required: Angel 6.1-6.3, 6.5, 6.7-6.8 Optional: Shading Angel 6.4 OpenGL red book, chapter 5. 1 2 Introduction An abundance of photons So far, we ve talked exclusively about geometry. Properly
More informationthis is processed giving us: perceived color that we actually experience and base judgments upon.
color we have been using r, g, b.. why what is a color? can we get all colors this way? how does wavelength fit in here, what part is physics, what part is physiology can i use r, g, b for simulation of
More informationModule 5: Video Modeling Lecture 28: Illumination model. The Lecture Contains: Diffuse and Specular Reflection. Objectives_template
The Lecture Contains: Diffuse and Specular Reflection file:///d /...0(Ganesh%20Rana)/MY%20COURSE_Ganesh%20Rana/Prof.%20Sumana%20Gupta/FINAL%20DVSP/lecture%2028/28_1.htm[12/30/2015 4:22:29 PM] Diffuse and
More informationAnnouncement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface.
Lighting and Photometric Stereo CSE252A Lecture 7 Announcement Read Chapter 2 of Forsyth & Ponce Might find section 12.1.3 of Forsyth & Ponce useful. HW Problem Emitted radiance in direction f r for incident
More informationComputer Vision Course Lecture 02. Image Formation Light and Color. Ceyhun Burak Akgül, PhD cba-research.com. Spring 2015 Last updated 04/03/2015
Computer Vision Course Lecture 02 Image Formation Light and Color Ceyhun Burak Akgül, PhD cba-research.com Spring 2015 Last updated 04/03/2015 Photo credit: Olivier Teboul vision.mas.ecp.fr/personnel/teboul
More informationCPSC 314 LIGHTING AND SHADING
CPSC 314 LIGHTING AND SHADING UGRAD.CS.UBC.CA/~CS314 slide credits: Mikhail Bessmeltsev et al 1 THE RENDERING PIPELINE Vertices and attributes Vertex Shader Modelview transform Per-vertex attributes Vertex
More informationCharacterizing and Controlling the. Spectral Output of an HDR Display
Characterizing and Controlling the Spectral Output of an HDR Display Ana Radonjić, Christopher G. Broussard, and David H. Brainard Department of Psychology, University of Pennsylvania, Philadelphia, PA
More informationAnnouncements. Light. Properties of light. Light. Project status reports on Wednesday. Readings. Today. Readings Szeliski, 2.2, 2.3.
Announcements Project status reports on Wednesday prepare 5 minute ppt presentation should contain: problem statement (1 slide) description of approach (1 slide) some images (1 slide) current status +
More informationGame Programming. Bing-Yu Chen National Taiwan University
Game Programming Bing-Yu Chen National Taiwan University What is Computer Graphics? Definition the pictorial synthesis of real or imaginary objects from their computer-based models descriptions OUTPUT
More informationThe Display pipeline. The fast forward version. The Display Pipeline The order may vary somewhat. The Graphics Pipeline. To draw images.
View volume The fast forward version The Display pipeline Computer Graphics 1, Fall 2004 Lecture 3 Chapter 1.4, 1.8, 2.5, 8.2, 8.13 Lightsource Hidden surface 3D Projection View plane 2D Rasterization
More informationImage Analysis and Formation (Formation et Analyse d'images)
Image Analysis and Formation (Formation et Analyse d'images) James L. Crowley ENSIMAG 3 - MMIS Option MIRV First Semester 2010/2011 Lesson 4 19 Oct 2010 Lesson Outline: 1 The Physics of Light...2 1.1 Photons
More informationPhotometric Stereo. Lighting and Photometric Stereo. Computer Vision I. Last lecture in a nutshell BRDF. CSE252A Lecture 7
Lighting and Photometric Stereo Photometric Stereo HW will be on web later today CSE5A Lecture 7 Radiometry of thin lenses δa Last lecture in a nutshell δa δa'cosα δacos β δω = = ( z' / cosα ) ( z / cosα
More informationShading. Brian Curless CSE 557 Autumn 2017
Shading Brian Curless CSE 557 Autumn 2017 1 Reading Optional: Angel and Shreiner: chapter 5. Marschner and Shirley: chapter 10, chapter 17. Further reading: OpenGL red book, chapter 5. 2 Basic 3D graphics
More informationRendering: Reality. Eye acts as pinhole camera. Photons from light hit objects
Basic Ray Tracing Rendering: Reality Eye acts as pinhole camera Photons from light hit objects Rendering: Reality Eye acts as pinhole camera Photons from light hit objects Rendering: Reality Eye acts as
More informationColor Vision. Spectral Distributions Various Light Sources
Color Vision Light enters the eye Absorbed by cones Transmitted to brain Interpreted to perceive color Foundations of Vision Brian Wandell Spectral Distributions Various Light Sources Cones and Rods Cones:
More informationSensor Modalities. Sensor modality: Different modalities:
Sensor Modalities Sensor modality: Sensors which measure same form of energy and process it in similar ways Modality refers to the raw input used by the sensors Different modalities: Sound Pressure Temperature
More informationOPPA European Social Fund Prague & EU: We invest in your future.
OPPA European Social Fund Prague & EU: We invest in your future. Image formation and its physical basis Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering, Department
More information2/26/2016. Chapter 23 Ray Optics. Chapter 23 Preview. Chapter 23 Preview
Chapter 23 Ray Optics Chapter Goal: To understand and apply the ray model of light. Slide 23-2 Chapter 23 Preview Slide 23-3 Chapter 23 Preview Slide 23-4 1 Chapter 23 Preview Slide 23-5 Chapter 23 Preview
More informationCS4670: Computer Vision
CS4670: Computer Vision Noah Snavely Lecture 30: Light, color, and reflectance Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Properties of light
More informationCS201 Computer Vision Lect 4 - Image Formation
CS201 Computer Vision Lect 4 - Image Formation John Magee 9 September, 2014 Slides courtesy of Diane H. Theriault Question of the Day: Why is Computer Vision hard? Something to think about from our view
More informationComputer Graphics. Illumination and Shading
() Illumination and Shading Dr. Ayman Eldeib Lighting So given a 3-D triangle and a 3-D viewpoint, we can set the right pixels But what color should those pixels be? If we re attempting to create a realistic
More informationMODELING LED LIGHTING COLOR EFFECTS IN MODERN OPTICAL ANALYSIS SOFTWARE LED Professional Magazine Webinar 10/27/2015
MODELING LED LIGHTING COLOR EFFECTS IN MODERN OPTICAL ANALYSIS SOFTWARE LED Professional Magazine Webinar 10/27/2015 Presenter Dave Jacobsen Senior Application Engineer at Lambda Research Corporation for
More informationGlobal Illumination. Frank Dellaert Some slides by Jim Rehg, Philip Dutre
Global Illumination Frank Dellaert Some slides by Jim Rehg, Philip Dutre Color and Radiometry What is color? What is Color? A perceptual attribute of objects and scenes constructed by the visual system
More informationComp 410/510 Computer Graphics. Spring Shading
Comp 410/510 Computer Graphics Spring 2017 Shading Why we need shading Suppose we build a model of a sphere using many polygons and then color it using a fixed color. We get something like But we rather
More information