Abstract. 1 Introduction. Information and Communication Engineering July 2nd Fast Spectral Reflectance Recovery using DLP Projector

Size: px
Start display at page:

Download "Abstract. 1 Introduction. Information and Communication Engineering July 2nd Fast Spectral Reflectance Recovery using DLP Projector"

Transcription

1 Information and Communication Engineering July 2nd 2010 Fast Spectral Reflectance Recovery using DLP Projector Sato Laboratory D2, , Shuai Han Abstract We present a practical approach to fast spectral reflectance recovery by exploiting the unique colorforming mechanism of Digital Light Processing (DLP) projectors. On the basis of this approach, an imaging system that can take spectral measurements at 100 Hz was built. In our system, a DLP projector is used as a light source. Scenes appearance under the projector s irradiation is captured by a high-speed camera. Illumination spectra of the captured frames are recovered by using a white board as a calibration target. Express spectral reflectance as a linear combination of a set of basis functions, our system can reconstruct the spectral reflectance of scene points based on the captured frames and recovered illuminations. We verified the recovery accuracy of our system by using Macbeth ColorChecker. Moreover, effectiveness of the system is demonstrated by spectral relighting of a dynamic scene. 1 Introduction The amount of light reflected on an object s surface varies for different wavelengths. The ratio of the spectral intensity of reflected light to incident light is known as spectral reflectance. It is an intrinsic characteristic of an object, independent of illuminations and imaging sensors. Therefore, spectral reflectance offers direct descriptions about objects which are useful for a wide range of vision tasks, such as color constancy, object recognition, tracking etc. For spectral reflectance recovery, several methods have been proposed. Maloney used a common RGB camera to recover spectral reflectance under ambient illumination [1]. This method is limited by low recovery accuracy due to its RGB 3-channel measurement. To acquire measurements of more than 3 channels, some works acquire the changes in appearance by attaching filters to a light source to modulate illumination [2] or sequentially placing a set of band-pass filters in front of a monochromatic camera to produce a multi-channel camera [3]. These methods sacrifice temporal resolution for spectral resolution, and as a result, they are unsuitable for dynamic scenes. To increase temporal resolution, a special light source is built [4]. It works synchronously with an RGB camera for spectral measurement at 30 fps. Since such self-made light sources, as well as the controller for synchronization are not easily available, it requires some effort to build a similar system. What is more, using these light sources, the size of working volume is restricted by their non-uniform irradiation. What we seek next is a practical system for fast spectral reflectance recovery built on easily available devices. In this work, we exploit the unique color-forming mechanism of Digital Light Processing (DLP) projectors and apply it for spectral measurements. DLP projectors use color wheels to produce desired light. The color wheels are composed of several color segments, and the light that gets through these segments has different spectral distributions. In other words, DLP projectors provide several spectrally distinct illuminations. When the color wheels rotate quickly, light emitted from the DLP projectors switches among these illuminations rapidly. Making use of this switch, we built an imaging system for spectral reflectance recovery. In the system, a DLP projector is used as a light source, and a high-speed camera is adopted to capture scenes appearance under the projector s irradiation. A standard diffuse white board is placed in workspace to recover illumination spectra of captured frames. In order to reduce the number of required measurements for accurate spectral reflectance recovery, we express spectral reflectance as a linear combination of a limited number of spectral bases as done in previous studies [5, 6]. Using this linear model, the spectral reflectance can be reconstructed by the captured frames and the recovered illuminations. The contributions of this work are summarized below. Dense temporal spectral measurement: Our system is capable of taking spectral measurements at 100 Hz. This enables measurement of 1

2 fast-moving objects, and the recovered results are degraded little by motion blur. Easily built imaging system: Considering that high-speed cameras are becoming readily available on end-use market and no synchronization between the projector and the camera is required, our system can be easily replicated by others. Furthermore, with the DLP projectors as light sources, irradiation uniformity in the whole projection plane can be guaranteed, so the calibrations are simple and the working volume is large. This paper is organized as follows. Section 2 gives a brief review of related works. Section 3 presents our imaging system and its use for spectral reflectance recovery. section 4 verifies its accuracy. Section 5 shows relighting results of a static scene and a moving object. We conclude with section 6 in the end. 2 Related work Spectral reflectance can be recovered under passive illumination. Maloney and Wandell used color constancy and an RGB camera for spectral reflectance recovery [1], but the accuracy of their method is low due to RGB 3-channel measurement. For accurate results, Tominaga put a set of band-pass filters in front of a monochromatic camera to measure more than 3 channels [3]. However, it tradeoffs temporal resolution for spectral resolution, thus is not suitable for dynamic scenes. Other existing methods for spectral reflectance recovery rely on active illumination. DiCalro and Wandell recovered spectral reflectance as an intermediate result [7], but its accuracy is limited by expressing surface reflectance as a combination of 3 spectral bases. To recover spectral reflectance with high accuracy, D Zmura proposed a method using distinct illuminations[8], but the author only showed results using synthetic data, and it is unclear how well the proposed method works for real scenes. Cui, Yoo, and Ben-Ezra proposed an algorithm for selecting an optimized set of wide-band filters and built a multi-illumination system [2]. They attached selected filters to a light source, and used it as additional light source for spectral reflectance recovery under ambient illumination. This method works well for static scenes. However, switching among different illuminations is time-consuming, so the system is not applicable for moving objects. To measure dynamic scenes, Park et al. built an imaging system based on multiplexed illumination [4]. They focused on combinations of different LEDs and built special LED panels to capture 30 fps multi-spectral videos. However, their system requires specially built LED panels and synchronization between the LED panels and a camera. Accordingly, their system is not easily available. Moreover, using these self-made LED panels, irradiation uniformity can be guaranteed only in a small area, so the working volume is quite limited. Our work is also related to DLP-based active vision. Nayar, Branzoi, and Boult implemented a programmable imaging system using a modified DLP projector-camera pair [9]. Users can control radiometric and geometric characteristics of captured images by this system. Narasimhan et al. exploited the temporal dithering of DLP projectors for a wide range of applications [10]. Zhang and Huang used fast illumination variation of a DLP projector for real-time 3D shape measurement [11]. These three works only utilize the fast alternation between the on and off statuses of the digital micromirror device in a DLP projector; color information is disregarded. In contrast, our work is the first to recover spectral reflectance using a DLP projector. 3 Spectral Reflectance Recovery 3.1 Overview Image brightness is related to three factors: incident light, the scene and camera. This relationship can be expressed as I m,n = s(λ)c m (λ)l n (λ)dλ, (1) where I m,n is the intensity of a scene point in captured frames, s(λ) is the spectral reflectance of that point, c m (λ) is the spectral response function of the camera at the mth color channel and l n (λ) is the spectrum of the nth illumination. The goal of this work is to recover spectral reflectance s(λ) in a visible range [ nm]. From Eq. 1, we can see that a large set of spectrally distinct measurements are required if we want to recover s(λ) with high spectral resolution. For instance, recovery of s(λ) every 10 nm in [ nm] leads to 31 unknowns, and thus requires at least 31 measurements. However, capture of so many spectrally distinct measurements is not only complicated but also time-consuming, so it is not suitable for fast spectral reflectance recovery. If we reduce the spectral resolution, such as from 10 nm to 50 nm, the number of required measurements can be decreased. However, the accuracy of the recovered results is not sufficient. 2

3 Figure 1: System prototype. For recovery without sacrificing spectral resolution, we express spectral reflectance as a combination of a limited number of basis functions. Several linear models [5, 6] and a nonlinear model [12] have been built by principal component analysis [13] or other tools (see Ref. [14] for a review). With regard to how many bases are required for accurate reconstruction, different works have different conclusions [5, 6, 15, 16, 17]. We adopt an 8-dimension linear model for spectral reflectance derived from [6] on account of its high reconstruction accuracy. In this way, spectral reflectance can be reconstructed by estimating eight coefficients. The linear model can be expressed as s(λ) = 8 β j Φ j (λ), (2) where Φ j (λ)(j = 1, 2,.., 8)is the jth spectral basis from Ref. [6] (spectral resolution:10nm), β j is the corresponding coefficient. Substituting Eq.2 into Eq.1 I m,n = 8 β j Φ j (λ)c m (λ)l n (λ)dλ (3) Suppose the camera has a linear intensity response, Eq. 3 can be transformed into I m,n = 8 β j Φ j (λ)c m (λ)l n (λ)dλ (4) In our work, we first estimate β j from observed I m,n. Then, spectral reflectance s(λ) is reconstructed by substituting β j into Eq. 2. As shown in Fig. 1, our imaging system is composed of a one-chip DLP projector (PLUS TM U2-1130), 500 fps RGB camera (PointGrey TM Lightning), and a standard diffuse white board (labsphere TM SRT-99). The camera has a linear intensity response and its spectral response function, c m (λ) (m = 1, 2, 3), is measured Figure 2: Camera s spectral response function for RGB 3 channels. by a spectrometer and a monochromator. The measured spectral response function is shown in Fig. 2. Using our imaging system, we recover spectral reflectance in the follow steps. 1. Image acquisition: Scene s appearance under the projector s irradiation, I m,n, is acquired by using the high-speed camera. Every five consecutive images are used as one measurement for spectral reflectance recovery. (Section 3.2) 2. Illumination recovery: Illumination spectra, l n (λ), changes from frame to frame. We use the white board as a calibration target to recover illumination of captured frames. (Section 3.3) 3. Spectral reflectance reconstruction: Based on the 8-dimensional linear model, spectral reflectance, s(λ), can be reconstructed from the acquired images and recovered illuminations. (Section 3.4) In the following, we explain each of these steps in detail. 3.2 Image acquisition Different from other kinds of projectors, DLP projectors use a color wheel to produce desired light. The color wheel consists of several color segments, and these segments allows only light in a specific wavelength range to get through. When a color wheel rotates quickly, the emitted light from the DLP projectors changes rapidly. In this work, this temporal variation of light is referred to as color switch. A diagrammatic sketch is shown in Fig. 3. In our system, the DLP projector is equipped with a 3-segment color wheel that rotates at 120 rps, so color switch occurs at 360 Hz (3 120) when we input (255, 255, 255). Human eyes, or common video cameras that work at low rates (24 30 Hz), cannot detect the color switch. In our work, the 500 fps camera is adopted to take videos of scenes under the projector s irradiation. During one rotation of the color wheel, the high-speed camera can capture 3

4 Figure 3: Color switch caused by rotation of color wheel frames. To cover all 3 spectrally distinct illuminations, we use 5 consecutive frames as one measurement for spectral reflectance recovery. Fig. 4 shows us one measurement about Macbeth ColorChecker. We can see that the scene s appearance clearly changes under the color switch of the DLP projector. 3.3 Illumination recovery Our system does not require synchronization between the projector and the camera. Due to the asynchronism, illuminations changes from frame to frame. Thus we need to recovery illumination spectrum, l n (λ), of every frame. In this section, we describe a method by using the white board as a calibration target. As mentioned above, light that gets through different segments on color wheels has distinct spectral distributions. If we use these spectral distributions as illumination bases, light emitted from the DLP projectors in a certain period can be expressed by a linear combination of these bases. In our system, since the 3 segments of the color wheel corresponding to RGB color filters, we can get these 3 distinct illuminations by inputting the projector (255, 0, 0), (0, 255, 0), and (0, 0, 255) respectively. Their spectra, measured by a spectrometer, are shown in Fig. 5. Therefore, l n (λ) in our system can be expressed as l n (λ) = 3 α n,k b k (λ), subject to α n,k > 0, (5) k=1 where b k (λ) is the spectrum of the kth illumination basis, α n,k is the corresponding coefficient. Different combinations of coefficients enable the DLP projector to produce millions of kinds of light with different spectral distributions. From Eq.1 and Eq.5, the brightness of a surface point on the white board is Figure 4: One measurement of Macbeth ColorChecker and corresponding illumination spectra. Top row is 5 frames captured sequentially by 500 fps camera in 1/100s. Bottom row is recovered illuminations of these frames. Im,n w = s w (λ)c m (λ) = k=1 3 α n,k b k (λ)dλ k=1 3 α n,k b k (λ)s w (λ)c m (λ)dλ, (6) where I w m,n is the intensity of that point, and s w (λ) means its spectral reflectance. By letting B k,m represent the intensity of the white board at the mth channel under the kth illumination basis B k,m = b k (λ)s w (λ)c m (λ)dλ (k = 1, 2, 3), (7) Eq. 6 can be rewritten as I w m,n = 3 α n,k B k,m (8) k=1 Using the white board s appearance under 3 distinct illuminations of the projector, B k,m (k = 4

5 Figure 5: Spectra of RGB illuminations of the DLP projector. 1, 2, 3) can be directly measured. We only need to measure them once in advance. From Eq. 8, we see that the intensity of a surface point on the white board under illumination l n (λ) is a linear combination of its intensities under three illumination bases I w I w 1,n B 1,1 B 2,1 B 3,1 α n,1 n = I 2,n w = B 1,2 B 2,2 B 3,2 α n,2 = B w α n, I3,n w B 1,3 B 2,3 B 3,3 α n,3 (9) where I w n represents the RGB value of a surface point on the white board under the nth illuminations, B w is a matrix consists of B k,m (k = 1, 2, 3 m = 1, 2, 3), α n is the corresponding coefficient vector. In principle, α n can be easily calculated by α n = (B w ) 1 I w n. However, due to the noise, α n,k (k = 1, 2, 3) may be negative sometimes. This conflicts with the non-negative constraint of Eq. 5. Thus, we solve α n as a non-negative least squares problem: α n = argmin α n I w n B w α n 2 subject to α n,k 0 (k = 1, 2, 3) (10) by using calculated α n, illumination spectra, l n (λ), can be reconstructed by Eq Spectral reflectance reconstruction By Eq. 4: I m,n = 8 β j Φj (λ)c m (λ)l n (λ)dλ, the intensity of a scene point can be computed. l n (λ) is recovered in the previous section, thus the integral in this equation can be represented as known coefficients: f j,m,n = Φ j (λ)c m (λ)l n (λ)dλ. One measurement that contains five consecutive frames can be written in matrix form as I = F β, (11) where I is a 15 1 vector (15 measurements: RGB 3 channels 5 frames), F is a 15 8 matrix (15 measurements 8 spectral bases), and β is an 8 1 coefficient vector. If β is estimated from I, spectral reflectance s(λ) can be reconstructed as: s(λ) = 8 β j Φ j (λ). this way, the problem of spectral reflectance recovery can be solved through 8 coefficients estimation. The DLP projector in our system has 3 spectrally distinct illuminations, and the high-speed camera provides a 3-channel measurement under each illumination. In total, we can obtain 3 3, i.e. 9 effective channels. Thus, the problem of estimating eight coefficients becomes over-determined. However, by using of the least squares solution of Eq. 11, the reconstructed spectral reflectance does not always satisfy the non-negative constraint and the solutions tend to be unstable. Therefore, we adopt a constrained minimization method proposed in Ref. [4]. We use the first derivative of the spectral reflectance respective to λ as a constraint: [ β = argmin I F β 2 +c smooth s(λ) ] β λ 2 subject to Φβ 0 for all λ, (12) where c smooth is a parameter for constraint term. Φ is the 8 spectral bases matrix. 4 Accuracy Evaluation In this section, we evaluate the accuracy of our system by Macbeth ColorChecker. In the system, every 5 consecutive frames captured by the 500 fps camera is used as one measurement. Thus, spectral measurements are taken at 100 Hz. The color wheel rotates at 120 rps. Due to the asynchronism between the DLP projector and the camera, illuminations of the frames captured at different time have different spectra. The accuracy of the recovered results would be affected by the illumination variation. In this section, we are going to evaluate both the spectral accuracy and temporal accuracy of our system. To evaluate spectral accuracy, we sequentially took 200 measurements (1000 frames) of a static 24- clip Macbeth ColorChecker. For every clip, we set c smooth to 50 and reconstructed its spectrum based on the measurements; then, the root mean square (RMS) error of the 200 reconstructed results was calculated; after that, we computed the maximum, mean, and minimum of the 200 RMS error values. The results for all 24 clips are shown in Fig. 6. We In 5

6 Figure 6: Maximum, mean and minimum RMS error of 24 clips of Macbeth ColorChecker for 200 measurements. Figure 7: Average value of RMS error of 24 clips for 200 measurements. For every 5 measurements, color wheel rotates 6 rounds. Thus, a pattern can be seen. can see that our system can accurately recover spectral reflectance of many clips, such as foliage. For some other clips, though the recovered results have comparatively bigger error because inaccuracies occur at the red range, they are still acceptable. For every clip, its maximum RMS error does not deviate a lot from the minimum one. And the biggest mean RMS error of all 24 clips is less than These results demonstrate that our system can recover spectral reflectance with reasonable spectral accuracy. Next, we evaluate the temporal accuracy of our system. We reused the 200 measurements taken in previous test. For every measurement, we reconstructed the spectral reflectance of all 24 clips; then, the RMS error of the 24 reconstructed results was calculated; after that, we computed the average value of the 24 RMS error values, and use it as the criterion to evaluate each measurement. Results for all 200 measurements are shown in Fig. 7. The average value fluctuates in a narrow band (0.047, 0.06) which verifies the temporal accuracy of our system. Figure 8: Recovered spectral reflectance of some clips on Macbeth ColorChecker by the measurement shown in Fig. 4. Ground truth: red lines; recovered: black lines. 5 Image and Video Relighting We used the spectral reflectance recovered by our method for spectral relighting of a static scene as well as a moving object. To ensure strong and spatial uniformly distributed light, an LCD projector (EPSON TM ELP-735) was used as the light source for relighting. Spectral distributions of its white, red, green, and blue were measured by a spectrometer. 5.1 Image relighting We set a static scene with fruits, vegetables and small statues. Five consecutive frames of the scene were captured by our imaging system. Using them as one measurement, the spectral reflectance of scene points was recovered pixel by pixel. Then the scene was spectrally relit by Eq. 1 with known illumination spectra of the LCD projector. A comparison between the relit results and the real captured images is shown in Fig. 9. From the comparison, we can see that the computed results are very similar to the ground truth. It reveals the accuracy our system. 6

7 Illumination Computed Ground Truth evaluation, the accuracy and the robustness of our system have been verified. Moreover, our system is built on easily available devices, and the excellent optical design of DLP projectors guarantees simple calibrations and large working volume. Therefore, it can be concluded that our system is practical and robust for spectral reflectance recovery of fastmoving objects. References Figure 9: Comparison between relit results and captured images of a static scene under distinct illuminations of the LCD projector. 5.2 Real video relighting Our system works at 100 Hz, so it is capable of measuring fast-moving objects. By our system, spectral measurements of a manipulated toy were captured continuously. For every measurement, spectral reflectance of scene points was reconstructed. Based on the recovered data, toy s movements were spectrally relit under a variety of illuminations. From Fig. 10, we can see that the computed results look natural. In the bottom of Fig. 10, a relit result is shown in the middle. It was computed on the basis of the spectral data recovered by our system. The left is a real image captured by the high-speed camera under the LCD projector s irradiation. A synthesized result to simulate captured image by a 30 fps camera is shown on the right side. Through comparisons, we can see that the relit result resembles the real captured image, and it is not degraded by the motion blur which is obvious in the synthesized result. These comparisons show the robustness of our system to artifacts caused by motion. Thus, it can be said that our system is suitable for fast-moving objects. 6 Conclusion In this work, we exploited the unique color-forming mechanism of DLP projectors. Making use of this mechanism, an imaging system for fast spectral reflectance recovery was built. This system is capable of taking measurements as fast as 100 Hz. Every measurement consists of a set of sequentially captured images. For each set, spectral reflectance of scene points can be recovered. Through intensive [1] Laurence T. Maloney and Brain A. Wandell. Color constancy: a method for recovering surface spectral reflectance. Journal of the Optical Society of America A, 3(1):29 33, [2] Cui Chi, Hyunjin Yoo, and Moshe Ben- Ezra. Multi-spectral imaging by optimized wide band illumination. International Journal on Computer Vision, 86: , Jan [3] Shoji Tominaga. Multichannel vision system for estimating surface and illumination functions. Journal of the Optical Society of America A, 13(11): , [4] J. Park, M. Lee, M. D. Grossberg, and S. K. Nayar. Multispectral Imaging Using Multiplexed Illumination. In IEEE International Conference on Computer Vision, Oct [5] J.Cohen. Dependency of the spectral reflectance curves of the munsell color chips. Psychon. Sci, 1: , [6] J. Hallikainen J. Parkkinen and T. Jaaskelainen. Characteristic spectra of munsell colors. Journal of the Optical Society of America A, 6(2): , [7] Feng Xiao Jeffrey M. DiCarlo and Brian A Wandell. Illuminating illumination. In Proc. Ninth Color Imaging Conference, pages 27 34, [8] Michael D Zmura. Color constancy: surface color from changing illumination. Journal of the Optical Society of America A, 9(3): , [9] T. E. Boult S. K. Nayar, V. Branzoi. Programmable imaging: Towards a flexible camera. International Journal on Computer Vision, 70:7 22, Oct [10] S. J. Koppal S.G Narasimhan and S. Yamazaki. Temporal dithering of illumination for fast active vision. In Proc.European Conference Computer Vision, Oct

8 Captured image (500 Hz) Relit result(100 Hz) Synthesized image(30 Hz) Figure 10: Top two rows: relit results of fast-moving toy. Continuous movements through very different illuminations are shown. Bottom row: left is image captured by 500 fps camera, middle is relit result, right is synthesized result to simulate captured image by a 30 fps camera. Recovered result by our system is degraded little by motion blur. [11] Song Zhang and Peisen Huang. Highresolution, real-time 3d shape acquisition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition Workshops, volume 3, pages 28 37, [12] Feng Xiao Jeffrey M. DiCarlo and Brian A Wandell. Spectral estimation theory: beyond linear but before bayesian. Journal of the Optical Society of America A, 20(7): , [13] Roy S. Berns. Di-Yuan Tzeng. A review of principal component analysis and its applications to color technology. Color Research And Application, 30(2):84 98, necessary? Journal of the Optical Society of America A, 9(4): , [16] Thomas W. Cronin Chuan-Chin Chiao and Daniel Osorio. Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants. Journal of the Optical Society of America A, 17(2): , [17] Laurence T. Maloney. Evaluation of linear models of surface spectral reflectance with small numbers of parameters. Journal of the Optical Society of America A, 3(10): , [14] and Timo Jskelinen. Oili Kohonen, Jussi Parkkinen. Databases for spectral color science. Color Research And Application, 31(5): , [15] James L. Dannemiller. Spectral reflectance of natural objects: how many basis functions are 8

Fast Spectral Reflectance Recovery using DLP Projector

Fast Spectral Reflectance Recovery using DLP Projector Fast Spectral Reflectance Recovery using DLP Projector Shuai Han 1, Imari Sato 2, Takahiro Okabe 1, and Yoichi Sato 1 1 Institute of Industrial Science, The University of Tokyo, Japan 2 National Institute

More information

Spectral Imaging Using Basis Lights

Spectral Imaging Using Basis Lights ANTONY LAM, ET AL.: SPECTRAL IMAGING USING BASIS LIGHTS 1 Spectral Imaging Using Basis Lights Antony Lam 1 antony@nii.ac.jp Art Subpa-Asa 2 art@set.or.th Imari Sato 1 imarik@nii.ac.jp Takahiro Okabe 3

More information

Estimating basis functions for spectral sensitivity of digital cameras

Estimating basis functions for spectral sensitivity of digital cameras (MIRU2009) 2009 7 Estimating basis functions for spectral sensitivity of digital cameras Abstract Hongxun ZHAO, Rei KAWAKAMI, Robby T.TAN, and Katsushi IKEUCHI Institute of Industrial Science, The University

More information

Supplementary materials of Multispectral imaging using a single bucket detector

Supplementary materials of Multispectral imaging using a single bucket detector Supplementary materials of Multispectral imaging using a single bucket detector Liheng Bian 1, Jinli Suo 1,, Guohai Situ 2, Ziwei Li 1, Jingtao Fan 1, Feng Chen 1 and Qionghai Dai 1 1 Department of Automation,

More information

Reconstruction of Surface Spectral Reflectances Using Characteristic Vectors of Munsell Colors

Reconstruction of Surface Spectral Reflectances Using Characteristic Vectors of Munsell Colors Reconstruction of Surface Spectral Reflectances Using Characteristic Vectors of Munsell Colors Jae Kwon Eem and Hyun Duk Shin Dept. of Electronic Eng., Kum Oh ational Univ. of Tech., Kumi, Korea Seung

More information

Estimating the surface normal of artwork using a DLP projector

Estimating the surface normal of artwork using a DLP projector Estimating the surface normal of artwork using a DLP projector KOICHI TAKASE 1 AND ROY S. BERNS 2 1 TOPPAN Printing co., ltd. 2 Munsell Color Science Laboratory, Rochester Institute of Technology Summary:

More information

Introduction to color science

Introduction to color science Introduction to color science Trichromacy Spectral matching functions CIE XYZ color system xy-chromaticity diagram Color gamut Color temperature Color balancing algorithms Digital Image Processing: Bernd

More information

Spectral Images and the Retinex Model

Spectral Images and the Retinex Model Spectral Images and the Retine Model Anahit Pogosova 1, Tuija Jetsu 1, Ville Heikkinen 2, Markku Hauta-Kasari 1, Timo Jääskeläinen 2 and Jussi Parkkinen 1 1 Department of Computer Science and Statistics,

More information

FLUORESCENCE analysis has received attention in recent

FLUORESCENCE analysis has received attention in recent IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Reflectance and Fluorescence Spectral Recovery via Actively Lit RGB Images Ying Fu, Student Member, IEEE, Antony Lam, Member, IEEE, Imari

More information

High Information Rate and Efficient Color Barcode Decoding

High Information Rate and Efficient Color Barcode Decoding High Information Rate and Efficient Color Barcode Decoding Homayoun Bagherinia and Roberto Manduchi University of California, Santa Cruz, Santa Cruz, CA 95064, USA {hbagheri,manduchi}@soe.ucsc.edu http://www.ucsc.edu

More information

Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems

Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Abstract In this paper we present a method for mirror shape recovery and partial calibration for non-central catadioptric

More information

Announcements. Lighting. Camera s sensor. HW1 has been posted See links on web page for readings on color. Intro Computer Vision.

Announcements. Lighting. Camera s sensor. HW1 has been posted See links on web page for readings on color. Intro Computer Vision. Announcements HW1 has been posted See links on web page for readings on color. Introduction to Computer Vision CSE 152 Lecture 6 Deviations from the lens model Deviations from this ideal are aberrations

More information

Using Trichromatic and Multi-channel Imaging

Using Trichromatic and Multi-channel Imaging Reconstructing Spectral and Colorimetric Data Using Trichromatic and Multi-channel Imaging Daniel Nyström Dept. of Science and Technology (ITN), Linköping University SE-674, Norrköping, Sweden danny@itn.liu.se

More information

Local Linear Models for Improved von Kries Adaptation

Local Linear Models for Improved von Kries Adaptation Appeared in Proc. of 10th Colour Imaging Conf., Scottsdale AZ, 2002 1 Local Linear Models for Improved von Kries Adaptation G. D. Finlayson, A. Alsam, and S. D. Hordley School of Information Systems University

More information

Photometric Stereo with Auto-Radiometric Calibration

Photometric Stereo with Auto-Radiometric Calibration Photometric Stereo with Auto-Radiometric Calibration Wiennat Mongkulmann Takahiro Okabe Yoichi Sato Institute of Industrial Science, The University of Tokyo {wiennat,takahiro,ysato} @iis.u-tokyo.ac.jp

More information

COLOR FIDELITY OF CHROMATIC DISTRIBUTIONS BY TRIAD ILLUMINANT COMPARISON. Marcel P. Lucassen, Theo Gevers, Arjan Gijsenij

COLOR FIDELITY OF CHROMATIC DISTRIBUTIONS BY TRIAD ILLUMINANT COMPARISON. Marcel P. Lucassen, Theo Gevers, Arjan Gijsenij COLOR FIDELITY OF CHROMATIC DISTRIBUTIONS BY TRIAD ILLUMINANT COMPARISON Marcel P. Lucassen, Theo Gevers, Arjan Gijsenij Intelligent Systems Lab Amsterdam, University of Amsterdam ABSTRACT Performance

More information

Physics-based Vision: an Introduction

Physics-based Vision: an Introduction Physics-based Vision: an Introduction Robby Tan ANU/NICTA (Vision Science, Technology and Applications) PhD from The University of Tokyo, 2004 1 What is Physics-based? An approach that is principally concerned

More information

Color Constancy from Hyper-Spectral Data

Color Constancy from Hyper-Spectral Data Color Constancy from Hyper-Spectral Data Th. Gevers, H. M. G. Stokman, J. van de Weijer Faculty of Science, University of Amsterdam, The Netherlands fgevers, stokman, joostwg@wins.uva.nl Abstract This

More information

Time-to-Contact from Image Intensity

Time-to-Contact from Image Intensity Time-to-Contact from Image Intensity Yukitoshi Watanabe Fumihiko Sakaue Jun Sato Nagoya Institute of Technology Gokiso, Showa, Nagoya, 466-8555, Japan {yukitoshi@cv.,sakaue@,junsato@}nitech.ac.jp Abstract

More information

Estimating the wavelength composition of scene illumination from image data is an

Estimating the wavelength composition of scene illumination from image data is an Chapter 3 The Principle and Improvement for AWB in DSC 3.1 Introduction Estimating the wavelength composition of scene illumination from image data is an important topics in color engineering. Solutions

More information

Estimation of Reflection Properties of Silk Textile with Multi-band Camera

Estimation of Reflection Properties of Silk Textile with Multi-band Camera Estimation of Reflection Properties of Silk Textile with Multi-band Camera Kosuke MOCHIZUKI*, Norihiro TANAKA**, Hideaki MORIKAWA* *Graduate School of Shinshu University, 12st116a@shinshu-u.ac.jp ** Faculty

More information

Phase error correction based on Inverse Function Shift Estimation in Phase Shifting Profilometry using a digital video projector

Phase error correction based on Inverse Function Shift Estimation in Phase Shifting Profilometry using a digital video projector University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2010 Phase error correction based on Inverse Function Shift Estimation

More information

Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision

Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision Zhiyan Zhang 1, Wei Qian 1, Lei Pan 1 & Yanjun Li 1 1 University of Shanghai for Science and Technology, China

More information

Estimation of Surface Spectral Reflectance on 3D. Painted Objects Using a Gonio-Spectral Imaging System

Estimation of Surface Spectral Reflectance on 3D. Painted Objects Using a Gonio-Spectral Imaging System Estimation of Surface Spectral Reflectance on 3D Painted Objects Using a Gonio-Spectral Imaging System Akira Kimachi, Shogo Nishi and Shoji Tominaga Osaka Electro-Communication University, Chiba University

More information

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix

More information

Hyperspectral Remote Sensing

Hyperspectral Remote Sensing Hyperspectral Remote Sensing Multi-spectral: Several comparatively wide spectral bands Hyperspectral: Many (could be hundreds) very narrow spectral bands GEOG 4110/5100 30 AVIRIS: Airborne Visible/Infrared

More information

Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems

Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Nuno Gonçalves and Helder Araújo Institute of Systems and Robotics - Coimbra University of Coimbra Polo II - Pinhal de

More information

Color patterns in a tapered lightpipe with RGB LEDs

Color patterns in a tapered lightpipe with RGB LEDs Color patterns in a tapered lightpipe with RGB LEDs Diego Esparza, Ivan Moreno Unidad Academica de Fisica, Universidad Autonoma de Zacatecas, 98060, Zacatecas, Mexico. ABSTRACT There is an enormous range

More information

A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction

A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical

More information

Removing Shadows from Images

Removing Shadows from Images Removing Shadows from Images Zeinab Sadeghipour Kermani School of Computing Science Simon Fraser University Burnaby, BC, V5A 1S6 Mark S. Drew School of Computing Science Simon Fraser University Burnaby,

More information

Synthesis of Facial Images with Foundation Make-Up

Synthesis of Facial Images with Foundation Make-Up Synthesis of Facial Images with Foundation Make-Up Motonori Doi 1,RieOhtsuki 2,RieHikima 2, Osamu Tanno 2, and Shoji Tominaga 3 1 Osaka Electro-Communication University, Osaka, Japan 2 Kanebo COSMETICS

More information

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching Stereo Matching Fundamental matrix Let p be a point in left image, p in right image l l Epipolar relation p maps to epipolar line l p maps to epipolar line l p p Epipolar mapping described by a 3x3 matrix

More information

Acquiring 4D Light Fields of Self-Luminous Light Sources Using Programmable Filter

Acquiring 4D Light Fields of Self-Luminous Light Sources Using Programmable Filter Acquiring 4D Light Fields of Self-Luminous Light Sources Using Programmable Filter Motohiro Nakamura 1, Takahiro Okabe 1, and Hendrik P. A. Lensch 2 1 Kyushu Institute of Technology 2 Tübingen University

More information

Illuminant retrieval for fixed location cameras

Illuminant retrieval for fixed location cameras Illuminant retrieval for fixed location cameras Joanna Marguier and Sabine Süsstrunk School of Computer and Communication Sciences, Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland Abstract

More information

An Algorithm to Determine the Chromaticity Under Non-uniform Illuminant

An Algorithm to Determine the Chromaticity Under Non-uniform Illuminant An Algorithm to Determine the Chromaticity Under Non-uniform Illuminant Sivalogeswaran Ratnasingam and Steve Collins Department of Engineering Science, University of Oxford, OX1 3PJ, Oxford, United Kingdom

More information

ENHANCEMENT OF DIFFUSERS BRDF ACCURACY

ENHANCEMENT OF DIFFUSERS BRDF ACCURACY ENHANCEMENT OF DIFFUSERS BRDF ACCURACY Grégory Bazalgette Courrèges-Lacoste (1), Hedser van Brug (1) and Gerard Otter (1) (1) TNO Science and Industry, Opto-Mechanical Instrumentation Space, P.O.Box 155,

More information

Linear Approximation of Sensitivity Curve Calibration

Linear Approximation of Sensitivity Curve Calibration Linear Approximation of Sensitivity Curve Calibration Dietrich Paulus 1 Joachim Hornegger 2 László Csink 3 Universität Koblenz-Landau Computational Visualistics Universitätsstr. 1 567 Koblenz paulus@uni-koblenz.de

More information

Spectral Adaptation. Chromatic Adaptation

Spectral Adaptation. Chromatic Adaptation Spectral Adaptation Mark D. Fairchild RIT Munsell Color Science Laboratory IS&T/SID 14th Color Imaging Conference Scottsdale 2006 Chromatic Adaptation Spectra-to-XYZ-to-LMS Chromatic adaptation models

More information

Color. Reading: Optional reading: Chapter 6, Forsyth & Ponce. Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this.

Color. Reading: Optional reading: Chapter 6, Forsyth & Ponce. Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this. Today Color Reading: Chapter 6, Forsyth & Ponce Optional reading: Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this. Feb. 17, 2005 MIT 6.869 Prof. Freeman Why does

More information

Radiometric Calibration from a Single Image

Radiometric Calibration from a Single Image Radiometric Calibration from a Single Image Stephen Lin Jinwei Gu Shuntaro Yamazaki Heung-Yeung Shum Microsoft Research Asia Tsinghua University University of Tokyo Abstract Photometric methods in computer

More information

Color. Computational Photography MIT Feb. 14, 2006 Bill Freeman and Fredo Durand

Color. Computational Photography MIT Feb. 14, 2006 Bill Freeman and Fredo Durand Color Computational Photography MIT Feb. 14, 2006 Bill Freeman and Fredo Durand Why does a visual system need color? http://www.hobbylinc.com/gr/pll/pll5019.jpg Why does a visual system need color? (an

More information

Chaplin, Modern Times, 1936

Chaplin, Modern Times, 1936 Chaplin, Modern Times, 1936 [A Bucket of Water and a Glass Matte: Special Effects in Modern Times; bonus feature on The Criterion Collection set] Multi-view geometry problems Structure: Given projections

More information

Motion. 1 Introduction. 2 Optical Flow. Sohaib A Khan. 2.1 Brightness Constancy Equation

Motion. 1 Introduction. 2 Optical Flow. Sohaib A Khan. 2.1 Brightness Constancy Equation Motion Sohaib A Khan 1 Introduction So far, we have dealing with single images of a static scene taken by a fixed camera. Here we will deal with sequence of images taken at different time intervals. Motion

More information

Video Alignment. Final Report. Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin

Video Alignment. Final Report. Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin Final Report Spring 2005 Prof. Brian Evans Multidimensional Digital Signal Processing Project The University of Texas at Austin Omer Shakil Abstract This report describes a method to align two videos.

More information

Spectral Compression: Weighted Principal Component Analysis versus Weighted Least Squares

Spectral Compression: Weighted Principal Component Analysis versus Weighted Least Squares Spectral Compression: Weighted Principal Component Analysis versus Weighted Least Squares Farnaz Agahian a*, Brian Funt a, Seyed Hossein Amirshahi b a Simon Fraser University, 8888 University Dr. V5A 1S6,

More information

Exploiting Spatial and Spectral Image Regularities for Color Constancy

Exploiting Spatial and Spectral Image Regularities for Color Constancy Exploiting Spatial and Spectral Image Regularities for Color Constancy Barun Singh and William T. Freeman MIT Computer Science and Artificial Intelligence Laboratory David H. Brainard University of Pennsylvania

More information

Lecture 19: Motion. Effect of window size 11/20/2007. Sources of error in correspondences. Review Problem set 3. Tuesday, Nov 20

Lecture 19: Motion. Effect of window size 11/20/2007. Sources of error in correspondences. Review Problem set 3. Tuesday, Nov 20 Lecture 19: Motion Review Problem set 3 Dense stereo matching Sparse stereo matching Indexing scenes Tuesda, Nov 0 Effect of window size W = 3 W = 0 Want window large enough to have sufficient intensit

More information

From RGB to Spectrum for Natural Scenes via Manifold-based Mapping

From RGB to Spectrum for Natural Scenes via Manifold-based Mapping From RGB to Spectrum for Natural Scenes via Manifold-based Mapping Yan Jia 1, Yinqiang Zheng 2, Lin Gu 2, Art Subpa-Asa 3, Antony Lam 4, Yoichi Sato 5, Imari Sato 2 1 RWTH Aachen University, Germany 2

More information

Projector Calibration for Pattern Projection Systems

Projector Calibration for Pattern Projection Systems Projector Calibration for Pattern Projection Systems I. Din *1, H. Anwar 2, I. Syed 1, H. Zafar 3, L. Hasan 3 1 Department of Electronics Engineering, Incheon National University, Incheon, South Korea.

More information

Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude

Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude A. Migukin *, V. atkovnik and J. Astola Department of Signal Processing, Tampere University of Technology,

More information

Surround Structured Lighting for Full Object Scanning

Surround Structured Lighting for Full Object Scanning Surround Structured Lighting for Full Object Scanning Douglas Lanman, Daniel Crispell, and Gabriel Taubin Brown University, Dept. of Engineering August 21, 2007 1 Outline Introduction and Related Work

More information

Mu lt i s p e c t r a l

Mu lt i s p e c t r a l Viewing Angle Analyser Revolutionary system for full spectral and polarization measurement in the entire viewing angle EZContrastMS80 & EZContrastMS88 ADVANCED LIGHT ANALYSIS by Field iris Fourier plane

More information

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation. 3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly

More information

New Sony DepthSense TM ToF Technology

New Sony DepthSense TM ToF Technology ADVANCED MATERIAL HANDLING WITH New Sony DepthSense TM ToF Technology Jenson Chang Product Marketing November 7, 2018 1 3D SENSING APPLICATIONS Pick and Place Drones Collision Detection People Counting

More information

Characterizing and Controlling the. Spectral Output of an HDR Display

Characterizing and Controlling the. Spectral Output of an HDR Display Characterizing and Controlling the Spectral Output of an HDR Display Ana Radonjić, Christopher G. Broussard, and David H. Brainard Department of Psychology, University of Pennsylvania, Philadelphia, PA

More information

CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM

CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM 1 PHYO THET KHIN, 2 LAI LAI WIN KYI 1,2 Department of Information Technology, Mandalay Technological University The Republic of the Union of Myanmar

More information

Polynomial Regression Spectra Reconstruction of Arctic Charr s RGB

Polynomial Regression Spectra Reconstruction of Arctic Charr s RGB Polynomial Regression Spectra Reconstruction of Arctic Charr s RGB J. Birgitta Martinkauppi 1, Yevgeniya Shatilova, Jukka Kekäläinen 1, and Jussi Parkkinen 1 1 University of Joensuu, PL 111, 80101 Joensuu

More information

Why does a visual system need color? Color. Why does a visual system need color? (an incomplete list ) Lecture outline. Reading: Optional reading:

Why does a visual system need color? Color. Why does a visual system need color? (an incomplete list ) Lecture outline. Reading: Optional reading: Today Color Why does a visual system need color? Reading: Chapter 6, Optional reading: Chapter 4 of Wandell, Foundations of Vision, Sinauer, 1995 has a good treatment of this. Feb. 17, 2005 MIT 6.869 Prof.

More information

Notes 9: Optical Flow

Notes 9: Optical Flow Course 049064: Variational Methods in Image Processing Notes 9: Optical Flow Guy Gilboa 1 Basic Model 1.1 Background Optical flow is a fundamental problem in computer vision. The general goal is to find

More information

Spectral Estimation of Skin Color with Foundation Makeup

Spectral Estimation of Skin Color with Foundation Makeup Spectral Estimation of Skin Color with Foundation Makeup M. Doi 1, R. Ohtsuki, and S. Tominaga 3 1 Department of Telecommunications and Computer Networks, Faculty of Information and Communication Engineering,

More information

Lecture 1 Image Formation.

Lecture 1 Image Formation. Lecture 1 Image Formation peimt@bit.edu.cn 1 Part 3 Color 2 Color v The light coming out of sources or reflected from surfaces has more or less energy at different wavelengths v The visual system responds

More information

Abstract. 1. Introduction

Abstract. 1. Introduction Recovery of Chromaticity Image Free from Shadows via Illumination Invariance Mark S. Drew School of Computing Science Simon Fraser University Vancouver, British Columbia Canada V5A 1S6 mark@cs.sfu.ca Graham

More information

3D graphics, raster and colors CS312 Fall 2010

3D graphics, raster and colors CS312 Fall 2010 Computer Graphics 3D graphics, raster and colors CS312 Fall 2010 Shift in CG Application Markets 1989-2000 2000 1989 3D Graphics Object description 3D graphics model Visualization 2D projection that simulates

More information

3D Modeling using multiple images Exam January 2008

3D Modeling using multiple images Exam January 2008 3D Modeling using multiple images Exam January 2008 All documents are allowed. Answers should be justified. The different sections below are independant. 1 3D Reconstruction A Robust Approche Consider

More information

A three-step system calibration procedure with error compensation for 3D shape measurement

A three-step system calibration procedure with error compensation for 3D shape measurement January 10, 2010 / Vol. 8, No. 1 / CHINESE OPTICS LETTERS 33 A three-step system calibration procedure with error compensation for 3D shape measurement Haihua Cui ( ), Wenhe Liao ( ), Xiaosheng Cheng (

More information

LED holographic imaging by spatial-domain diffraction computation of. textured models

LED holographic imaging by spatial-domain diffraction computation of. textured models LED holographic imaging by spatial-domain diffraction computation of textured models Ding-Chen Chen, Xiao-Ning Pang, Yi-Cong Ding, Yi-Gui Chen, and Jian-Wen Dong* School of Physics and Engineering, and

More information

CALIBRATION BETWEEN DEPTH AND COLOR SENSORS FOR COMMODITY DEPTH CAMERAS. Cha Zhang and Zhengyou Zhang

CALIBRATION BETWEEN DEPTH AND COLOR SENSORS FOR COMMODITY DEPTH CAMERAS. Cha Zhang and Zhengyou Zhang CALIBRATION BETWEEN DEPTH AND COLOR SENSORS FOR COMMODITY DEPTH CAMERAS Cha Zhang and Zhengyou Zhang Communication and Collaboration Systems Group, Microsoft Research {chazhang, zhang}@microsoft.com ABSTRACT

More information

Compact and Low Cost System for the Measurement of Accurate 3D Shape and Normal

Compact and Low Cost System for the Measurement of Accurate 3D Shape and Normal Compact and Low Cost System for the Measurement of Accurate 3D Shape and Normal Ryusuke Homma, Takao Makino, Koichi Takase, Norimichi Tsumura, Toshiya Nakaguchi and Yoichi Miyake Chiba University, Japan

More information

Announcements. Camera Calibration. Thin Lens: Image of Point. Limits for pinhole cameras. f O Z

Announcements. Camera Calibration. Thin Lens: Image of Point. Limits for pinhole cameras. f O Z Announcements Introduction to Computer Vision CSE 152 Lecture 5 Assignment 1 has been posted. See links on web page for reading Irfanview: http://www.irfanview.com/ is a good windows utility for manipulating

More information

Spectral Estimation and Reconstruction.

Spectral Estimation and Reconstruction. Characterization of Digital Camera Based on Spectral Estimation and Reconstruction. Mei-Chun Lo +, Ruey-Kuen Perng, and Xin-Yan Shen + + Department of Information Management, Shih Hsin University, Taipei,

More information

Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants

Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants 218 J. Opt. Soc. Am. A/Vol. 17, No. 2/February 2000 Chiao et al. Color signals in natural scenes: characteristics of reflectance spectra and effects of natural illuminants Chuan-Chin Chiao and Thomas W.

More information

Colour Reading: Chapter 6. Black body radiators

Colour Reading: Chapter 6. Black body radiators Colour Reading: Chapter 6 Light is produced in different amounts at different wavelengths by each light source Light is differentially reflected at each wavelength, which gives objects their natural colours

More information

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 1. IMAGE PROCESSING Computer Vision 2 Dr. Benjamin Guthier Content of this Chapter Non-linear

More information

Multiple View Geometry of Projector-Camera Systems from Virtual Mutual Projection

Multiple View Geometry of Projector-Camera Systems from Virtual Mutual Projection Multiple View Geometry of rojector-camera Systems from Virtual Mutual rojection Shuhei Kobayashi, Fumihiko Sakaue, and Jun Sato Department of Computer Science and Engineering Nagoya Institute of Technology

More information

Projection Center Calibration for a Co-located Projector Camera System

Projection Center Calibration for a Co-located Projector Camera System Projection Center Calibration for a Co-located Camera System Toshiyuki Amano Department of Computer and Communication Science Faculty of Systems Engineering, Wakayama University Sakaedani 930, Wakayama,

More information

Self-calibration of a pair of stereo cameras in general position

Self-calibration of a pair of stereo cameras in general position Self-calibration of a pair of stereo cameras in general position Raúl Rojas Institut für Informatik Freie Universität Berlin Takustr. 9, 14195 Berlin, Germany Abstract. This paper shows that it is possible

More information

DECOMPOSING and editing the illumination of a photograph

DECOMPOSING and editing the illumination of a photograph IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017 1 Illumination Decomposition for Photograph with Multiple Light Sources Ling Zhang, Qingan Yan, Zheng Liu, Hua Zou, and Chunxia Xiao, Member, IEEE Abstract Illumination

More information

Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo

Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo Miao Liao 1, Xinyu Huang, and Ruigang Yang 1 1 Department of Computer Science, University of Kentucky Department of Mathematics

More information

Measurement of 3D Foot Shape Deformation in Motion

Measurement of 3D Foot Shape Deformation in Motion Measurement of 3D Foot Shape Deformation in Motion Makoto Kimura Masaaki Mochimaru Takeo Kanade Digital Human Research Center National Institute of Advanced Industrial Science and Technology, Japan The

More information

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp

More information

doi: /

doi: / Yiting Xie ; Anthony P. Reeves; Single 3D cell segmentation from optical CT microscope images. Proc. SPIE 934, Medical Imaging 214: Image Processing, 9343B (March 21, 214); doi:1.1117/12.243852. (214)

More information

Color Correction for Projected Image on Colored-screen Based on a Camera

Color Correction for Projected Image on Colored-screen Based on a Camera Color Correction for Projected Image on Colored-screen Based on a Camera Dae-Chul Kim a, Tae-Hyoung Lee a, Myong-Hui Choi b, and Yeong-Ho Ha* a a School of Electronics Engineering, Kyungpook Natl. Univ.,

More information

MEASUREMENT OF THE WAVELENGTH WITH APPLICATION OF A DIFFRACTION GRATING AND A SPECTROMETER

MEASUREMENT OF THE WAVELENGTH WITH APPLICATION OF A DIFFRACTION GRATING AND A SPECTROMETER Warsaw University of Technology Faculty of Physics Physics Laboratory I P Irma Śledzińska 4 MEASUREMENT OF THE WAVELENGTH WITH APPLICATION OF A DIFFRACTION GRATING AND A SPECTROMETER 1. Fundamentals Electromagnetic

More information

HOW USEFUL ARE COLOUR INVARIANTS FOR IMAGE RETRIEVAL?

HOW USEFUL ARE COLOUR INVARIANTS FOR IMAGE RETRIEVAL? HOW USEFUL ARE COLOUR INVARIANTS FOR IMAGE RETRIEVAL? Gerald Schaefer School of Computing and Technology Nottingham Trent University Nottingham, U.K. Gerald.Schaefer@ntu.ac.uk Abstract Keywords: The images

More information

Color to Binary Vision. The assignment Irfanview: A good utility Two parts: More challenging (Extra Credit) Lighting.

Color to Binary Vision. The assignment Irfanview: A good utility Two parts: More challenging (Extra Credit) Lighting. Announcements Color to Binary Vision CSE 90-B Lecture 5 First assignment was available last Thursday Use whatever language you want. Link to matlab resources from web page Always check web page for updates

More information

2003 Steve Marschner 7 Light detection discrete approx. Cone Responses S,M,L cones have broadband spectral sensitivity This sum is very clearly a dot

2003 Steve Marschner 7 Light detection discrete approx. Cone Responses S,M,L cones have broadband spectral sensitivity This sum is very clearly a dot 2003 Steve Marschner Color science as linear algebra Last time: historical the actual experiments that lead to understanding color strictly based on visual observations Color Science CONTD. concrete but

More information

Intensity Transformations and Spatial Filtering

Intensity Transformations and Spatial Filtering 77 Chapter 3 Intensity Transformations and Spatial Filtering Spatial domain refers to the image plane itself, and image processing methods in this category are based on direct manipulation of pixels in

More information

Metamer Constrained Colour Correction

Metamer Constrained Colour Correction In Proc. 7th Color Imaging Conference, Copyright IS & T 1999 1 Metamer Constrained Colour Correction G. D. Finlayson, P. M. Morovič School of Information Systems University of East Anglia, Norwich, UK

More information

Compressive Sensing of High-Dimensional Visual Signals. Aswin C Sankaranarayanan Rice University

Compressive Sensing of High-Dimensional Visual Signals. Aswin C Sankaranarayanan Rice University Compressive Sensing of High-Dimensional Visual Signals Aswin C Sankaranarayanan Rice University Interaction of light with objects Reflection Fog Volumetric scattering Human skin Sub-surface scattering

More information

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 3. HIGH DYNAMIC RANGE Computer Vision 2 Dr. Benjamin Guthier Pixel Value Content of this

More information

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION

CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION CHAPTER 3 DISPARITY AND DEPTH MAP COMPUTATION In this chapter we will discuss the process of disparity computation. It plays an important role in our caricature system because all 3D coordinates of nodes

More information

A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation

A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation , pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,

More information

Visible and Long-Wave Infrared Image Fusion Schemes for Situational. Awareness

Visible and Long-Wave Infrared Image Fusion Schemes for Situational. Awareness Visible and Long-Wave Infrared Image Fusion Schemes for Situational Awareness Multi-Dimensional Digital Signal Processing Literature Survey Nathaniel Walker The University of Texas at Austin nathaniel.walker@baesystems.com

More information

Integrated three-dimensional reconstruction using reflectance fields

Integrated three-dimensional reconstruction using reflectance fields www.ijcsi.org 32 Integrated three-dimensional reconstruction using reflectance fields Maria-Luisa Rosas 1 and Miguel-Octavio Arias 2 1,2 Computer Science Department, National Institute of Astrophysics,

More information

AUTOMATED CALIBRATION TECHNIQUE FOR PHOTOGRAMMETRIC SYSTEM BASED ON A MULTI-MEDIA PROJECTOR AND A CCD CAMERA

AUTOMATED CALIBRATION TECHNIQUE FOR PHOTOGRAMMETRIC SYSTEM BASED ON A MULTI-MEDIA PROJECTOR AND A CCD CAMERA AUTOMATED CALIBRATION TECHNIQUE FOR PHOTOGRAMMETRIC SYSTEM BASED ON A MULTI-MEDIA PROJECTOR AND A CCD CAMERA V. A. Knyaz * GosNIIAS, State Research Institute of Aviation System, 539 Moscow, Russia knyaz@gosniias.ru

More information

Project 3 code & artifact due Tuesday Final project proposals due noon Wed (by ) Readings Szeliski, Chapter 10 (through 10.5)

Project 3 code & artifact due Tuesday Final project proposals due noon Wed (by  ) Readings Szeliski, Chapter 10 (through 10.5) Announcements Project 3 code & artifact due Tuesday Final project proposals due noon Wed (by email) One-page writeup (from project web page), specifying:» Your team members» Project goals. Be specific.

More information

IMAGING SPECTROMETER DATA CORRECTION

IMAGING SPECTROMETER DATA CORRECTION S E S 2 0 0 5 Scientific Conference SPACE, ECOLOGY, SAFETY with International Participation 10 13 June 2005, Varna, Bulgaria IMAGING SPECTROMETER DATA CORRECTION Valentin Atanassov, Georgi Jelev, Lubomira

More information

HYPERSPECTRAL reflectance data are beneficial to

HYPERSPECTRAL reflectance data are beneficial to IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Separating Reflective and Fluorescent Components Using High Frequency Illumination in the Spectral Domain Ying Fu, Student Member, IEEE, Antony

More information

High-resolution 3D profilometry with binary phase-shifting methods

High-resolution 3D profilometry with binary phase-shifting methods High-resolution 3D profilometry with binary phase-shifting methods Song Zhang Department of Mechanical Engineering, Iowa State University, Ames, Iowa 511, USA (song@iastate.edu) Received 11 November 21;

More information

Smooth shading of specular surfac Title ased high-definition CGH Author(s) MATSUSHIMA, Kyoji 2011 3DTV Conference: The True Vi Citation, Transmission and Display of 3D ) Issue Date 2011 URL http://hdl.handle.net/10112/5575

More information