Introduction to Video and Image Processing

Transcription

1 Thomas В. Moeslund Introduction to Video and Image Processing Building Real Systems and Applications Springer

2 Contents 1 Introduction The Different Flavors of Video and Image Processing General Framework The Chapters in This Book Exercises 5 2 Image Acquisition Energy Illumination The Optical System Thebens The Image Sensor The Digital Image The Region of Interest (ROI) Further Information Exercises 23 3 Color Images What Is a Color? Representation of an RGB Color Image The RGB Color Space Converting from RGB to Gray-Scale The Normalized RGB Color Representation Other Color Representations The HSI Color Representation The HSV Color Representation The YUV and YQ,C r Color Representations Further Information Exercises 42 4 Point Processing Gray-Level Mapping Non-linear Gray-Level Mapping Gamma Mapping Logarithmic Mapping 48 vii

3 4.2.3 Exponential Mapping The Image Histogram Histogram Stretching Histogram Equalization Thresholding Color Thresholding Thresholding in Video Logic Operations on Binary Images Image Arithmetic Programming Point Processing Operations Further Information Exercises 69 Neighborhood Processing The Median Filter Rank Filters Correlation Template Matching Edge Detection Image Sharpening Further Information Exercises 88 Morphology Level 1: Hit and Fit Hit Fit Level 2: Dilation and Erosion Dilation Erosion Level 3: Compound Operations Closing Opening Combining Opening and Closing Boundary Detection Further Information Exercises 100 BLOB Analysis BLOB Extraction The Recursive Grass-Fire Algorithm The Sequential Grass-Fire Algorithm BLOB Features BLOB Classification Further Information Exercises 114

4 Contents ix 8 Segmentation in Video Data Video Acquisition Detecting Changes in the Video The Algorithm Background Subtraction Defining the Threshold Value Image Differencing Further Information Exercises Tracking Tracking-by-Detection Prediction Tracking Multiple Objects Good Features to Track Further Information Exercises Geometric Transformations Affine Transformations Translation Scaling Rotation Shearing Combining the Transformations Making It Work in Practice Backward Mapping Interpolation Homography Further Information Exercises Visual Effects Visual Effects Based on Pixel Manipulation Point Processing Neighborhood Processing Motion Reduced Colors Randomness Visual Effects Based on Geometric Transformations Polar Transformation Twirl Transformation Spherical Transformation Ripple Transformation Local Transformation Further Information Exercises 167

5 X Contents 12 Application Example: Edutainment Game The Concept Setup Infrared Lighting Calibration Segmentation Representation Postscript Application Example: Coin Sorting Using a Robot The Concept Image Acquisition Preprocessing Segmentation Representation and Classification Postscript 185 Appendix A Bits, Bytes and Binary Numbers 187 A.l Conversion from Decimal to Binary 188 Appendix В Mathematical Definitions 191 B.l Absolute Value 191 B.2 min and max 191 B.3 Converting a Rational Number to an Integer 192 B.4 Summation 192 B.5 Vector 194 B.6 Matrix 195 B.7 Applying Linear Algebra 197 B.8 Right-Angled Triangle 198 B.9 Similar Triangles 198 Appendix С Learning Parameters in Video and Image Processing Systems 201 C.l Training 201 C.2 Initialization. 203 Appendix D Conversion Between RGB and HSI 205 D.l Conversion from RGB to HSI 205 D.2 Conversion from HSI to RGB 208 Appendix E Conversion Between RGB and HSV 211 E.l Conversion from RGB to HSV 211 E.l.l HSV: Saturation 212 E.1.2 HSV: Hue 213 E.2 Conversion from HSV to RGB 214 Appendix F Conversion Between RGB and YUV/YC 6 C r 217 F.l The Output of a Colorless Signal 217

6 Contents xi F.2 The Range of X, and X F.3 YUV 218 F.4 YC b Cr 219 References 221 Index 223 r