Table 1. Different types of Defects on Tiles

Similar documents
Keywords: Thresholding, Morphological operations, Image filtering, Adaptive histogram equalization, Ceramic tile.

Automatic Defect Detection and Classification Technique from Image Processing

Detection of Edges Using Mathematical Morphological Operators

Surface Defects Detection for Ceramic Tiles Using Image Processing and Morphological Techniques

Morphological Image Processing

Biomedical Image Analysis. Mathematical Morphology

Mathematical Morphology and Distance Transforms. Robin Strand

Morphological Image Processing GUI using MATLAB

Morphological Image Processing

[ ] Review. Edges and Binary Images. Edge detection. Derivative of Gaussian filter. Image gradient. Tuesday, Sept 16

Edges and Binary Images

International Journal of Advance Engineering and Research Development. Applications of Set Theory in Digital Image Processing

Morphological Image Processing

EE795: Computer Vision and Intelligent Systems

A Survey on Edge Detection Techniques using Different Types of Digital Images

Morphological Image Processing

Comparative Analysis of Edge Detection Algorithms Based on Content Based Image Retrieval With Heterogeneous Images

N.Priya. Keywords Compass mask, Threshold, Morphological Operators, Statistical Measures, Text extraction

Previously. Edge detection. Today. Thresholding. Gradients -> edges 2/1/2011. Edges and Binary Image Analysis

Failure Detection and Isolation in Ceramic Tile Edges Based on Contour Descriptor Analysis

FABRICATION ANALYSIS FOR CORNER IDENTIFICATION USING ALGORITHMS INCREASING THE PRODUCTION RATE

Filters. Advanced and Special Topics: Filters. Filters

Computer Vision Techniques Applied to the Quality Control of Ceramic Plates

morphology on binary images

EECS490: Digital Image Processing. Lecture #17

Development of system and algorithm for evaluating defect level in architectural work

Extracting Layers and Recognizing Features for Automatic Map Understanding. Yao-Yi Chiang

Morphological Image Processing

Character Recognition of High Security Number Plates Using Morphological Operator

ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall Midterm Examination

OCR For Handwritten Marathi Script

Edges and Binary Image Analysis April 12 th, 2018

CS443: Digital Imaging and Multimedia Binary Image Analysis. Spring 2008 Ahmed Elgammal Dept. of Computer Science Rutgers University

Morphological Image Processing

Processing of binary images

Comparative Analysis of Various Edge Detection Techniques in Biometric Application

DESIGNING A REAL TIME SYSTEM FOR CAR NUMBER DETECTION USING DISCRETE HOPFIELD NETWORK

Fabric Defect Detection Based on Computer Vision

Lecture 7: Morphological Image Processing

Edges and Binary Image Analysis. Thurs Jan 26 Kristen Grauman UT Austin. Today. Edge detection and matching

SURVEY ON IMAGE PROCESSING IN THE FIELD OF DE-NOISING TECHNIQUES AND EDGE DETECTION TECHNIQUES ON RADIOGRAPHIC IMAGES

MORPHOLOGICAL EDGE DETECTION AND CORNER DETECTION ALGORITHM USING CHAIN-ENCODING

Finger Print Analysis and Matching Daniel Novák

EE 584 MACHINE VISION

Introduction. Computer Vision & Digital Image Processing. Preview. Basic Concepts from Set Theory

Introduction to Medical Imaging (5XSA0)

09/11/2017. Morphological image processing. Morphological image processing. Morphological image processing. Morphological image processing (binary)

Digital Image Processing COSC 6380/4393

Fast Vehicle Detection and Counting Using Background Subtraction Technique and Prewitt Edge Detection

REVIEW ON IMAGE COMPRESSION TECHNIQUES AND ADVANTAGES OF IMAGE COMPRESSION

Binary Shape Characterization using Morphological Boundary Class Distribution Functions

Detection of Roof Holes and Wall Crack using Shape-Based Method

International Journal of Signal Processing, Image Processing and Pattern Recognition Vol.9, No.2 (2016) Figure 1. General Concept of Skeletonization

Segmentation of Noisy Binary Images Containing Circular and Elliptical Objects using Genetic Algorithms

Leaf vein segmentation using Odd Gabor filters and morphological operations

Image Processing. Bilkent University. CS554 Computer Vision Pinar Duygulu

MORPHOLOGICAL BOUNDARY BASED SHAPE REPRESENTATION SCHEMES ON MOMENT INVARIANTS FOR CLASSIFICATION OF TEXTURES

C E N T E R A T H O U S T O N S C H O O L of H E A L T H I N F O R M A T I O N S C I E N C E S. Image Operations II

A vision-based system for inspecting painted slates

Image Processing: Final Exam November 10, :30 10:30

11/10/2011 small set, B, to probe the image under study for each SE, define origo & pixels in SE

Gesture based PTZ camera control

Evaluation of Moving Object Tracking Techniques for Video Surveillance Applications

Digital Image Processing COSC 6380/4393

Digital Image Processing Fundamentals

Topic 6 Representation and Description

Biometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong)

SECTION 5 IMAGE PROCESSING 2

From Pixels to Blobs

Blood Vessel Segmentation in Angiograms using Fuzzy Inference System and Mathematical Morphology

COMPUTER AND ROBOT VISION

What will we learn? What is mathematical morphology? What is mathematical morphology? Fundamental concepts and operations

CITS 4402 Computer Vision

An Efficient Image Sharpening Filter for Enhancing Edge Detection Techniques for 2D, High Definition and Linearly Blurred Images

ECG782: Multidimensional Digital Signal Processing

EDGE BASED REGION GROWING

Digital Image Processing

Encryption of Text Using Fingerprints

Edge detection by combination of morphological operators with different edge detection operators

Binary Image Processing. Introduction to Computer Vision CSE 152 Lecture 5

Fingerprint Image Enhancement Algorithm and Performance Evaluation

Image Processing Fundamentals. Nicolas Vazquez Principal Software Engineer National Instruments

Shape Prediction Linear Algorithm Using Fuzzy

ECG782: Multidimensional Digital Signal Processing

CLASSIFICATION OF BOUNDARY AND REGION SHAPES USING HU-MOMENT INVARIANTS

Automatic Detection of Texture Defects using Texture-Periodicity and Gabor Wavelets

Effects Of Shadow On Canny Edge Detection through a camera

RESTORATION OF DEGRADED DOCUMENTS USING IMAGE BINARIZATION TECHNIQUE

EDGE DETECTION-APPLICATION OF (FIRST AND SECOND) ORDER DERIVATIVE IN IMAGE PROCESSING

PERFORMANCE MEASURE OF LOCAL OPERATORS IN FINGERPRINT DETECTION ABSTRACT

Image Enhancement Using Fuzzy Morphology

A Visual Programming Environment for Machine Vision Engineers. Paul F Whelan

Detection of a Single Hand Shape in the Foreground of Still Images

Bioimage Informatics

A Novice Approach To A Methodology Using Image Fusion Algorithms For Edge Detection Of Multifocus Images

A New Technique of Extraction of Edge Detection Using Digital Image Processing

CHAPTER 6 DETECTION OF MASS USING NOVEL SEGMENTATION, GLCM AND NEURAL NETWORKS

A Review on Role of Mathematical Morphology in Face Detection

CS534 Introduction to Computer Vision Binary Image Analysis. Ahmed Elgammal Dept. of Computer Science Rutgers University


Transcription:

DETECTION OF SURFACE DEFECTS ON CERAMIC TILES BASED ON MORPHOLOGICAL TECHNIQUES ABSTRACT Grasha Jacob 1, R. Shenbagavalli 2, S. Karthika 3 1 Associate Professor, 2 Assistant Professor, 3 Research Scholar Department of Computer Science, Rani Anna Government College for Women, Tirunelveli e-mail: arthisha2015@gmail.com Ceramic tiles have become very popular and are used in the flooring of offices and shopping malls. As testing the quality of tiles manually in a highly polluted environment in the manufacturing industry is a laborintensive and time consuming process, analysis is carried out on the tile images. This paper discusses an automated system to detect the defects on the surface of ceramic tiles based on dilation, erosion, SMEE and boundary detection techniques. Keywords: Ceramic Tiles, Tile Defect, Structuring Element, Dilation, Erosion, Quality Control 1.0 INTRODUCTION The techniques of image processing are being used in in the Quality Control departments of Glass industry, Textile industry, and Ceramic industry. In ceramic tile industry many automated systems have been developed to analyze the quality of tiles. Generally these automated systems have been developed to detect the defects only for plane surface tiles as it is very difficult to detect the defects on designed tiles. Defects on designed tiles can be identified based on morphological techniques. Morphological image processing is a set of non-linear operations associated with the shape or morphology of features in an image. Montreal & Quebec, (2006) described the need for detecting edges of images and proposed edge detection methods such as Canny and Sobel [1]. These methods were applied on images of ceramic tiles with defect based on color and surface. Ar & Akgul, (2008) presented marble tile feature extraction system which can be easily used for any classification system [2]. Image processing techniques especially Gabor filtering was engaged to differentiate between different marble textures and a new verification method on the basis of the inter-expert variability was presented and the percentages of veins, spots, and swirls on the marble images were calculated. Therefore, the system was considered as the core engine of a very portable marble tile classification system. Hocenski & Vasilic, (2006) proposed the method for faults detection based on edge detection techniques using Canny edge detector [3]. Histogram subtraction method was used to fix problem of defining hysteresis threshold and edge and surface faults were identified. Morphological techniques scan an image with a small shape or template called a structuring element. The structuring element serves as a key in identifying the defect on tiles. The structuring element is positioned at all possible locations in the image and it is compared with the corresponding neighborhood of pixels. Certain operations test whether the element fits within the neighborhood and others test whether it hits or intersects the neighborhood. Table 1. Different types of Defects on Tiles Defect Blob Corner Crack Edge Glaze Pinhole Scratch Spot Description Water drop spot on the surface Break down in the corner of tile Break in tile Break in edge Blurred surface on the tile Isolated black-white pinpoint spot Scratch on surface Discontinuity of color on the surface The morphological operations like Dilation, Erosion, Dilation and Erosion, Simple Morphological Edge Extraction (SMEE), and Boundary Extraction techniques are used in identifying the different types of defects. This paper proposes an efficient defect detection and classification technique that would find out the defects on ceramic

tiles at a higher rate within a very short span of time. Table 1 describes the different types of defects on the surface of ceramic tiles. 2.0 MORPHOLOGICAL OPERATORS AND OPERATIONS The morphological operators centered on dilation and erosion are Opening and Closing. Opening smoothens the contour of images by breaking narrow gaps and eliminating small holes or thin protrusions. The Opening of an image A by a structuring element B (denoted by A B) is given by the successive operations of erosion and dilation and is given by the expression A B= (A Θ B) B (1) Closing tends to smoothen the contour of an image by fusing narrow breaks and long thin gulfs, and eliminates small holes by filling gaps in the contour. The Closing of an image A by a structuring element B (denoted by A B) is given by the successive operations of dilation and erosion and is represented by the expression A B= (A B) Θ B (2) Dilation and erosion are the fundamental morphological operations. Dilation adds pixels to the boundaries of objects in an image, while erosion removes pixels on object boundaries. The number of pixels added or removed from the objects in an image depends on the size and shape of the structuring element used to process the image. 2.1 DILATION Dilation is the addition of a pixel at object boundary based on a structuring element. It is defined as the maximum value in the window. The image after dilation will be brighter with an increase in intensity. It enlarges the image objects by changing pixels with the value of 0 to 1. Foreground pixels are denoted by 1's and background pixels by 0's.To compute the dilation of a binary input image based on the structuring element consider each of the background pixels in the input image and superimpose the structuring element on top of the input image so that the origin of the structuring element coincides with the input pixel position. If anyone pixel in the structuring element coincides with a foreground pixel in the mage underneath, then the input pixel is set to the foreground value. If all the corresponding pixels in the image are background, however, the input pixel is left at the background value. The dilation operation is pictorially epitomized in Figure 1. Dilation operation can be applied using the formula: {[(I Se) Se] Se} Se {[(I Se) Se] Se} (3) Figure 1: Dilation Operation 2.1.1 PROCEDURE FOR DILATION Step 1: Obtain the input image. Step 2: Convert the images into binary image. Step 3: Apply closing operator on the binary image using structuring element. Step 4: Apply opening operator on the resulting image obtained in step 3 with the same structuring element. Step 5: Apply closing operator once again on the resultant image obtained in step 4. Step 6: Make a copy of the closed image obtained in Step 5.

Step 7: Dilate the image obtained in Step 5 with the same structuring element. Step 8: Finally, subtract the closed image in Step 6 from the dilated image obtained in Step 7. Step 9: Compute the pixel count of the image obtained in Step 8. 2.2. EROSION The inverse of dilation is erosion and it is defined as the minimum value in the window. It removes the pixel from the object boundary based on the structuring element. The image after erosion will be darker than the original image. Erosion shrinks the images by altering the pixels with the value of 1 to 0. The erosion operation is pictorially exemplified in Figure 2. Erosion operation can be applied using the formula: {[(I Se) Se] Se} Θ Se + {[(I Se) Se] Se} (4) 2.2.1 PROCEDURE FOR EROSION Step 1: Obtain the input image. Step 2: Convert the image into binary image. Figure 2: Erosion Operation Step 3: Apply closing operator on the binary image using structuring element. Step 4: Apply opening operator on the image obtained in step 3 with the same structuring element. Step 5: Apply closing operator on the resultant image obtained in step 4. Step 6: Make a copy of the closed image obtained in Step 5. Step 7: Erode the image obtained in Step 5 with the same structuring element. Step 8: Finally, add the closed image obtained in Step 6 with the eroded image obtained in Step 7. Step 9: Compute the pixel count of the image obtained in Step 8. 2.3. SIMPLE MORPHOLOGICAL EDGE EXTRACTION (SMEE) In Simple Morphological Edge Extraction, the query image is initially dilated and then the original image is subtracted from the dilated image. SMEE is represented by the expression: SMEE= (A B) - A (5)

2.3.1 PROCEDURE FOR SMEE Step 1: Obtain the input image. Step 2: Dilate the input image based on the structuring element. Step 3: Subtract the input image from the dilated image. Step 4: Compute the pixel count of the image obtained in Step 3. 2.4. BOUNDARY EXTRACTION D1 = imdilate (img, se) (6) SMEE = D1 img (7) The boundary of a set A, denoted as β (A), can be obtained by first eroding A by B and then applying the set difference operation between A and its erosion. The boundary extraction operation is pictorially symbolized in Figure 3. Boundary Extraction can be denoted as follows: Figure 3: Boundary Extraction β (A) = A (A Θ B) (8) 2.4.1 PROCEDURE FOR BOUNDARY EXTRACTION Step 1: Obtain the input image. Step 2: Erosion operation is applied on the input image, which increases on the black pixels. E1 = imerode (img, se) (9) Step 3: Subtract the input image from the eroded image. BE = img - E1 (10) Step 4: Compute the pixel count of the image obtained in Step 3. 3.0 METHODOLOGY To identify the different types of defects on the surface of tiles based on the above said procedures the morphological operations - Dilation, Erosion, Dilation and Erosion, Simple Morphological Edge Extraction (SMEE), and Boundary Extraction techniques are used. On the basis of the pixel count of both the reference and test

images, the ceramic tile images are tested and classified as either defect-free or defective. The pixel count of the image is computed by determining the number of picture elements (pixels). In each method, the pixel count of the test image and that of the standard defect free image (reference image) are calculated. If the pixel count of the tile image that is tested for defect (D 1 ) is greater than the pixel count of the reference image (defect free image) (R 1 ), then it is classified as a defective tile otherwise it is a defect-free tile. The defect, d of the image is given by the relation d=r 1- D 1 (11) where R 1 is the pixel count of the standard defect free image (reference image) and D 1 is the pixel count of the image being tested. For a defective tile, the defect, d of the image will be negative (< 0). The PSNR and MSE values are also calculated for each of the method applied to obtain a more precise and clear idea of the defective images. In addition, comparison is done based on the time complexity to identify the method that finds out the different types of defects quickly. 4. EXPERIMENTAL RESULTS AND ANALYSIS Figure 4: Reference image and Defective images In this work, in order to detect and identify the different types of defects such as Crack, Pinhole, Blob and Spot, two hundred ceramic tile images were considered. Figure 4 represents the reference tile image (Standard defect-free image) and three defective tile images. Figure 5 shows the implementation of dilation operation on the three defective tile images. Figure 5: Dilation Figure 6 shows the implementation of erosion operation on the three defective tile images. Figure 6: Erosion

Figure 7 shows the implementation of SMEE operation on the three defective tile images. Figure 7: SMEE Figure 8 shows the implementation of boundary extraction operation on the three defective tile images. Figure 8: Boundary Extraction Table 2 tabulates the pixel count of the standard defect free tile image (reference tile) and that of the defective tile images that are tested based on the four different operations. Table 2: Pixel Count of the tile images Method Defect free Pixel count Crack Pixel count of Defect Paint Conceals Spot Dilation Erosion SMEE Boundary Extraction 315 425 510 704 2904 1426 6823 7964 1532 1670 2169 2416 1029 1185 1501 1916 It is clear from Table 2 that the pixel count of the defective tiles are greater than that of the standard defect free tile (reference tile image) indicating that the tested tile images are defective. Peak signal-to-noise ratio, often abbreviated as PSNR gives an approximation to human perception of reconstruction quality. A higher PSNR value generally indicates that the reconstruction is of higher quality. (12) where MAX I is the maximum possible pixel value of the image. MAX I is 255When the pixels are represented using 8 bits per sample. Table 3 tabulates the PSNR value obtained for the four different operations on the three defective tiles.

Table 3: PSNR Defect Type Dilation Erosion SMEE Boundary Extraction Crack 17.0101 12.4384 13.4492 12.7368 Paint Conceals 20.9963 15.5265 19.2789 18.178 Spot 20.7864 9.5647 19.3205 18.9877 Given a noise-free m x n monochrome image I and its noisy approximation K, the mean squared error (MSE) is defined as: (13) Table 4 tabulates the PSNR value obtained for the four different operations on the three defective tiles. Table 4: MSE Defect Type Dilation Erosion SMEE Boundary Extraction Crack 0.011991 0.05703 0.04519 0.05325 Paint Conceals 0.00795 0.02801 0.01180 0.01521 Spot 0.00834 0.11005 0.01169 0.01262 Figure 9: Graphical Representation of PSNR

Figure 9 displays the graphical representation of PSNR values and Figure 10 displays the graphical representation of MSE values. From Table 3 and Table 4, PSNR and MSE vales tabulated for the defective tiles help to decide the method that gives a clear vision of the defective portion on the tile. It is clear that a high PSNR value and a low MSE value will clearly identify the type of defect on the tiles. Based on Table 3, PSNR value of dilation method is high and based on Table 4, MSE value of the same method (dilation) has a low value. Therefore, from the above four methods, dilation method is considered to be the best method to detect the different types of defects. Figure 10: Graphical Representation of MSE The time taken to detect the different defects according to different morphological methods is calculated. Table 5 represents the time complexity involved in the four different operations. According to Table 5, Simple Morphological Edge Extraction operation takes the least time to detect the cracks, Pinholes and Blob defects. Figure 11 represents the time taken to detect the different types of defects. Table 5: Time Complexity Defect Type Dilation (t0) Erosion (t1) SMEE (t2) Boundary Extraction(t3) Crack 1.2776 1.2550 0.5482 0.5926 Paint Conceals 1.0248 1.4022 0.5596 0.5825 Spot 1.1441 1.4817 0.5399 0.6167 Figure 11: Graphical Representation of time complexity

Thus the experimental results clearly reveal that the dilation operation is well suited for identification of defects in ceramic tile images and SMEE is considered to be the best method based on time complexity. 6. CONCLUSION In ceramic tile manufacturing industries, quality control is a labor intensive process and has to be performed in a highly polluted industrial environment. This work will assist the quality control department of tile manufacturing industries in determining and identifying the defects in the surface of the ceramic tiles based on the morphological operations such as Dilation, Erosion, SMEE and Boundary Extraction with the help of the tile images. REFERENCES [1] Vincent LEBRUN. Quality control of ceramic tiles by machine vision. Flaw Master 3000, Surface Inspection Ltd. 2001. [2] C. Boukouvalas, J Kittler, R Marik, M Mirmehdi and M Petrou. Ceramic Tile Inspection for Color and Structural defect. I.E.E.E Transcations on Pattern Analysis and Machine Intelligence, vol. 14, no. 1, March 1998. [3] R. C. Gonzalez, R. E. Woods. Digital Image Processing. Pearson Education (Singapore), Pte. Ltd., Indian Branch, 482 F.I.E. Patparganj, 2005-2006. [4] Puyin Liu, Hongxing Li. Fuzzy Neural Network Theory and Application. World Scientific, 2004. [5] Mohamed Roushdi. Comparative Study of Edge Detection Algorithms Applying on the Grayscale Noisy Image Using Morphological Filter, GVIP Journal, Volume 6, Issue 4, December, 2006. [6] Mark E. Lehr and Keh-Shin Li, Template basis techniques to Pattern recognition. University of California Riverside, Department of Statistics Riverside, California, USA, Vol. 2825, 1996. [7] Song K Y, Petrou M, and Kittler, Texture crack detection.. Machine Vision Applications, Jan., 1995. [8] S Mueller, Morphological image processing for the recognition of surface defects. Inspection is a very important task for quality control in a factory, - 1994. [9] S Vasilic, Suzana Vasilic, Zeljko Hocenski Montreal, Quebec, Canada, The Edge Detecting Methods in Ceramic Tiles. Defects Detection, IEEE ISIE 2006, July 9-12, 2006. [10] Angélica R. Jiménez-Sánchez, Jorge D. Mendiola-Santibañez, Iván R.Terol Villalobos Morphological Background Detection and Enhancement of Images With Poor Lighting, IEEE Transactions on image processing, Vol. 18(3), March 2009.