arxiv: v1 [cs.cv] 17 Jul 2018

Transcription

1 A Novel Color Edge Detection Algorithm Based on Quaternion Hardy Filter Wen-shan Bi and Kit Ian Kou Department of Mathematics, Faculty of Science and Technology, University of Macau, Macao, China arxiv: v1 [cs.cv] 17 Jul 2018 Abstract A study on color edge detection using the improved Di Zenzo s gradient operator associated with quaternion Hardy filter is presented. The Di Zenzo gradient operator recently achieved great attentions in edge detection, but it is sensitive to image with additive noise. The quaternion Hardy filter demonstrates its advantage in denoising image. A robust color image edge detection algorithm called Quaternion Hardy filter with the improved Di Zenzo s gradient operator, namely QHFIDZ, is presented in this paper. It preprocesses the color image to quaternion Hardy filter which reduces the noise effect and then apply the improved Di Zenzo s gradient algorithm for edge map. The proposed technique is a robust algorithm for noisy image detection comparison to other image detection techniques. Keywords: Quaternion Hardy filter, Quaternion Fourier transform, Color edge detection, Improved Di Zenzo s gradient operator. 1 Introduction Color edge detection is designed to identify discontinuities in the digital image where the brightness or color changes drastically or more formally. Color edge detection in image segmentation, pattern recognition, computer vision and many other aspects is crucial. It is significant in various types of image processing such as the high-level feature extraction, feature description, image understanding and target recognition, etc. Canny [1], Sobel [2], Prewitt [3], differential phase congruence (DPC) [4] and modified differential phase congruence (MDPC) [5] detectors have drawn wide attention and achieved great success in grayscale edge detection. Given a color image, converting it to grayscale and then applied these grayscale-based image detectors which have been well developed. The grayscaling is a threedimensional to one-dimensional process, which will inevitably lose some information about the image. As shown in Fig. 1, the left half of the rectangle has RGB values of 2, 170 and 2, and the right half has RGB values of 250, 2 and 240, respectively. Fig. 1 (a) is the original image, Fig. 1 (d)-(f) are the grayscale-based edge detectors obtained by the Canny, Sobel and Prewitt algorithms, respectively. With the exception of (c), they all failed to extract the outline of different regions because only the wenshan0608@163.com kikou@umac.mo 1

2 Figure 1: (a) Original test color image; (b) The grayscale image of the test image; (c) The edge map captured with the proposed method; (d) The edge map captured with Canny detector, (e) Sobel detector and (f) Prewitt detector, respectively. brightness information was kept in the grayscale process.this makes the grayscale-based edge detection algorithms are more passive. Secondly, when dealing with color images, most of them use the gray images estimator to calculate each color component separately and then combine them to get the operator without considering the correlation information between each color channel. What we need to pay attention is that compared with grayscale images and binary images, each pixel of a color image includes not only brightness information but also color information. The role of these color information in edge detection can not be ignored. As early as 1986, Di [6] proposed a multi-channel gradient operator and has been widely used. In 2012, Jin [7] solved the uncertainty of the Di s gradient direction, namely improved Di Zenzo (IDZ) gradient operator. In this work, we propose a novel quaternion-based IDZ gradient algorithm combining with the quaternion Hardy filter, which can enhance the border effect in a holistic manner by extracting the main features of the color image. It naturally extends the IDZ gradient algorithm in the quaternion setting. A growing body of research [8, 9, 10, 11, 12, 13] has shown that quaternions are well adapted to color images by encoding color channels into three imaginary parts. The quaternion analytic signal [14] is the non-tangential boundary values of quaternion Hardy filter. It is shown that [14] the quaternion analytic signal is a robust gray image detector with additive noises. Despite its initial success, it is original designed for gray image. To the author s knowledge, the study of quaternion Hardy filter to color-based edge detector is not carried out. In this work, we apply the Quaternion Hardy filter with the IDZ gradient operator to detect the edge of the color image. We develop a novel quaternion-based IDZ gradient operator with visual and quantitative analysis for color edge detection. The contributions of this paper are summarized as follows. 1. We propose a novel IDZ gradient algorithm based on quaternion Hardy filter, namely QHFIDZ algorithm, with application to color edge detection. Different from the classic IDZ gradient algorithm, QHFIDZ treats a color image in a holistic manner. 2. We set up a series of experiments to verify the denoising performance of the proposed algorithm in various environments. Visual and quantitative analysis are both considered. In term of peak SNR (PSNR) and similarity index measure (SSIM), compared with the classic five detec- 2

3 tion algorithms, namely Canny, Sobel, Prewitt, differential phase congruence (DPC) and modified differential phase congruence (MDPC). The proposed QHFIDZ algorithm consistently shows the superiority in color edge detection. The remainder of this paper is structured as follows. In order to make it self-contained, Section 2 gives a brief introduction to some general definitions and basic properties of quaternions, quaternion Fourier transform, quaternion analytic signal and the improved Di Zenzo gradient operator. Section 3 presents the main result of the paper, it defined the novel algorithm for color-based edge detection of real-world image. Finally, visual and quantitative analysis of the proposed algorithm are drawn in Section 4. 2 Preliminaries The present section collects some basic facts about quaternions, quaternion Fourier transform [16], quaternion analytic signal, quaternion Hardy space and the improved Di Zenzo s gradient operator which will be used throughout the text. 2.1 Quaternions As a natural extension of the complex space C, the quaternion space H was first proposed by Hamilton in 1843 [17]. A complex number consists of two components: one real part and one imaginary part. The quaternion q H has four components, i.e., one real part and three imaginary parts: q = q 0 + q 1 i + q 2 j + q 3 k, (1) where q n R, n = 0, 1, 2, 3, and the basis elements {i, j, k} obey the Hamilton s multiplication rules: i 2 = j 2 = k 2 = ijk = 1; ij = k, jk = i, ki = j; ji = k, kj = i, ik = j. (2) Given a quaternion q = q 0 + q 1 i + q 2 j + q 3 k, its quaternion conjugate is q := q 0 q 1 i q 2 j q 3 k. We write Sc(q) := 1 2 (q + q) = q 0 and Vec(q) := 1 2 (q q) = q 1i + q 2 j + q 3 k, which are the scalar and vector parts of q, respectively. This leads to a modulus of q H defined by q := qq = qq = q0 2 + q2 1 + q2 2 + q2 3, (3) where q n R, n = 0, 1, 2, 3. By (1), an H-valued function f : R 2 H can be expressed as f(x 1, x 2 ) = f 0 (x 1, x 2 ) + f 1 (x 1, x 2 )i + f 2 (x 1, x 2 )j + f 3 (x 1, x 2 )k, (4) where f n : R 2 R(n = 0, 1, 2, 3). 2.2 Quaternion Fourier transform Suppose that f is an absolutely integrable complex function defined on R, then the Fourier transform [18] of f is given by f(w) := 1 f(x)e iwx dx, (5) 2π R 3

4 where w denote the angular frequency. Moreover, if f is an absolutely integrable complex function defined on R, then f can be reconstructed by the Fourier transform of f and is expressed by f(x) = 1 f(w)e iwx dw. (6) 2π R The quaternion Fourier transform, which can be regarded as an extension of Fourier transform in quaternion domain, plays a vital role in grayscale image processing. The first definition of the quaternion Fourier transform was given in 1992 [19] and the first application to color images was discussed in 1996 [20]. It was recently applied to find the envelope of the image [21]. The application of quaternion Fourier transform on color images was discussed in [13, 22]. The Plancherel and inversion theorems of quaternion Fourier transform in the square intrgrable signals class was established in [23]. Due to the non-commutativity of the quaternions, there are various types of quaternion Fourier transforms. In the following, we focus our attention on the two-sided quaternion Fourier transform (QFT). Suppose that f is an absolutely integrable H-valued function defined on R 2, then the continuous quaternion Fourier transform of f is defined by (Ff)(w 1, w 2 ) := 1 e iw 1x 1 f(x 1, x 2 )e jw 2x 2 dx 1 dx 2, (7) 2π R 2 where w l and x l denote the 2D angular frequency and 2D space (l = 1, 2), respectively. Furthermore, if f is an absolutely integrable H-valued function defined on R 2, then the continuous inverse quaternion Fourier transform of f is defined by (F 1 f)(x l, x 2 ) := 1 e iw 1x 1 f(w 1, w 2 )e jw 2x 2 dw 1 dw 2, (8) 2π R 2 where w l and x l denote the 2D angular frequency and 2D space (l = 1, 2), respectively. 2.3 Quaternion analytic function In the following, we review the concept of analytic signal. Given a real signal f, combined with its own Hilbert transform, then the analytic signal of f is given by f a (x) := f(x) + ih[f](x), x R, (9) where H[f] denotes the Hilbert transform of f and is defined by H[f](x) := 1 π lim f(s) ds. (10) ε 0 + x s ε x s The Fourier transform of analytic f a defined in (9) is given by where w R. f a (w) = (1 + sgn(w)) f(w), As a natural extension of the analytic signal from 1D to 4D space in the quaternion setting is called quaternion analytic signal. It was proposed by Hu [14] using partial and total Hilbert transform associated with QFT. Given a 2D quaternion valued signal f, combined with its own quaternion partial and total Hilbert transform, then we get a quaternion holomorphic signal f q [24] as follows 4

5 where f q (x 1, x 2 ) := f(x 1, x 2 ) + ih x1 [f](x 1 ) + H x2 [f](x 2 )j + ih x1 x 2 [f](x 1, x 2 )j, (11) H x1 [f](x 1 ) := 1 π lim f(t1, x 2 ) x 1 t 1 dt 1 ; H x2 [f](x 2 ) := 1 π lim f(x1, t 1 ) x 2 t 1 dt 1 are the quaternion partial Hilbert transform of f along the x 1 -axis, x 2 -axis, respectively. While H x1 x 2 [f](x 1, x 2 ) := 1 π lim f(t 1, t 2 ) (x 1 t 1 )(x 2 t 2 ) dt 1dt 2 (13) is the quaternion total Hilbert transform along the x 1 and x 2 axes. (12) 2.4 Quaternion Hardy space Let C := {z z = x + si, x, s R} be the complex plane and a subset of C is defined by C + := {z z = x + si, x, s R, s > 0}, namely upper half complex plane. The Hardy space H 2 (C + ) on the upper half complex plane consists of functions c satisfying the following conditions z (sup s>0 c(z) = 0; (14) c(x + si) 2 dx) 1 2 <. R The generalization [14] to the higher dimension is given as follows. Let C ij := {(z 1, z 2 ) z 1 = x 1 + s 1 i, z 2 = x 2 + s 2 j, x l, s l R, l = 1, 2} and a subset of C ij is defined by C + ij := {(z 1, z 2 ) z 1 = x 1 + s 1 i, z 2 = x 2 + s 2 j, x l, s l R, s l > 0, l = 1, 2}. The quaternion Hardy space Q 2 (C + ij ) consists of all functions satisfying the following conditions h(z 1, z 2 ) = 0; z 1 h(z 1, z 2 ) = 0; z 2 (sup h(x 1 + s 1 i, x 2 + s 2 j) 2 dx 1 dx 2 ) 1 2 <. s 1 >0 R 2 s 2 >0 Let f be a 2D H-valued function with zero scalar part which is given by f := Vec(f) = f 1 i+f 2 j+ f 3 k. The Cauchy integral of f on R 2, h(z 1, z 2 ) = 1 ( ) f(r 1, r 2 ) 1 2πi R 2 (r 1 z 1 )(r 2 z 2 ) dr 1dr 2 2πj is some quaternion Hardy filter [15] h Q 2 (C + ij ) which satisfies the followings, z 1 = x 1 + s 1 i, z 2 = x 2 + s 2 j, i) The non-tangential boundary value of quaternion Hardy filter h is the quaternion analytic signal of f, that is f q (x 1, x 2 ) = lim h(z 1, z 2 ). 5 s1 0 s 2 0

6 ii) Suppose that h(z 1, z 2 ) = ξ + η 1 i + η 2 j + η 3 k, then ξ(z 1, z 2 ) = f O ps1 p s2 (x 1, x 2 ) η 1 (z 1, z 2 ) = f O qs1 p s2 (x 1, x 2 ) η 2 (z 1, z 2 ) = f O ps1 q s2 (x 1, x 2 ) η 3 (z 1, z 2 ) = f O qs1 q s2 (x 1, x 2 ) (15) where O fg (x 1, x 2 ) := f(x 1 )g(x 2 ), p s1 (x 1 ) := s 1 s 2 1 +x 2 1 and q s1 (x 1 ) := x 1 s 2 1 +x 2 1 are the Poisson and conjugate Poisson kernels, respectively. Here denotes the 2D convolution operator of H- valued function f and real valued function g, i.e., f g(r 1, r 2 ) := f(m, n)g(r 1 m, r 2 n)dmdn. R 2 (16) 2.5 The improved Di Zenzo s gradient operator In the following, we recall the improved Di Zenzo s gradient operator, namely IDZ gradient operator, which will be combined with the quaternion Hardy filter to establish the novel edge detection algorithm in next section. Let f be an M N color image that maps a point (x 1, x 2 ) to a vector (f 1 (x 1, x 2 ), f 2 (x 1, x 2 ), f 3 (x 1, x 2 )). Then the square of the variation of f at the position (x 1, x 2 ) with the distance γ in the direction θ is given by where df 2 := f(x 1 + γcos θ, x 2 + γsin θ) f(x 1, x 2 ) ( fi γ cos θ + f ) 2 i γ sin θ x 1 x 2 f(θ) :=2 i=1 = γ 2 f(θ), + 3 f l f l cos θ sin θ x 1 x 2 3 ( ) 2 fl cos 2 θ + i=1 i=1 x 1 3 ( ) 2 fl sin 2 θ. i=1 x 2 Let A := B := C := 3 ( ) 2 fl ; x 1 3 ( ) 2 fl ; i=1 i=1 3 i=1 x 2 f l x 1 f l x 2. (17) 6

7 Start Input color image f Decompose f as equation (18) and (19) Compute the 2-D discrete FFT of equation (19) Construct DQFT of f End Figure 2: The flow chart of the DQFT algorithm. Then the improved Di Zenzo s gradient operator, the gradient magnitude f max is given by: f max (θ max ) : = max f(θ) 0 θ 2π = 1 (A + C + ) (A C) (2B) 2. The gradient direction is defined as the value θ max that maximizes f(θ) over 0 θ 2π ( ) fmax A θ max := sgn(b) arcsin + Kπ, 2f max A C if (A C) 2 + B 2 0 where sgn(b) = { 1, B 0; 1, B < 0. When (A C) 2 + B 2 = 0, θ max is undefined. 3 Main Results To propose the novel color edge detection algorithms, we first review the discrete quaternion Fourier transform pairs. Then we construct the quaternion Hardy filter. Finally, we apply the IDZ gradient operator to obtain the edge map. 7

8 Start Input color image g Decompose g as equation (21) and (22) Compute the 2-D discrete IFFT of equation (22) Construct IDQFT of g End Figure 3: The flow chart of the IDQFT algorithm. 3.1 Discrete quaternion Fourier transform pairs Discrete quaternion Fourier transform To proceed, we first review the discrete quaternion Fourier transform (DQFT) algorithm [8] in the following. Step 1. Given Step 2. Decompose f as where f = f 1 i + f 2 j + f 3 k. f = f a + f b j, (18) f a = f 1 i, f b = f 2 + f 3 i. (19) Step 3. Compute the 2-D fast Fourier transform of f a and f b, namely F [f a ] and F [f b ], respectively. Here F [f](w 1, w 2 ) := is the 2-D fast Fourier transform of f. M 1 N 1 x 1 =0 x 2 =0 e i2π( w 1 x 1 M + w 2 x 2 N ) f(x 1, x 2 ) 8

9 Step 4. Then construct the DQFT of f by F D [f] := F [f a ] + F [f b ]j. (20) Therefore we obtain the DQFT of f, F D [f], with nonzero scalar part in general Inverse discrete quaternion Fourier transform We next perform the inverse discrete quaternion Fourier transform (IDQFT) algorithm as follows. Step 1.Given an H-valued function g = g 0 + g 1 i + g 2 j + g 3 k. Step 2. Decompose g as follows where g := g a + g b j, (21) g a := g 0 + g 1 i, g b := g 2 + g 3 i. (22) Step 3.Compute 2-D inverse fast Fourier transform of g a and g b, then we respectively obtain F 1 [f a ] and F 1 [f b ], where F 1 [f](x 1, x 2 ) := Step 4. Construct the IDQFT as follows Therefore we obtain the IDQFT of f. M 1 N 1 w 1 =0 w 2 =0 e i2π( w 1 x 1 M + w 2 x 2 N ) f(w 1, w 2 ). (23) F D 1 [g] := F 1 [f a ] + F 1 [f b ]j. (24) 3.2 Color edge detection algorithm To proceed, we first give the convolution theorem of DQFT. Theorem 3.1 (Convolution theorem of DQFT) Suppose that g = g 0 + g 1 i + g 2 j + g 3 k is a 2D H-valued function and f is a 2D R-valued function, then where is the 2D convolution operator defined in (??). Proof. F D [f g] = F D [f]f D [g], (25) LHS =F D [f (g 0 + g 1 i + g 2 j + g 3 k)] =F D [f g 0 + (f g 1 )i + (f g 2 )j + (f g 3 )k] =F D [f g 0 ] + F D [f g 1 ]i + F D [f g 2 ]j + F D [f g 3 ]k, 9

10 by the convolution theorem of 2-D fast Fourier transform of real-valued functions F D [f g l ] = F [f g l ] = F [f]f [g l ], l = 0, 1, 2, 3. Therefore, the left hand side of (25) becomes F D [f g] =F [f]f [g 0 ] + F [f]f [g 1 ]i + F [f]f [g 2 ]j + F [f]f [g 3 ]k =F [f](f [g 0 ] + F [g 1 ]i + F [g 2 ]j + F [g 3 ]k) =F D [f]f D [g] =RHS. In the following, we give the color edge detection algorithm, namely QHFIDZ algorithm. Start Input color image f Compute the DQFT of f Set s 1 > 0, s 2 > 0.. Compute the Fourier transform of Poisson and conjugate Poisson kernels, P sl and Q sl, l = 1,2. Compute α, β 1, β 2, β 3, in (26). Compute IDQFT of (26). Extract the vector part of h Perform IDZ gradient operator on vector part of h Edge map End Figure 4: The flow chart of the QHFIDZ algorithm. 10

11 Step 1. Given an input color image f, obtain the quaternion valued signal with zero scalar part f(x 1, x 2 ) := f 1 (x 1, x 2 )i + f 2 (x 1, x 2 )j + f 3 (x 1, x 2 )k, where f 1, f 2 and f 3 represent the red, green and blue components of color image f, respectively. Step 2. Compute the DQFT of the f, i.e., F D [f]. Step 3. For fixed s 1 > 0, s 2 > 0, apply the one-dimensional Fourier transform to Poisson kernel p s1 and conjugate Poisson kernel q s1, then { Ps1 (w 1 ) := p s1 (w 1 ) = e w 1 s 1 ; Q s1 (w 1 ) := q s1 (w 1 ) = ( w 1 w 1 i)e w 1 s 1. Here P s1 and Q s1 are the Fourier transform of Poisson and conjugate Poisson kernels. Step 4. Compute the following equations: α(w 1, w 2 ; s 1, s 2 ) :=F D [f]p s1 (w 1 )P s2 (w 2 ); β 1 (w 1, w 2 ; s 1, s 2 ) :=F D [f]q s1 (w 1 )P s2 (w 2 ); β 2 (w 1, w 2 ; s 1, s 2 ) :=F D [f]p s1 (w 1 )Q s2 (w 2 ); β 3 (w 1, w 2 ; s 1, s 2 ) :=F D [f]q s1 (w 1 )Q s2 (w 2 ). Step 5. Compute the IDQFT of equations in (26), then obtain Step 6. Form the quaternion Hardy filter: ξ(x 1, x 2 ; s 1, s 2 ) := F 1 D [α](x 1, x 2 ; s 1, s 2 ); η 1 (x 1, x 2 ; s 1, s 2 ) := F 1 D [β 1](x 1, x 2 ; s 1, s 2 ); η 2 (x 1, x 2 ; s 1, s 2 ) := F 1 D [β 2](x 1, x 2 ; s 1, s 2 ); η 3 (x 1, x 2 ; s 1, s 2 ) := F 1 D [β 3](x 1, x 2 ; s 1, s 2 ). h := ξ + η 1 i + η 2 j + η 3 k, where ξ, η 1, η 2 and η 3 are H-valued function defined in (27). Extract the vector part of h, we obtain where h l, l = 1, 2, 3 are real-valued functions. Vec(h) := h 1 i + h 2 j + h 3 k, (26) (27) Step 7. Perform the IDZ gradient operator to Vec(h). Applying equation (17), we obtain A = ( h 1 ) 2 + ( h 2 ) 2 + ( h 3 ) 2 ; x 1 x 1 x 1 B = ( h 1 ) 2 + ( h 2 ) 2 + ( h 3 ) 2 ; x 2 x 2 x 2 C = h 1 x 1 h 1 x 2 + h 2 x 1 h 2 x 2 + h 3 x 1 h 3 x 2, then substitute them into equation (18), we obtain Vec(h) max = 1 (A + C + ) (A C) (2B) 2. Step 8. Finally, we obtain the final processed result, edge map, by applying the nonmaxmum suppress. 11

12 4 Experiments In this section, we aim to evaluate the performance of the proposed QHFIDZ algorithm for color edge detection. Figure 5: Original images. The six randomly chosen noiseless images are Lena, Men, House (from left to the right on the 1st row), Image A, Image B and Image C (from left to the right on the 2nd row) respectively. Figure 6: Noisy images. From the first row to the last row, they were obtained by adding I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise to the original images (the 1st row of Fig. 5). 12

13 Figure 7: Noisy images. From the first row to the last row, they were obtained by adding I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise to the original images (the 2nd row of Fig. 5). Figure 8: The noiseless House image (left). The edge maps obtained by IDZ gradient algorithm (middle) and QHFIDZ algorithm (right). Figure 9: The first row is the noisy House image with additive Gaussian, Poisson, salt and pepper, and speckle noises noise from left to right. The second and third rows are the edge maps which are captured by IDZ gradient algorithm and QHFIDZ algorithms, respectively. 13

14 Figure 10: The edge maps of the noiseless test images of Lena, Men and House by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithm, from the 1st to the last row, respectively. 14

15 Figure 11: The edge maps of the noiseless test images of A, B and C by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithm, from the 1st to the last row, respectively. 15

16 Figure 12: The edge maps of the noisy images of Lena (the 1st column of Fig. 6) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. 16

17 Figure 13: The edge maps of the noisy images of Men (the 2nd column of Fig. 6) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. 17

18 Figure 14: The edge maps of the noisy images of House (the 3rd column of Fig. 6) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. 18

19 Figure 15: The edge maps of the noisy Images A (the 1st column of Fig. 7) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. 19

20 Figure 16: The edge maps of the noisy Images B (the 2nd column of Fig. 7) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. 20

21 Figure 17: The edge maps of the noisy Images C (the 3rd column of Fig. 7) by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the 1st to the last row, respectively. We conducted this study to compare the visual and quantitative analysis for detection of edge. MAT- LAB is applied to give the performance of various comparisons. Six randomly test images (Fig. 5) with different environmental settings are considered. They are from smart phone image (Image B in the 2nd row of Fig. 5), printed images (Images A and C in the 2nd row of Fig. 5 [25]), and frequently used images, namely Lena, Men and House (the 1st row of Fig. 5), respectively. Digital image distorted due to different type of noises such as I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise et al. We applied these four fundamental noises (I to IV) 21

22 Table 1: The Lena image in Fig. 6. Noise SNR QHFIDZ MDPC,DPC I s 1 = 7.0, s 2 = 7.0 s = 3.5 II s 1 = 6.0, s 2 = 6.0 s = 2.5 III s 1 = 7.0, s 2 = 7.0 s = 4.5 IV s 1 = 7.0, s 2 = 7.0 s = 4.5 Table 2: The Men image in Fig. 6. Noise SNR QHFIDZ MDPC, DPC I s 1 = 5.5, s 2 = 5.5 s = 3.5 II s 1 = 5.5, s 2 = 5.5 s = 2.5 III s 1 = 5.5, s 2 = 5.5 s = 4.5 IV s 1 = 5.5, s 2 = 5.5 s = 4.5 into the six noiseless images (Fig. 6 and 7). The ideal noiseless (Fig. 5) and noisy images (Fig. 6 and 7) are both taken into account. Tables 1-6 summaries the parameter settings in terms of the signal-to-noise (SNR) ratio, scale values [26, 27] s 1, s 2, and s respectively for QHFIDZ and (DPC, MDPC) algorithms, respectively. 4.1 Visual comparisons For visual analysis, the color-based method is used, namely IDZ gradient algorithm. Five grayscalebased methods are also applied, namely Canny, Sobel, Prewitt, Differential Phase Congruence (DPC) and Modified Differential Phase Congruence (MDPC) algorithms Color-based algorithm In this section, we first compare the proposed QHFIDZ algorithm with the IDZ gradient algorithm. Fig. 8 presents the edge map of the noiseless House image, while Fig. 9 presents the edge map of the House image corrupted with four different noises. It can be seen from the second row of Fig. 9 that the IDZ gradient algorithm can hardly identify the house under these fundamental noises interference. They illustrate that the IDZ gradient algorithm is sensitive to the noises. The third row of Fig. 9 shows the detection result of the proposed QHFIDZ algorithm. They preserve more clearly details than the second row. They demonstrate that the QHFIDZ algorithm gives robust performance than the IDZ gradient algorithm Grayscale-based algorithms The performance of the proposed QHFIDZ algorithm is compared with five grayscale-based algorithms, called Canny, Sobel, Prewitt, differential phase congruence (DPC) and modified differential phase congruence (MDPC) methods. The ideal noiseless (Fig. 5) and noisy images (Fig. 6 and 7) are both taken into account. Noiseless case: Figure 5 shows six noiseless test images whose edge maps of various detectors are shown in Fig. 10 and 11, respectively. Fig. 10 demonstrates the edge maps of the noiseless test 22

23 Table 3: The House image in Fig. 6. Noise SNR QHFIDZ MDPC, DPC I s 1 = 8.0, s 2 = 8.0 s = 3.5 II s 1 = 6.0, s 2 = 6.0 s = 2.5 III s 1 = 8.0, s 2 = 8.0 s = 4.5 IV s 1 = 8.0, s 2 = 8.0 s = 4.5 Table 4: The image A in Fig. 7. Noise SNR QHFIDZ MDPC, DPC I s 1 = 5.5, s 2 = 5.0 s = 2.0 II s 1 = 5.5, s 2 = 5.0 s = 2.0 III s 1 = 5.5, s 2 = 5.0 s = 2.0 IV s 1 = 5.5, s 2 = 5.0 s = 2.0 images of Lena, Men and House by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the first to the last row, respectively. While Fig. 11 demonstrates the edge maps of the noiseless test Images A, B and C by Canny, Sobel, Prewitt, DPC, MDPC and QHFIDZ algorithms, from the first to the last row, respectively. Noisy case: Performing four additional noises (I-IV) to the first row and the second row of Fig. 5 yields Fig. 6 and Fig. 7, respectively. The edge maps obtained by performing the Canny, Sobel, Prewitt, DPC and MDPC methods on Fig. 6 are shown in Fig. 12, 13 and 14, respectively. While the edge maps by these various detectors on Fig. 7 are given in Fig. 14, 15 and 16, respectively. From the third columns of edge maps in Fig. 12, 13 and 14, we can clearly see that the QHFIDZ algorithm is able to extract edge maps that are resistance to noise. The QHFIDZ algorithm is clearly superior to the other detectors on the images with Salt and Pepper noise. From these experimental results, we can clearly see that the QHFIDZ algorithm can easily extract boundary details from the noisy images, while the other five methods are comparably difficult to achieve. This shows that the QHFIDZ algorithm is robust than the other detectors. 4.2 Quantitative analysis To show the accuracy of the proposed edge detector, the PSNR and SSIM [28] values of various type of edge detectors on noisy images (I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise) are calculated (Table 7-10). Table 5: The image B in Fig. 7. Noise SNR QHFIDZ MDPC, DPC I s 1 = 2.0, s 2 = 2.0 s = 0.5 II s 1 = 2.0, s 2 = 2.0 s = 0.5 III s 1 = 2.0, s 2 = 2.0 s = 0.5 IV s 1 = 2.0, s 2 = 2.0 s =

24 Table 6: The image C in Fig. 7. Noise SNR QHFIDZ MDPC, DPC I s 1 = 7.0, s 2 = 7.0 s = 7.0 II s 1 = 6.0, s 2 = 6.0 s = 5.5 III s 1 = 8.0, s 2 = 8.0 s = 8.0 IV s 1 = 8.0, s 2 = 8.0 s = 8.0 Table 7: The PSNR comparison values for Fig. 12, 13 and 14. Type of noises: I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise. QHFIDZ Canny Sobel Prewitt MDPC DPC IDZ I LENA II III IV I MEN II III IV I HOUSE II III IV The PSNR is the most common and widely used method of objective evaluation of two images. It is based on the error between the corresponding pixel, which is based on the error-sensitive image quality evaluation. The PSNR between the original image(the edge map of noiseless image) X and the reference image(the edge map of noisy image) Y is defined by ( (2 n 1) 2 ) PSNR(X, Y ) := 10 log 10, (28) MSE(X, Y ) where n is the number of bits per pixel and MSE(X, Y ) denotes the mean square error of those two images, that is MSE(X, Y ) := 1 M N M N i=1 j=1 (X ij Y ij ) 2. The PSNR value obtained by this method is the degree of similarity or fidelity of the edge maps. The unit of PSNR is db, the bigger the value is, the stronger the robustness is. 2. The SSIM is a method of comparing two images from three aspects of brightness, contrast and structure. In general, the SSIM between two images X and Y is defined by SSIM(X, Y ) := [L(X, Y )] α [C(X, Y )] β [S(X, Y )] γ, where α, β, γ > 0. They are used to adjust the importance of the three modules. Luminance contrast function uses the average gray level µ x and µ y as an estimate of the luminance measurement, which is defined by L(X, Y ) := 2µ Xµ Y + c 1 µ 2 X + µ2 Y + c, 1 24

25 where µ X = 1 N N i=1 X i is the average grayscale of image X. The parameter c 1 is to avoid system instability when µ 2 X + µ2 Y approaches zero. In particular, we choose small constants c 1 = (k 1 l) 2, k 1 1, and l represents the grayscale of one image. Contrast comparison function uses the standard deviation σ X and σ Y as the contrast measure,which is C(X, Y ) := 2σ Xσ Y + c 2 σx 2 + σ2 Y + c, 2 where σ X = 1 N 1 N i=1 (X i µ X ) 2, c 2 = (k 2 l) 2, k 2 1. Structure contrast function is defind by S(X, Y ) := σ XY + c 3 σ X σ Y + c 3 where σ XY = 1 N 1 N i=1 (X i µ X )(Y i µ Y ). In this paper, assume α = β = γ = 1, c 3 = 1 2 c 2, by straightforward computation, we have SSIM(X, Y ) := (2µ Xµ Y + c 1 )(2σ XY + c 2 ) (µ 2 X + µ2 Y + c 1)(σ 2 X + σ2 Y + c 2). (29) The SSIM(X, Y ) value is between 0 and 1. The larger the value, the greater the similarity between the two images X and Y. Table 8: The PSNR comparison values for Fig. 15, 16 and 17. Type of noises: I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise. QHFIDZ Canny Sobel Prewitt MDPC DPC IDZ I Image A II III IV I Image B II III IV I Image C II III IV According to the definitions of PSNR and SSIM, the edge maps in Fig. 10 and 11 are marked as Image X, while the edge maps in Fig are marked as Image Y in both formulas (28) and (29). Tables 7-10 show in details the PSNR and SSIM values for Fig Each value in the table represents the similarity of the edge map of the noisy image and the edge map of the original noiseless image. That is, the larger the value, the stronger the denoising ability. From the results in Tables 7-8, we have the following conclusions. Table 7 and 8 show the PSNR comparison values for Fig. 12, 13 and 14. The larger PSNR values demonstrate better denoising performance among various detectors. For the convenience of observation, we mark them as bold letter under each type of noises. 25

26 Table 9: The SSIM comparison values for Fig. 12, 13 and 14. Type of noises: I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise. QHFIDZ Canny Sobel Prewitt MDPC DPC IDZ I LENA II III IV I MEN II III IV I HOUSE II III IV Table 10: The SSIM comparison values for Fig. 15, 16 and 17. Type of noises: I- Gaussian noise, II- Poisson noise, III- Salt and Pepper noise and IV- Speckle noise. QHFIDZ Canny Sobel Prewitt MDPC DPC IDZ I Image A II III IV I Image B II III IV I Image C II III IV Among various algorithms listed in Fig. 10, we see that from the values of the top two rows in Table 7, QHFIDZ method performs the best in all the noisy images, except Poisson noise. While we studied the various detectors under Poisson noise, we found that the top three algorithm are Sobel, prewitt, and QHFIDZ. For the last row in Table 7, it corresponds to house image in Fig. 6, although the PSNR values are not the best, but still in the top three. Therefore, for these three classic graphs, our method performed very well overall, especially for the effects of Lena and Men in Fig. 6. From the results shown in Fig. 11, we found that not all methods are suitable for testing these images in Fig. 7. Under these conditions, if we want to analyze their denoising effect, we need to analyze the significance of PSNR values in combination with visual effects. Let s first rank first two methods in terms of visual effects, follow the order from excellent to poor, respectively, the QHFIDZ method and the Canny method. Now we only need to analyze the numbers of the two 26

27 methods in Tables 8 and choose the largest number among them. It is not difficult to find that the algorithm of QHFIDZ has achieved excellent results compared with Canny. This is why, despite the fact that we find that the QHFIDZ s PSNR values, though not the largest of all methods, still marks it as bold. In particular, the PSNR values for the QHFIDZ method in Table 8 are optimal regardless of the conditions. On the whole, using the QHFIDZ method to do color edge detection on this type of graph, the effect is obvious and excellent. Tables 9 and 10 show the SSIM values between the edge map of original noiseless image and edge map of noisy images under various kinds of noises. When the SSIM value is close to 1, it shows robust denoising performance among various algorithms. From the SSIM values in these tables, we have the followings. From the SSIM values in Table 9, our proposed QHFIDZ algorithm give better performance than the other methods under four different noises. In particular, the noise reduction effect of salt and pepper is obviously robust than the other five methods. In addition, despite the speckle noise corresponding to the house image in Fig. 6, the SSIM value of the QHFIDZ algorithm is not the largest, but it is still the top three. As can be seen from Table 10 the method of QHFIDZ is obviously did better work than the other methods. Although the SSIM values of method QHFIDZ and Prewitt are closely, combined with Fig. 11 we found that Prewitt s edge detection results are not perform well within or without noise. Therefore, the value of SSIM does not have reference meaning. In contrast, the SSIM values of our method are close to 1. In other words, its noise immunity is the best. 5 Conclusions and Discussions In this paper, we have proposed a novel quaternion representation-based methods referred as QHFIDZ for color-based edge detection. The proposed QHFIDZ algorithm naturally extends the IDZ gradient operator from noiseless to noisy setting in quaternion space. The proposed algorithm in this paper shows a powerful effectiveness and stability when processing color image edge detection. The noisy images considered in this article only involve one single kind of noise disturbance. A forthcoming paper will be devoted to explain what this could be considered when deal with mixed noises [29, 30, 31] situation. Another significant area being developed which involves edge detection and recognizing textures is finding pathological objects in medical image processing. Acknowledgements The authors would like to thank Mr. Dong Cheng for his valuable comments and suggestions to improve the quality of the paper. This research was supported by the Macao Science and Technology Development Fund under Grant FDCT/031/2016/A1. References [1] Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, (1986) 27

28 [2] Sobel, I.: An isotropic 3* 3 image gradient operator. Machine vision for three-dimensional scenes (1990) [3] Prewitt, J.M.S.: Object enhancement and extraction. Picture processing and Psychopictorics. 10(1), (1970) [4] Felsberg, M., Sommer, G.: The monogenic scale-space: A unifying approach to phase-based image processing in scale-space. J. Math. Imaging Vis. 21(1-2), 5-26 (2004) [5] Yang, Y., Kou, K.I., Zou, C.: Edge detection methods based on modified differential phase congruency of monogenic signal. Multidimensional Systems and Signal Processing. 29(1), (2018) [6] Di Zenzo, S.: A note on the gradient of a multi-image. 33(1), (1986) [7] Jin, L., Liu, H., Xu, X., Song, E.: Improved direction estimation for Di Zenzo s multichannel image gradient operator. Pattern Recognition. 45(12), (2012) [8] Pei, S.C., Ding, J.J.: Efficient implementation of quaternion Fourier transform, convolution, and correlation by 2-D complex FFT. IEEE Trans. Signal Process. 49(11), (2001) [9] Barthelemy, Q., Larue, A., Mars J.I.: Color sparse representations for image processing: review, models, and prospects. IEEE Trans. Image Process. 24(11), (2015) [10] Kolaman, A., Yadid-Pecht, O.: Quaternion structural similarity: a new quality index for color images. IEEE Trans. Image Process. 21(4), (2012) [11] Alexiadis, D.S., Sergiadis, G.D.: Estimation of motions in color image sequences using hypercomplex Fourier transforms. IEEE Trans. Image Process. 18(1), (2009) [12] Jin, L., Liu, H., Xu, X., Song, E.: Quaternion-based impulse noise removal from color video sequences. IEEE Trans. Circuits Syst. Video Technol. 23(5), (2013) [13] Ell, T.A., Sangwine, S.J.: Hypercomplex Fourier transforms of color images. IEEE Trans. Image Process. 16(1), (2007) [14] Hu, X.X., Kou, K.I.: Quaternion Fourier and linear canonical inversion theorems. Math. Meth. Appl. Sci. 40(7), (2017) [15] Hu, X.X., Kou, K.I.: Phase-based edge detection algorithms. Math. Meth. Appl. Sci (2018) [16] Hitzer, E.M.S.: Quaternion Fourier transform on quaternion fields and generalizations. Adv. Appl. Clifford alg. 17(3), (2007) [17] Hamilton, W.R.: On quaternions; or on a new system of imaginaries in algebra. Philosophical Magazine. 25(3), (1844) [18] Stein, E.M., Shakarchi, R.: Fourier analysis: an introduction. Princeton University Press, (2011) [19] Ell, T.A.: Hypercomplex spectral transformations. (1992) [20] Sangwine, S.J.: Fourier transforms of colour images using quaternion or hypercomplex. Electronics letters. 32(21), (1996) 28

29 [21] Kou, K.I., Liu, M.S., Morais, J.P., Zou, C.: Envelope detection using generalized analytic signal in 2D QLCT domains, Multidimensional Systems and Signal Processing. 28(4), (2017) [22] Grigoryan, A.M., Jenkinson, J., Agaian, S.S.: Quaternion Fourier transform based alpha-rooting method for color image measurement and enhancement. Signal Process. 109, (2015) [23] Cheng, D., Kou, K.I.: Plancherel theorem and quaternion Fourier transform for square integrable functions. Complex Variables and Elliptic Equations (2018) [24] Bulow, T., Sommer, G.: Hypercomplex signals-a novel extension of the analytic signal to the multidimensional case. IEEE Transactions on signal processing, 49(11): (2001) [25] Chen, D.S., Song, F.F., Zhang, Q.: An adaptive global mapping approach for color to grayscale image conversion. Comput. Syst. Appl. 22, (2013) [26] Felsberg, M., Sommer, G.: The monogenic signal. IEEE Trans. Signal Process. 49(12), (2001) [27] Demarcq, G., Mascarilla, L., Berthier, M., Courtellemont, P.: The color monogenic signal: Application to color edge detection and color optical flow. J. Math. Imaging Vis. 40(3), (2011) [28] Hore, A., Ziou, D.: Image quality metrics: PSNR vs. SSIM. In Pattern recognition (icpr), th international conference on. IEEE, pp (2010) [29] Chen, C.L.P., Liu, L., Chen, L., Tang, Y.Y., Zhou, Y.: Weighted couple sparse representation with classified regularization for impulse noise removal. IEEE Trans. Image Process. 24(11), (2015) [30] Liu, L., Chen, L., Chen, C.P., Tang, Y.Y.: Weighted joint sparse representation for removing mixed noise in image. IEEE transactions on cybernetics, 47(3): (2017) [31] Shen, Y., Han, B., Braverman, E.: Removal of mixed Gaussian and impulse noise using directional tensor product complex tight framelets. J. Math. Imaging Vis. 54(1): 64-77(2016) 29