Acne Detection Methods and Performance Analysis using Component Images of Various Color Spaces

Ⅰ. Introduction

Today, various skin care for clean skin is recognized as part of physical or mental health care [1-3]. For this purpose, numerous beauty clinic programs are being used to treat skin diseases such as skin tone(or color), pores, acne, and pigmentation, regardless of age or gender. In particular, in the previous study [4], a survey was conducted on 302 female college students to analyze their concerns about skin care. As a result of the survey, skin diseases such as pores, skin tone, acne and excessive sebum (or oils) were analyzed as 32.1%, 22.5%, 18.5%, and 9.9%, respectively.

Skin tone and pigmentation, a phenomenon that occurs when the amount of pigment in the skin tissue changes abnormally, is related to melanin and hemoglobin pigments. In general, skin tone is determined by the amount of melanin, and as the amount of melanin increases, the skin tone becomes darker. The detection of images corresponding to melanin from digital images was proposed in a previous study [5]. In order to analyze pores, a digital image is generally obtained using a photographing device equipped with a microscope and a telemedicine haptic. However, in the previous study [6], a method of photographing and analyzing pores based on an image sensor built into a smartphone without a separate microscope was also proposed.

In this paper, a method for acne detection in skin diseases was proposed, and a comparative analysis was performed between the previous studies and the proposed method. In fact, skin disease diagnosis should be made by a dermatologist, but the previous studies and suggested acne detection will serve as an effective assistant to reduce time in the process of manually checking and diagnosing skin diseases.

The rest of the paper is organized as follows. In Section 2, the acne detection methods of previous studies are presented, and the proposed acne detection is explained in Section 3. In Section 4, the performance of previous studies and the proposed method was compared and analyzed. Finally, Section 5 describes the conclusions and future studies.

Ⅱ. Previous Studies for Acne Detection

In this section, color models and algorithms adopted in previous studies for detecting acne candidate regions in images containing acne are described. However, in the acne detection method of previous studies, a process such as detecting a face region or a region of interest (ROI) is not described.

2-1 Acne detection using R, G, B channels

In the previous study [7], automated lesion counting for 5 types of acne such as nodule, pustule, papule, whitehead and blackhead comedone was performed based on image processing. Here, the authors evaluate that the sensitivity and predictive value of the lesion counting program has more than 70% performance compared to the proposed method and manual counting performed by a professional dermatologist [7]. The color space applied for acne detection is based on the basic RGB color space, and the detection process is very simple as shown in Equations (1) and (2).

$\[ A_r=\left|R-B\right|+\left|R-G\right|. \]$

(1)

In Equation (1), A_r is an equation for calculating a region (or channel) with a large influence of red, and a smooth image A_s is obtained from the obtained A_r through filtering with a disk average. Then, as shown in Equation (2), the final acne candidate A_s was detected by comparing the obtained image A_f with the threshold value T, and (i, j) represents the pixel position of the image.

$\[ A_f=\left\{\begin{array}{cc}1\hfill & ,\text{if} A_s\left(i,j\right)>T\hfill \\ 0\hfill & ,otherwise\hfill \end{array}\right.. \]$

(2)

Figure 1 shows the results of acne detection obtained by Equations (1) and (2) and the main result images for each stage. In Figure 1, the threshold T for acne detection was set at a pixel value of 120. As described so far, the method of the previous study [7] is very simple and has the advantage of fast calculation.

Fig. 1.

Acne detection results of reference [7]

2-2 Acne detection using Gray-level and V channel

Acne detection in the previous study [8] was used based on the gray-level space of the RGB color image and the component image V of the converted HSV color space, and the overall flow of acne detection is shown in Figure 2. First, a gray-level image and a component image V are obtained, and then normalization is performed on the two images with values between 0 and 1 as in Equation (3).

$\[ N_{img}=\frac{img-\left\{\text{arg} min\left(img\right)\right\}}{\left\{\text{arg} max\left(img\right)\right\}-\left\{\text{arg} min\left(img\right)\right\}}, \]$

(3)

Fig. 2.

Block diagram for acne detection in reference [8]

where img includes the two images V and G in Figure 2, and the final N_img represents the two normalized images NV and NG. Then, the difference image N_diff between the two images was acquired and adjusted, and the finally detected acne candidate A_f was detected by Equation (4). The authors set the threshold value T in Equation 4 to 0.75, which is a double type value.

$\[ A_f=\left\{\begin{array}{cc}1\hfill & ,\text{if} N_{diff}\left(i,j\right)>T\hfill \\ 0\hfill & ,otherwise\hfill \end{array}\right.. \]$

(4)

Figure 3 shows the normalized images NV and NG from the image of Figure 1(a), and Figure 4 shows the final acne candidate image detected by the method of the previous study [8].

Fig. 3.

NV and NG images obtained by Eq. (3)

Fig. 4.

Acne detection results of reference [8]

2-3 Acne detection using RGB and HSV color model

In the previous study [9], each component image of the RGB color space and H (hue) image of the HSV color space were used for acne detection.

First, the smooth Gaussian method was pre-processed on the component image G of the RGB color space, and the image was segmented using the adaptive thresholding segmentation (ATS). And then, acne was quantified using a simple BLOB detector and speed up robust feature (SURF) technology. In addition, the redness included in the image applies the range of 0 to 8 and 172 to 255, which is the red color range of H. As the main features for acne quantification, the standard deviation (SD) of each component image in RGB color space, redness, mean of H, mean and SD of S (saturation), and Shannon entropy were used. On the basis that acne is generally circular, the circularity [9, 10] as in Equation (5) was also applied as a feature for quantification.

$\[ f_{circ}=\frac{4\pi A}{P^2}, \]$

(5)

where A and P are the area and perimeter of the blob, respectively. Figure 5 shows the result images of reference [9].

Fig. 5.

ATS and BLOB detection results of a reference [9]

2-4 Acne detection using RGB and CIE color model

Acne detection in the previous study [11] used the component image a* after converting the RGB color space into the CIE L*a*b* color space. First, a color balancing (CB) of test image was performed using Equation (6) as the pre-processing process, and a color space was converted from RGB to CIE L*a*b*.

$\[ \begin{array}{c}{S}_i=\frac{N_i}{max(N_R,N_G,N_B)}, \hfill \\ here,N_{i=R,G,B}=\frac{1}{arg mean\left(i\right)},\hfill \end{array} \]$

(6)

where N_i represents a value inverted by the average of each component image, and S_i is a scaling factor of each component image normalized to the maximum value of N_{i = R, G, B}. Therefore, each component image of the color balanced image is acquired as R×S_R, G×S_G, and B×S_B. After converting the color balanced image into CIE L*a*b*, acne was detected using the component image a*.

The authors used the feature that when the value of component image a* is negative, it is green, and when the value is positive, it is close to red. Based on these features, the acne detection was performed by Equation (7). Figure 6 shows the acne detection results of reference [11] using the test image of Figure 1(a).

$\[ \begin{array}{c}{A}_f=\left\{\begin{array}{cc}1\hfill & ,\text{if} N_{a^{\text{*}}}\left(i,j\right)>T\hfill \\ 0\hfill & ,otherwize\hfill \end{array}\right., \hfill \\ here,N_{a^{\text{*}}}=\frac{a^{\text{*}}}{arg max\left\{a^{\text{*}}\left(i,j\right)\right\}}.\hfill \end{array} \]$

(7)

Fig. 6.

Acne detection results of reference [11]

Ⅲ. Proposed Method for Acne Detection

The overall flow of the proposed acne detection is shown in Figure 7, and the component image Cr is used after converting the RGB color image into the YCbCr color space. Since acne is generally red, the acne region can be inferred using pixel information of the component image R. However, as shown in Figure 8(a), acne cannot be estimated using only the information of component image R, that is, brightness information. In other words, all regions such as acne, spots, and pigmentation can be detected. Therefore, the component image Cr was used to separate the red information from the information of the component image R. Since the component image Cr shows the difference from the reference value of the red components, it is suitable for acne detection.

Fig. 7.

Block diagram for the proposed acne detection

Fig. 8.

Acne detection results of the proposed method

First, if the constant luminance (Y) value is set to 0.5 in the YCbCr color space, the CbCr plane is shown in Figure 8(b) [12]. Based on this, a new YCbCr color space is created as shown in Equation (8).

where the parameter w is set to the median of the pixel range, and is 128. Then, the obtained YCbCr_new is converted back to the RGB color space to generate a new image RGB_new. The component image R_new extracted from the generated RGB_new is shown in Figure 8(c). Figure 8(d) is the result of applying the contrast adjustment between 0 and 1 to the image of Figure 8(c). The acne detection is detected by Equation (9), and when the threshold value T is 200 or more, it is determined as a red region.

Figures 8(e) and (f) show the results of setting the threshold value T to 175 and 200 in Equation (9), respectively. In this paper, we estimated that if the pixel values in Figure 8(d) were between 175 and 200, it was pigmentation, and if it was 200 or more, it was acne. This is because even the same red color can be separated into pigmentation and acne.

Ⅳ. Experiment and Discussion

In this section, the performance of the previous studies [7, 8, 11] described in Section 2 and the proposed method were compared and analyzed. In the pre-processing and acne detection process, acne candidate regions were detected by Equation (2, 4, 7), which is each method of previous studies, and Equation (9) which is the proposed method. Figure 9 shows the results of the final acne detection in each study. However, the post-processing procedure after detecting acne candidate regions is different among previous studies.

Fig. 9.

Acne detection results of previous studies [7, 8, 11] and the proposed method

Therefore, the post-processing procedure was unified for objective performance analysis. In the post-processing, objects smaller than 50 in size were removed from the binary image including the acne candidate region, and the morphological imaging techniques of erosion and dilation operations were applied for noise removal. At this time, a mask for the operation was applied in the form of a disk with the size of 3 by 3.

In Figure 9, the threshold value T applied to reference [7] was set to 120, 145, 100, and 147, from top to bottom, respectively. This means that the threshold value T must be applied differently according to the brightness of the input image. In the acne detection result of reference [8], the second image was detected incorrectly because the image was dark and ruddy as a whole, and the brightness information of the selected gray-level and component image V was similar. The result of reference [11] is generally good, but a spot was also detected in the acne detection result of the first image. Table 1 shows the color models and component images adopted in the methods which is described in this paper for the acne detection. Only RGB color model was used in reference [7], and component images R and Cr were applied in the proposed method.

Table 1.

Color models adopted in previous studies and proposed method

The detection of various skin diseases, including acne, should not be used for diagnostic purposes. Image processing-based acne detection should be a means to help overcome the excessive effort of dermatologists who manually check for acne.

Ⅴ. Conclusions and Future Works

In this paper, the general characteristic that acne is red (or ruddy) is applied to the proposed acne detection as in previous studies. The main procedure is to obtain YCbCr color space where the intensity of constant luminance and Cb are 0.5 after converting RGB color space-based image into YCbCr color space. Then, it is converted back to the RGB color space. The acne regions were detected using the component image R in the converted RGB color space. In this image, if it is greater than the threshold value of 200, it was estimated as acne. As a result of the experiment, it was confirmed that the proposed method is more effective in detecting acne than the existing methods. However, the acne detection using image processing should never make a final diagnosis, and should be a means to help overcome the excessive efforts of dermatologists. In the future, we plan to conduct deep learning-based research for skin analysis such as the frontal face detection, pigmentation, blemishes, and wrinkles.

Acknowledgments

This work was supported by Hanshin University Research Grant.

References

• Y. B. Kim, J. H. Baek and B. C. Ahn, “An Implementation of a Skin Care System for Android Phones,” in Proceedings of International Conference on Embedded Systems, Cyber-physical Systems, & Applications, pp. 57-61, 2016.
• J. D. Kim and J. E. Seol, “A Study on the State of Acne Awareness and Care,” The Journal of the Korean Society of Knit Design, Vol. 13, No. 2, pp. 1-9, June, 2015.
• K. H. Park and Y. H. Kim, “Skin Condition Analysis of Facial Image using Smart Device - Based on Acne, Pigmentation, Flush and Blemish,” Journal of Advanced Information Technology and Convergence, Vol. 8, No. 2, pp. 47-58, Dec. 2018. [https://doi.org/10.14801/JAITC.2018.8.2.47]
• J. D. Kim, “Study on Female College Students’ Recognition and State on Skin care,” The Journal of Korean Society of Knit Design, Vol. 15, No. 1, pp. 54-65, Feb. 2017.
• L. Yang, S. H. Lee, S. G. Kwon and K. R. Kwon, “Skin Pigmentation Detection Using Projection Transformed Block Coefficient,” Journal of Korea Multimedia Society, Vol. 16, No. 9, pp. 1044-1056, Sep. 2013. [https://doi.org/10.9717/kmms.2013.16.9.1044]
• J. S. Bae, J. H. Jeon, J. Y. Lee and J. O. Kim, “Skin Condition Estimation Using Mobile Handheld Camera,” ETRI Journal, Vol. 38, No. 4, pp. 776–786, August, 2016.
• S. Min, H. J. Kong, C. Yoon, H. C. Kim and D. H. Suh, “Development and evaluation of an automatic acne lesion detection program using digital image processing,” Skin Research and Technology, Vol. 19, pp. e423-e432, 2013. [https://doi.org/10.1111/j.1600-0846.2012.00660.x]
• T. Chantharaphaichit, B. Uyyanonvara, C. Sinthanayothin, and A. Nishihara, “Automatic Acne Detection for Medical Treatment,” in Proceeding of the 6th International Conference of Information and Communication Technology for Embedded Systems (IC-ICTES), Hua Hin, Thailand, pp. 33-38, 2015. [https://doi.org/10.1109/ICTEmSys.2015.7110813]
• N. Kittigul, Automatic Acne Detection and Quantification for Medical Treatment through Image Processing, M.S. dissertation, Sirindhorn International Institute of Technology, Thammasat University, Bangkok, 2017.
• LearnOpenCV, Blob Detection Using OpenCV [Internet]. Available: https://learnopencv.com/blob-detection-using-opencv-python-c/, .
• K. H. Park and H. S. Noh, “Effective Acne Detection using Component Image a* of CIE L*a*b* Color Space,” Journal of Digital Contents Society, Vol. 19, No. 7, pp. 1397-1403, July 2018. [https://doi.org/10.9728/dcs.2018.19.7.1397]
• Wikipedia, YCbCr [Internet]. Available: https://en.wikipedia.org/wiki/YCbCr, .