Research of Single Image Rain Removal Algorithm Based on LBP-CGAN Rain Generation Method

Rain has an undesirable negative effect on the clarity of the collected images. In situation where images are captured in rain, it can lead to a loss of information and disability in reflecting real images of the situation. Consequently, rain has become an obstacle in outdoor scientific research studies. The reason why images captured in rain are difficult to process is due to the indistinguishable interactions between the background features and rain textures. Since current image data are only processed with the CNN (convolutional neural network) model, a trained neural network to remove rain and obtain clear images, the resulted images are either insufficient or excessive from standard results. In order to achieve more ideal results of clearer images, series of additional methods are taken place. Firstly, the LBP (local binary pattern) method is used to extract the texture features of rain in the image. Then, the CGAN (conditional generative adversarial network) model is constructed to generate rain datasets according to the extracted rain characteristics. Finally, the existing clear images, rain datasets generated by CGAN, as well as the images with rain are used for convolution operation to remove rain from the images, and the average value of PSNR (peak signal to noise ratio) can reach 38.79 by using this algorithm. Moreover, a large number of experiments are done and have proven that this joint processing method is able to successfully and effectively generate clear images despite the rain.