Citation: | V. Karthikeyan, E. Raja, K. Gurumoorthy. DENOISING CONVOLUTIONAL NEURAL NETWORK WITH ENERGY-BASED ATTENTION FOR IMAGE ENHANCEMENT[J]. Journal of Applied Analysis & Computation, 2024, 14(4): 1893-1914. doi: 10.11948/20220303 |
In the realm of image denoising, the use of convolutional neural networks (CNNs) has lately gained traction. Several activities involve the utilization of excellent-clarity pictures and recordings. Images were captured in a wide variety of illumination circumstances, which means that not all of them are of the highest quality. Low-light photography suffers from a decline in perceived image quality because of the restricted dynamic range of the pixel values. Therefore, it is vital to enhance the appearance of images. Maximum texture retention is achieved by the structural similarity index-loss-based method. The suggested discrete wavelet transform (DWT)-self attention (SA)-Denoising convolutional neural networks (DnCNNs) make use of state-of-the-art techniques for image denoising like energy band analysis, very deep architecture, learning algorithms, dense-sparse-dense training, and regularization approaches. DnCNN is intended to remove the hidden layers' latent, yielding a pure picture. After a degraded input sample has had its relevant energy features retrieved using DWT, the perfect image enhancement is achieved thanks to the incorporation of the self-attention mechanism. Second, a hierarchical-branch network is formed by combining the suggested network with the denoising CNN and additional loss in order to reduce the reliance on the amount of noisy data in multi-modal picture analysis and make the problem of image enhancement more tractable. In the end, DWT-SA-DnCNN's self-learning qualities are used to improve image quality by obtaining features including undesirable noisy data, edge factor, texture, uniform and non-uniform areas, smoothness, and object structure. Simulation results show that our hybrid DWT-SA-DnCNN-based contrast enhancement strategy outperforms state-of-the-art methods.
[1] | M. Abdullah-Al-Wadud, M. H. Kabir, M. A. A. Dewan and O. Chae, A dynamic histogram equalization for image contrast enhancement, IEEE Transactions on Consumer Electronics, 2007, 53(2), 593-600. doi: 10.1109/TCE.2007.381734 |
[2] | S. Ai and J. Kwon, Extreme low-light image enhancement for surveillance cameras using attention U-Net, Sensors, 2020, 20(2), 495. doi: 10.3390/s20020495 |
[3] | B. O. Alawode, M. Masood, T. Ballal and T. Al-Naffouri, Dense-sparse deep CNN training for image denoising, 2021. preprint arXiv: 2107.04857. |
[4] | P. B. Alisha and K. Gnana Sheela, Image denoising techniques-an overview, IOSR Journal of Electronics and Communication Engineering, 2016, 11, 78-84, 2016. (C-3). |
[5] | Y. A. Al-Najjar and D. C. Soong, Comparison of image quality assessment: PSNR, HVS, SSIM, UIQI, Int. J. Sci. Eng. Res, 2012, 3(8), 1-5. |
[6] | S. Asha and G. Sreenivasulu Satellite image enhancement using contrast limited adaptive histogram equalization, Int. J. Sci. Res. Sci. Eng. Technol, 2018, 4, 1070-1075. |
[7] | Y. Atoum, M. Ye, L. Ren, Y. Tai and X. Liu, Color-wise attention network for low-light image enhancement, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, 506-507. |
[8] | P. P. Banik, R. Saha and K. D. Kim, Contrast enhancement of low-light image using histogram equalization and illumination adjustment, in 2018 international conference on electronics, information, and Communication (ICEIC), 2018, 1-4. IEEE. |
[9] | N. Bassiou and C. Kotropoulos, Color image histogram equalization by absolute discounting back-off, Computer Vision and Image Understanding, 2007, 107(1-2), 108-122. doi: 10.1016/j.cviu.2006.11.012 |
[10] | C. Chen, Q. Chen, J. Xu and V. Koltun, Learning to see in the dark, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, 3291-3300. |
[11] | D. Dominici, S. Zollini, M. Alicandro, F. Della Torre, P. M. Buscema and V. Baiocchi, High resolution satellite images for instantaneous shoreline extraction using new enhancement algorithms, Geosciences, 2019, 9(3), 123. DOI: 10.3390/geosciences9030123. |
[12] | L. Fan, F. Zhang, H. Fan and C. Zhang, Brief review of image denoising techniques, Visual Computing for Industry, Biomedicine, and Art, 2019, 2(1), 7. DOI: 10.1186/s42492-019-0016-7. |
[13] | X. Fu, Y. Liao, D. Zeng, Y. Huang, X. P. Zhang and X. Ding, A probabilistic method for image enhancement with simultaneous illumination and reflectance estimation, IEEE Transactions on Image Processing, 2015, 24(12), 4965-4977. DOI: 10.1109/TIP.2015.2474701. |
[14] | X. Fu, X, J. Wang, D. Zeng, Y. Huang and X. Ding, Remote sensing image enhancement using regularized-histogram equalization and DCT, IEEE Geoscience and Remote Sensing Letters, 2015, 12(11), 2301-2305. doi: 10.1109/LGRS.2015.2473164 |
[15] | R. C. Gonzalez, R. E. Woods and B. R. Masters, Digital image processing, Third Edition. J. Biomed. Opt., 2009, 14, 029901. doi: 10.1117/1.3115362 |
[16] | X. Guo, Y. Li and H. Ling, LIME: Low-light image enhancement via illumination map estimation, IEEE Transactions on Image Processing, 2016, 26(2), 982-993. |
[17] |
B. G. Han, H. S. Yang and Y. S. Moon, Locally adaptive contrast enhancement using convolutional neural network, in 2018 IEEE International Conference on Consumer Electronics (ICCE), 2018, 1-2. IEEE. DOI: |
[18] | S. Han, J. Pool, S. Narang, H. Mao, E. Gong, S. Tang and W. J. Dally, DSD: Dense-sparse-dense training for deep neural networks, 2016. arXiv preprint, arXiv: 1607.04381. |
[19] |
K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 770-778. DOI: |
[20] | L. Hu, M. Qin, F. Zhang, Z. Du and R. Liu, RSCNN: A CNN-based method to enhance low-light remote-sensing images, Remote Sensing, 2021, 13(1), 62. DOI: 10.3390/rs13010062. |
[21] | H. Ibrahim and N. S. P. Kong, Brightness preserving dynamic histogram equalization for image contrast enhancement, IEEE Transactions on Consumer Electronics, 53(4), 1752-1758. |
[22] | S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in International Conference on Machine Learning, PMLR-37, 2015, 448-456. |
[23] | V. Jain, J. F. Murray, F. Roth, S. Turaga, V. Zhigulin, K. L. Briggman and H. S. Seung, Supervised learning of image restoration with convolutional networks, in 2007 IEEE 11th International Conference on Computer Vision, 2007, 1-8. |
[24] | D. J. Jobson, Z. U. Rahman and G. A. Woodell, A multiscale retinex for bridging the gap between color images and the human observation of scenes, IEEE Transactions on Image Processing, 1997, 6(7), 965-976. doi: 10.1109/83.597272 |
[25] | V. Karthikeyan, E. Raja and D. Pradeep, Energy based denoising convolutional neural network for image enhancement, The Imaging Science Journal, 2023, 72(1), 1-16. |
[26] | R. Kaur, M. Juneja and A. K. Mandal, A comprehensive review of denoising techniques for abdominal CT images, Multimedia Tools and Applications, 2018, 77(17), 22735-22770. DOI: 10.1007/s11042-017-5500-5. |
[27] | J. Kim, J. K. Lee and K. M. Lee, Accurate image super-resolution using very deep convolutional networks, in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2016, 1646-1654. |
[28] | E. H. Land, The retinex theory of color vision, Scientific American, 1977, 237(6), 108-129. |
[29] | D. Lee, K. H. Kim, H. E. Kang, S. H. Wang, S. Y. Park and J. H. Kim, Learning speed improvement using multi-gpus on dnn-based acoustic model training in korean intelligent personal assistant, in Natural Language Dialog Systems and Intelligent Assistants, 2015, 263-271. Springer, Cham. |
[30] | E. Lee, S. Kim, W. Kang, D. Seo and J. Paik, Contrast enhancement using dominant brightness level analysis and adaptive intensity transformation for remote sensing images, IEEE Geoscience and Remote Sensing Letters, 2012, 10(1), 62-66. |
[31] | C. Li, J. Guo, F. Porikli and Y. Pang, LightenNet: A convolutional neural network for weakly illuminated image enhancement, Pattern Recognition Letters, 2018, 104, 15-22. |
[32] | L. Li, R. Wang, W. Wang and W. Gao, A low-light image enhancement method for both denoising and contrast enlarging, in 2015 IEEE International Conference on Image Processing (ICIP), 2015, 3730-3734. IEEE. |
[33] | C. Liu, I. Cheng, Y. Zhang and A. Basu, Enhancement of low visibility aerial images using histogram truncation and an explicit Retinex representation for balancing contrast and color consistency, ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 128, 16-26. DOI: 10.1016/j.isprsjprs.2017.02.016. |
[34] | Z. Liu, W. Q. Yan and M. L. Yang, Image denoising based on a CNN model, 4th International Conference on Control, Automation and Robotics (ICCAR), 2018, 389-393. IEEE. |
[35] | K. G. Lore, A. Akintayo and S. Sarkar, LLNet: A deep autoencoder approach to natural low-light image enhancement, Pattern Recognition, 2017, 61, 650-662. DOI: 10.1016/j.patcog.2016.06.008. |
[36] | X. Ma, D. Wang, D. Liu and J. Yang, DWT and CNN based multi-class motor imagery electroencephalographic signal recognition, Journal of Neural Engineering, 2020, 17(1), 016073. |
[37] | E. D. Pisano, S. Zong, B. M. Hemminger, M. DeLuca, R. E. Johnston, K. Muller and S. M. Pizer, Contrast limited adaptive histogram equalization image processing to improve the detection of simulated spiculations in dense mammograms, Journal of Digital Imaging, 1998, 11(4), 193. |
[38] | J. Portilla, V. Strela, M. J. Wainwright and E. P. Simoncelli, Image denoising using scale mixtures of Gaussians in the wavelet domain, IEEE Transactions on Image Processing, 2003, 12(11), 1338-1351. |
[39] | Z. U. Rahman, D. J. Jobson and A. Woodell, Multi-scale retinex for color image enhancement, in Proceedings of 3rd IEEE International Conference on Image Processing, 1996, 3, 1003-1006. |
[40] | E. Shelhamer, J. Long and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4), 640-651. DOI: 10.1109/TPAMI.2016.2572683. |
[41] | L. Shen, Z. Yue, F. Feng, Q. Chen, S. Liu and J. Ma, Msr-net: Low-light image enhancement using deep convolutional network, 2017. arXiv preprint, arXiv: 1711.02488. |
[42] | P. Singh and R. Shree, Impact of method noise on SAR image despeckling, International Journal of Information Technology and Web Engineering (IJITWE), 2020, 15(1), 52-63. |
[43] | L. Tao, C. Zhu, J. Song, T. Lu, H. Jia and X. Xie, Low-light image enhancement using CNN and bright channel prior, in 2017 IEEE International Conference on Image Processing (ICIP), 2017, 3215-3219. IEEE. |
[44] | A. Toshev and C. Szegedy, Deeppose: Human pose estimation via deep neural networks, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, 1653-1660. |
[45] | W. Wang, C. Wei, W. Yang and J. Liu, Gladnet: Low-light enhancement network with global awareness, in 201813th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018), 2018, 751-755. IEEE. |
[46] | X. Wang, X. Bai, G. Li, L. Sun, H. Ye and T. Tong, Noise attenuation for CSEM Data via deep residual denoising convolutional neural network and shift-invariant sparse coding, Remote Sensing, 2023, 15(18), 4456. |
[47] | Z. Wang and A. C. Bovik, A universal image quality index, IEEE Signal Processing Letters, 2002, 9(3), 81-84. |
[48] | Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing, 2004, 13(4), 600-612. |
[49] | J. Xie, L. Xu and E. Chen, Image denoising and inpainting with deep neural networks, in Advances in Neural Information Processing Systems, 2012, 341-349. |
[50] | Z. Ying, G. Li, Y. Ren, R. Wang and W. Wang, A new low-light image enhancement algorithm using camera response model, IEEE International Conference on Computer Vision Workshops (ICCVW), 2017, 3015-3022. DOI: 10.1109/ICCVW.2017.356. |
[51] | C. Zhang, Q. Yan, Y. Zhu, X. Li, J. Sun and Y. Zhang, Attention-based network for low-light image enhancement, in 2020 IEEE International Conference on Multimedia and Expo (ICME), 2020, 1-6. IEEE. |
[52] | K. Zhang, W. Zuo, Y. Chen, D. Meng and L. Zhang L, Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising, IEEE Transactions on Image Processing, 2017, 26(7), 3142-3155. |
[53] | S. Zollini, M. Alicandro, M. Cuevas-González, V. Baiocchi, D. Dominici and P. M. Buscema, Shoreline extraction based on an active connection matrix (ACM) image enhancement strategy, Journal of Marine Science and Engineering, 2020, 8(1), 9. DOI: 10.3390/jmse8010009. |
Image Enhancement
Block diagram of Suggested system
Proposed hybrid DWT-SA-DnCNN Architecture
Proposed Hybrid DWT-DnCNN sample result
Proposed Hybrid DWT-DnCNN sample result
Restoration results of proposed methodology under various