2024 Volume 14 Issue 4
Article Contents

V. Karthikeyan, E. Raja, K. Gurumoorthy. DENOISING CONVOLUTIONAL NEURAL NETWORK WITH ENERGY-BASED ATTENTION FOR IMAGE ENHANCEMENT[J]. Journal of Applied Analysis & Computation, 2024, 14(4): 1893-1914. doi: 10.11948/20220303
Citation: V. Karthikeyan, E. Raja, K. Gurumoorthy. DENOISING CONVOLUTIONAL NEURAL NETWORK WITH ENERGY-BASED ATTENTION FOR IMAGE ENHANCEMENT[J]. Journal of Applied Analysis & Computation, 2024, 14(4): 1893-1914. doi: 10.11948/20220303

DENOISING CONVOLUTIONAL NEURAL NETWORK WITH ENERGY-BASED ATTENTION FOR IMAGE ENHANCEMENT

  • In the realm of image denoising, the use of convolutional neural networks (CNNs) has lately gained traction. Several activities involve the utilization of excellent-clarity pictures and recordings. Images were captured in a wide variety of illumination circumstances, which means that not all of them are of the highest quality. Low-light photography suffers from a decline in perceived image quality because of the restricted dynamic range of the pixel values. Therefore, it is vital to enhance the appearance of images. Maximum texture retention is achieved by the structural similarity index-loss-based method. The suggested discrete wavelet transform (DWT)-self attention (SA)-Denoising convolutional neural networks (DnCNNs) make use of state-of-the-art techniques for image denoising like energy band analysis, very deep architecture, learning algorithms, dense-sparse-dense training, and regularization approaches. DnCNN is intended to remove the hidden layers' latent, yielding a pure picture. After a degraded input sample has had its relevant energy features retrieved using DWT, the perfect image enhancement is achieved thanks to the incorporation of the self-attention mechanism. Second, a hierarchical-branch network is formed by combining the suggested network with the denoising CNN and additional loss in order to reduce the reliance on the amount of noisy data in multi-modal picture analysis and make the problem of image enhancement more tractable. In the end, DWT-SA-DnCNN's self-learning qualities are used to improve image quality by obtaining features including undesirable noisy data, edge factor, texture, uniform and non-uniform areas, smoothness, and object structure. Simulation results show that our hybrid DWT-SA-DnCNN-based contrast enhancement strategy outperforms state-of-the-art methods.

    MSC: 62H35, 68T10, 91C20
  • 加载中
  • [1] M. Abdullah-Al-Wadud, M. H. Kabir, M. A. A. Dewan and O. Chae, A dynamic histogram equalization for image contrast enhancement, IEEE Transactions on Consumer Electronics, 2007, 53(2), 593-600. doi: 10.1109/TCE.2007.381734

    CrossRef Google Scholar

    [2] S. Ai and J. Kwon, Extreme low-light image enhancement for surveillance cameras using attention U-Net, Sensors, 2020, 20(2), 495. doi: 10.3390/s20020495

    CrossRef Google Scholar

    [3] B. O. Alawode, M. Masood, T. Ballal and T. Al-Naffouri, Dense-sparse deep CNN training for image denoising, 2021. preprint arXiv: 2107.04857.

    Google Scholar

    [4] P. B. Alisha and K. Gnana Sheela, Image denoising techniques-an overview, IOSR Journal of Electronics and Communication Engineering, 2016, 11, 78-84, 2016. (C-3).

    Google Scholar

    [5] Y. A. Al-Najjar and D. C. Soong, Comparison of image quality assessment: PSNR, HVS, SSIM, UIQI, Int. J. Sci. Eng. Res, 2012, 3(8), 1-5.

    Google Scholar

    [6] S. Asha and G. Sreenivasulu Satellite image enhancement using contrast limited adaptive histogram equalization, Int. J. Sci. Res. Sci. Eng. Technol, 2018, 4, 1070-1075.

    Google Scholar

    [7] Y. Atoum, M. Ye, L. Ren, Y. Tai and X. Liu, Color-wise attention network for low-light image enhancement, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, 506-507.

    Google Scholar

    [8] P. P. Banik, R. Saha and K. D. Kim, Contrast enhancement of low-light image using histogram equalization and illumination adjustment, in 2018 international conference on electronics, information, and Communication (ICEIC), 2018, 1-4. IEEE.

    Google Scholar

    [9] N. Bassiou and C. Kotropoulos, Color image histogram equalization by absolute discounting back-off, Computer Vision and Image Understanding, 2007, 107(1-2), 108-122. doi: 10.1016/j.cviu.2006.11.012

    CrossRef Google Scholar

    [10] C. Chen, Q. Chen, J. Xu and V. Koltun, Learning to see in the dark, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, 3291-3300.

    Google Scholar

    [11] D. Dominici, S. Zollini, M. Alicandro, F. Della Torre, P. M. Buscema and V. Baiocchi, High resolution satellite images for instantaneous shoreline extraction using new enhancement algorithms, Geosciences, 2019, 9(3), 123. DOI: 10.3390/geosciences9030123.

    CrossRef Google Scholar

    [12] L. Fan, F. Zhang, H. Fan and C. Zhang, Brief review of image denoising techniques, Visual Computing for Industry, Biomedicine, and Art, 2019, 2(1), 7. DOI: 10.1186/s42492-019-0016-7.

    CrossRef Google Scholar

    [13] X. Fu, Y. Liao, D. Zeng, Y. Huang, X. P. Zhang and X. Ding, A probabilistic method for image enhancement with simultaneous illumination and reflectance estimation, IEEE Transactions on Image Processing, 2015, 24(12), 4965-4977. DOI: 10.1109/TIP.2015.2474701.

    CrossRef Google Scholar

    [14] X. Fu, X, J. Wang, D. Zeng, Y. Huang and X. Ding, Remote sensing image enhancement using regularized-histogram equalization and DCT, IEEE Geoscience and Remote Sensing Letters, 2015, 12(11), 2301-2305. doi: 10.1109/LGRS.2015.2473164

    CrossRef Google Scholar

    [15] R. C. Gonzalez, R. E. Woods and B. R. Masters, Digital image processing, Third Edition. J. Biomed. Opt., 2009, 14, 029901. doi: 10.1117/1.3115362

    CrossRef Google Scholar

    [16] X. Guo, Y. Li and H. Ling, LIME: Low-light image enhancement via illumination map estimation, IEEE Transactions on Image Processing, 2016, 26(2), 982-993.

    Google Scholar

    [17] B. G. Han, H. S. Yang and Y. S. Moon, Locally adaptive contrast enhancement using convolutional neural network, in 2018 IEEE International Conference on Consumer Electronics (ICCE), 2018, 1-2. IEEE. DOI: 10.1109/ICCE.2018.8326096.

    Google Scholar

    [18] S. Han, J. Pool, S. Narang, H. Mao, E. Gong, S. Tang and W. J. Dally, DSD: Dense-sparse-dense training for deep neural networks, 2016. arXiv preprint, arXiv: 1607.04381.

    Google Scholar

    [19] K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, 770-778. DOI: 10.1109/CVPR.2016.90.

    Google Scholar

    [20] L. Hu, M. Qin, F. Zhang, Z. Du and R. Liu, RSCNN: A CNN-based method to enhance low-light remote-sensing images, Remote Sensing, 2021, 13(1), 62. DOI: 10.3390/rs13010062.

    CrossRef Google Scholar

    [21] H. Ibrahim and N. S. P. Kong, Brightness preserving dynamic histogram equalization for image contrast enhancement, IEEE Transactions on Consumer Electronics, 53(4), 1752-1758.

    Google Scholar

    [22] S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in International Conference on Machine Learning, PMLR-37, 2015, 448-456.

    Google Scholar

    [23] V. Jain, J. F. Murray, F. Roth, S. Turaga, V. Zhigulin, K. L. Briggman and H. S. Seung, Supervised learning of image restoration with convolutional networks, in 2007 IEEE 11th International Conference on Computer Vision, 2007, 1-8.

    Google Scholar

    [24] D. J. Jobson, Z. U. Rahman and G. A. Woodell, A multiscale retinex for bridging the gap between color images and the human observation of scenes, IEEE Transactions on Image Processing, 1997, 6(7), 965-976. doi: 10.1109/83.597272

    CrossRef Google Scholar

    [25] V. Karthikeyan, E. Raja and D. Pradeep, Energy based denoising convolutional neural network for image enhancement, The Imaging Science Journal, 2023, 72(1), 1-16.

    Google Scholar

    [26] R. Kaur, M. Juneja and A. K. Mandal, A comprehensive review of denoising techniques for abdominal CT images, Multimedia Tools and Applications, 2018, 77(17), 22735-22770. DOI: 10.1007/s11042-017-5500-5.

    CrossRef Google Scholar

    [27] J. Kim, J. K. Lee and K. M. Lee, Accurate image super-resolution using very deep convolutional networks, in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, 2016, 1646-1654.

    Google Scholar

    [28] E. H. Land, The retinex theory of color vision, Scientific American, 1977, 237(6), 108-129.

    Google Scholar

    [29] D. Lee, K. H. Kim, H. E. Kang, S. H. Wang, S. Y. Park and J. H. Kim, Learning speed improvement using multi-gpus on dnn-based acoustic model training in korean intelligent personal assistant, in Natural Language Dialog Systems and Intelligent Assistants, 2015, 263-271. Springer, Cham.

    Google Scholar

    [30] E. Lee, S. Kim, W. Kang, D. Seo and J. Paik, Contrast enhancement using dominant brightness level analysis and adaptive intensity transformation for remote sensing images, IEEE Geoscience and Remote Sensing Letters, 2012, 10(1), 62-66.

    Google Scholar

    [31] C. Li, J. Guo, F. Porikli and Y. Pang, LightenNet: A convolutional neural network for weakly illuminated image enhancement, Pattern Recognition Letters, 2018, 104, 15-22.

    Google Scholar

    [32] L. Li, R. Wang, W. Wang and W. Gao, A low-light image enhancement method for both denoising and contrast enlarging, in 2015 IEEE International Conference on Image Processing (ICIP), 2015, 3730-3734. IEEE.

    Google Scholar

    [33] C. Liu, I. Cheng, Y. Zhang and A. Basu, Enhancement of low visibility aerial images using histogram truncation and an explicit Retinex representation for balancing contrast and color consistency, ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 128, 16-26. DOI: 10.1016/j.isprsjprs.2017.02.016.

    CrossRef Google Scholar

    [34] Z. Liu, W. Q. Yan and M. L. Yang, Image denoising based on a CNN model, 4th International Conference on Control, Automation and Robotics (ICCAR), 2018, 389-393. IEEE.

    Google Scholar

    [35] K. G. Lore, A. Akintayo and S. Sarkar, LLNet: A deep autoencoder approach to natural low-light image enhancement, Pattern Recognition, 2017, 61, 650-662. DOI: 10.1016/j.patcog.2016.06.008.

    CrossRef Google Scholar

    [36] X. Ma, D. Wang, D. Liu and J. Yang, DWT and CNN based multi-class motor imagery electroencephalographic signal recognition, Journal of Neural Engineering, 2020, 17(1), 016073.

    Google Scholar

    [37] E. D. Pisano, S. Zong, B. M. Hemminger, M. DeLuca, R. E. Johnston, K. Muller and S. M. Pizer, Contrast limited adaptive histogram equalization image processing to improve the detection of simulated spiculations in dense mammograms, Journal of Digital Imaging, 1998, 11(4), 193.

    Google Scholar

    [38] J. Portilla, V. Strela, M. J. Wainwright and E. P. Simoncelli, Image denoising using scale mixtures of Gaussians in the wavelet domain, IEEE Transactions on Image Processing, 2003, 12(11), 1338-1351.

    Google Scholar

    [39] Z. U. Rahman, D. J. Jobson and A. Woodell, Multi-scale retinex for color image enhancement, in Proceedings of 3rd IEEE International Conference on Image Processing, 1996, 3, 1003-1006.

    Google Scholar

    [40] E. Shelhamer, J. Long and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(4), 640-651. DOI: 10.1109/TPAMI.2016.2572683.

    CrossRef Google Scholar

    [41] L. Shen, Z. Yue, F. Feng, Q. Chen, S. Liu and J. Ma, Msr-net: Low-light image enhancement using deep convolutional network, 2017. arXiv preprint, arXiv: 1711.02488.

    Google Scholar

    [42] P. Singh and R. Shree, Impact of method noise on SAR image despeckling, International Journal of Information Technology and Web Engineering (IJITWE), 2020, 15(1), 52-63.

    Google Scholar

    [43] L. Tao, C. Zhu, J. Song, T. Lu, H. Jia and X. Xie, Low-light image enhancement using CNN and bright channel prior, in 2017 IEEE International Conference on Image Processing (ICIP), 2017, 3215-3219. IEEE.

    Google Scholar

    [44] A. Toshev and C. Szegedy, Deeppose: Human pose estimation via deep neural networks, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, 1653-1660.

    Google Scholar

    [45] W. Wang, C. Wei, W. Yang and J. Liu, Gladnet: Low-light enhancement network with global awareness, in 201813th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018), 2018, 751-755. IEEE.

    Google Scholar

    [46] X. Wang, X. Bai, G. Li, L. Sun, H. Ye and T. Tong, Noise attenuation for CSEM Data via deep residual denoising convolutional neural network and shift-invariant sparse coding, Remote Sensing, 2023, 15(18), 4456.

    Google Scholar

    [47] Z. Wang and A. C. Bovik, A universal image quality index, IEEE Signal Processing Letters, 2002, 9(3), 81-84.

    Google Scholar

    [48] Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing, 2004, 13(4), 600-612.

    Google Scholar

    [49] J. Xie, L. Xu and E. Chen, Image denoising and inpainting with deep neural networks, in Advances in Neural Information Processing Systems, 2012, 341-349.

    Google Scholar

    [50] Z. Ying, G. Li, Y. Ren, R. Wang and W. Wang, A new low-light image enhancement algorithm using camera response model, IEEE International Conference on Computer Vision Workshops (ICCVW), 2017, 3015-3022. DOI: 10.1109/ICCVW.2017.356.

    CrossRef Google Scholar

    [51] C. Zhang, Q. Yan, Y. Zhu, X. Li, J. Sun and Y. Zhang, Attention-based network for low-light image enhancement, in 2020 IEEE International Conference on Multimedia and Expo (ICME), 2020, 1-6. IEEE.

    Google Scholar

    [52] K. Zhang, W. Zuo, Y. Chen, D. Meng and L. Zhang L, Beyond a gaussian denoiser: Residual learning of deep CNN for image denoising, IEEE Transactions on Image Processing, 2017, 26(7), 3142-3155.

    Google Scholar

    [53] S. Zollini, M. Alicandro, M. Cuevas-González, V. Baiocchi, D. Dominici and P. M. Buscema, Shoreline extraction based on an active connection matrix (ACM) image enhancement strategy, Journal of Marine Science and Engineering, 2020, 8(1), 9. DOI: 10.3390/jmse8010009.

    CrossRef Google Scholar

Figures(6)  /  Tables(7)

Article Metrics

Article views(1262) PDF downloads(445) Cited by(0)

Access History

Other Articles By Authors

Catalog

    /

    DownLoad:  Full-Size Img  PowerPoint