TWO MODIFIED BARZILAI-BORWEIN PROJECTION METHODS WITH APPLICATIONS TO IMAGE RESTORATION

Peiting Gao; Ruiping Zhang; Jianchao Bai

doi:10.11948/20250205

2027 Volume 17 Issue 2

Article Contents

Article navigation > Journal of Applied Analysis & Computation > 2027 > 17(2): 1270-1292

Next Article Previous Article

Peiting Gao, Ruiping Zhang, Jianchao Bai. TWO MODIFIED BARZILAI-BORWEIN PROJECTION METHODS WITH APPLICATIONS TO IMAGE RESTORATION[J]. Journal of Applied Analysis & Computation, 2027, 17(2): 1270-1292. doi: 10.11948/20250205

Citation:

Peiting Gao, Ruiping Zhang, Jianchao Bai. TWO MODIFIED BARZILAI-BORWEIN PROJECTION METHODS WITH APPLICATIONS TO IMAGE RESTORATION[J]. Journal of Applied Analysis & Computation, 2027, 17(2): 1270-1292. doi: 10.11948/20250205

TWO MODIFIED BARZILAI-BORWEIN PROJECTION METHODS WITH APPLICATIONS TO IMAGE RESTORATION

1.
Shanxi Provincial People's Hospital, No. 29 Shuangtasi Street, Yingze District, 030001 Taiyuan, Shanxi Province, China
2.
College of Artificial Intelligence, Taiyuan University of Technology, No. 209 University Street, Yuci District, 030600 Jinzhong, Shanxi Province, China
3.
School of Mathematics and Statistics, Northwestern Polytechnical University, No. 1 Dongxiang Road, Chang'an District, 710129 Xi'an, Shaanxi Province, China

Author Bio: Email: gaopeitng3680@163.com(P. Gao)
Corresponding authors: Email: zrp_7142@sxmu.edu.cn(R. Zhang); Email: jianchaobai@nwpu.edu.cn(J. Bai)
Fund Project: This research was partially supported by the National Natural Science Foundation of China (62302331, 12471298), the Natural Science Foundation of Shanxi Province (202203021212255), and the Shaanxi Fundamental Science Research Project for Mathematics and Physics (23JSQ031)

Abstract

Abstract

In this paper, we propose two modified Barzilai-Borwein projection methods for solving constrained monotone nonlinear equations. These methods are proved to satisfy the Quasi-Newton equation and sufficient descent property independent of any line search. Performance comparisons show that our proposed methods are more competitive and efficient for solving these equations. Our projection methods are also used to restore images to demonstrate their effectiveness.
- Monotone nonlinear equations /
- projection method /
- quasi-newton equation /
- global convergence /
- image restoration
MSC: 65F10, 90C52, 65K05

FullText(HTML)

References

[1]	M. Abdullahi, A. B. Abubakar, A. Sulaiman and P. Chotpitayasunon, An efficient projection algorithm for solving convex constrained monotone operator equations and sparse signal reconstruction problems, The Journal of Analysis, 32, 2024, 2813–2832. doi: 10.1007/s41478-024-00757-w CrossRef Google Scholar
[2]	M. Abdullahi, K. J. Pan, A. Abubakar and A. S. Halilu, An Inertial Spectral Conjugate Gradient Method for Monotone Nonlinear Equations with Applications, Mathematical Methods in the Applied Sciences, 2025. DOI: org/10.1002/mma.10906. CrossRef Google Scholar
[3]	A. Abubakar, P. Kuman and A. Awwal, Global convergence via descent modified three-term conjugate gradient projection algorithm with applications to signal recovery, Results in Appled Mathematics, 2019, 4, 100069. doi: 10.1016/j.rinam.2019.100069 CrossRef Google Scholar
[4]	J. Barzilai and J. Borwein, Two-point step size gradient methods, IMA Journal of Numerical Analysis, 1988, 8, 141–148. doi: 10.1093/imanum/8.1.141 CrossRef Google Scholar
[5]	A. Bovik, Handbook of Image and Video Processing, Academic Press, 2000, New York. Google Scholar
[6]	O. Burdakov, Y. Dai and N. Huang, Stabilized Barzilai-Borwein method, Journal of Computational Mathematics, 2019, 37, 916–936. doi: 10.4208/jcm.1911-m2019-0171 CrossRef Google Scholar
[7]	Y. Dai and R. Fletcher, Projectioned Barzilai-Browein methods for large-scale box-constrained quadratic programming, Numerische Mathematik, 2005, 100, 21–47. doi: 10.1007/s00211-004-0569-y CrossRef Google Scholar
[8]	Y. Dai, W. Hager, K. Schittkowski and H. Zhang, The cyclic Barzilai-Borwein method for unconstrained optimization, IMA Journal of Numerical Analysis, 2006, 26, 604–627. doi: 10.1093/imanum/drl006 CrossRef Google Scholar
[9]	Y. Dai, Y. Huang and X. Liu, A family of spectral gradient methods for optimization, Computational and Applied Mathematics, 2019, 37, 916–936. Google Scholar
[10]	J. Dennis and J. Morè, Quasi-Newton method, motivation and theory, SIAM Review, 1977, 19, 46–89. doi: 10.1137/1019005 CrossRef Google Scholar
[11]	S. Dirkse and M. Ferris, MCPLIB: A collection of nonlinear mixed complementarity problems, Optimization Methods and Software, 1995, 5, 319–345. doi: 10.1080/10556789508805619 CrossRef Google Scholar
[12]	E. Dolan and J. Morè, Benchmarking optimization sofeware with performance profiles, Mathematical Programming, 2002, 91, 201–213. doi: 10.1007/s101070100263 CrossRef Google Scholar
[13]	M. Figueiredo, R. Nowak and S. Wright, Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problem, IEEE Journal Selected Topics Signal Processing, 2007, 4, 586–597. Google Scholar
[14]	P. Gao and C. He, A derivative-free projection algorithm involving spectral quotient for solving nonlinear monotone equations, Optimization, 2018, 67, 1631–1648. doi: 10.1080/02331934.2018.1482490 CrossRef Google Scholar
[15]	P. Gao and C. He, An adaptive family of projection methods for constrained monotone nonlinear equations with applications, Applied Mathematics and Computation, 359, 2019, 1–16. Google Scholar
[16]	P. Gao and C. He, An efficient three-term conjugate gradient method for nonlinear monotone equations with convex constraints, Calcolo, 2018, 55, 53. doi: 10.1007/s10092-018-0291-2 CrossRef Google Scholar
[17]	P. Gao, T. Wang, X. Liu and Y. Wu, An efficient three-term conjugate gradient-based algorithm involving spectral quotient for solving convex constrained monotone nonlinear equations with applications, Computational and Applied Mathematics, 2022, 41, 1–19. Google Scholar
[18]	P. Gao, W. Zheng, T. Wang, Y. Li and F. Li, Signal recovery with constrained monotone nonlinear equations through an effective three-term conjugate gradient method, Journal of Appled Analysis and Computation, 2023, 13, 2006–2025. Google Scholar
[19]	B. Ghaddar, J. Marecek and M. Mevissen, Optimal power flow as a polynomial optimization problem, IEEE Transactions on Power Systems, 2015, 31, 539–546. Google Scholar
[20]	M. El-Hawary, Optimal Power Flower: Solution Techniques, Requirement, and Challenges, IEEE Service Center, Piscataway, 1996. Google Scholar
[21]	Y. Huang, Y. Dai, X. Liu and H. Zhang, On the acceleration of the Barzilai-Borwein method, Computational Optimization and Applications, 2022, 81, 717–740. doi: 10.1007/s10589-022-00349-z CrossRef Google Scholar
[22]	J. B. Jian, Q. X. Huang, J. H. Yin and G. D. Ma, A family of inertial three-term CGPMs for large-scale nonlinear Pseudo-Monotone equations with convex constraints, Numerical Linear Algebra with Applications, 2025, 32, e2589. doi: 10.1002/nla.2589 CrossRef Google Scholar
[23]	J. B. Jian, Z. W. Ren, J. H. Yin and X. Z. Jiang, A family of hybrid acceleration DFPMs and applications for Pseudo-Monotone nonlinear equations with convex constraints, Journal of Optimization Theory and Applications, 2026, 209, 26. doi: 10.1007/s10957-026-02970-y CrossRef Google Scholar
[24]	X. Z. Jiang, Y. C. Dong and J. J. Bao, A memoryless Broyden-Fletcher-Goldfarb-Shanno-type projection method with self-adjusting line search for convexly constrained monotone equations and its applications, Numerical Algorithm, 2026. DOI: org/10.1007/s11075-026-02340-9. CrossRef Google Scholar
[25]	J. Liu, B. Tang, N. Zhang, J. Xiong, P. Gao and X. Dong, A subspace derivative-free projection method for convex constrained nonlinear equations, Japan Journal of Industrial and Applied Mathematics, 2025, 42, 197–221. doi: 10.1007/s13160-024-00675-1 CrossRef Google Scholar
[26]	G. D. Ma, J. C. Jin, J. B. Jian, J. H. Yin and D. L. Han, A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing, Numerical Algorithms, 2023, 92, 1621–1653. doi: 10.1007/s11075-022-01356-1 CrossRef Google Scholar
[27]	K. Meintjes and A. Morgan, A methodology for solving chemical equilibrium systems, Applied Mathematicss and Computation, 1987, 22, 333–361. doi: 10.1016/0096-3003(87)90076-2 CrossRef Google Scholar
[28]	E. Nermeh, M. Abdullahi, A. S. Halilu and H. Abdullahi, Modification of a conjugate gradient approach for convex constrained nonlinear mono tone equations with applications in signal recovery and image restoration, Communications in Nonlinear Science and Numerical Simulation, 2024, 136, 108079. doi: 10.1016/j.cnsns.2024.108079 CrossRef Google Scholar
[29]	J. Pang, Inexact Newton methods for the nonlinear complementarity problem, Mathematical Programming, 1986, 36, 54–71. doi: 10.1007/BF02591989 CrossRef Google Scholar
[30]	Y. Qu, W. Tong, H. He and Y. Liou, On projection alternating BB methods for variational inequalities, Optimization, 2021, 70, 827–846. doi: 10.1080/02331934.2020.1721495 CrossRef Google Scholar
[31]	S. B. Salihu, A. S. Halilu, M. Abdullahi, K. Ahmed, P. Mehta and S. Murtala, An improved spectral conjugate gradient projection method for monotone nonlinear equations with application, Journal of Applied Mathematics and Computing, 2024, 70, 3879–3915. doi: 10.1007/s12190-024-02121-4 CrossRef Google Scholar
[32]	M. Solodov and B. Svaiter, A new projection method for variational inequality problems, SIAM Journal on Control and Optimization, 1999, 37, 765–776. doi: 10.1137/S0363012997317475 CrossRef Google Scholar
[33]	M. Solodov and B. Svaiter, Reformulation: Nonsmooth, piecewise smooth, semismooth and smoothing methods, in: Fukushima, M., Qi, L. (eds. ) A globally convergent inexact Newton method for systems of monotone equations, Dordrecht: Kluwer Academic Publishers, 1998, 355–369. Google Scholar
[34]	R. Spangler and R. Shoults. Power generation, operation, and control [book review], IEEE Power Energy Magazine, 2014, 12, 90–93. Google Scholar
[35]	C. Wang, Y. Wang and C. Xu, A projection method for a system of nonlinear monotone equations with convex constraints, Mathematical Methods of Operations Research, 2007, 66, 33–46. doi: 10.1007/s00186-006-0140-y CrossRef Google Scholar
[36]	Y. Xiao, Q. Wang and Q. Hu, Non-smooth equations based method for $l_1 $-norm problems with applications to compressed sensing, Nonlinear Analysis, 2011, 74, 3570–3577. doi: 10.1016/j.na.2011.02.040 CrossRef $l_1 $-norm problems with applications to compressed sensing" target="_blank">Google Scholar
[37]	J. Yin, J. Jian and X. Jiang, A generalized hybrid CGPM-based algorithm for solving large-scale convex constrained equations with applications to image restoration, Journal of Computational and Applied Mathematics, 2021, 391, 113423. doi: 10.1016/j.cam.2021.113423 CrossRef Google Scholar
[38]	Y. X. Yuan and W. Y. Sun, Optimization Theory and Method, Science Press, Beijing, 1997. Google Scholar
[39]	W. Zhou and D. Li, Limited memory BFGS method for nonlinear monotone equations, Journal of Computational Mathematics, 2007, 25, 89–96. doi: 10.4208/jcm.v25.n1.p89 CrossRef Google Scholar
[40]	W. Zhou and D. Li, A globally convergent BFGS method for nonlinear monotone equations without any merit functions, Mathematics of Computation, 2008, 77, 2231–2240. doi: 10.1090/S0025-5718-08-02121-2 CrossRef Google Scholar