Research Papers

     * Optimization Theory and Algorithms

• An Adaptive Two-point Stepsize Gradient Algorithm

Numerical Algorithms 27 (2001), pp. 377-385.
(joint work with Y. H. Dai)
 
• A trust region-CG algorithm for deblurring problem in atmospheric image reconstruction

Science in China, 45(2002), pp. 731-740.
(joint work with Y. F. Wang and Y. Yuan)
 
• A nonmonotone trust region algorithm for nonlinear optimization subject to general constraints

Journal of Computational Mathematics, No 2, 21(2003), pp. 237-246.
 
• A Nonmonotone Line Search Technique and its Application to Unconstrained Optimization

SIAM Journal on Optimization, 14 (2004), pp. 1043-1056.
(Joint work with W. W. Hager)
 
• A New Conjugate Gradient Method with Guaranteed Descent And An Efficient Line Search

SIAM Journal on Optimization, 16 (2005), pp. 170-192.
(Joint work with W. W. Hager)
Test problem data for SIOPT paper.
Source code for CG_DESCENT Version 3.0May 18, 2008 (unconstrained optimization)
 
• Algorithm 851: CG\_DESCENT, A Conjugate Gradient Method with Guaranteed Descent

ACM Transactions on Mathematical Software, 32 (2006), pp. 113-137.
(Joint work with W. W. Hager)
Test problem data for ACM TOMS paper.
 
• The Cyclic Barzilai-Borwein Stepsize Method for Unconstrained Optimization

IMA Journal of Numerical Analysis, 26 (2006), pp.604-627.
(Joint work with Y. H. Dai, W. W. Hager, K. Schittkowski)
 
• PCBB: A projected cyclic Barzilai-Borwein algorithm for box constrained optimization

Multiscale Optimization Methods and Applications, William W. Hager, P .M. Pardalos, etc. ed., 2005, pp. 215-220.
(Joint work with W. W. Hager)
 
• Self-adaptive inexact proximal point methods

Computational Optimization and Applications, 39 (2008), pp. 161-181.
(Joint work with W. W. Hager)
 
• A survey of the nonlinear conjugate gradient methods

Pacific Journal of Optimization, 2 (2006), pp. 35-58.
(Joint work with W. W. Hager)
 
• A new active set algorithm for large-scale bound constrained optimization

Siam Journal on Optimization, 17 (2006), pp. 526-557.
(Joint work with W. W. Hager)
Test problem data for active set paper.
Source code for ASA_CG Version 1.3September 25, 2009 (bound constrained optimization)
 
• Recent advances in bound constrained optimization

System Modeling and Optimization, F. Ceragioli, A. Dontchev, H. Furuta, K. Marti, and L. Pandolfi, eds., Springer, 2006, pp. 67-82.
(Joint work with W. W. Hager)
 
• Asymptotic convergence analysis of a new class of proximal point methods

SIAM Journal on Control and Optimization, 46 (2007), pp. 1683-1704.
(Joint work with W. W. Hager)
 
• An affine-scaling interior-point CBB methods for box constrained optimization

Mathematical Programming, 119 (2009), pp. 1-32.
(Joint work with B. A. Mair and W. W. Hager)
Positron Emission Tomography (PET) test problem which includes:
1. Fortran code to evaluate cost function and gradient
2. A file containing the data for a PET scan of a thorax
3. A file containing the matrix which describes the PET scanner
4. The reconstructed image achieved using .0001 error tolerance
Randomly generated test problems
 
• A derivative-free algorithm for the least-squares minimization

SIAM Journal on Optimization, 20 (2010), pp. 3555-3576.
(Joint work with A. R. Conn and K. Scheinberg)
The codes DFBOLS: a Derivative-Free algorithm for Box constrained Least-Squares minimization is available
by Email request from: hozhang@math.lsu.edu
 
 
• On the local convergence of a derivative-free algorithm for least-squares minimization

Computational Optimization and Applications, 51, (2012), pp. 481-507.
(Joint work with A. R. Conn)
 
 
• An Affine-scaling Interior-point Method for Continuous Knapsack Constraints with Application to Support Vector Machines

SIAM Journal on Optimization, 21 (2011), pp. 361-390.
(Joint work with Maria D. Gonzalez-Lima, W. W. Hager)
Source code for ASL Version 1.2 September 9, 2009 (affine scaling method, linear constraint, bound constraints)
The Software, Testing Problems and Numerical Results
Source code for ASL Version 2.0 June 16, 2010 (affine scaling method, linear constraint, bound constraints)
 
• Gradient-based methods for sparse recovery

SIAM Journal on Imaging, 4 (2011), pp. 146-165.
(Joint work with W. W. Hager and D. T. Phan)
 
• A Topology-Preserved Optimization Algorithm for Polycube Mapping

Computers and Graphics, 35 (2011), pp. 639-649.
(Joint work with S. Wan, Z. Yin, K. Zhang and X. Li)
 
• On the convergence of an active set method for L1 minimization

Optimization Methods and Software, 27 (2012), pp. 1127-1146.
(Joint work with W. Wen, W. Yin, and D. Goldfarb)
 
• A nonmonotone spectral projected gradient method for large-scale topology optimization

Numerical Algebra, Control and Optimization, 2 (2012), pp. 395-412.
(Joint work with R. Tavakoli)
 
• An exact algorithm for graph partitioning

Mathematical Programming, 137 (2013), pp. 531-556.
(Joint work with W. W. Hager and D. T. Phan)
 
• Quadratic programming techniques in graph partitioning

November, 14, 2016.
(Joint work with S. C. Park, T. A. Davis and W. W. Hager)
 
• A quadratic C0 interior penalty method for the displacement obstacle problem of clamped kirchhoff plates

Siam Journal on Numerical Analysis, 50 (2012) pp. 3329-3350.
(Joint work with S. Brenner, L. Sung, and Y. Zhang)
 
• Bregman Operator Splitting with Variable Stepsize (BOSVS) for Total Variation Image Reconstruction

Computational Optimization and Applications, 54 (2013), pp. 317-342.
(Joint work with Y. Chen, W. Hager, M. Yashtini and X. Ye)
 
• An Affine Scaling Method for Optimization Problems with Polyhedral Constraints

Computational Optimization and Applications, 59 (2014) pp.163-183.
(Joint work with W. W. Hager)
Source code for BLG Version 1.1,
November 16, 2010 (solve problems with bound and linear constraints using gradient methods: gradient projection, affine scaling, or Frank-Wolfe)
Source code for SVMsubspace Version 1.0,
September 30, 2010 (solve Support Vector Machine problems by subspace methods and BLG)
 
• Adaptive Regularized Self-Consistent Field Iteration with Exact Hessian for Electronic Structure Calculation

Siam Journal on Scientific Computing, 35 (2013), pp.1299--1324..
(Joint work with Z. Wen, A. Milzarek, M. Ulbrich)
 
• The Limited Memory Conjugate Gradient Method

SIAM Journal on Optimization, 23 (2013), pp. 2150-2168.
(Joint work with W. W. Hager)
Source code for CG_DESCENT Version 6.0 November 6, 2012 (unconstrained optimization, function and gradient can be coded in MATLAB )
Test problem data for CG_DESCENT 6.0.
 
• A nonmonotone approximate sequence algorithm for unconstrained nonlinear optimization

Computational Optimization and Applications, 57 (2014), pp. 27-43.
 
• An augmented lagrangian affine scaling method for general nonlinear programming

Optimization Methods and Software, 30 (2015), pp. 934-964.
(Joint work with X. Wang)
 
• Mini-batch Stochastic approximation methods for nonconvex stochastic composite optimization

Math Programming, November, 155 (2016), pp. 267-305. .
(Joint work with S. Ghadimi and G. Lan)
 
• An O(1/k) Convergence rate for the variable stepsize Bregman operator splitting algorithm

SIAM Journal on Numerical Analysis, 54 (2016), pp. 1535-1556.
(Joint work with W. Hager and M. Yashtini)
 
• An efficient gradient method using the Yuan steplength

Computational Optimization and Applications, 59 (2014), pp. 541-563.
(Joint work with R. Asmundis, D. Serafino, W. Hager and G. Toraldo)
 
• An Alternating direction approximate Newton algorithm for ill-conditioned inverse problems with application to parallel MRI

Journal of the Operations Research Society of China, 3 (2015), pp. 139--162.
(Joint work with W. Hager, Cuong Ngo and M. Yashtini)
 
• Projection on a Polyhedron that Exploits Sparsity (includes tables of numerical data)

SIAM Journal on Optimization, 26 (2016), pp. 1773-1798.
(Joint work with W. Hager)
Source code for PPROJ Version 1.0, January 9, 2015 (project a point on a polyhedron)
Source code for Polyhedral Test Problems,
 
• An Active Set Algorithm for Nonlinear Optimization with Polyhedral Constraints

Science China Mathematics, ICIAM Special Issue, 59 (2016), pp. 1525-1542.
(Joint work with W. Hager)
 
• A new simple model trust-region method with generalized barzilai-borwein parameter for large-scale optimization

Science China Mathematics, 59 (2016), pp. 2265-2280.
(Joint work with Q. Zhou and W. Sun)
 
• A parameterized proximal point algorithm for separable convex optimization,

Optimization Letters, 12 (2018), pp. 1589-1608.
(Joint work with J. Bai and J. Li)
 
• Inexact proximal stochastic gradient method for convex composite optimization

Computational Optimization and Applications, 68 (2017), pp. 579-618.
(Joint work with X. Wang and S. Wang)
 
• Generalized symmetric admm for separable convex optimization

Computational Optimization and Applications, 70 (2018), pp. 129-170.
(Joint work with J. Bai, J. Li and F. Xu)
 
• Inexact alternating direction multiplier methods for separable convex optimization

Computational Optimization and Applications, 73 (2019), pp. 201-235.
(Joint work with W. Hager)
 
• Generalized uniformly optimal methods for nonlinear programming.

Journal of Scientific Computing, 79 (2019), pp. 1854-1881.
(Joint work with S. Ghadimi and G. Lan)
 
• Gradient methods exploiting spectral properties

Optimization Methods and Software, 35 (2020), pp. 681-705.
(Joint work with Y. Huang, Y-H. Dai and X-W. Liu )
 
• Inexact proximal stochastic second-order methods for nonconvex composite optimization

Optimization Methods and Software, 35 (2020), pp. 808-835.
(Joint work with X. Wang)
 
• Convergence rates for an inexact ADMM applied to separable convex optimization

Computational Optimization and Applications, 77 (2020), pp. 729-754.
(Joint work with W. Hager)
 
• A Derivative-Free Geometric Algorithm for Optimization on a Sphere

CSIAM Transactions on Applied Mathematics, 1 (2020), pp. 766-801.
(Joint work with Y. Chen and M. Xi)
 
• A Nonmonotone Smoothing Newton Algorithm for Weighted Complementarity Problems

Journal of Optimization Theory and Applications, 189 (2021), pp. 679-715.
(Joint work with J. Tang)
 
• A First-order Inexact Primal-dual Algorithm for a Class of Convex-concave Saddle Point Problems
  Numerical Algorithms, 88 (2021), pp. 1109-1136.
  
  Unified linear convergence of first-order primal-dual alogorithms for saddle point problems
  Optimization Letters, (16) 2022, pp. 1675-1700

(Joint work with F. Jiang, Z. Wu, X. Cai)
 
• A convexity enforcing C0 interior penalty method for the monge-ampere equation on convex polygonal domains

Numerische Mathematik 148 (2021), pp. 497-524.
(Joint work with S. Brenner, L.-Y. Sung and Z. Tan)
 
• On the asymptotic convergence and acceleration of gradient methods

Journal of Scientific Computing, 90 (2022), pp. 7-36
(Joint work with Y. Huang, Y-H Dai and X-W Liu)
 
• On the acceleration of the Barzilai-Borwein method

Computational Optimization and Applications, 81 (2022), pp 717-740.
(Joint work with Y. Huang, Y-H Dai and X-W Liu)
 
• An Inexact Accelerated Stochastic ADMM for Separable Convex Optimization

Compuational Optimization and Applications, 81 (2022), pp. 479-518.
(Joint work with J. Bai and W. Hager)
 
• Convergence on a Symmetric Accelerated Stochastic ADMM with Larger Stepsizes

CSIAM Transactions on Applied Mathematics, 3 (2022), pp. 448-479.
(Joint work with J. Bai, D. Han and H. Sun)
 
• An Accelerated Smoothing Newton Method with Cubic Convergence for Weighted Complementarity Problems

Journal of Optimization Theory and Applications, 196 (2023), pp. 641-665.
(Joint work with J. Tang and J. Zhou)
 
• Golden ratio primal-dual algorithm with linesearch

Siam Journal on Optimization, 32 (2022), pp. 1584-1613.
(Joint work with X. Chang and J. Yang)
 
• Algorithm 1035: A Gradient-Based Implementation of the Polyhedral Active Set Algorithm

ACM Trans. Math. Softw., 49 (2023), pp. 1-13.
(Joint work with W. Hager)
 
• Optimizing Client Selection for Federated Learning with Data and Latency Heterogeneity

IEEE Internet of Things Journal, 11 (2024), pp. 32183-32196.
(Joint work with X. Chen, X. Zhou, M. Sun and V. Poor)
 
• A Unified Proximal Gradient Method for Nonconvex Composite Optimization with Extrapolation

Numerical Algebra, Control and Optimization, doi:10.3934/naco.2024005
(Joint work with M. Zhang)
 
• Convergence Analysis of an Adaptively Regularized Natural Gradient Method

IEEE Transactions on Signal Processing, 72 (2024), pp. 2527-2542.
(Joint work with J. Wu, J. Hu and Z. Wen)
 
• A nonlinear least-squares convexity enforcing C0 interior penalty method for the Monge-Ampere equation on strictly convex smooth planar domains

Communications of the American Mathematical Society, 4 (2024), pp. 607-640.
(Joint work with S. Brenner, L. Y. Sung and Z. Tan)
 

• Estimation, Smoothing, and Characterization of Apparent Diffusion Coefficient Profiles from High Angular Resolution DWI.

(Joint work with Y. Chen, W. Guo, F. Huang, Y. Liu and B. C. Vemuri)
Proceeding of IEEE computer society conference on Computer Vision and Pattern Recognition, CVPR'04, pp. 588-593.
 
• Quadratic programming techniques for graph partitioning.

(Joint work with S. Park, W. W. Hager and A. Davis)
Test problem data
 
• A fast suboptimal algorithm for detection of 16-QAM signaling in MIMO Channels

Military Communications Conference, MILCOM, IEEE, pp.1-7, 2007.
(Joint work with S. Park, D. S. Han, J. Kim, E. S. Kang, W. W. Hager)
 
• Rock physics and depositional history from seismic matching: A model study

April, 2007, EAGA London, England.
(Joint work with S. A. Levin, U. T. Mello, V. Lopez, L. Xu, A. R. Conn and K. Scheinberg)
 
• Assisted seismic matching: joint inversion of seismic, rock physics and basin modeling

Sep, 2007, SEG San Antonio, U.S.A.
(Joint work with S. A. Levin, U. T. Mello, V. Lopez, A. R. Conn, K. Scheinberg, M. Henderson and L. Xu)
 
• Using multiscale regularization to obtain realistic optimal control strategies

SPE 142043, SPE Reservoir Simulation Symposium, 2011.
(Joint work with Y. Shuai, C. D. White and T. Sun)
 
• Efficient Spherical Parametrization Using Progressive Optimization

Computational Visual Media, Lecture Notes in Computer Science, 7633 (2012), pp. 170-177.
(Joint work with S. Wan, T. Ye, M. Li, X. Li)
 
• An Efficient Spherical Mapping Algorithm and its Application on Spherical Harmonics

Science China Information Sciences, 56 (2013), pp. 092103:1-092103:10.
(Joint work with S. Wan, T. Ye, M. Li, X. Li)
 
• A large scale network model to obtain interwell formation characteristics

International Journal of Oil, Gas and Coal Technology, 15 (2017), pp. 1-24.
(Joint work with S. Gherabati, R. Hughes and C. White)