Research Papers
* Optimization Theory and Algorithms
-
An Adaptive Two-point
Stepsize Gradient Algorithm
Numerical Algorithms 27 (2001), pp. 377-385.
(joint work with Y. H. Dai)
-
A trust region-CG
algorithm for deblurring problem in atmospheric image reconstruction
Science in China, 45(2002), pp. 731-740.
(joint work with Y. F. Wang and Y. Yuan)
-
A nonmonotone trust
region algorithm for nonlinear optimization subject to general constraints
Journal of Computational Mathematics, No 2, 21(2003), pp. 237-246.
-
A Nonmonotone
Line Search Technique and its Application to Unconstrained Optimization
SIAM Journal on Optimization, 14 (2004), pp. 1043-1056.
(Joint work with W. W. Hager)
-
A New Conjugate
Gradient Method with Guaranteed Descent And An Efficient Line Search
SIAM Journal on Optimization, 16 (2005), pp. 170-192.
(Joint work with W. W. Hager)
Test problem
data for SIOPT paper.
Source code for CG_DESCENT Version 3.0May 18, 2008 (unconstrained optimization)
-
Algorithm 851: CG\_DESCENT,
A Conjugate Gradient Method with Guaranteed Descent
ACM Transactions on Mathematical Software, 32 (2006), pp. 113-137.
(Joint work with W. W. Hager)
Test
problem data for ACM TOMS paper.
-
The Cyclic Barzilai-Borwein
Stepsize Method for Unconstrained Optimization
IMA Journal of Numerical Analysis, 26 (2006), pp.604-627.
(Joint work with Y. H. Dai, W. W. Hager, K. Schittkowski)
-
PCBB: A projected
cyclic Barzilai-Borwein algorithm for box constrained optimization
Multiscale Optimization Methods and Applications, William W.
Hager, P .M. Pardalos, etc. ed., 2005, pp. 215-220.
(Joint work with W. W. Hager)
-
Self-adaptive
inexact proximal point methods
Computational Optimization and Applications, 39 (2008), pp. 161-181.
(Joint work with W. W. Hager)
-
A survey
of the nonlinear conjugate gradient methods
Pacific Journal of Optimization, 2 (2006), pp. 35-58.
(Joint work with W. W. Hager)
-
A new active set
algorithm for large-scale bound constrained optimization
Siam Journal on Optimization, 17 (2006), pp. 526-557.
(Joint work with W. W. Hager)
Test problem
data for active set paper.
Source code for ASA_CG Version 1.3September 25, 2009 (bound constrained optimization)
-
Recent advances in bound constrained optimization
System Modeling and Optimization, F. Ceragioli, A. Dontchev, H. Furuta,
K. Marti, and L. Pandolfi, eds., Springer, 2006, pp. 67-82.
(Joint work with W. W. Hager)
-
Asymptotic convergence analysis of a new class of proximal point methods
SIAM Journal on Control and Optimization, 46 (2007), pp. 1683-1704.
(Joint work with W. W. Hager)
-
An affine-scaling interior-point CBB methods for box constrained optimization
Mathematical Programming, 119 (2009), pp. 1-32.
(Joint work with B. A. Mair and W. W. Hager)
Positron Emission Tomography (PET) test problem which includes:
1. Fortran code to evaluate cost function and gradient
2. A file containing the data for a PET scan of a thorax
3. A file containing the matrix which describes the PET scanner
4. The reconstructed image achieved using .0001 error tolerance
Randomly generated test problems
-
A derivative-free algorithm for the least-squares minimization
SIAM Journal on Optimization, 20 (2010), pp. 3555-3576.
(Joint work with A. R. Conn and K. Scheinberg)
The codes DFBOLS: a Derivative-Free algorithm for Box constrained Least-Squares minimization is available
by Email request from: hozhang@math.lsu.edu
-
On the local convergence of a derivative-free algorithm for least-squares minimization
Computational Optimization and Applications, 51, (2012), pp. 481-507.
(Joint work with A. R. Conn)
-
An Affine-scaling Interior-point Method for Continuous Knapsack Constraints with Application to Support Vector Machines
SIAM Journal on Optimization, 21 (2011), pp. 361-390.
(Joint work with Maria D. Gonzalez-Lima, W. W. Hager)
Source code for ASL Version 1.2 September 9, 2009 (affine scaling method, linear constraint, bound constraints)
The Software, Testing Problems and Numerical Results
Source code for ASL Version 2.0 June 16, 2010 (affine scaling method, linear constraint, bound constraints)
-
Gradient-based methods for sparse recovery
SIAM Journal on Imaging, 4 (2011), pp. 146-165.
(Joint work with W. W. Hager and D. T. Phan)
-
A Topology-Preserved Optimization Algorithm for Polycube Mapping
Computers and Graphics, 35 (2011), pp. 639-649.
(Joint work with S. Wan, Z. Yin, K. Zhang and X. Li)
-
On the convergence of an active set method for L1 minimization
Optimization Methods and Software, 27 (2012), pp. 1127-1146.
(Joint work with W. Wen, W. Yin, and D. Goldfarb)
-
A nonmonotone spectral projected gradient method for large-scale topology optimization
Numerical Algebra, Control and Optimization, 2 (2012), pp. 395-412.
(Joint work with R. Tavakoli)
-
An exact algorithm for graph partitioning
Mathematical Programming, 137 (2013), pp. 531-556.
(Joint work with W. W. Hager and D. T. Phan)
-
Quadratic programming techniques in graph partitioning
November, 14, 2016.
(Joint work with S. C. Park, T. A. Davis and W. W. Hager)
-
A quadratic C0 interior penalty method for the displacement obstacle
problem of clamped kirchhoff plates
Siam Journal on Numerical Analysis, 50 (2012) pp. 3329-3350.
(Joint work with S. Brenner, L. Sung, and Y. Zhang)
-
Bregman Operator Splitting with Variable Stepsize (BOSVS) for Total Variation Image Reconstruction
Computational Optimization and Applications, 54 (2013), pp. 317-342.
(Joint work with Y. Chen, W. Hager, M. Yashtini and X. Ye)
-
An Affine Scaling Method for Optimization Problems with Polyhedral Constraints
Computational Optimization and Applications, 59 (2014) pp.163-183.
(Joint work with W. W. Hager)
Source code for BLG Version 1.1,
November 16, 2010 (solve problems with bound and linear constraints using gradient methods: gradient projection, affine scaling, or Frank-Wolfe)
Source code for SVMsubspace Version 1.0,
September 30, 2010 (solve Support Vector Machine problems by subspace methods and BLG)
-
Adaptive Regularized Self-Consistent Field Iteration with Exact Hessian for Electronic Structure Calculation
Siam Journal on Scientific Computing, 35 (2013), pp.1299--1324..
(Joint work with Z. Wen, A. Milzarek, M. Ulbrich)
-
The Limited Memory Conjugate Gradient Method
SIAM Journal on Optimization, 23 (2013), pp. 2150-2168.
(Joint work with W. W. Hager)
Source code for CG_DESCENT Version 6.0 November 6, 2012 (unconstrained optimization, function and gradient can be coded in MATLAB )
Test problem data for CG_DESCENT 6.0.
-
A nonmonotone approximate sequence algorithm for unconstrained nonlinear optimization
Computational Optimization and Applications, 57 (2014), pp. 27-43.
-
An augmented lagrangian affine scaling method for general nonlinear programming
Optimization Methods and Software, 30 (2015), pp. 934-964.
(Joint work with X. Wang)
-
Mini-batch Stochastic approximation methods for nonconvex stochastic composite optimization
Math Programming, November, 155 (2016), pp. 267-305. .
(Joint work with S. Ghadimi and G. Lan)
-
An O(1/k) Convergence rate for the variable stepsize Bregman operator splitting algorithm
SIAM Journal on Numerical Analysis, 54 (2016), pp. 1535-1556.
(Joint work with W. Hager and M. Yashtini)
-
An efficient gradient method using the Yuan steplength
Computational Optimization and Applications, 59 (2014), pp. 541-563.
(Joint work with R. Asmundis, D. Serafino, W. Hager and G. Toraldo)
-
An Alternating direction approximate Newton algorithm for ill-conditioned inverse problems with application to parallel MRI
Journal of the Operations Research Society of China, 3 (2015), pp. 139--162.
(Joint work with W. Hager, Cuong Ngo and M. Yashtini)
-
Projection on a Polyhedron that Exploits Sparsity
(includes tables of numerical data)
SIAM Journal on Optimization, 26 (2016), pp. 1773-1798.
(Joint work with W. Hager)
Source code for PPROJ Version 1.0,
January 9, 2015 (project a point on a polyhedron)
Source code for Polyhedral Test Problems,
-
An Active Set Algorithm for Nonlinear Optimization with Polyhedral Constraints
Science China Mathematics, ICIAM Special Issue, 59 (2016), pp. 1525-1542.
(Joint work with W. Hager)
-
A new simple model trust-region method with generalized barzilai-borwein parameter for large-scale optimization
Science China Mathematics, 59 (2016), pp. 2265-2280.
(Joint work with Q. Zhou and W. Sun)
-
A parameterized proximal point algorithm for separable convex optimization,
Optimization Letters, 12 (2018), pp. 1589-1608.
(Joint work with J. Bai and J. Li)
-
Inexact proximal stochastic gradient method for convex composite optimization
Computational Optimization and Applications, 68 (2017), pp. 579-618.
(Joint work with X. Wang and S. Wang)
-
Generalized symmetric admm for separable convex optimization
Computational Optimization and Applications, 70 (2018), pp. 129-170.
(Joint work with J. Bai, J. Li and F. Xu)
-
Inexact alternating direction multiplier methods for separable convex optimization
Computational Optimization and Applications, 73 (2019), pp. 201-235.
(Joint work with W. Hager)
-
Generalized uniformly optimal methods for nonlinear programming.
Journal of Scientific Computing, 79 (2019), pp. 1854-1881.
(Joint work with S. Ghadimi and G. Lan)
-
Gradient methods exploiting spectral properties
Optimization Methods and Software, 35 (2020), pp. 681-705.
(Joint work with Y. Huang, Y-H. Dai and X-W. Liu )
-
Inexact proximal stochastic second-order methods for nonconvex composite optimization
Optimization Methods and Software, 35 (2020), pp. 808-835.
(Joint work with X. Wang)
-
Convergence rates for an inexact ADMM applied to separable convex optimization
Computational Optimization and Applications, 77 (2020), pp. 729-754.
(Joint work with W. Hager)
-
A Derivative-Free Geometric Algorithm for Optimization on a Sphere
CSIAM Transactions on Applied Mathematics, 1 (2020), pp. 766-801.
(Joint work with Y. Chen and M. Xi)
-
A Nonmonotone Smoothing Newton Algorithm for Weighted Complementarity Problems
Journal of Optimization Theory and Applications, 189 (2021), pp. 679-715.
(Joint work with J. Tang)
-
A First-order Inexact Primal-dual Algorithm for a Class of Convex-concave Saddle Point Problems
Numerical Algorithms, 88 (2021), pp. 1109-1136.
Unified linear convergence of first-order primal-dual alogorithms for saddle point problems
Optimization Letters, (16) 2022, pp. 1675-1700
(Joint work with F. Jiang, Z. Wu, X. Cai)
-
A convexity enforcing C0 interior penalty method for the monge-ampere equation on convex polygonal domains
Numerische Mathematik 148 (2021), pp. 497-524.
(Joint work with S. Brenner, L.-Y. Sung and Z. Tan)
-
On the asymptotic convergence and acceleration of gradient methods
Journal of Scientific Computing, 90 (2022), pp. 7-36
(Joint work with Y. Huang, Y-H Dai and X-W Liu)
-
On the acceleration of the Barzilai-Borwein method
Computational Optimization and Applications, 81 (2022), pp 717-740.
(Joint work with Y. Huang, Y-H Dai and X-W Liu)
-
An Inexact Accelerated Stochastic ADMM for Separable Convex Optimization
Compuational Optimization and Applications, 81 (2022), pp. 479-518.
(Joint work with J. Bai and W. Hager)
-
Convergence on a Symmetric Accelerated Stochastic ADMM with Larger Stepsizes
CSIAM Transactions on Applied Mathematics, 3 (2022), pp. 448-479.
(Joint work with J. Bai, D. Han and H. Sun)
-
An Accelerated Smoothing Newton Method with Cubic Convergence for Weighted Complementarity Problems
Journal of Optimization Theory and Applications, 196 (2023), pp. 641-665.
(Joint work with J. Tang and J. Zhou)
-
Golden ratio primal-dual algorithm with linesearch
Siam Journal on Optimization, 32 (2022), pp. 1584-1613.
(Joint work with X. Chang and J. Yang)
-
Algorithm 1035: A Gradient-Based Implementation of the Polyhedral Active Set Algorithm
ACM Trans. Math. Softw., 49 (2023), pp. 1-13.
(Joint work with W. Hager)
-
A Unified Proximal Gradient Method for Nonconvex Composite Optimization with Extrapolation
Numerical Algebra, Control and Optimization, doi:10.3934/naco.2024005
(Joint work with M. Zhang)
-
Convergence Analysis of an Adaptively Regularized Natural Gradient Method
IEEE Transactions on Signal Processing, 72 (2024), pp. 2527-2542
(Joint work with J. Wu, J. Hu and Z. Wen)
* Conference Proceeding: Medical imaging, Volumetric mapping,
Graph partitioning, Petrophysics
-
Estimation, Smoothing,
and Characterization of Apparent Diffusion Coefficient Profiles from High
Angular Resolution DWI.
(Joint work with Y. Chen, W. Guo, F. Huang, Y. Liu and B. C. Vemuri)
Proceeding of IEEE computer society conference on Computer Vision
and Pattern Recognition, CVPR'04, pp. 588-593.
-
Quadratic programming techniques for graph partitioning.
(Joint work with S. Park, W. W. Hager and A. Davis)
Test problem data
-
A fast suboptimal algorithm for detection of 16-QAM signaling in MIMO Channels
Military Communications Conference, MILCOM, IEEE, pp.1-7, 2007.
(Joint work with S. Park, D. S. Han, J. Kim, E. S. Kang, W. W. Hager)
-
Rock physics and depositional history from seismic matching: A model study
April, 2007, EAGA London, England.
(Joint work with S. A. Levin, U. T. Mello, V. Lopez, L. Xu, A. R. Conn
and K. Scheinberg)
-
Assisted seismic matching: joint inversion of seismic, rock physics and basin modeling
Sep, 2007, SEG San Antonio, U.S.A.
(Joint work with S. A. Levin, U. T. Mello, V. Lopez, A. R.
Conn, K. Scheinberg, M. Henderson and L. Xu)
-
Using multiscale regularization to obtain realistic
optimal control strategies
SPE 142043, SPE Reservoir Simulation Symposium, 2011.
(Joint work with Y. Shuai, C. D. White and T. Sun)
-
Efficient Spherical Parametrization Using Progressive Optimization
Computational Visual Media, Lecture Notes in Computer Science, 7633 (2012), pp. 170-177.
(Joint work with S. Wan, T. Ye, M. Li, X. Li)
-
An Efficient Spherical Mapping Algorithm and its Application on Spherical Harmonics
Science China Information Sciences, 56 (2013), pp. 092103:1-092103:10.
(Joint work with S. Wan, T. Ye, M. Li, X. Li)
-
A large scale network model to obtain interwell formation characteristics
International Journal of Oil, Gas and Coal Technology, 15 (2017), pp. 1-24.
(Joint work with S. Gherabati, R. Hughes and C. White)