Trust-Region Optimization

Ask about this topic

Overview

Trust-region optimization studies how to choose steps using a local approximation of an objective, accepting steps that improve the objective and adjusting the region when predictions are inaccurate. Methods include quadratic-model and sequential quadratic programming approaches, stochastic and derivative-free updates, and Bayesian optimization with local Gaussian-process models. These methods are used for constrained and noisy problems, expensive black-box search, and fine-tuning policies or machine-learning models; evaluations often include CUTEst problems, synthetic optimization benchmarks, and application-specific tasks. A central challenge is balancing reliable local progress and convergence guarantees against the need to scale, handle noisy evaluations, and explore beyond the current region.

Latest papers

CardsList

29 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

  1. Anisotropic Trust Region Warping for Prior-Data Fitted Networks in Bayesian Optimisation

    Oct 27, 2026Samuel Younger, Tinkle Chugh, George De AthBayesian OptimizationPrior-Data Fitted Networks

    Imperial College London · University of Exeter

  2. Trust Your Targets: Is Target Propagation Block-Diagonal Gauss-Newton?

    Oct 19, 2026Giuseppe Castiglione, Christopher Buckley, Ivor SimpsonGauss-Newton OptimizationTrust-Region Optimization

    Department of Informatics University of Sussex

  3. Generative Models as Adaptive Trust Regions for Discrete Bayesian Optimisation

    Oct 12, 2026Michael Dodds, Erik Bodin, Sebastian W. Ober +3Bayesian OptimizationBlack-Box Optimization

    University of Cambridge · Monumo · BigHat Biosciences +2

  4. STREGO: A Scalable Implementation of a Trust-Region Framework for Noisy Bayesian Optimization

    Oct 9, 2026Youssef Diouane, Issmail El Hallaoui, Meisseme Kadri +1Bayesian OptimizationTrust-Region Optimization

    GERAD & Department of Mathematics and Industrial Engineering, Polytechnique Montr´eal. · GERAD & Department of Management, Universit´e du Qu´ebec `a Trois-Rivi`eres.

  5. Trust-Region Optimization for Smooth Potential-Interaction Energies in Wasserstein Space

    Oct 6, 2026You Wan, Ting Gao, Jinqiao DuanTrust-Region OptimizationSecond-Order Optimization

    School of Mathematics, Nanjing University, Nanjing, 210093, China · School of Sciences, Great Bay University, Dongguan 523000, China · Guangdong Provincial Key Laboratory of Mathematical and Neural Dynamical Systems, Great Bay University, Dongguan 523000, China +3

  6. Dynamics-Aware Adaptive Corridors with Feasibility-Perturbed Trust-Region SQP for Certified Nonholonomic Motion Planning

    Oct 5, 2026Yang ShiConstrained Motion PlanningTrajectory Generation

    Jiangsu College of Safety Technology, Jiangsu, China

  7. Bayesian Optimization with Fisher Information Geometry: Gradient Bounds and Trust-Region Methods

    Sep 25, 2026Saksham Kiroriwal, Julius Pfrommer, Jürgen BeyererBayesian OptimizationTrust-Region Optimization

    Cognitive Industrial Systems, Fraunhofer IOSB, Karlsruhe, Germany · Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany

  8. TR-SSQP: A Trust-Region Method for Constrained Stochastic Optimization under Heavy-Tailed Noise

    Sep 25, 2026Haoxuan Wang, Yuchen Fang, Sen NaStochastic OptimizationStochastic Optimization Convergence

    School of Industrial and Systems Engineering, Georgia Institute of Technology · Department of Mathematics, University of California, Berkeley

  9. CrystalMO-TuRBO: Multi-Objective Trust-Region Bayesian Optimization for High-precision Joint Crystal Structure Refinement

    Sep 17, 2026Joseph Agada, Yishu Wang, Arpan BiswasBayesian OptimizationTrust-Region Optimization

    University of Tennessee - Oak Ridge Innovation Institute University of Tennessee Knoxville, TN 37996 · Department of Materials Science and Engineering University of Tennessee Knoxville, TN 37996

  10. MpSub: A Momentum pp-Dimensional Subspace Trust-Region Method for Derivative-Free Fine-Tuning of Large Language Models

    Sep 7, 2026Yuyang Wang, Haoyu Yao, Pengcheng XieMemory-Efficient Fine-TuningZeroth-Order Optimization

    Xi’an Jiaotong University, Xi’an, China · Lawrence Berkeley National Laboratory, Berkeley, CA, USA

  11. A Trust-region Framework for Moment Estimation

    Jul 26, 2026Oluwasegun A. SomefunLearning Rate SchedulingTrust-Region Optimization

  12. One More Time: Revisiting Neural Quantum States from a Reinforcement Learning Perspective

    Jul 2, 2026Juan Agustín Duque, Sergio García Heredia, Vinicius Hernandes +4Neural Quantum StatesSecond-Order Optimization

    Mila Quebec AI Institute, Université de Montréal, Montréal, Canada · Applied Quantum Algorithms ⟨aQaL⟩, LIACS & LION, Leiden University, Leiden, Netherlands · QuTech and Kavli Institute of Nanoscience, Delft University of Technology, Delft, Netherlands +1

  13. Local Preferential Bayesian Optimization

    Jun 1, 2026Johanna Menn, Miriam Kober, Paul Brunzema +2Pairwise Preference LearningPairwise Preference Evaluation

    Institute for Data Science in Mechanical Engineering, RWTH Aachen University, Aachen, Germany · Department of Clinical Research, University of Bern, Bern, Switzerland · Center for Reproducible Science and Research Synthesis, University of Zurich, Zurich, Switzerland +1

  14. Trust Region On-Policy Distillation

    May 31, 2026Xingrun Xing, Haoqing Wang, Boyan Gao +2Language Model DistillationTrust-Region Optimization

    Samsung Research, Beijing, China · University of Oxford · Peking University

  15. Trust-Region Behavior Blending for On-Policy Distillation

    May 29, 2026Daniil Plyusov, Alexey Gorbatovski, Alexey Malakhov +4Language Model DistillationTrust-Region Optimization

    T-Tech

  16. SmoCap: Unified Scale-Pose Canonicalization with Proxy-Mapped Trust-Region QP

    May 20, 2026Shihao Li, Naohiko SugitaMarkerless Motion Capture3D Human Pose Estimation

    The Research into Artifacts, Center for Engineering, The University of Tokyo

  17. Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation

    May 14, 2026Yuheng Wu, Xiangbo Gao, Tianhao Chen +4Real-Time Interactive Video GenerationStreaming Video Generation

    1KAIST · *Work done when intern at Visko · 3Texas A&M University +3

  18. TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination

    May 1, 2026Yi Xie, Siao Liu, Falong Fan +3Multi-Agent System OptimizationMulti-Agent Coordination

    Department of Electrical & Computer Engineering, University of Arizona · Future Science and Engineering College, Soochow University · INSAIT, Sofia University ”St. Kliment Ohridski” +1

  19. Query-Efficient Quantum Approximate Optimization via Graph-Conditioned Trust Regions

    Apr 27, 2026Molena HuynhBlack-Box OptimizationCombinatorial Optimization

    North Carolina State University

  20. Rethinking Trust Region Bayesian Optimization in High Dimensions

    Apr 24, 2026Wei-Ting Tang, Joel A. PaulsonBayesian OptimizationBlack-Box Optimization

    University of Wisconsin–Madison

  21. Stochastic Trust-Region Methods for Over-parameterized Models

    Apr 15, 2026Aike Yang, Hao WangTrust-Region OptimizationNonconvex Stochastic Optimization

    ShanghaiTech University, Shanghai, China

  22. Memory-Guided Trust-Region Bayesian Optimization (MG-TuRBO) for High Dimensions

    Mar 25, 2026Abhilasha Saroj, Shaked Regev, Guanhao Xu +3Bayesian OptimizationBlack-Box Optimization

  23. Trust Region Constrained Bayesian Optimization with Penalized Constraint Handling

    Mar 25, 2026Raju Chowdhury, Tanmay Sen, Biswabrata PradhanBayesian OptimizationBlack-Box Optimization

    Statistical Quality Control and Operations Research Unit, Indian Statistical Institute, Kolkata, India.

  24. Boost Like a (Var)Pro: Trust-Region Gradient Boosting via Variable Projection

    Mar 24, 2026Abhijit Chowdhary, Elizabeth Newman, Deepanshu VermaEnsemble LearningTrust-Region Optimization

    Department of Mathematics, Tufts University, Medford, MA 02155, USA · School of Mathematical and Statistical Sciences, Clemson University, Clemson, SC 29634

  25. Factored Levenberg-Marquardt for Diffeomorphic Image Registration: An efficient optimizer for FireANTs

    Mar 19, 2026Rohit Jena, Pratik Chaudhari, James C. GeeMedical Image RegistrationDeformable Image Registration

    Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Radiology & Penn Image Computing and Science Laboratory (PICSL), Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA

  26. A Trust-Region Interior-Point Stochastic Sequential Quadratic Programming Method

    Mar 10, 2026Yuchen Fang, Jihun Kim, Sen Na +2Constrained OptimizationStochastic Optimization

    Department of Mathematics, University of California, Berkeley · Department of IEOR, University of California, Berkeley · School of Industrial and Systems Engineering, Georgia Tech +1

  27. Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning

    Mar 10, 2026Yechen Zhang, Shuhao Xing, Junhao Huang +5Deep Learning OptimizationMuon Optimizer

    Shanghai Jiao Tong University · Shanghai AI Laboratory · Fudan University

  28. LAGO: A Local-Global Optimization Framework Combining Trust Region Methods and Bayesian Optimization

    Mar 3, 2026Eliott Van Dieren, Tommaso Vanzan, Fabio NobileBlack-Box OptimizationBayesian Optimization

    Institute of Mathematics, EPFL, Lausanne, Switzerland · Dipartimento di Scienze Matematiche, Politecnico di Torino, Turin, Italy

  29. QUATRO: Query-Adaptive Trust Region Policy Optimization for LLM Fine-tuning

    Feb 4, 2026Doyeon Lee, Eunyi Lyou, Hyunsoo Cho +3Trust-Region OptimizationPolicy Learning

    Seoul National University · Department of Artificial Intelligence / Institute for Multiscale Matter and Systems, Ewha Woman University · Geogia Institute of Technology