Constrained Optimization

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 44

All topics

ORACLE: Optimizer-Relative Alignment for Constrained LEarning
Oct 6, 2026Utkarsh Grover, Wyatt Mackey, Kaixun Hua +2Constrained Optimization
Cross-entropy optimization with prioritized constraints
Oct 1, 2026Francisco Roldan Sanchez, Pau de las Heras Molins, David Fridovich-Keil +1Constrained Optimization Prioritization
LTCI, Télécom Paris, Institut Polytechnique de Paris · The University of Texas at Austin
HeurEvo: Agentic Evolution of Hybrid Solver-Augmented Heuristics for Time-Critical Mathematical Optimization
Sep 28, 2026Feijie Wu, Hugo Barbalho, Konstantina Mellou +5Automated Heuristic Design Heuristics
Purdue University · Microsoft Research
Learned Preconditioning for a Primal-Dual Interior-Point Method
Sep 28, 2026Abhinav Madabhushi, Jialin Liu, Minxin ZhangPrimal-Dual Methods Spectral Preconditioning
Department of Mathematics, University of California, Los Angeles · School of Data, Mathematical, and Statistical Sciences, University of Central Florida
Efficient Reasoning via Constrained Optimization in Latent Space
Sep 28, 2026Zhinan Hou, XingChen Li, Keyou YouLarge Reasoning Models Reasoning Traces
Tsinghua University
GenOR-Twin: A Semantic Middleware for Integrating Operational Discourse with Mathematical Optimization
Sep 14, 2026Rahimeh Neamatian Monemi, Shahin Gelareh, Lubin Cui +1Orchestration Twins
Sharkey Predictim Globe · Département R&T, IUT de Béthune, Université d’Artois, F-62000 Béthune, France · Federal University of Rio de Janeiro, COPPE-PESC, P.O. Box 68511, Rio de Janeiro, RJ 21941-972, Brazil +1
Constrained Graph Diffusion for Mixed Integer Optimization
Aug 13, 2026Vincenzo Di Vito, Yusuf Guven, Babak Badnava +3Mixed-Integer Programming Constrained Optimization
University of Virginia · MIT · Los Alamos National Laboratory
Basin: Efficient and Extensible Numerical Optimization in Rust
Aug 11, 2026Johan LarssonBasin Constrained Optimization
Department of Mathematical Sciences, University of Copenhagen, Denmark
Generative Optimization for Incentivized Advertising with Global Level Constraints
Aug 5, 2026Gege Chen, Ning Luo, Hao Jiang +7Ads Incentives
University of Electronic Science and Technology of China · Kuaishou Technology
Optimization with Dynamic Constraint Learning (DCL)
Jul 28, 2026Ezgi Oztekin, Figen Oztoprak, S. Ilker BirbilConstrained Optimization Uncoupled Learning
Department of Mathematics, Gebze Technical University · Department of Industrial Engineering, Gebze Technical University · Amsterdam Business School, University of Amsterdam
Soft-Constrained Optimization of Latent Space in Variational Autoencoders
Jul 26, 2026Ye ShiConditional Variational Autoencoder Latent Variable
Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, 47906 USA
A Multi-stage Constrained Optimization Framework for Data-driven Problems
Jul 26, 2026Ye ShiConstrained Optimization Conditional Variational Autoencoder
Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA
Constraint-Bound Agnostic Bayesian Optimization: One Model for All Thresholds
Jul 26, 2026Jin Wang, Xi Lin, Handing WangBayesian Optimization Constrained Optimization
School of Artificial Intelligence, Xidian University, China · School of Mathematics and Statistics, Xi’an Jiaotong University, China
Hybrid Augmented Lagrangian Method for General Constrained Optimization via Evolutionary Algorithms
Jul 18, 2026Lampros Printzios, Konstantinos ChatzilygeroudisConstrained Optimization Genetic Algorithms
Laboratory of Automation & Robotics (LAR), Department of Electrical & Computer Engineering, University of Patras, University Campus, Patras, GR-26504, Achaia, Greece
Structure-Feature Aligned Graph Learning via Alternating Constrained Optimization
Jul 13, 2026Chengcheng Yan, Qingsong WangGraph Neural Networks Sparse Spatial Anchors
College of Artificial Intelligence, Shaoxing Institute of Technology, Shaoxing, 312000, China. · School of Mathematics and Computational Science, Xiangtan University, Xiangtan, 411105, China.
A Mathematical Optimization Approach for Expert-Informed Bayesian Best Subset Selection
Jun 28, 2026Nolan Alexander, Henning MortveitModel Selection Probability
Systems and Information Engineering University of Virginia
DE-2LS: Differential Evolution with Lightweight Late Local Search for Constrained Numerical Optimization
Jun 26, 2026Dikshit Chauhan, Anupam TrivediLarge Neighborhood Search Constrained Optimization
Department of Electrical and Computer Engineering, National University of Singapore
DE-2LS: Differential Evolution with Late-Stage local-search for Unconstrained Single-Objective Numerical Optimization
Jun 26, 2026Dikshit ChauhanLarge Neighborhood Search Constrained Optimization
Department of Electrical and Computer Engineering, National University of Singapore
PSyGenTAB: A Privacy-Preserving Framework for Synthetic Clinical Tabular Data Generation via Constrained Optimization
Jun 16, 2026Arshia Ilaty, Hossein Shirazi, Manasi Chitale +5Synthetic Tabular Data Privacy-Preserving Framework
San Diego State University, San Diego, CA 92182 USA. · University of California, Irvine, CA 92697 USA.
LearnOpt: Recovering the Latent Cognitive Structure of Standardized Examinations via Knowledge Graphs and Constrained Optimization
Jun 13, 2026Joy Bose, Om ThomasLearn Assessment
Independent Researchers Bengaluru, India
Learning What to Remember: Observability-Safe Memory Retention via Constrained Optimization for Long-Horizon Language Agents
Jun 9, 2026Qingcan Kang, Liu Mingyang, Shixiong Kai +3Long-Horizon Agents Partial Observability
Department of Industrial Engineering and Decision Analytics, Hong Kong University of Science and Technology · Department of Computer Science, City University of Hong Kong · Huawei Noah’s Ark Lab
Multi-ResNets for Subspace Preconditioning in Constrained Optimization
Jun 4, 2026Merve Karakas, Christopher J. Williams, Emmanuel O. Balogun +3Constrained Optimization Residual Networks
UCLA · University of Oxford · Sunrun† +1
Optuna Constrained Tree-Structured Parzen Estimator Is a Joint Density Generalization of c-TPE
Jun 3, 2026Shuhei Watanabe, Kaichi IrieGeneral Grid Search Framework Constrained Optimization
Independent Researcher · Kyoto University
Unlearning in Diffusion Models: A Unified Framework with KL Divergence and Likelihood Constraints
May 29, 2026Shervin Khalafi, Alejandro Ribeiro, Dongsheng DingDiffusion Models Kullback-Leibler Divergence
University of Pennsylvania · University of Tennessee, Knoxville
Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design
May 28, 2026Sven Gutjahr, Riccardo De Santi, Luca Schaufelberger +2Molecular Design Generative Flow Networks
Department of Computer Science, ETH Zurich · ETH AI Center · NCCR Catalysis, Switzerland +1
REST3D: Reconstructing Physically Stable 3D Scenes from a Single Image
May 28, 2026Xiaoxuan Ma, Jiashun Wang, Nicolas Ugrinovic +23D Scene Generation 3D Generation
Carnegie Mellon University
FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation
May 28, 2026Zehao Wang, Guanglei Yang, Yihan Zeng +4Multi-Lora Smoothing
1Harbin Institute of Technology · 2Huawei Noah’s Ark Lab · University College Dublin
Constrained Bayesian Experimental Design via Online Planning
May 26, 2026Yujia Guo, Daolang Huang, Xinyu Zhang +3Bayesian Experimental Design Constrained Optimization
ELLIS Institute Finland · Department of Computer Science, Aalto University, Finland · Department of Computer Science, University of Manchester, UK
Blocked Gibbs meets Diffusion Transformers: Unsupervised Learning for Constraint Optimization
May 24, 2026Yudong W. Xu, Wenhao Li, Xiaoyu Wang +2Constraint Satisfaction Diffusion Transformers
University of Toronto · Vector Institute
Time-Dependent PDE-Constrained Optimization via Weak-Form Latent Dynamics
May 20, 2026April Tran, Terry Haut, David Bortz +1Partial Differential Equations Constrained Optimization
Department of Applied Mathematics, University of Colorado, Boulder, CO, 80309, USA · Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, Livermore, 94550, CA, USA
Transforming Constraint Programs to Input for Local Search
May 19, 2026Jo Devriendt, Patrick De Causmaecker, Marc DeneckerLarge Neighborhood Search Constraint Satisfaction
University of Leuven
A Family of Quaternion-Valued Differential Evolution Algorithms for Numerical Function Optimization
May 12, 2026Gerardo Altamirano-Gomez, Álvaro Gallardo, Carlos Ignacio Hernández CastellanosConstrained Optimization Bio-Inspired Framework
Instituto de Investigaciones en Matem´aticas Aplicadas y Sistemas, Universidad Nacional Aut´onoma de M´exico, M´exico · Universidad Iberoamericana, M´exico
Augmented Lagrangian Method for Last-Iterate Convergence for Constrained MDPs
May 12, 2026Michael Lu, Max Qiushi Lin, Mo Chen +1Markov Decision Processes Constrained Optimization
Simon Fraser University
GAR: Carbon-Aware Routing for LLM Inference via Constrained Optimization
May 12, 2026Disha Sheshanarayana, Rajat Subhra Pal, Manjira Sinha +1LLM Inference Optimization Greenhouse Gas
Manipal University Jaipur · TCS Research
Network-Based Interventions for HIV Prevention via Cascade-Aware Suppression of Transmission
May 11, 2026Akseli Kangaslahti, Davin Choo, Milind Tambe +2Sirus Maximum Independent Set
Harvard University · University of Witwatersrand · Wits Health Consortium +1
Broximal Gradient Descent: A Projection-Free Sister of Projected Gradient Descent
May 9, 2026Peter Richtárik, Kaja Gruntkowska, Hanmin LiNonconvex Constrained Optimization
King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
Matrix-Valued Optimism is Matrix-Valued Augmentation: Additive Hybrid Designs for Constrained Optimization
May 7, 2026Jiayi ZhaoPrimal-Dual Methods Constrained Optimization
University of Washington Seattle, WA, USA
Position: LLM Serving Needs Mathematical Optimization and Algorithmic Foundations, Not Just Heuristics
May 2, 2026Zijie ZhouLarge Language Model Serving LLM Inference Optimization
Department of Industrial Engineering and Decision Analytics, HKUST
On The Mathematics of the Natural Physics of Optimization
Apr 19, 2026I. M. RossConstrained Optimization Optimal Control
Department of Mechanical and Aerospace Engineering, Naval Postgraduate School, Monterey, CA
A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo
Apr 19, 2026S. Gratton, Ph. L. TointStochastic Convex Optimization Convergence
Université de Toulouse, INP, IRIT, Toulouse, France. · Université de Toulouse, INP, IRIT, Toulouse, France, and NAXYS, University of Namur, Namur, Belgium.
Joint Surrogate Learning of Objectives, Constraints, and Sensitivities for Efficient Multi-objective Optimization of Neural Dynamical Systems
Mar 22, 2026Frithjof Gressmann, Ivan Georgiev Raikov, Seung Hyun Kim +3Surrogate Gradient Neural Network Optimization
Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign, Urbana, IL · The Grainer College of Engineering, University of Illinois Urbana-Champaign, Urbana, IL · Department of Neurosurgery, Stanford University, Stanford, CA +3
A Constrained Optimization Perspective of Unrolled Transformers
Jan 24, 2026Javier Porras-Valenzuela, Samar Hadou, Alejandro RibeiroTransformer Architectures Constrained Optimization
Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA, United States of America.
Decoupling Constraints from Two Directions for Evolutionary Constrained Multi-objective Optimization
Dec 30, 2025Ruiqing Sun, Dawei Feng, Xing Zhou +6Multi-Objective Optimization Constrained Optimization
College of Computer Science and Technology, National University of Defense Technology, Changsha 410000, P.R. China · College of Intelligence Science and Technology, National University of Defense Technology, Changsha, 410000, P.R. China · State Key Laboratory of Complex & Critical Software Environment, College of Information and Communication, National University of Defense Technology, Wuhan 430019, P.R. China +1
Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion
Date pendingRunyu Zhang, Jiawei Zhang, Gioele Zardini +2Wasserstein Gradient Flows Diffusion Models
MIT · University of Wisconsin–Madison

Oct 6, 2026, cs.LGJ/K move · Enter open · S save

ORACLE: Optimizer-Relative Alignment for Constrained LEarning

Utkarsh Grover, Wyatt Mackey, Kaixun Hua, J. Morris Chang+1

Constrained Optimization

Open paper AskPDF arXiv

Constraint handling methods typically intervene before the optimizer acts, by modifying the objective or the gradient. Yet momentum, adaptive scaling, and structured preconditioning can substantially reshape that signal before it becomes a parameter update. We formulate optimizer relative constrained learning, where constraint compatibility is assessed on the post optimizer update. Building on this view, we introduce ORACLE, which evaluates the native optimizer's realized step through a joint endpoint linearization of heterogeneous constraint families, constructs the resulting alignment in the optimizer's own geometry, bounds its authority, and commits it only after validation. We evaluate ORACLE across eight Partial Differential Equation benchmarks and four optimizers spanning Euclidean, diagonal adaptive, and structured preconditioned geometries, where it improves or matches native optimizer in 94% of configurations. Cross model analysis shows the same behavior in 92% of configurations, while matched comparisons show improvements over alternative constraint-handling methods acting at the objective, gradient, and post-optimizer levels.

Momentum

Related topics

Latest papers 44