cs.LGOct 6, 2026

ORACLE: Optimizer-Relative Alignment for Constrained LEarning

Authors: Utkarsh Grover, Wyatt Mackey, Kaixun Hua, J. Morris Chang, Xiaomin Lin

Abstract

Constraint handling methods typically intervene before the optimizer acts, by modifying the objective or the gradient. Yet momentum, adaptive scaling, and structured preconditioning can substantially reshape that signal before it becomes a parameter update. We formulate optimizer relative constrained learning, where constraint compatibility is assessed on the post optimizer update. Building on this view, we introduce ORACLE, which evaluates the native optimizer's realized step through a joint endpoint linearization of heterogeneous constraint families, constructs the resulting alignment in the optimizer's own geometry, bounds its authority, and commits it only after validation. We evaluate ORACLE across eight Partial Differential Equation benchmarks and four optimizers spanning Euclidean, diagonal adaptive, and structured preconditioned geometries, where it improves or matches native optimizer in 94% of configurations. Cross model analysis shows the same behavior in 92% of configurations, while matched comparisons show improvements over alternative constraint-handling methods acting at the objective, gradient, and post-optimizer levels.

Explore similar work

CardsList
  1. Optimization with Dynamic Constraint Learning (DCL)

    Jul 28, 2026Ezgi Oztekin, Figen Oztoprak, S. Ilker BirbilConstrained OptimizationUncoupled Learning

  2. ORCA: The Annealed Spectral Conditioning Optimizer for Faster, Better LLM Training

    Oct 5, 2026Yuanshi Liu, Boyuan Jiang, Liang Hou +4

  3. Meta-Learning-Assisted Constraint Relaxation for Constrained Black-Box Optimization

    Jan 31, 2026Sijie Ma, Zeyuan Ma, Yue-Jiao Gong +1Black-Box OptimizationMeta-Learning