Overview

Bilevel optimization models decisions in two levels: an outer problem evaluates choices using the solution of an inner problem, as in hyperparameter tuning, data selection, meta-learning, and neural architecture search. Common approaches differentiate through inner optimization using unrolling or implicit hypergradients, while single-loop stochastic, penalty-based, and derivative-free methods aim to reduce computation and handle larger or black-box problems. Applications also use the framework for decision-focused learning, reinforcement learning, and strategic settings where one agent responds to another. A central challenge is making these methods efficient and reliable when the inner problem is nonconvex or has multiple solutions, while establishing useful convergence and generalization guarantees without restrictive assumptions.

Latest papers

CardsList

96 papers10 papers in the last four weeks, down 23% on the four weeks before. 0.1% of all new papers.

  1. Your Hypergradient is Skewed: Antithetic Neumann Estimation for Bilevel Optimization

    Nov 11, 2026Jason Bohne, Pawel Polak, Gary Kazantsev +1Stochastic Bilevel OptimizationBilevel Optimization

  2. On Generalization in Bilevel Least Squares with Overparameterized Neural Networks

    Nov 7, 2026Fares El Khoury, Edouard Pauwels, Samuel Vaiter +1Bilevel OptimizationHypergradient Optimization

  3. Lower-Level Agnostic Bilevel Optimization

    Nov 6, 2026Peiwen Qiu, Prashant Khanduri, Jia LiuBilevel OptimizationHypergradient Optimization

  4. A Theoretical Analysis of a Bilevel Optimization Formulation for Combined Local-Global Optical Flow Models

    Nov 5, 2026El Mostafa KalmounOptical FlowBilevel Optimization

  5. A Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least Squares

    Nov 5, 2026Juntao Li, Qihang Guo, Deyuan MengSparse RecoveryDistributed Optimization

  6. Differentiable Iterative Learning Control for Black-Box Position-Commanded Manipulators

    Oct 31, 2026Mohammed Al-Ghaili, Yakoop Qasim, Hassan AlmubarakIterative Learning ControlRobot Trajectory Tracking

  7. Structure-Actuation Co-Design of All-Electric Heavy-Duty Robotic Manipulators

    Oct 27, 2026Mohammad Bahari, Amir Hossein Barjini, Jouni MattilaRoboticsRobotic Optimization

  8. Decentralized Bi-Level Optimization for Cooperative Orbital Transportation of a Rigid Payload

    Oct 22, 2026Sidhdharth D. Sikka, Revathy Ravuri, Hei Yin Jowett Chan +2Trajectory OptimizationMulti-Robot Cargo Transportation

  9. Newton-Based Methods for Bilevel Optimization Beyond Lower-Level Strong Convexity

    Oct 19, 2026Youran Dong, Junfeng Yang, Wei Yao +1Bilevel OptimizationSecond-Order Optimization

  10. Probabilistic Multi-Source Data Selection via Learnable Categorical Priors: Variance Reduction and Guaranteed Derandomization

    Oct 10, 2026Shizhan Cai, Qixin Zhang, Siyuan Ma +3Data SelectionBilevel Optimization

  11. A Single-Loop, Constant-Batch First-Order Penalty Method for Stochastic Bilevel Optimization

    Oct 5, 2026Xingyu Chen, Ming Yang, Quanqi Hu +1Stochastic Bilevel OptimizationBilevel Optimization

  12. Smoothed Gradient Method for Nonconvex Federated Stochastic Bilevel Optimization

    Oct 4, 2026Xinwen Zhang, Peiran Yu, Zhaosong Lu +1Gradient DescentNonconvex Stochastic Optimization

  13. Optimal Stochastic Bilevel Optimization with First-Order Oracles

    Oct 1, 2026Linxuan Pan, Junchi YangStochastic Bilevel OptimizationOracle Complexity

  14. Anchoring Adversarial Trajectories to Data Manifolds: A Bilevel Transfer Optimization Framework

    Sep 30, 2026Yaohua Liu, Yifan Guo, Jiaxin GaoAdversarial AttacksBilevel Optimization

  15. Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models

    Sep 29, 2026Zhenyu Wang, Tianze Wang, Linjun Zhang +1Language Model DistillationBilevel Optimization

  16. BRIDGE: Bilevel Retrieval-Credit-Aware Agentic Reinforcement Learning

    Sep 29, 2026Quan Xiao, Mingda Liu, Gaowen Liu +2Reinforcement LearningAgentic RAG

  17. Learning the Robustness Mechanism with Bilevel Optimization

    Sep 28, 2026Yiyang Shen, Qihang Lin, Weiran WangDistribution Shift RobustnessGroup Distributionally Robust Optimization

  18. Learning to Re-Draft: A Variational Stackelberg Game for Discrete Diffusion

    Sep 28, 2026Dmitrii Moor, Federico Tomasi, Paul N. Bennett +2Bilevel OptimizationMolecular Generation

  19. A Light Bilevel Refinement Aligns Self-Supervised Representations for Stronger Task-Specific Learning

    Sep 27, 2026Gustav Wagner Zakarias, Zheng-Hua TanFine-TuningBilevel Optimization

  20. ABO-Med: Accelerated Bilevel Optimization for Few-Shot Medical Image Classification

    Sep 27, 2026Ruoxuan Shi, Sheng Yang, Zhengxing Su +2Few-Shot LearningMeta-Learning

  21. To Solve Bilevel Optimization with Nonconvex Lower Levels, We Need Second-Order Stationarity

    Sep 24, 2026Zhiyao Zhang, Menglu Yu, Alvaro Velasquez +2Bilevel OptimizationSecond-Order Optimization

  22. Bilevel Optimization of Topology and Hyperparameters (BOTH)

    Sep 18, 2026Suryanarayanan Manoj Sanu, Miguel Anibal Bessa, Alejandro Marcos AragónHypergradient OptimizationTopology Optimization

  23. Decision-Focused Learning for Mean-Variance Portfolio Optimization via KKT-Based Reformulation

    Sep 18, 2026Kensei Nosaka, Shunnosuke Ikeda, Yuichi TakanoPortfolio OptimizationDecision-Focused Learning

  24. Federated stochastic bilevel optimization with fully first-order gradients

    Sep 14, 2026Yihan Zhang, Rohit Dhaipule, Chiu C Tan +2Stochastic OptimizationBilevel Optimization

  25. Stochastic Nonconvex Bilevel Optimization: Improved Rates Without Rare-Visit Assumption

    Sep 6, 2026Daniel Cortild, Mathias Staudigl, Juan Peypouquet +1Stochastic Bilevel OptimizationBilevel Optimization

  26. Disciplined Bilevel Programming

    Sep 1, 2026Hao Zhu, Joschka BoedeckerBilevel OptimizationConstrained Optimization