Overview

Bilevel optimization models decisions in two levels: an outer problem evaluates choices using the solution of an inner problem, as in hyperparameter tuning, data selection, meta-learning, and neural architecture search. Common approaches differentiate through inner optimization using unrolling or implicit hypergradients, while single-loop stochastic, penalty-based, and derivative-free methods aim to reduce computation and handle larger or black-box problems. Applications also use the framework for decision-focused learning, reinforcement learning, and strategic settings where one agent responds to another. A central challenge is making these methods efficient and reliable when the inner problem is nonconvex or has multiple solutions, while establishing useful convergence and generalization guarantees without restrictive assumptions.

Latest papers

CardsList

96 papers10 papers in the last four weeks, down 23% on the four weeks before. 0.1% of all new papers.

  1. SGHA: A Single-Loop Fully First-Order Algorithm for Nonconvex-Strongly-Convex Bilevel Optimization

    Aug 24, 2026Zhihao Gu, Qilong Wu, Junchi YangStochastic Bilevel OptimizationBilevel Optimization

  2. Designing Compact Neural Architectures via Neuron Gating and Mixed Activation

    Aug 14, 2026Abhishek Shukla, Ankur Sinha, Faiz HamidNeural Architecture SearchBilevel Optimization

  3. Efficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Level

    Aug 13, 2026Yicong Jiang, Feihu HuangBilevel Optimization

  4. Learning with Bilevel-Minimax Optimization for Efficient and Reliable Transfer Attacks

    Aug 12, 2026Yaohua Liu, Yifan Guo, Jiaxin GaoBilevel OptimizationTransfer-Based Adversarial Attacks

  5. Efficient Hypergradient Descent for Inverse Reinforcement Learning

    Aug 11, 2026Nikita Sevriukov, Anna Barabanova, Uliana Gagarina +4Reinforcement LearningGradient Descent

  6. Beyond Post-Hoc Temperature Scaling: Bilevel Optimization for LLM Calibration

    Aug 7, 2026Ruochen Jin, Zhanliang Wang, Zongyu Dai +2LLM Fine-TuningLanguage Model Calibration

  7. Exploiting Separability in Multi-Scale Grey-Box Bayesian Optimization

    Aug 4, 2026Joshua E. Hammond, Tyler A. Soderstrom, Brian A. Korgel +1Bayesian OptimizationBilevel Optimization

  8. Hypergradient-based Bilevel Reinforcement Learning with Improved Sample Complexity

    Jul 30, 2026Naman Saxena, Mudit Gaur, Vaneet AggarwalReinforcement LearningHypergradient Optimization

  9. SpecAHD: Localize to Specialize for Automated Heuristic Design in Large-Scale Routing Problems

    Jul 26, 2026Kezhao Lai, Yutao Lai, Hai-Lin LiuAutomated Heuristic DesignLarge Language Model-Guided Optimization

  10. Sharper Analysis of Single-Loop Methods for Bilevel Optimization

    Jul 11, 2026Yubo Zhou, Jun Shu, Luo Luo +4Implicit DifferentiationOptimization Convergence Analysis

  11. Directly Optimizing Mean Demographic Parity for Nonlinear Regression

    Jul 6, 2026Ieva Petrulionyte, Julien Mairal, Michael ArbelAlgorithmic FairnessGroup Fairness

  12. Domain Adaptive Object Detection via Dual-Stream Bilevel-Cycle Optimization

    Jun 30, 2026Yannan Chen, Wei Wang, Wenqiang Wang +5Unsupervised Domain AdaptationSelf-Training

  13. Bilevel Optimization for Neural Architecture Search

    Jun 28, 2026Abhishek Shukla, Ankur Sinha, Faiz HamidBilevel OptimizationNeural Architecture Search

  14. Agentic AI for Bilevel Long-Term Optimization of Policy-Driven Physical Layer Systems

    Jun 23, 2026Bingnan Xiao, Chenhao Yang, Wei Ni +2Wireless CommunicationsBilevel Optimization

  15. Constrained Variable Projection for Structured Problems

    Jun 22, 2026Emanuele Zangrando, Sara Venturini, Francesco Rinaldi +1Bilevel OptimizationConstrained Optimization

  16. Distribution-Aware Robust Bilevel Optimization: Quantile-Guided Huber Updates in Two-Timescale Stochastic Approximation

    Jun 21, 2026Zhiyu Li, Xi Xuan, Davide CarboneStochastic OptimizationStochastic Approximation

  17. Escaping the Variance Trap: Jacobian-Free Dynamics for Root-Finding Bilevel Optimization

    Jun 21, 2026Zhiyu Li, Xi Xuan, Davide CarboneStochastic ApproximationBilevel Optimization

  18. DUET: Decentralized Bilevel Optimization without Lower-Level Strong Convexity

    Jun 19, 2026Zhen Qin, Zhuqing Liu, Songtao Lu +2Bilevel OptimizationDecentralized Optimization

  19. Federated Bilevel Performative Prediction

    Jun 18, 2026Liangxin Qian, Chang Liu, Xuanyu Cao +2Bilevel OptimizationPerformative Prediction

  20. Mixed-Categorical Black-Box Optimization via Information-Geometric Bilevel Decomposition

    Jun 11, 2026Marc Ong, Shinichi Shirakawa, Youhei AkimotoBlack-Box OptimizationBilevel Optimization

  21. Gradient based Bilevel for Inverse Optimal Control, a Riemannian approach

    Jun 9, 2026Ahmed-Manaf Dahmani, Vincent Bonnet, David Daney +1Bilevel OptimizationOptimal Control

  22. TANDEM: Bi-Level Data Mixture Optimization with Twin Networks

    Jun 3, 2026Jiaxing Wang, Deping Xiang, Jin Xu +9Bilevel OptimizationData Mixture Optimization

  23. On the Difficulty of Learning a Meta-network for Training Data Selection

    May 30, 2026Zilin Du, Junqi Zhao, Boyang Albert LiMeta-LearningTraining Data Selection

  24. S3^3LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization

    May 29, 2026Chao Yin, Youran Dong, Shiqian Ma +2Multi-Agent System OptimizationBilevel Optimization

  25. Adversarial Training for Robust Coverage Network under Worst-case Facility Losses

    May 26, 2026Changhao Miao, Yuntian Zhang, Tongyu Wu +2Adversarial TrainingCombinatorial Optimization

  26. Bilevel Optimization over Saddle Points of Zero-Sum Markov Games

    May 26, 2026Zihao Zheng, Irwin King, Songtao LuGame TheoryZero-Sum Games

  27. Bilevel Optimization of Synthetic Trajectories for Multi-Turn LLM Fine-Tuning

    May 23, 2026Shresth Verma, Mauricio Tec, Cheol Woo Kim +2Synthetic Data AugmentationOffline RL

  28. RL with Learnable Textual Feedback: A Bilevel Approach

    May 23, 2026Utsav Singh, Sidhaarth Sredharan, Souradip Chakraborty +1Reinforcement LearningRL for Language Model Reasoning

  29. Parametric Rates for Nonparametric Conditional-Moment Bilevel Optimization

    May 20, 2026Fares El Khoury, Houssam Zenati, Nathan Kallus +2Semiparametric InferenceHypergradient Optimization