Optimal Control

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 96

All topics

Deterministic Policy Gradient for Learning Equilibrium in Time-Inconsistent Control Problems
Jun 10, 2026Xin Guo, Yijie Huang, Xiang YuPolicy Gradient Stochastic Optimal Control
Department of Industrial Engineering and Operations Research, University of California, Berkeley, USA. · Department of Applied Mathematics, The Hong Kong Polytechnic University, Kowloon, Hong Kong.
Gradient based Bilevel for Inverse Optimal Control, a Riemannian approach
Jun 9, 2026Ahmed-Manaf Dahmani, Vincent Bonnet, David Daney +1Bilevel Optimization Optimal Control
INRIA Bordeaux, Universit´e de Bordeaux, Talence, France · INRIA Nancy, Universit´e de Lorraine, Villers-l`es-Nancy, France · LAAS-CNRS, Universit´e de Toulouse, CNRS, Toulouse, France
Bayesian Optimization for Learning Nonlinear MPC in Autonomous Agent Navigation
Jun 8, 2026Lorenzo Ortolani, Gabriel Voss, Gabriele Beltrami +2Constrained Motion Planning Nonlinear MPC
Talos Robotics AI Milan, Italy
Families of Control-Cost-Parametrized Inverse-Optimal Universal Stabilizers
Jun 8, 2026Miroslav Krstic, Luke BhanFeedback Control Optimal Control
Department of Mechanical and Aerospace Engineering, University of California San Diego, La Jolla, CA 92093-0411, USA · Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA 92093-0411, USA
Optimal Control Approach for Non-prehensile Ball Juggling Using a 7-DoF Manipulator
Jun 4, 2026Joel Ramadani, Vasilije Rakčević, Riddhiman Laha +4Contact-Rich Manipulation Non-Prehensile Manipulation
Technical University of Munich · Technical University of Munich, Munich, Germany. · DLR Oberpfaffenhofen +3
Amortized Nonlinear Model Predictive Control
Jun 4, 2026Francesco Pillitteri, Alberto BemporadRobotic Control Nonlinear MPC
IMT School for Advanced Studies, Lucca, Italy
Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Control
Jun 3, 2026Jihoon Hong, Alice Chan, Qiyue Dai +2Text-to-Video Generation Video Generation
Georgia Institute of Technology Atlanta, GA 30308
When Mean Age Is Not Enough: Distribution-Aware Scheduling for Networked LQR Control
Jun 3, 2026Abdullah Y. Etcibasi, C. Emre Koksal, Eylem EkiciAge of Information Feedback Control
Department of Electrical and Computer Engineering, The Ohio State University, Columbus, OH 43210, USA.
Global Convergence of a Line-Search Filter Differential Dynamic Programming Method
May 31, 2026Ming Xu, Iman ShamesOptimization Convergence Analysis Constrained Optimization
School of Computer and Communication Sciences EPFL 1015 Lasanne, Switzerland · Department of Electrical and Electronic Engineering University of Melbourne Parkville, VIC, 3010, Australia
Time-Optimal Collision Avoidance Via a Greedy Polynomial Backward Sweep
May 31, 2026Zeno Pavanello, Frank De Veld, Roberto ArmellinCollision Avoidance Trajectory Optimization
Department of Aerospace Science and Technology (DAER), Politecnico di Milano, via Privata Giuseppe La Masa 34, Milano, 20156, Italy · Netherlands Aerospace Centre (NLR), Anthony Fokkerweg 2, Amsterdam, 1059 CM, The Netherlands · Te Pūnaha ¯Atea Auckland - Space Institute (TPA-SI), The University of Auckland, 20 Symonds Street, Auckland, 1010, New Zealand
Prospect-Theory Behavior from Bellman Optimality in MDPs with Catastrophic States
May 31, 2026Yujiao ChenMarkov Decision Processes Stochastic Optimal Control
Massachusetts Institute of Technology · Cambridge, MA 02139, USA
Beyond Pure Sampling: Hybrid Optimization Mechanisms for Non-Convex Model Predictive Control
May 30, 2026Yuichiro Aoyama, Minchan Jung, Akash Ratheesh +1Nonlinear MPC Optimal Control
School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, USA · Development Division, Komatsu Ltd., Tokyo, Japan · Department of Electrical and Computer Engineering, Inha University, Incheon, Republic of Korea
OptiWorld: Optimal Control for Video World Generation under Physical Constraints
May 30, 2026Yu Yuan, Jianhao Yuan, Xijun Wang +4Physical Consistency in Video Generation Image-to-Video Generation
Purdue University · University of Oxford · SixteenMiles Labs
Predicted-Flow Control Barrier Functions for Real-Time Safe Optimal Control
May 29, 2026Amirsaeid Safari, Jesse B. HoaggSafety-Critical Control Control Barrier Functions
Department of Mechanical and Aerospace Engineering, University of Kentucky, Lexington, KY 40506 USA
Adaptive Reinforcement Learning for Robust Open Quantum System Control: A Multi-Task Framework with Temporal Optimization
May 26, 2026Haftu W. Fentaw, Steve Campbell, Simon CatonRL Control Multi-Task RL
School of Computer Science, University College Dublin, Belfield, Dublin 4, Dublin, Ireland. · Centre for Quantum Engineering, Science, and Technology, University College Dublin, Belfield, Dublin 4, Dublin, Ireland. · School of Physics, University College Dublin, Belfield, Dublin 4, Dublin, Ireland.
Sample Complexity of Policy Gradient for Log-Growth Control
May 26, 2026Qiuhua Pan, Yukai Shen, Liwei Zhang +2Stochastic Linear Dynamical Systems Stochastic Optimal Control
State Key Laboratory of Submarine Geoscience, School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China · Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai 200240, China · Shanghai Key Laboratory of Perception and Control in Industrial Network Systems, Shanghai 200240, China +1
Real-Time Auto-Optimization in Unknown Environments via Structure-Exploiting Dual Control for Exploration and Exploitation
May 21, 2026Shiying Dong, Haoyang Yang, Qiwei Liu +1Second-Order Optimization Optimal Control
Department of Aeronautical and Aviation Engineering and Research Centre for Low Altitude Economy (RCLAE), the Hong Kong Polytechnic University, Hong Kong, China
Chebyshev Policies and the Mountain Car Problem: Reinforcement Learning for Low-Dimensional Control Tasks
May 21, 2026Stefan Huber, Hannes Unger, Georg Schäfer +1RL Control Policy Optimization
Josef Ressel Centre for Intelligent and Secure Industrial Automation, University of Applied Sciences, Salzburg, Austria
Noise Schedule Design for Diffusion Models: An Optimal Control Perspective
May 21, 2026Seo Taek Kong, Weina Wang, R. SrikantDiffusion Sampling Diffusion-Based Image Generation
ECE & CSL University of Illinois Urbana-Champaign · Computer Science Department Carnegie Mellon University · ECE, CSL & NCSA University of Illinois Urbana-Champaign
Zero-shot adaptation to order book dynamics
May 20, 2026Arip AsadulaevSequential Decision Making Stochastic Optimal Control
Beyond the Bellman Recursion: A Pontryagin-Guided Framework for Non-Exponential Discounting
May 20, 2026Hojin Ko, Jeonggyu HuhReinforcement Learning Stochastic Optimal Control
Department of Mathematics, Sungkyunkwan University, Suwon, Republic of Korea
Transformer-like Inference from Optimal Control
May 15, 2026Aditya Kudre, Heng-Sheng Chang, Prashant G. MehtaTransformer Inference Decoder-Only Language Models
Coordinated Science Laboratory · Electrical and Computer Engineering · University of Illinois Urbana-Champaign +1
Language Generation as Optimal Control: Closed-Loop Diffusion in Latent Control Space
May 14, 2026ZiYi Dong, Yuliang Huang, Weijian Deng +3Language Model-Based Control Stochastic Optimal Control
Sun Yat-sen University, Guangzhou, Guangdong, China · Australian National University, Canberra, ACT, Australia · Tsinghua University, Beijing, China
Mutual Information Optimal Density Control of Linear Systems and Generalized Schrödinger Bridges with Reference Refinement
May 10, 2026Shoju Enami, Kenji KashimaStochastic Optimal Control Schrödinger Bridges
Graduate School of Informatics, Kyoto University, Kyoto, Japan
SHIELD: Scalable Optimal Control with Certification using Duality and Convexity
May 9, 2026Hansung Kim, Siddharth H. Nair, Francesco BorrelliPrimal-Dual Optimization Model Predictive Control
Model Predictive Control Laboratory, UC Berkeley · Nextracker Inc.
IMPACT: An Implicit Active-Set Augmented Lagrangian for Fast Contact-Implicit Trajectory Optimization
May 9, 2026Jiayun Li, Dejian Gong, Georgia ChalvatzakiConstrained Motion Planning Trajectory Optimization
1PEARL Lab, Dept. of Computer Science, TU Darmstadt, Germany · 2Hessian.AI, Darmstadt, Germany · 3Robotics Institute Germany (RIG)
Interactive Trajectory Planning with Learning-based Distributionally Robust Model Predictive Control and Markov Systems
May 8, 2026Erik Börve, Nikolce Murgovski, Morteza Haghir Chehreghani +1Distributionally Robust Optimization Model Predictive Control
Chalmers University of Technology, Chalmersgatan 4, 412 96 Göteborg, Sweden · Volvo Group Trucks Technology, Gropegårdsgatan 2, 417 15 Göteborg, Sweden
SNAPO: Smooth Neural Adjoint Policy Optimization for Optimal Control via Differentiable Simulation
May 7, 2026Dmitri Goloubentsev, Natalija KarpichinaPolicy Optimization Differentiable Programming
MatLogica, U.K.
On the Emergence of Pendular Structure in Multi-Contact Locomotion
May 7, 2026Lingxue Lyu, Zihui LiuLegged Robotics Trajectory Optimization
School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104, USA · Department of Aeronautics & Astronautics, Stanford University, Stanford, CA 94305, USA
Maximal Controlled Invariant-MPC: Enhancing Feasibility and Reducing Conservatism through Terminal CBF Constraint in Safety-Critical Control
May 7, 2026Tanmay Dokania, Yashwanth Kumar NakkaDynamical Systems Safety-Critical Control
Graduate Student, Daniel Guggenheim School of Aerospace Engineering. · Assistant Professor, Director, Aerospace Robotics Lab, Daniel Guggenheim School of Aerospace Engineering.

Jun 10, 2026, q-fin.CPJ/K move · Enter open · S save

Deterministic Policy Gradient for Learning Equilibrium in Time-Inconsistent Control Problems

Xin Guo, Yijie Huang, Xiang Yu

Department of Industrial Engineering and Operations Research, University of California, Berkeley, USA. · Department of Applied Mathematics, The Hong Kong Polytechnic University, Kowloon, Hong Kong.

Policy Gradient Stochastic Optimal Control Continuous-Time RL Model-Free RL Deep Deterministic Policy Gradient Policy Learning+1

Open paper AskPDF arXiv

In this paper, we develop a continuous-time model-free reinforcement learning algorithm to learn deterministic equilibrium policies in general time-inconsistent control problems. Utilizing the extended Hamilton-Jacobi-Bellman system, we recast the original time-inconsistent problem into an equivalent two-stage problem. In the first stage, for given auxiliary functions, we employ the deterministic policy gradient approach to learn an optimal policy in an auxiliary time-consistent control problem. In the second stage, given the updated policy, we exploit the inner fixed point iterations and some martingale characterizations to learn the auxiliary functions. As a theoretical contribution, we provide some mild model assumptions and establish the convergence of inner fixed point iterations. By repeating this actor-critic style of iterations across two stages, our algorithm aims to learn the equilibrium under different sources of time-inconsistency in a unified manner. The superior effectiveness of the proposed algorithm are illustrated in two classical financial applications with time-inconsistency: mean-variance portfolio management and optimal tracking portfolio under non-exponential discounting.

Momentum

Related topics

Latest papers 96