cs.LGSep 27, 2025

Continuous-Time Reinforcement Learning for Asset-Liability Management

Authors: Yilie Huang

Organizations: Department of Industrial Engineering and Operations Research, Columbia University New York, New York, USA

Abstract

This paper proposes a novel approach for Asset-Liability Management (ALM) by employing continuous-time Reinforcement Learning (RL) with a linear-quadratic (LQ) formulation that incorporates both interim and terminal objectives. We develop a model-free, policy gradient-based soft actor-critic algorithm tailored to ALM for dynamically synchronizing assets and liabilities. To ensure an effective balance between exploration and exploitation with minimal tuning, we introduce adaptive exploration for the actor and scheduled exploration for the critic. Our empirical study evaluates this approach against two enhanced traditional financial strategies, a model-based continuous-time RL method, and three state-of-the-art RL algorithms. Evaluated across 200 randomized market scenarios, our method achieves higher average rewards than all alternative strategies, with rapid initial gains and sustained superior performance. The outperformance stems not from complex neural networks or improved parameter estimation, but from directly learning the optimal ALM strategy without learning the environment.

Figures & tables

Explore similar work

CardsList
  1. Mean--Variance Portfolio Selection by Continuous-Time Reinforcement Learning: Algorithms, Regret Analysis, and Empirical Study

    Dec 8, 2024Yilie Huang, Yanwei Jia, Xun Yu ZhouPortfolio OptimizationQuantitative Finance

  2. AlphaPareto: Formulaic Alpha Discovery with LLM-Guided Multi-Objective Reinforcement Learning

    Sep 28, 2026Yingbo Zhao, Zeyu Yang, Zhoufan ZhuMulti-Objective Reinforcement LearningNon-Stationary RL

  3. Data-Driven Exploration for a Class of Continuous-Time Indefinite Linear--Quadratic Reinforcement Learning Problems

    Jul 1, 2025Yilie Huang, Xun Yu ZhouRL ControlContinuous-Time RL