math.OCApr 9, 2026

Density-Driven Optimal Control: Convergence Guarantees for Stochastic LTI Multi-Agent Systems

Authors: Kooktae Lee

Organizations: Department of Mechanical Engineering, New Mexico Institute of Mining and Technology, Socorro, NM 87801, USA

Abstract

This paper addresses the decentralized non-uniform area coverage problem for multi-agent systems, a critical task in missions with high spatial priority and resource constraints. While existing density-based methods often rely on computationally heavy Eulerian PDE solvers or heuristic planning, we propose Stochastic Density-Driven Optimal Control (D2^2OC). This is a rigorous Lagrangian framework that bridges the gap between individual agent dynamics and collective distribution matching. By formulating a stochastic MPC-like problem that minimizes the Wasserstein distance as a running cost, our approach ensures that the time-averaged empirical distribution converges to a non-parametric target density under stochastic LTI dynamics. A key contribution is the formal convergence guarantee established via reachability analysis, providing a bounded tracking error even in the presence of process and measurement noise. Numerical results verify that Stochastic D2^2OC achieves robust, decentralized coverage while outperforming previous heuristic methods in optimality and consistency.

Figures & tables

Explore similar work

CardsList
  1. Nonlinear Density-Driven Optimal Control (D2OC) for Multi-Agent Spatial Coverage via Sequential Convex Programming

    Oct 3, 2026Julian Martinez, Kooktae LeeMulti-Agent ControlOptimal Control

  2. Computationally Efficient Density-Driven Optimal Control via Analytical KKT Reduction and Contractive MPC

    Mar 19, 2026Julian Martinez, Kooktae LeeMulti-Agent ControlOptimal Control

  3. Density-Driven Area Coverage for Nonholonomic Multi-Robot Systems with Safety Guarantee

    Sep 19, 2026Julian Martinez, Kooktae LeeRobotic ControlMulti-Robot Systems