In this work, we developed a nonlinear model predictive control (NMPC) framework that employs learned dynamics via the Koopman Operator theory for mobile multi-robot navigation. We formulated and solved NMPC problems using a lifted bilinear Koopman-based model that accurately predicts affine input systems affected by perturbations and uncertainties. Two exemplary multi-robot navigation problems are considered: target reaching and formation control. The output of our method enables closed-loop multi-robot navigation and formation control in environments populated with obstacles, whereby the Koopman operator-based model used in the NMPC formulation addresses runtime uncertainties, namely, various degrees of random wheel slipping. We validated the effectiveness of our method for both problems via extensive numerical simulations in different environments with wheeled robots affected by different amounts of slip and without knowledge of their true dynamic models.
Figures & tables
Figure 1: Comparison of the Koopman-bilinear approximation with the exact differential-drive robot model without (left) and with (right) slip.
Figure 2: Qualitative results on target reaching in Map 1 for (left) nominal, (center) low-slip, and (right) high-slip settings. (Best viewed in color.)
Figure 3: Sample target-reaching trajectories in Map 2 for (left) low-slip and (right) high-slip cases. The nominal case is not depicted for brevity but resembles the low-slip case, as in Map 1 (cf. Fig. 2 ). (Best viewed in color.)
Map
Slip
SR
mean ± SD final distance [ ×10−2m ]
Robot 1
Robot 2
Robot 3
Map 1
Nominal
10/10
0.9
1.9
1.9
Low
9/10
3.1±0.7
2.7±0.1
6.6±4.1
High
8/10
1.9±1.5
2.7±0.2
6.6±1.9
Map 2
Nominal
10/10
2.8
1.8
2.3
Low
9/10
5.0±0.4
2.4±0.4
6.4±2.4
Table 1: Koopman-NMPC Statistics for Target Reaching.
Map
Slip
SR
mean ± SD final distance [ ×10−2m ]
Robot 1
Robot 2
Robot 3
Map 1
Nominal
10/10
1.8
1.5
15.6
Low
8/10
1.3±0.4
1.8±0.2
3.5±2.7
High
3/10
1.1±0.4
2.4±0.2
4.0±2.5
Map 2
Nominal
0/10
NaN
NaN
NaN
Low
1/10
2.4
0.5
3.4
Table 2: Nominal NMPC Statistics for Target Reaching.
Figure 4: Qualitative results on formation control in Map 3 for (left) nominal, (center) low-slip, and (right) high-slip settings. (Best viewed in color.)
Map
Slip
SR
mean ± SD final distance [ ×10−2m ]
Robot 1
Robot 2
Robot 3
Map 3
Nominal
10/10
0.9
1.9
1.9
Low
9/10
1.7±0.1
4.5±0.1
3.9±0.8
High
8/10
1.7±0.2
2.4±1.1
1.1±0.7
Map 4
Nominal
10/10
2.5
7.0
7.5
Low
8/10
2.6±0.0
8.4±0.0
9.6±4.0
Table 3: Koopman-NMPC Statistics for Formation Control.
Figure 5: Sample formation control trajectories in Map 4 for (left) low-slip and (right) high-slip cases. The nominal case is not depicted for brevity but resembles the low-slip case, as in Map 3 (cf. Fig. 4 ). (Best viewed in color.)
Map
Slip
SR
mean ± SD final distance [ ×10−2m ]
Robot 1
Robot 2
Robot 3
Map 3
Nominal
10/10
0.5
1.0
1.1
Low
0/10
NaN
NaN
NaN
High
0/10
NaN
NaN
NaN
Map 4
Nominal
10/10
1.7
4.1
3.8
Low
4/10
2.0±0.1
3.7±0.5
8.6±1.6
Table 4: Nominal NMPC Statistics for Formation Control.
Map
Slip
SR
mean ± SD final distance [ ×10−2m ]
Robot 1
Robot 2
Robot 3
Map 3
Nominal
10/10
4.1
76.3
45.1
Low
9/10
4.1
148.3±63.0
50.3±4.5
High
9/10
4.1
158.3±54.9
51.0±12.1
Map 4
Nominal
10/10
7.4
71.4
82.6
Low
10/10
7.4
69.5±0.8
113.2±66.2
Table 5: Consensus-based Statistics for Formation Control.
Figure 6: Sample formation control trajectories in Map 3 for the consensus-control method. (left) Ignoring collisions, consensus control provides well-matching trajectories. (right) When collision avoidance is enforced, the followers fail to reach their targets within the allotted time, even in the nominal (no slip) case. (Best viewed in color.)
This paper presents Residual Koopman MPC (RK-MPC), a Koopman-based, data-driven model predictive control framework for quadruped locomotion that improves prediction fidelity while preserving real-time tractability. RK-MPC augments a nominal template model with a compact linear residual predictor learned from data in lifted coordinates, enabling systematic correction of model mismatch induced by contact variability and terrain disturbances with provable bounds on multi-step prediction error. The learned residual model is embedded within a convex quadratic-program MPC formulation, yielding a receding-horizon controller that runs onboard at 500 Hz and retains the structure and constraint-handling advantages of optimization-based control. We evaluate RK-MPC in both Gazebo simulation and Unitree Go1 hardware experiments, demonstrating reliable blind locomotion across contact disturbances, multiple gait schedules, and challenging off-road terrains including grass, gravel, snow, and ice. We further compare against Koopman/EDMD baselines using alternative observable dictionaries, including monomial and SE(3)-structured bases, and show that the residual correction improves multi-step prediction and closed-loop performance while reducing sensitivity to the choice of observables. Overall, RK-MPC provides a practical, hardware-validated pathway for data-driven predictive control of quadrupeds in unstructured environments. See https://sriram-2502.github.io/rk-mpc for implementation videos.
Sriram S. K. S. Narayanan, Umesh Vaidya
Department of Mechanical Engineering, Clemson University, Clemson, SC 29630, USA
Offline models for autonomous robots often fail under time-varying dynamics outside their training distribution. Koopman operator theory offers a linear representation of nonlinear dynamics via lifting, but its transition to real-time recursive estimation may suffer numerical vulnerabilities: covariance windup under low excitation when using exponential forgetting, and vanishing gain without forgetting. This paper introduces a Covariance-Regulated Recursive Koopman Learning (CR-RKL) framework with two complementary strategies--error dead-zone gating and constant-trace normalization--each independently capable of preventing covariance explosion and parameter freezing, with the latter additionally preserving the geometric structure of uncertainty. Validated on a non-holonomic differential-drive robot with wheel slip and Stribeck friction and on a 26-gram butterfly-inspired flapping-wing micro aerial vehicle, CR-RKL achieves numerically stable and accurate online modeling, and when embedded in model predictive control, it maintains reliable tracking performance under uncertain, time-varying dynamics.
Weibin Gu, Chen Yang, Lu Shi +1
1Tsinghua University, PR China · 2China University of Petroleum-Beijing at Karamay, PR China · 3Xinchen Qihang Inc., PR China
This paper presents a safety-critical centralized nonlinear model predictive control (NMPC) framework for cooperative payload transportation by two quadrupedal robots. The interconnected robot-payload system is modeled as a discrete-time nonlinear differential-algebraic system, capturing the coupled dynamics through holonomic constraints and interaction wrenches. To ensure safety in complex environments, we develop a control barrier function (CBF)-based NMPC formulation that enforces collision avoidance constraints for both the robots and the payload. The proposed approach retains the interaction wrenches as decision variables, resulting in a structured DAE-constrained optimal control problem that enables efficient real-time implementation. The effectiveness of the algorithm is validated through extensive hardware experiments on two Unitree Go2 platforms performing cooperative payload transportation in cluttered environments under mass and inertia uncertainty and external push disturbances.
Ruturaj S. Sambhus, Yicheng Zeng, Kapi Ketan Mehta +2
R.S. Sambhus, Y. Zeng, K. K. Mehta, and K. Akbari Hamed are with the Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24061, USA · J. Kim is with The University of Texas at El Paso, El Paso, TX 79968, USA