cs.RONov 17, 2026

Learning and Control in Physically Coupled Dynamical Systems

Authors: Bao Trung Truong, Dat Thanh Nguyen, Thinh T. Doan

Organizations: Department of Aerospace Engineering, The University of Texas at Austin, Austin, TX 78712 USA

Abstract

We introduce TAG (Testbed for Autonomous Games), a compact, low-cost robotic platform for studying learning and control in physically coupled dynamical systems. TAG combines an actively tilted and steered ball-in-maze board with a top-mounted rotary inverted pendulum. The pendulum's reaction torque and vibration disturb the board and marble, while the board's tilt, driven by the maze-solving policy, simultaneously disturbs the pendulum's balance. The main challenge in learning control policies for each subsystem is accounting for the impact of one subsystem's dynamics on the other's learning process. To address this challenge, we present complementary reinforcement learning paradigms, leveraging model-based and model-free approaches to learn the control policies for the maze and pendulum, respectively. Our key finding is that introducing the pendulum causes an immediate, sharp drop in the maze policy's success rate, but the policy adapts online and recovers to its pre-coupling performance within a small number of learning episodes. Experimental results show that both policies, trained independently, successfully control the maze board and the pendulum despite their physical coupling.

Figures & tables

Explore similar work

CardsList
  1. Data-Driven Physics Embedded Dynamics with Predictive Control and Reinforcement Learning for Quadrupeds

    Mar 15, 2026Prakrut Kotecha, Aditya Shirwatkar, Shishir KolathayaLagrangian Neural NetworksRL for Legged Locomotion

  2. SMaRT-Tug: Structured Multi-Agent Reinforcement Learning for Physics-Based Tugboat-Barge Collaborative Manipulation

    Sep 7, 2026Junkai Lu, Jiadong Zhao, Jiacheng Zhang +8Multi-Agent CoordinationMulti-Agent Control

  3. Koopman Model-Based Reinforcement Learning

    Nov 10, 2026Wenjian Hao, Paulo C. Heredia, Shaoshuai MouModel-Based RLRobotic Control