cs.LGOct 18, 2026

Dynamics-Aligned Representation Learning under Induced Partial Observability

Authors: SM Mazharul Islam, Manfred Huber

Organizations: Department of Computer Science and Engineering, University of Texas at Arlington, TX-76019, USA

Abstract

Model-based reinforcement learning (MBRL) has enabled sample-efficient learning of continuous control policies from high-dimensional observations through learned latent dynamics models. These models are typically trained with observation reconstruction objectives, which provide strong supervision but can bias representations toward visual fidelity leading to an undertrained prior and unreliable long-horizon predictions. We propose a stochastic gating mechanism that induces controlled partial observability during training by sampling a spatial binary mask from a Beta--Bernoulli random field and applying it to the raw observation. The gate probability is resampled at each time step, exposing the encoder to conditions ranging from near-total occlusion to near-full visibility. Integration of our method requires minimal architectural changes from existing dynamics models: the gated observation and the binary mask are channel-wise concatenated and passed to the encoder as a single augmented input, with no modifications to the broader training pipeline. We evaluate the proposed approach on a set of pixel-based continuous control tasks selected from the DeepMind Control Suite. Using model predictive control for evaluation, which relies solely on open-loop model rollouts, we show that stochastic gating improves planning performance and data efficiency across tasks. Further analysis demonstrates that performance is robust to the spatial scale of the mask, and a balanced observability during training outperforms configurations biased toward either sparser or denser observations.

Figures & tables

Explore similar work

CardsList
  1. Observation-Grounded Self-Predictive Reinforcement Learning for Visual Continuous Control

    Aug 6, 2026Xinwei Liu, Junyuan Liang, Jianting Zhang +1Predictive Representation LearningContinuous Control

  2. PriPG-RL: Privileged Planner-Guided Reinforcement Learning for Partially Observable Systems with Anytime-Feasible MPC

    Apr 9, 2026Mohsen Amiri, Mohsen Amiri, Ali Beikmohammadi +2Partially Observable RLLearning Using Privileged Information

  3. Action-Conditioned Risk Gating for Safety-Critical Control under Partial Observability

    May 14, 2026Yushen Liu, Yin-Jen Chen, Ziyi Chen +4Safety-Critical ControlPartially Observable RL