cs.RONov 9, 2026

Particle Filtering with Generative Trajectory Models for State Estimation and Control

Authors: Lukas Lao Beyer, Samvit Das, Sertac Karaman

Organizations: Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA.

Abstract

Generative models can support both state estimation and control in robotics. For control, a common approach is to use the model as a policy that directly samples actions conditioned on observation histories. However, models that jointly represent states, actions, and observations can also predict how the robot state and its environment evolve. We investigate whether these predictions can improve state estimation and control through a change in inference procedure, without modifying the pretrained model. To this end, we use particle filtering to maintain competing hypotheses about state histories. A single pretrained diffusion model generates these hypotheses along with their predicted observations and associated action proposals. As new measurements arrive, particles are reweighted according to how well their predicted observations match the measurements. While particle filtering conventionally uses these weights only for state estimation, we also use them to guide action selection, favoring proposals associated with hypotheses that better explain the observations. Simulation experiments in partially observed navigation and vision-based manipulation demonstrate improvements in both state estimation and task performance compared to action generation without filtering, using the same pretrained model and no additional test-time information.

Figures & tables

Explore similar work

CardsList
  1. Denoising Particle Filters: Learning State Estimation with Single-Step Objectives

    Feb 23, 2026Lennart Röstel, Berthold BäumlRobot State EstimationParticle Filtering

  2. Benchmarking Generative Trajectory Models for Active-Inference Control

    Oct 5, 2026Yulin Li, Mohsen A. Jafari, Andrea MattaActive InferenceGenerative Modeling