Predictive State Representations

Follow this topic Ask about this topic

Latest papers

9 papers2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Ontic state recovery through prediction
Oct 19, 2026Ping Zhang, Quang-Huy Nguyen, Yingtie Lei +1Predictive State Representations State Representation Learning
Boston University · The Ohio State University
Generative sequence modeling for infinite memory processes via predictive states
Sep 29, 2026Michael Wieck-Sosa, Cosma Rohilla ShaliziConditional Distribution Estimation Sequence Modeling
Department of Statistics & Data Science Carnegie Mellon University
The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models
Sep 26, 2026Dongsheng Liu, Chao Jin, Wenkui Yang +7Predictive State Representations World Models
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · MAIS&NLPR, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences +1
RoboDreamer: Anticipatory Humanoid Locomotion with Predictive State-Space Models
Sep 7, 2026Zhe Li, Yangyang Wei, Xichen Yuan +4Robot Trajectory Tracking Humanoid Robot Locomotion
BAAI · NJU
Orthogonal JEPA: Factorized Predictive States for Latent World Models
Aug 20, 2026Taoyong Cui, Pheng Ann Heng, Wanli OuyangJoint-Embedding Predictive Architecture Orthogonal Representation Learning
The Chinese University of Hong Kong (CUHK)
Pretraining Recurrent Networks without Recurrence
Jun 4, 2026Akarsh Kumar, Phillip IsolaRecurrent Neural Networks Predictive State Representations
MIT
Predictive Representations for Skill Transfer in Reinforcement Learning
Apr 8, 2026Ruben Vereecken, Luke Dickens, Alessandra RussoTransfer Learning in RL Predictive State Representations
Computer Science, Imperial College, UK · Information Studies, UCL, UK
What Capable Agents Must Know: Selection Theorems for Robust Decision-Making under Uncertainty
Mar 3, 2026Aran NayebiWorld Models Decision-Making under Uncertainty
Machine Learning Department and Neuroscience & Robotics Institutes, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
Toward Learning POMDPs Beyond Full-Rank Actions and State Observability
Jan 26, 2026Seiji Shaw, Travis Manderson, Chad Kessens +1Partially Observable Markov Decision Processes Predictive State Representations
MIT Computer Science and Artificial Intelligence Lab, 51 Vassar St, Cambridge, MA 02139, USA · DEVCOM Army Research Laboratory 2800 Powder Mill Road, Adelphi, MD 20783, USA

Oct 19, 2026J/K move · Enter open · S save

Ontic state recovery through prediction

Ping Zhang, Quang-Huy Nguyen, Yingtie Lei, Wei-Lun Chao

Boston University · The Ohio State University

Predictive State Representations State Representation Learning Predictive Representation Learning

Open paper AskPDF arXiv

We encounter a system through its responses, yet its state concerns how the system is. Predicting further responses promises knowledge beyond what is immediately observed. What that knowledge tells us about the system's state depends on what we mean by a state in the first place. We give this notion a model-relative meaning: a state is the complete response profile over a specified query universe, and configurations agreeing on every query are regarded as the same state. From this perspective, a learned state is understood through the distinctions between these profiles that it retains. Prediction concerns selected observations; recovery concerns the profile as a whole. We examine their relationship through query ambiguity, state-space geometry, and the choice of prediction targets. Synthetic systems with known response laws and neural recordings provide complementary settings for this investigation. The aim is to clarify how prediction can become a way of knowing a system, and what it would mean for a learned state to preserve the state being studied.