State Representation Learning

Overview

State representation learning asks how an agent or model can turn observations and histories into an internal state that preserves what matters for future prediction or action. Methods include predictive objectives such as JEPA and successor representations, inverse-dynamics and bisimulation learning, recurrent belief states, and task- or reward-driven abstractions. They are studied in partially observed control, pixel-based robot planning, navigation, and dynamical-system forecasting, where useful states can improve sample efficiency, transfer, and robustness. A central tension is that predictive accuracy or reconstruction does not guarantee a decision-sufficient state: representations must retain control-relevant distinctions without carrying irrelevant detail, and their adequacy remains difficult to measure.

Latest papers

CardsList

132 papers10 papers in the last four weeks, down 58% on the four weeks before. 0.1% of all new papers.

  1. Embodied Graph: A Relational World Model for Long-Horizon Tasks

    Nov 18, 2026Zongyuan Wu, Xin Wang, Tongtong Feng +4World Model LearningWorld Models

  2. Tensorized Automata: Algebraically Informed Representation Learning for Sequential Decision Making

    Nov 16, 2026Anand Balakrishnan, Dweep Trivedi, Swarat ChaudhuriRepresentation Learning for RLState Representation Learning

  3. Hilbert States for Decision-Making under Partial Observability

    Nov 16, 2026Zibo Meng, Andrew C. M. Austin, Alin AchimDecision-Making under UncertaintySequential Decision Making

  4. TReC: Evaluating Move-Induced State Changes in Instruction-Conditioned Go

    Nov 13, 2026Zhuangsheng Li, Yunhan Zhang, Dailin Li +4State Representation Learning

  5. SeqFold: Timestamp-Addressable Compressed States for User Action Sequence Backbones

    Nov 10, 2026Mianwei Zhou, Duo Zhang, Henry Tsai +7User ModelingState Representation Learning

  6. Probing Spatial State Representations in Visual Foundation Models

    Oct 29, 2026Baiqiao Yin, Zhongang Cai, Ruisi Wang +3Visual Spatial ReasoningVision Foundation Models

  7. SWIM: Learning What Matters from Behaviors for JEPA World Models

    Oct 27, 2026Jiaming Hu, Shi Bo, Yan Zheng +11World Models for RoboticsWorld Model-Based Planning

  8. DepState-JEPA: Learning Depth-Grounded State Representation for Visual Perception and Manipulation

    Oct 21, 2026Xiujian Liang, Liuyuan Na, Zehao Du +6State Representation LearningVisual Representation Learning

  9. Understanding the Inner Workings of a State-Space Foundation Model for Limit Order Books

    Oct 20, 2026Valentin Mohl, Alexandre Bismuth, Aramis Marti-Shahandeh +6Limit Order Book ModelingState Representation Learning

  10. World Models with Configurable Perception

    Oct 20, 2026Yijun Shen, Delong Chen, Xianming Hu +2World Model LearningWorld Model-Based Planning

  11. EASformer: Environment-Action-State Alignment for Industrial Generative Ranking

    Oct 20, 2026Bohao Li, DingLun Cao, Pengcheng Huang +11Learning to RankGenerative Recommendation

  12. Meta-iLaD: Identifiable Latent Dynamics via Meta-Learning of Dynamics Environments

    Oct 19, 2026Yubo Ye, Sweekar Piya, Xiajun Jiang +1Latent Dynamics ModelingTime Series Forecasting

  13. Ontic state recovery through prediction

    Oct 19, 2026Ping Zhang, Quang-Huy Nguyen, Yingtie Lei +1Predictive State RepresentationsState Representation Learning

  14. CoRe-WM: Conditioned Response-State World Modeling for Longitudinal Treatment-Response Prediction in Breast DCE-MRI

    Oct 18, 2026Lin Zhao, Bowen Chen, Qiaohui Gao +4Cancer Drug Response PredictionClinical Outcome Prediction

  15. PatientWM: Towards Generalizable Clinical World Models via Unified Patient States

    Oct 12, 2026Ziwen Kan, Jie Peng, Bo Yan +5Action-Conditioned World ModelsClinical Prediction

  16. World Modeling through Spectral Alignment

    Oct 11, 2026Holger Molin, William Peng, Marco Bagatella +1World Model LearningLatent World Models

  17. State Representation Shapes Long-Horizon Agent Learning and Transfer: An Empirical Study

    Oct 11, 2026Dong Nie, Rui Lan, Yixin Nie +1LLM AgentsTransfer Learning

  18. Active Neural Matter: A Finite-Window Response Framework for Physical Systems and Distributed AI Workflows

    Oct 10, 2026Tianchi Chen, Shihua YuState Representation Learning

  19. Block Disentanglement in CRL: Bridging Identifiability and Visual State Estimation

    Oct 5, 2026Emre Acartürk, Pranamya Kulkarni, Puranjay Datta +3Causal Representation LearningCausal Identifiability

  20. Attention-Based Surface Representation Learning for Robot State Prediction and Open-Ended Surface Classification

    Oct 3, 2026Oleg Kushnarev, Alexander BelyaevRobotic PerceptionClassification

  21. Action-On-Item Preference Flow: A Shared Event Schema for Predictive and Generative Personalization

    Oct 1, 2026Parthiv Chatterjee, Kashish Kanjaria, Vashisth Purani +2User ModelingState Tracking

  22. Learning Transferable Skills using Goal-Conditioned Bisimulation

    Sep 30, 2026Mohammad Amin Abbasfar, Farbod Azimmohseni, Mohammad Hossein RohbanAgent Skill LearningTrajectory Representation Learning

  23. Do Better Goal Representations Improve Goal-Conditioned Reinforcement Learning?

    Sep 30, 2026Syed Nazmus Sakib, Abdul Monaf Chowdhury, Nafiul Haque +2Offline RLRepresentation Learning for RL

  24. Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism

    Sep 28, 2026Peiyu Zang, Jiayi Hao, Yongqiang CaiDynamical SystemsLatent Dynamics Modeling