State Space

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, down 25% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 50

All topics

Going Beyond State-Reaching: Learning Abstractions for Intrinsically Motivated Option Discovery
Sep 29, 2026Akhil Bagaria, Anita De Mello Koch, George KonidarisExploration State Space
Brown University
Identifying Neural Source Dynamics from Unknown Local Interventions
Sep 28, 2026Ayana Mussabayeva, Jiaqi Sun, Anuar Aimoldin +2Electroencephalography Neural Dynamics
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE · Carnegie Mellon University (CMU), Pittsburgh, PA, USA
Learning Social Navigation from Internet Videos in the Policy State Space
Sep 26, 2026Jiaming Wang, Duc Thang Nguyen, Jizhuo Chen +4Safe Navigation Pedestrian
National University of Singapore, Singapore · Singapore Management University, Singapore · The Chinese University of Hong Kong, Hong Kong SAR, China +1
Logos: An Agent Harness on a Cross-Process Bus
Aug 28, 2026Hanzhang Jia, Liheng Zeng, Hao Cheng +2Agent Harness State Space
University of Sussex Brighton, United Kingdom · Zhejiang Gongshang University Hangzhou, China · Shanghai Shuyuan Information Technology Co., Ltd. Shanghai, China
The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models
Aug 24, 2026Taebong Kim, Youngsik Hong, Minsik Kim +3Sequence Modeling Real-World Cloud Fault Injection Dataset
VIDRAFT AI Research · QuantumOS, Seoul, Republic of Korea
Threshold Structure of Optimal Policies in Restart POMDPs
Aug 11, 2026Konstantin Avrachenkov, Alexey Piunovskiy, Yi ZhangPartially Observable Markov Decision Process Optimal Policies
Inria, France · Department of Mathematical Sciences, University of Liverpool, UK · School of Mathematics, University of Birmingham, UK
Beyond Binary: Continuous State Optimization with Graph-Structured Objectives
Aug 10, 2026Corinna Cortes, Yishay Mansour, Mehryar MohriState Space Objectives
Google Research · Tel Aviv University · Courant Institute
IcFuzz: Fuzzing Isaac Sim with Semantic Stage Guidance and Multi-level Mutation
Aug 6, 2026Zhixiang Chen, Zhuangbin Chen, Ruoxi Jia +4Fuzzing Nvidia Isaac Sim
Sun Yat-sen University Zhuhai, China · Zhuhai Key Laboratory of Trusted Large Language Models, Sun Yat-sen University, Zhuhai, China · Nanyang Technological University Singapore, Singapore +1
Shielding for Higher-Order Safety
Aug 4, 2026Filip Cano, Thomas A. Henzinger, Konstantin KueffnerSafety Constraints Cyber-Physical System
Institute of Science and Technology Austria, 3400 Klosterneuburg, Austria
Property-driven Causal Abstractions for Markov Decision Processes
Jul 29, 2026Jule Schmidt, Maximilian Weininger, Clemens Dubslaff +2Markov Decision Processes Causal Modeling
Ruhr-University Bochum, Germany · Eindhoven University of Technology, The Netherlands · Oxford University, UK +1
Expanding Flow Maps
Jul 23, 2026Sophia Tang, Pranam ChatterjeeGenerative Flow Networks Flow Map
Department of Computer and Information Science, University of Pennsylvania · Department of Bioengineering, University of Pennsylvania
On the Limits of Sampling-Based Reachability: Geometry, Dynamics, and Sample Complexity
Jul 21, 2026Jixian Liu, Ihab Tabbara, Hussein Sibai +1Reachability Hamilton-Jacobi Reachability
Department of Electrical and Computer Engineering, Johns Hopkins University · Department of Computer Science, Washington University in St. Louis
Organization of computation in reservoir computing
Jul 20, 2026Mohab Abdalla, Damien RontaniReservoir Computing Nonlinearity
CentraleSupélec, Université de Lorraine, LMOPS EA-4423 Laboratory, 57070 Metz, France
Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion
Jul 16, 2026Wenqi Si, Gongyang Li, Shixiang Shi +1Rgb-Thermal Object Detection Pixel-Level Annotation
School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China · School of Computer Science and Engineering, Nanyang Technological University, Singapore 639798
Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
Jul 15, 2026Ye Yuan, Weien Li, Rui Song +19Diffusion Models Denoising Diffusion Probabilistic Model
McGill University · University of Cambridge · Mila - Quebec AI Institute +6
ASALT: Adaptive State Alignment for Lateral Transfer in Multi-agent Reinforcement Learning
Jun 23, 2026Anurag Akula, Satheesh K. Perepu, Abhishek Sarkar +1Multi-Agent Reinforcement Learning Transfer Learning
Indian Institute of Technology Madras, India · Ericsson Research, India
Formalizing Task-Space Complexity for Zero-Shot Generalization
Jun 18, 2026Jung-Hoon Cho, Heling Zhang, Siqi Du +2State Space
Massachusetts Institute of Technology · University of Illinois Urbana-Champaign
Physics-conforming Latent Twins
Jun 13, 2026Matthias Chung, Yutong Bu, Deepanshu VermaSurrogate Models Latent Dynamics
Department of Mathematics, Emory University, 400 Dowman Drive, Atlanta, 30322, GA, USA · School of Mathematical and Statistical Sciences, Clemson University, 220 Parkway Drive, Clemson, 29634, SC, USA
A Formal Tool for Verification of Probabilistic Spiking Neural Networks Based on Quotient Abstractions
Jun 12, 2026Nikan Zandian Jazi, Elisabetta De Maria, Christopher LeturcSpiking Neural Networks Neural Network Verification
Université Côte d'Azur, CNRS, I3S, France
Value Functions as Supermartingale Certificates
May 29, 2026Alessandro Abate, Daniel Contro, Mirco Giacobbe +2Value Functions Reinforcement Learning With Verifiable Reward
University of Oxford, UK · University of Birmingham, UK
Free energy Estimation on Any State Space
May 29, 2026Jiajun He, Zijing Ou, Francisco Vargas +4Free Energy Principle State Space
University of Cambridge · Imperial College London · Xaira Therapeutics +1
Structure-Induced Information for Rerooting Levin Tree Search
May 28, 2026Jake Tuero, Michael Buro, Laurent Orseau +1Tree Search High-Level Subgoal Generation
Department of Computing Science, University of Alberta, Edmonton, Canada. · Alberta Machine Intelligence Institute (Amii), Edmonton, Canada. · Google DeepMind, London, United Kingdom.
SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution
May 25, 2026Wenbin Zou, Yawen Cui, Yi Wang +5Vision State Space Models Topomamba
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR · School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China
Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations
May 25, 2026Minghao Fu, Fan Feng, Nicklas Hansen +1World Models Frozen Vision-Language Models
University of California, San Diego
Synheart Capacity: A Theory-Driven Physiological Representation of Cognitive Capacity Dynamics from Wearable Signals
May 23, 2026Yisak Debele, Henok Ademtew, Israel GoytomPhysiological Data Wearable Physiology
Synheart AI, Vancouver, Canada
Pure Exploration for a Good Policy in Reinforcement Learning with Bandit Feedback
May 22, 2026Zitian Li, Wang Chi CheungBandits Optimality
Department of Industrial Systems Engineering & Management National University of Singapore Engineering Drive 2 Block E1A #06-25 Singapore 117576
Smaller Abstract State Spaces Enable Cross-Scale Generalization in Reinforcement Learning
May 19, 2026Nasehatul Mustakim, Lucas LehnertState Space Out-Of-Distribution
Department of Computer Science University of Saskatchewan Saskatoon, Saskatchewan, Canada
Stability and Discretization Error of State Space Model Neural Operators
May 17, 2026Abderrahim Bendahi, Adrien Fradin, Johan Peralez +2Neural Operators Fourier Neural Operators
École polytechnique Paris, France · Université Claude Bernard Lyon 1, CNRS, LAGEPP UMR 5007 Villeurbanne, France · CNRS, UniversitéJulieLyonDigne1, INSA Lyon, LIRIS Lyon, France +1
Axial-Relation Guided Fusion State Space Model for Optical-Elevation Sensing Image Segmentation
May 16, 2026Feng Gao, Zhilin Jin, Yanhai Gan +2Remote Sensing Image Segmentation Cross-Modal
State Key Laboratory of Physical Oceanography, Ocean University of China, Qingdao 266100, China · Department of Electrical and Computer Engineering, Mississippi State University, Starkville, MS 39762 USA
Discrete MeanFlow: One-Step Generation via Conditional Transition Kernels
May 12, 2026Fairoz Nower Khan, Nabuat Zaman Nahim, Md Sajid Ahmed +2Meanflow Generative Flow Networks
Department of Computer Science, University of Kentucky Lexington, Kentucky 40506, USA
Taming the Curses of Multiagency in Robust Markov Games with Large State Space through Linear Function Approximation
May 4, 2026Jingchu Gai, Laixi ShiMean Field Games Multi-Agent Reinforcement Learning
Machine Learning Department, Carnegie Mellon University. · Department of Electrical and Computer Engineering, Johns Hopkins University, MD 21286, USA.
Escaping Mode Collapse in LLM Generation via Geometric Regulation
May 1, 2026Xin Du, Kumiko Tanaka-IshiiLarge Language Model Generation Collapse
Department of Communications and Computer Engineering, Waseda University, Tokyo, Japan · Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai, China · Department of Computer Science and Engineering, Waseda University, Tokyo, Japan
Lost in State Space: Probing Frozen Mamba Representations
Apr 30, 2026Bhagyashree Wagh, Akash SinghToken Embeddings Recurrent State
University of Washington · University of Florida
$\text{PKS}^4$ :Parallel Kinematic Selective State Space Scanners for Efficient Video Understanding
Apr 29, 2026Lingjie Zeng, Hailun Zhang, Xiwen Wang +1Spatio-Temporal Attention Vision State Space Models
College of Computer Science, Sichuan University Chengdu, China
Prior-Agnostic Robust Forecast Aggregation
Apr 27, 2026Zhi Chen, Cheng Peng, Wei TangRetrieval-Augmented Forecasting Logistic Regression
Chinese University of Hong Kong
Score-Repellent Monte Carlo: Toward Efficient Non-Markovian Sampler with Constant Memory in General State Spaces
Apr 24, 2026Jie Hu, Lingyun Chen, Geeho Kim +3Markovian Sampling Monte Carlo
CSE, Oakland University, Rochester, USA · ECE, North Carolina State University, Raleigh, USA · ECE +2
Sessa: Selective State Space Attention
Apr 20, 2026Liubomyr HorbatkoEfficient Long-Context Inference Sequence Modeling
Physics-Informed Causal MDPs for Sequential Constraint Repair in Engineering Simulation Pipelines
Apr 20, 2026Chuhan QiaoMarkov Decision Processes Structural Constraints
Beijing JiaoTong University
Reference-state System Reliability method for scalable uncertainty quantification of coherent systems
Apr 18, 2026Ji-Eun Byun, Hyeuk Ryu, Junho SongState Space Uncertainty Quantification
Department of Civil and Environmental Engineering, Imperial College London, United Kingdom · Geoscience Australia, Australia · Department of Civil, Urban, and Environmental Engineering, Seoul National University, South Korea
SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification
Apr 17, 2026Enhui Chai, Sicheng Chen, Tianyi Zhang +2Mamba Self-Supervised Learning
School of Computer Science, Northwest University · PuzzleLogic Pte Ltd, Singapore 229594, Singapore · Department of Electrical & Computer Engineering, National University of Singapore +1
POMDP-based Object Search with Growing State Space and Hybrid Action Domain
Apr 16, 2026Yongbo Chen, Hesheng Wang, Shoudong Huang +1Partially Observable Markov Decision Process Mobile Robots
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, 200240, People’s Republic of China · School of Computing, Australian National University (ANU), Canberra, ACT, 2601, Australia (The main part of this work is completed at ANU) · Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai, 200240, People’s Republic of China +1
Wasserstein Formulation of Reinforcement Learning. An Optimal Transport Perspective on Policy Optimization
Apr 16, 2026Mathias DusRiemannian Optimization Wasserstein Distance
IRMA
HAMSA: Scanning-Free Vision State Space Models via SpectralPulseNet
Apr 16, 2026Badri N. Patro, Vijay S. AgneeswaranVision State Space Models Self-Supervised Vision Transformers
Microsoft
Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces
Mar 9, 2026Hamish Flynn, Joe Watson, Ingmar Posner +1Gaussian Process State Space
Carnegie Mellon University · University of Oxford · Technical University of Darmstadt +2
Lag Operator SSMs: A Geometric Framework for Structured State Space Modeling
Dec 22, 2025Sutashu Tomonaga, Kenji Doya, Noboru MurataState Space Models State Space
Okinawa Institute of Science and Technology · Waseda University
Compositional Concept-Based Neuron-Level Interpretability for Deep Reinforcement Learning
Feb 2, 2025Zeyu Jiang, Hai Huang, Xingquan ZuoInterpretability Neurons
School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China
SSM Meets Video Diffusion Models: Efficient Long-Term Video Generation with Structured State Spaces
Mar 12, 2024Yuta Oshima, Shohei Taniguchi, Masahiro Suzuki +1Video Diffusion Models Interactive Video Generation
The University of Tokyo
Reinforcement Learning with Temporal-Logic-Based Causal Diagrams
Jun 23, 2023Yash Paliwal, Rajarshi Roy, Jean-Raphaël Gaglione +5Offline Reinforcement Learning Linear Temporal Logics
Arizona State University, Arizona, USA · Max Planck Institute for Software Systems, Kaiserslautern, Germany · University of Texas at Austin, Texas, USA +3
Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning
Date pendingXuan Yu, Xu Wang, Rui Zhu +2Generative Flow Networks State Space
University of Science and Technology of China (USTC), Hefei, China · Suzhou Institute for Advanced Research, USTC, Suzhou, China · State Key Laboratory of Precision and Intelligent Chemistry, USTC, Hefei, China
Safe Learning Under Irreversible Dynamics via Asking for Help
Date pendingBenjamin Plaut, Juan Liévano-Karim, Hanlin Zhu +1Markov Decision Processes Irreversibility
Division of Computer Science University of California Berkeley, CA 94720-1776, USA

Sep 29, 2026, cs.AIJ/K move · Enter open · S save

Going Beyond State-Reaching: Learning Abstractions for Intrinsically Motivated Option Discovery

Akhil Bagaria, Anita De Mello Koch, George Konidaris

Brown University

Exploration State Space High-Level Subgoal Generation Temporal Reasoning

Open paper AskPDF arXiv

Temporal abstraction via options can improve exploration in large environments. However, existing option discovery algorithms find subgoals that target all aspects of the state simultaneously. This state-reaching approach produces options that only apply in narrow regions of the state-space, eventually causing an explosion in the number of options that overwhelms the agent, and impedes progress on its primary task of reward maximization. We introduce an algorithm that instead identifies a small, relevant subset of features for each subgoal, yielding options that generalize broadly and accelerate exploration. Our approach learns abstract, transferrable options and achieves rapid exploration in three sparse-reward, image-based domains, including the Atari game MontezumasRevenge.

Momentum

Related topics

Latest papers 50