Reachability

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 77

All topics

Q-Learning for Reachability in MEC-Free MDPs
Oct 1, 2026Lu-Chin Chang, Suguman BansalQ-Learning Markov Decision Processes
Georgia Institute of Technology
Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers
Oct 1, 2026Yashdeep Chaudhary, Roberto Armellin, Harry HoltIntent-Aligned Autonomous Spacecraft Guidance Reachability
Faculty of Engineering Waipapa Taumata Rau– University of Auckland Auckland 1010, New Zealand · Advanced Concepts Team ESTEC, European Space Agency Noordwijk 2201 AZ The Netherlands
Learning Goal-Reaching Quasimetric Geometry From Finite-Time Reachability
Sep 30, 2026Daisuke Yamada, Travis Pence, Vikas SinghGoal-Conditioned Reinforcement Learning Reachability
Department of Computer Science University of Wisconsin–Madison · Department of Biostatistics and Medical Informatics University of Wisconsin–Madison
Reachability is not enough: Diagnosing long-range behavior in GNNs
Sep 27, 2026Filippo Maria BianchiGraph Neural Networks Message Passing Neural Networks
UiT The Arctic University of Norway · NORCE Norwegian Research Centre
Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Features
Sep 24, 2026Anne M. Tumlin, Ben Wooding, Zhenxuan Shao +3Graph Neural Networks Optimal Power Flow
Vanderbilt University, Nashville, TN, USA
NNV3: Expanding Neural Network Verification to New Architectures and Domains
Sep 24, 2026Anne M. Tumlin, Samuel Sasaki, Ben Wooding +8Neural Network Verification Formal Verification
Vanderbilt University, USA · The University of Texas at Dallas, USA
Missing Bridges: Composition-Aware Active Imitation Learning
Sep 16, 2026Maxwell J. Jacobson, Ahmed H Qureshi, Yexiang XueStrong Imitation Learning Multi-Turn Reinforcement Learning
Department of Computer Science, Purdue University West Lafayette, Indiana, USA
Timely Activation of Safety Filters via One-Step Reachability Expansion
Sep 15, 2026Javier BorquezSafety Filters Hamilton-Jacobi Reachability
Universidad de Santiago de Chile Santiago, Chile
Recurrent GraphNeural NetworkswithSet-BasedAggregation
Sep 14, 2026Blai BonetReachability Neural Network Verification
Universidad Simón Bolívar Caracas, Venezuela
Safe Meta-Reinforcement Learning via Information Space Reachability
Sep 14, 2026Zeyang Li, Sunbochen Tang, Navid AzizanSafety Constraints Offline Reinforcement Learning
Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA 02139, USA
Fixed State, Long Reach: What a Constant-Size Cache Buys Block Diffusion at Scale
Sep 14, 2026Vaibhav Singh, Pierre-André Noël, Torsten Scholak +2Diffusion Language Models Cache
Mila · Concordia University · ServiceNow Research
Fast Constraint Extraction for Corrective Control under STL Specifications via Logical Dependency Tracking
Sep 8, 2026Antoine Besset, Joris Tillet, Chuchu Fan +1Signal Temporal Logic Reachability
u2IS, ENSTA, Institut Polytechnique de Paris, France · Univ. Grenoble Alpes, CNRS, Grenoble INP, VERIMAG, France · REALM, AeroAstro, Massachusetts Institute of Technology, Cambridge, USA
ResidualAuth: What Authorization State Must Language Agents Preserve under Revocable Delegation?
Sep 8, 2026Moonwon Choi, Seokho Jeong, Sian Choi +1Authorization Delegation
Graduate School of Data Science, Seoul National University
LARC: Lazy Adaptive Reachability Certification of Robot Manipulator Trajectories
Aug 30, 2026Yu Feng, Hao Wu, Yuzhe Wang +1Reachability Robot Trajectories
Department of Mechanical Engineering, National University of Singapore, Singapore · Singapore Institute of Manufacturing Technology, Agency for Science Technology and Research, Singapore
Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis
Aug 11, 2026Sungje Park, Stephen TuHamilton-Jacobi Reachability Reachability
with the Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA.
Exact Model-Free Policy Iteration for Co-safe LTL Planning
Aug 5, 2026Zetong Xuan, Yu WangModel-Free Reinforcement Learning Linear Temporal Logics
Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville, FL 32611 USA
Reachability in 3-VAS
Aug 5, 2026Łukasz Kamiński, Sławomir LasotaReachability Np-Hard
University of Warsaw, Poland
Shielding for Higher-Order Safety
Aug 4, 2026Filip Cano, Thomas A. Henzinger, Konstantin KueffnerSafety Constraints Cyber-Physical System
Institute of Science and Technology Austria, 3400 Klosterneuburg, Austria
Reachability Is Not Realization: Tracing the Sources of LLM Benchmark Gains
Aug 4, 2026Yanchao Li, Wanhao Liu, Jiaqing Xie +4Reasoning Benchmark Possibilities
Nanjing University · Shanghai Artificial Intelligence Laboratory · North University of China
Staying on Spec: Real-Time Monitoring under Uncertainty with a Maritime Case Study
Aug 3, 2026Elizabeth Dietrich, Hanna Krasowski, Emir Cem Gezer +3Maritime Navigation Situational Awareness
University of California, Berkeley · Norwegian University of Science and Technology
Probabilistic Reachable-Action Verification of Visuomotor Policies via Set-Based Training
Aug 3, 2026Yanliang Huang, Zhuocheng Zhang, Peng Xie +5Visuomotor Policy Reachability
School of Computation, Information and Technology, Technical University of Munich, Munich, Germany · School of Engineering, Hainan Bielefeld University of Applied Sciences, Hainan, China
Certifying Plans under Model Mismatch: A Trilemma for Reachability from Scarce Data
Aug 3, 2026Yanliang Huang, Zhen Zhang, Ahmad Hafez +4Certification Reachability
School of Computation, Information and Technology, Technical University of Munich, Munich, Germany · School of Engineering, Hainan Bielefeld University of Applied Sciences, Hainan, China
Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)
Aug 1, 2026Jianlin Li, Nick Guo, Peter Ye +1Probabilistic Model Checking Markov
David R. Cheriton School of Computer Science University of Waterloo, Canada
Library Reachability in LSR-Synth: How Anti-Memorization Design Changes the Measurement of Symbolic Discovery
Jul 30, 2026Zhan'ao Yao, Liang Yin, Zhihao Gao +9Scientific Discovery Synthetic Benchmark
State Key Laboratory of High Performance Ceramics, Shanghai Institute of Ceramics, Chinese Academy of Sciences, 1295 Dingxi Road, Shanghai 200050, China · Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China +4
Action from Adjacent Set in Physical Space Outperforms the Best Prediction in World Models
Jul 26, 2026Liangyu Li, Qingwen Liu, Mingqing Liu +1Low-Latency Latent Planning Latent World Models
Tongji University
Can Generative Recommendation Reach Cold Items? A Temporal Perspective on Semantic-ID Generation
Jul 23, 2026Jie Peng, Yanping Zheng, Zhewei Zhe +3Sequential Recommendation Reachability
Renmin University of China · Beijing, China · Alibaba
On the Limits of Sampling-Based Reachability: Geometry, Dynamics, and Sample Complexity
Jul 21, 2026Jixian Liu, Ihab Tabbara, Hussein Sibai +1Reachability Hamilton-Jacobi Reachability
Department of Electrical and Computer Engineering, Johns Hopkins University · Department of Computer Science, Washington University in St. Louis
PAC Learning in Turn-Based Stochastic Games with Reachability Objectives: A Decentralized Private Approach via Expected Conditional Distance
Jul 16, 2026Ali Asadi, Krishnendu Chatterjee, Pavol KebisObservable Stochastic Game Reachability
Institute of Science and Technology Austria (ISTA), Austria
MAGIC: Transition-Aware Generation of Navigable Multi-Scene Game Worlds with Large Language Models
Jul 13, 2026Tsz Hei Fan, Choi Wing Fung, Yuxuan Wan +2Object Goal Navigation Reachability
Department of Computer Science and Engineering, The Chinese University of Hong Kong
Mirror Horizon: Viable Path Entropy as a Measure of Bounded Reflection
Jul 11, 2026Tiantian ZhangReflections Reasoning Paths
Crystal · Department of Computer Science, Columbia University
Learning-enabled Parameter Synthesis for Nonlinear Systems from Signal Temporal Logic
Jul 9, 2026Alex Beaudin, Hanna Krasowski, Eric Palanques-Tost +2Signal Temporal Logic Nonlinear Dynamics
University of California, Berkeley · Boston University · University of Maryland, College Park
Widest-Path Reachability Fields for Connectivity-Preserving Slender Structure Segmentation
Jul 8, 2026Youcheng Zong, Runda Jia, Minxuan Hu +2Vessel Segmentation Receptive Fields
College of Information Science and Engineering, Northeastern University, Shenyang 110004, China · Changsha Stomatological Hospital, Changsha 410005, China
Revisiting Scene Graph Generation from the Perspective of Detector-Conditioned Reachability
Jul 7, 2026Runfeng Qu, Pia K Bideau, Ole Hall +3Spatio-Temporal Scene Graphs Reachability
Technische Universität Berlin, Germany · Science of Intelligence Research Cluster of Excellence, Germany · Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK, France +2
Generalization in offline RL: The structure is more important than the amount of pessimism
Jul 2, 2026Max Weltevrede, Matthijs T. J. Spaan, Wendelin BöhmerPessimism Model-Based Reinforcement Learning
Delft University of Technology, Delft, The Netherlands
A Category Theory Account of AI Identity
Jun 30, 2026Andrea FerrarioTrustworthy Artificial Intelligence Persistence
Institute of Biomedical Ethics and History of Medicine, University of Zürich, Zürich, Switzerland · SUPSI, Dalle Molle Institute for Artificial Intelligence (IDSIA), Lugano, Switzerland · ETH Zürich, Zürich, Switzerland
Sample-Efficient Learning of Probabilistic Causes for Reachability in Markov Decision Processes with Probabilistic Guarantees
Jun 29, 2026Ryohei Oura, Georgios Fainekos, Hideki Okamoto +1Markov Decision Processes Reachability
Toyota Research Institute of North America, Toyota Motor North America · Frontier Research Center, Toyota Motor Corporation
Reachability Guarantees for Cart-Pole Swing-Up and Stabilization
Jun 26, 2026Mohamed Khalid M JaffarLyapunov Function Linear Quadratic Regulator
Department of Aerospace Engineering University of Maryland, College Park, USA
PRISM: Efficient and Locally Optimal Probabilistic Planning with Reachability Guarantees
Jun 24, 2026Alex Rose, Christopher Jewison, Jonathan P. HowMotion Planning Reachability
Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge MA 02139 · Draper, Cambridge MA 02139
FT-WBC: Learning Fault-Tolerant Whole-Body Control for Legged Loco-Manipulation
Jun 23, 2026Yudong Zhong, Pengfei Mai, Sikai Guo +6Whole-Body Control Humanoid Loco-Manipulation
1The Hong Kong University of Science and Technology (Guangzhou) · 2The University of Hong Kong
Active Sensing and Deferred-Decision Trajectory Optimization for Robust Target Identification
Jun 21, 2026Farbod Siahkali, Mengxue Hou, Vijay GuptaRobust Trajectory Reachability
Department of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA · Department of Electrical Engineering, University of Notre Dame, Notre Dame, IN 46556, USA
Monitoring Diameters of Causal Communication Graph with Spatio-Temporal Logic
Jun 19, 2026Lydia Bakiri, Jérémy Dubut, Sergio MoverLinear Temporal Logics Reachability
LIX, CNRS, École polytechnique, Institut Polytechnique de Paris, Palaiseau, France
Safe, Real-Time Active Model Discrimination and Fault Diagnosis for Nonlinear Systems via Differentiable Reachability
Jun 17, 2026Xinpei Ni, Melkior Ornik, Glen Chou +1Fault Diagnosis Reachability
Institute of Robotics and Intelligent Machines (IRIM), Georgia Institute of Technology, Atlanta, GA 30332, USA · Department of Aerospace Engineering, University of Illinois Urbana-Champaign, Urbana, IL 61801, USA
TNODEV: Toolbox for Neural ODE Verification
Jun 15, 2026Abdelrahman Sayed Sayed, Pierre-Jean Meyer, Mohamed GhazelNeural Network Verification Neural Ordinary Differential Equations
Univ Gustave Eiffel, COSYS-ESTAS, F-59657 Villeneuve d’Ascq, France
$λ$ -Reachability: Geometric-Horizon Safety Bellman Equations for Humanoid Safety
Jun 14, 2026Rui Chen, Shangtao Li, Yifan Sun +1Hamilton-Jacobi Reachability Reachability
Robotics Institute Carnegie Mellon University United States · Mechanical Engineering Carnegie Mellon University United States
Exact, Efficient, and Safe Occlusion-Aware Planning Using AH-Polyhedrons
Jun 13, 2026Long Kiu Chung, David Isele, Toktam Mohammadnejad +4Collision Avoidance Automated Vehicles
Honda Research Institute (HRI), Mountain View, CA. · Georgia Institute of Technology, Atlanta, GA.
Runtime Enforcement of Hybrid System Properties
Jun 10, 2026Mir Md Sajid Sarwar, Srinivas Pinisetty, Rajarshi Ray +1Runtime Enforcement Cyber-Physical System
Indian Institute of Technology Bhubaneswar, Bhubaneswar 752050, India · Indian Association for the Cultivation of Science, Kolkata 700032, India · Univ Rennes, Inria, CNRS, IRISA, France
RAM: Reachability Across Morphologies
Jun 8, 2026Tim Walter, Xinyu Chen, Jonathan Külz +1Reachability Morphology
Department of Computer Engineering Technical University Munich Germany · German Electron Synchrotron University of Hamburg Germany
Post-Boundary Bridge: Must Local Attention Go Global Between Global Layers?
Jun 1, 2026Zhibo YangCausal Attention Boundaries
Ocean University of China
CARVE: Certified Affordable Repair of Vetoed Maneuvers via Envelopes for Interactive Driving
May 31, 2026Yifan WangHuman Driving Reachability
Department of Mechanical Engineering, McGill University, QC, H3A 2T7, Canada
Reachability and asymptotics of Gaussian Transformer dynamics
May 29, 2026Albert Alcalde, Zhengping Ji, Enrique ZuazuaTransformer Architectures Finite Time Analysis
†Chair for Dynamics, Control, Machine Learning & Numerics (Alexander von Humboldt Profes- sorship), Department of Mathematics, Friedrich–Alexander-Universität Erlangen–Nürnberg, 91058 Erlangen, Germany. · ‡Departamento de Matem´aticas, Universidad Aut´onoma de Madrid, 28049 Madrid, Spain. · Chair of Computational Mathematics, Fundaci´on Deusto. Av. de las Universidades, 24, 48007 Bilbao, Basque Country, Spain.
An Operator-Based Approach to STL
May 27, 2026Panagiotis Rousseas, Dimos V. DimarogonasSignal Temporal Logic Reachability
Department of Decision and Control Systems, School of Electrical Engineering and Computer Science, Royal Institute of Technology KTH, Sweden.
Lost in Sampling: Assessing Lexical Reachability in LLMs via the Word Coverage Score (WCS)
May 26, 2026Samer Awad, Javier Conde, Carlos Arriaga +3Discourse Coherence Text Corpora
Information and Processing Telecommunications Center Universidad Politécnica de Madrid Madrid, Spain · Politecnico di Milano Milano, Italy · Banco de España Madrid, Spain
Developing a Totally Unimodular Linear Program for Optimal Conformance Checking: When and Why It Complements A*
May 26, 2026Izack CohenProbabilistic Model Checking Linear Programming
aFaculty of Engineering, Bar-Ilan University, Ramat Gan, Israel
Pretrained Approximators for Low-Thrust Trajectory Cost and Reachability
May 26, 2026Zhong Zhang, Giacomo Acciarini, Dario Izzo +2Intent-Aligned Autonomous Spacecraft Guidance Robust Trajectory
Politecnico di Milano · European Space Agency · Tsinghua University
Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers
May 25, 2026Keyi Shen, Glen ChouReachability Learning-Based Control
Georgia Institute of Technology, Atlanta, GA 30308
Reinforcement Learning for Reachability: Guaranteeing Asymptotic Optimality
May 23, 2026Amogh Palasamudram, Jakub Svoboda, Suguman Bansal +1Reachability Convergence
Georgia Institute of Technology, USA · Institute of Science and Technology, Austria · Dartmouth College, USA
World Model Control by Trajectory Reachability Metrics
May 21, 2026Liangyu Li, Shengzhi Wang, Libin Qiu +2Latent World Models Low-Latency Latent Planning
Tongji University
Mind the Sim-to-Real Gap & Think Like a Scientist
May 20, 2026Harsh Parikh, Gabriel Levin-Konigsberg, Dominique Perrault-Joncas +1Simulation-Based Reinforcement Learning Sim-To-Real Gap
Amazon SCOT, Seattle, USA · Yale University, New Haven, USA · Duke University, Durham, USA
Quadratic Characterizations for Reachability Analysis of Neural Networks
May 19, 2026Elias Khalife, Mazen Farhood, Pierre-Loic GarocheNeural Network Verification Reachability
Kevin T. Crofton Department of Aerospace and Ocean Engineering, Virginia Tech, Blacksburg, VA 24061, USA · Federation ENAC ISAE-SUPAERO ONERA, Universite de Toulouse, Toulouse, France
Hamilton--Jacobi Reachability for Spacecraft Collision Avoidance
May 19, 2026Larry Hui, Jordan Kam, William Su +1Hamilton-Jacobi Reachability Collision Avoidance
Department of Mechanical Engineering, University of California, Berkeley, Berkeley, CA 94720, USA. · Aerospace Engineering Program, University of California, Berkeley, Berkeley, CA 94720, USA. · Department of Mechanical Engineering, National University of Singapore, Singapore 117575.

Oct 1, 2026, cs.AIJ/K move · Enter open · S save

Q-Learning for Reachability in MEC-Free MDPs

Lu-Chin Chang, Suguman Bansal

Georgia Institute of Technology

Q-Learning Markov Decision Processes Reachability Model-Free Offline Reinforcement Learning

Open paper AskPDF arXiv

Reinforcement learning (RL) for reachability specifications is fundamental to sequential decision-making. Prior work establishes asymptotic convergence to optimal policies, but only through model-based methods that must explicitly estimate the transition probabilities of the underlying Markov Decision Process (MDP). We present Quasar, the first model-free algorithm with asymptotic guarantees for reachability on the fragment of MDPs free of non-terminal maximal end components (MECs), a building block to which every MDP reduces by the standard MEC quotient. Our algorithm follows the classical Q-learning approach, using temporal-difference updates to converge to an optimal policy without ever learning the transition probabilities. The resulting learner reduces the memory footprint from the O(|S|^2|A|) that model-based methods require to O(|S||A|). On the standardized Quantitative Verification Benchmark Set, our algorithm converges to the optimal policy with orders of magnitude fewer samples than the previous model-based state-of-the-art. Together these results are a concrete step toward the practical deployment of reachability learning and, with it, of specification-guided RL.

Momentum

Related topics

Latest papers 77