Exploration

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

11 new papers

A weekly snapshot of new work published in Exploration.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Exploration.

Period ending 2026-09-07

8 new papers

A weekly snapshot of new work published in Exploration.

Inside this field

Focused directions

Focused topic

Autonomous Exploration Strategies

Within Exploration

235 papersExplore

Focused topic

Efficient Exploration

Within Exploration

129 papersExplore

Focused topic

Exploration-Exploitation Dilemma

Within Exploration

25 papersExplore

352 papers

Latest in Exploration

Browse all topics →

Randomized Least Squares Value Iteration itself is Joint Differentially Private
Jun 1, 2026Haiyang Lu, Pratik Gajane, Shaojie Bai +1AI Privacy Risks and Protection Efficient Exploration
Joint Agent Memory and Exploration Learning via Novelty Signals
Jun 1, 2026Shizuo Tian, Xiaohong Weng, Rui Kong +9Agent Memory Agentic Reinforcement-Learning Framework
Efficient Exploration for Iterative Nash Preference Optimization
May 31, 2026Tianlong Nan, Xiaopeng Li, Christian Kroer +1Reinforcement Learning From Human Feedback Exploration-Exploitation Dilemma
All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning
May 31, 2026Bernd Frauenknecht, Devdutt Subhasish, Artur Eisele +2Scalable Robot Learning Robotics
Where to Look: Can Foundation Models Reach a Target Viewpoint Through Active Exploration?
May 31, 2026Liyang Li, Muzhi Zhu, Zhiyue Zhao +53D Foundation Models Foundation Model
Bandit Simulation for Average Reward Inference
May 30, 2026Samya Praharaj, Chih-Yu Chang, Koulik Khamaru +1Confidence Intervals Bandits
STEM: Semantic Target Search and Exploration using MAVs in Cluttered Environments
May 30, 2026Nikhil Sethi, Max Lodel, Laura Ferranti +2Social Robot Navigation Classical Planning
VESTA: Visual Exploration with Statistical Tool Agents
May 29, 2026William Rudman, Abhishek Divekar, Kanishk Jain +6Visual Analytics Autonomous Exploration Strategies
Cluster Analysis with Resampling for Validation and Exploration (CARVE)
May 29, 2026Kai R. Wycik, Tiffany M. Tang, Tarek M. Zikry +1Image Clustering Cross Validation
Learning to Adapt: Self-Improving Web Agent via Cognitive-Aware Exploration
May 29, 2026Weile Chen, Bingchen Miao, Qifan Yu +6Web Agents Efficient Exploration
TARIC: Memory-Augmented Traversability-Aware Outdoor VLN under Interrupted Semantic Cues
May 29, 2026Tianle Zeng, Hanjing Ye, Jianwei Peng +3Vision-Language Navigation Autonomous Exploration Strategies
Emergence of Exploration in Policy Gradient Reinforcement Learning via Retrying
May 29, 2026Soichiro Nishimori, Paavo Parmas, Sotetsu Koyamada +4Efficient Exploration Retrying
Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO
May 29, 2026Yiming Ren, Yiran Xu, Zicheng Lin +8Group Relative Policy Optimization Multi-Objective Policy Optimization
Uncertainty-Aware and Temporally Regulated Expert Advice in Reinforcement Learning for Autonomous Driving
May 28, 2026Ahmed Abouelazm, Felix Klingebiel, Philip Schörner +1Autonomous Driving Control System Operator Learning
Destruction is a General Strategy to Learn Generation; Diffusion's Strength is to Take it Seriously; Exploration is the Future
May 28, 2026Pierre-André NoëlAutonomous Exploration Strategies
LLM-Guided Future Hypotheses for Horizon-Aware Exploration in Multi-Step Robot Manipulation
May 28, 2026Mohammad Khoshnazar, Andrew Melnik, Michael BeetzLong-Horizon Planning Generalizable Robotic Manipulations
UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
May 28, 2026Yuxiang Chai, Han Xiao, Xinyu Fu +3Graphical User Interface Agents Graphical User Interface
MOOSE-Copilot: A Web-Based Interactive Assistant for Unified Exploratory and Fine-Grained Scientific Hypothesis Discovery
May 28, 2026Hongran An, Zonglin YangHypothesis Generation Scientific Discovery
Global Policy-Space Response Oracles for Two-Player Zero-Sum Games
May 27, 2026Junyu Zhang, Feihong Yang, Jian Wang +2Imperfect-Information Games Exploration-Exploitation Dilemma
Long Live The Balance: Information Bottleneck Driven Tree-based Policy Optimization
May 27, 2026Hao Jiang, Shurui Li, Tianpeng Bu +7Multi-Objective Policy Optimization Exploration-Exploitation Dilemma
Exploratory Experience Shapes the Geometry of Predictive Representations
May 27, 2026Kseniia Shilova, Abdelrahman Sharafeldin, Advay Balakrishnan +1Predictive Coding Perception-Action Loop
AI Research Agents Narrow Scientific Exploration
May 27, 2026Yixuan Tang, Yi YangArtificial Intelligence Scientists Ideas
Long Live the Librarian! A Persistent Search Sub-Agent for Energy-Efficient Multi-Agent Software Engineering Systems
May 27, 2026Seunghyuk Cho, Sunghyun Choi, Jaeseung Heo +4Multi-Agent Systems Agentic Search
Eliot: Interactively $\underline{E}$ xploring Fast-Changing Scientific $\underline{Li}$ terature Trends with $\underline{O}$ nline Da $\underline{t}$ a and Learning
May 26, 2026Bernardo A. Denkvitts, Nitin Gupta, Biplav SrivastavaReal Datacite Dois Scientific Discovery
Collaborative Navigation and Exploration with $β$ -Sparse Gaussian Processes
May 25, 2026Evangelos Psomiadis, Dipankar Maity, Panagiotis TsiotrasSocial Robot Navigation Simultaneous Localization And Mapping
Explore Before You Solve: The Speed--Depth Trade-off in Epistemic Agents for ARC-AGI-3
May 25, 2026Liew Keong HanAgentic Benchmarks Efficient Exploration
On the Benefits of Free Exploration for Regret Minimization in Multi-Armed Bandits
May 25, 2026Yunlong Hou, Zixin Zhong, Vincent Y. F. TanMulti-Armed Bandits Linear Bandits
Implicit Null-space Manifold Generation for Redundant Robotic Systems
May 25, 2026Taiki Ishigaki, Teresa Vidal-Calleja, Ko Ayusawa +1Robotic Arms Manifolds
OPAL: Omnidirectional Path-efficient Aerial 3D expLoration
May 25, 2026Yoga Satwik Chappidi, Avideh ZakhorCoverage Path Planning Autonomous Exploration Strategies
Boosting Inference with Guided Reasoning: Stochastic Exploration for Recursive Models
May 24, 2026Andrew Corbett, Archit Sood, Anna Tzatzopoulou +2Reasoning Trajectory Recursion
Selective Test-Time Compute Scaling for Click-Through Rate Prediction via Uncertainty-Triggered Feature Path Exploration
May 24, 2026Moyu Zhang, Yun Chen, Yujun Jin +3Click-Through Rate Prediction Test Time
Test-Time Deep Thinking to Explore Implicit Rules
May 24, 2026Wentong Chen, Xin Cong, Zhong Zhang +8Agentic Reasoning Reasoning Trajectory
Towards Low-Gravity Planetary Exploration using Reinforcement Learning for Walking, Jumping, and In-flight Attitude Control
May 23, 2026Jørgen Anker Olsen, Kostas AlexisPerceptive Locomotion Policies Planetary Exploration
Terrain-Adaptive Grouser Wheel for Optimal Planetary Exploration: Design and Experimental Investigation
May 23, 2026Vincent Griffo, Yashwanth Kumar NakkaAutonomous Surface Vehicles Terrain
Multi-Floor Exploration for Ground Robots via an Incremental Reachable Graph and Structural Priors
May 22, 2026Zhiwen Zhu, Jiaqi Chen, Xiangyi Huang +2Autonomous Exploration Strategies
Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervision
May 22, 2026Jiayi FangWorld Models Semantic Representations
Pure Exploration for a Good Policy in Reinforcement Learning with Bandit Feedback
May 22, 2026Zitian Li, Wang Chi CheungOptimal Policies Bandits
Autonomous Frontier-Based Exploration with VLM Guidance
May 22, 2026Aarush Aitha, Avideh ZakhorVision-Language Navigation Social Robot Navigation
Semantic-Aware Guided Drone Exploration for Language-Conditioned 3D Indoor Mapping
May 22, 2026Nitin Vegesna, Avideh Zakhor3D Mapping 3D Scene Understanding
Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration
May 21, 2026Lily Goli, Justin Kerr, Daniele Reda +3Autonomous Exploration Strategies
Real-Time Auto-Optimization in Unknown Environments via Structure-Exploiting Dual Control for Exploration and Exploitation
May 21, 2026Shiying Dong, Haoyang Yang, Qiwei Liu +1Optimal Control Llm-Based Optimization Modeling
Kernel-Based Safe Exploration in Deep Reinforcement Learning
May 21, 2026Rupak Majumdar, Nikhil Singh, Sadegh SoudjaniControl Barrier Functions Deep Reinforcement Learning
ExComm: Exploration-Stage Communication for Error-Resilient Agentic Test-Time Scaling
May 21, 2026Woomin Song, Beomjun Kim, Daewon Choi +4Test-Time Scaling Communication
LABO: LLM-Accelerated Bayesian Optimization through Broad Exploration and Selective Experimentation
May 21, 2026Zhuo Chen, Xinzhe Yuan, Jianshu Zhang +8Bayesian Optimization Bayesian
A Visitation Grid for Complete Coverage Foraging in Robot Swarms
May 21, 2026Qi Arturo Gonzalez, Yifeng Gao, Li Zhang +1Swarms Efficient Exploration
MetaDNS: Enhancing Exploration in Discrete Neural Samplers via Well-Tempered Metadynamics
May 20, 2026Xiaochen Du, Juno Nam, Jaemoo Choi +7Samplers Molecular Dynamics
Mind the Gaps: Multi-Robot Feedback-Driven Ergodic Coverage in Unknown Environments
May 20, 2026Thales Costa Silva, Nora AyanianMulti-Robot Systems Finite-Sample Coverage Guarantees
APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents
May 20, 2026Yibo Li, Jiashuo Yang, Zhi Zheng +5Self-Evolving Agents Autonomous Exploration Strategies
CIG: Exploration via Conditional Information Gain
May 20, 2026Tim Joseph, Marcus Fechner, Philipp Stegmaier +2Information Gain Entropy Regularized Reinforcement Learning
Lower Bounds for Advection-Diffusion Equations: An Exploration with AI-Generated Proofs
May 20, 2026Chenyang An, Xiaoqian XuAdvection-Reaction-Diffusion Lower Bounds
A conceptual framework for learning to listen by reward: Curiosity-driven search for novel sources
May 19, 2026Andreas Triantafyllopoulos, Jakub Šťastný, Alexios Terpinas +3Deep Reinforcement Learning Audio
TravExplorer: Cross-Floor Embodied Exploration via Traversability-Aware 3-D Planning
May 19, 2026Han Zheng, Zhe Chen, Yudong Huang +4Unknown Environments Autonomous Exploration Strategies
Sampling-Based Safe Reinforcement Learning
May 19, 2026Luca Vignola, Bruce D. Lee, Manish Prajapat +4Safety Constraints Efficient Exploration
Beyond Mode Collapse: Distribution Matching for Diverse Reasoning
May 19, 2026Xiaozhe Li, Yang Li, Xinyu Fang +10Kullback-Leibler Divergence Autonomous Exploration Strategies
Generative Auto-Bidding with Unified Modeling and Exploration
May 19, 2026Mingming Zhang, Feiqing Zhuang, Na Li +7First-Price Auctions Ads
Exploring and Developing a Pre-Model Safeguard with Draft Models
May 19, 2026Hongyu Cai, Arjun Arunasalam, Yiming Liang +2Large Language Model Safety Safeguard
Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR
May 19, 2026Chongyu Fan, Gaowen Liu, Mingyi Hong +2Muon Reinforcement Learning With Verifiable Reward
Not all uncertainty is alike: volatility, stochasticity, and exploration
May 19, 2026Payam PirayEfficient Exploration Autonomous Exploration Strategies
ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop
May 18, 2026Yining Hong, Jiageng Liu, Han Yin +5Embodied Spatial Intelligence Perception-Action Loop
FBOS-RL: Feedback-Driven Bi-Objective Synergistic Reinforcement Learning
May 18, 2026Xikai Zhang, Yongzhi Li, Likang Xiao +6Group Relative Policy Optimization Efficient Exploration

Jun 1, 2026 · cs.LGJ/K move · Enter open · S save

Randomized Least Squares Value Iteration itself is Joint Differentially Private

Haiyang Lu, Pratik Gajane, Shaojie Bai, Mohammad Sadegh Talebi

1Laboratoire d’Informatique Fondamentale d’Orléans (LIFO), Université d’Orléans · College of Control Science and Engineering, Zhejiang University · Department of Computer Science, University of Copenhagen

As reinforcement learning (RL) increasingly applies to sensitive domains, such as health care and recommendation systems, privacy-preserving techniques have become essential to protect users' sensitive information. We investigate privacy-preserving RL under an episodic setting, focusing on algorithms based on randomized exploration, such as Randomized Least Squares Value Iteration (RLSVI). The overall goal is to study how randomized exploration interacts with the injected noise required by privacy mechanisms. In this work, we show a new privacy analysis that characterizes how the noise in RLSVI set for exploration simultaneously provides privacy protection. Specifically, we prove that RLSVI is

(\varepsilon(δ),δ)

-joint differentially private in tabular MDP as is with

\varepsilon(δ) = \frac{2AK}{H^2\log(2HSA)} + 2\sqrt{\frac{2AK\log(1/δ)}{H^2\log(2HSA)}}

, where

S

and

A

are the number of states and actions respectively,

H

is the length of an episode and

K

is the number of episodes.

AI Privacy Risks and Protection Efficient Exploration

Open paper Ask about it PDF