Exploration

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

11 new papers

A weekly snapshot of new work published in Exploration.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Exploration.

Period ending 2026-09-07

8 new papers

A weekly snapshot of new work published in Exploration.

Inside this field

Focused directions

Focused topic

Autonomous Exploration Strategies

Within Exploration

235 papersExplore

Focused topic

Efficient Exploration

Within Exploration

129 papersExplore

Focused topic

Exploration-Exploitation Dilemma

Within Exploration

25 papersExplore

352 papers

Latest in Exploration

Browse all topics →

Dual-Flow Reinforcement Learning with State-Aware Exploration
Jun 29, 2026Qijun Li, Zheng Fu, Qi Song +4Flow-Based Policy Deep Reinforcement Learning
Keypose Exploration: Efficient Automatic Trajectory Labelling and Cross-Embodiment Policy Transfer
Jun 27, 2026Yupu Lu, Hang Xu, Yizhou Chen +1Cross-Embodiment Transfer Interaction Trajectories
Randomized Exploration for Linear Bandits via Absolute Perturbations
Jun 26, 2026Toshinori Kitamura, Shuai Liu, Csaba SzepesváriThompson Sampling Linear Bandits
Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planning
Jun 25, 2026Tianyi Men, Zhuoran Jin, Pengfei Cao +3Large Language Model Planning Multimodal Agents
Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?
Jun 24, 2026Tyler Ga Wei Lum, Kushal Kedia, C. Karen Liu +1Imitation Learning Dexterous Manipulation
Implementation of reinforcement learning in chemical reaction networks: application to phototaxis as curiosity-driven exploration
Jun 24, 2026Ruyi Tang, Grégoire Sergeant-Perthuis, David ColliauxPartially Observable Markov Decision Process Reaction
TACTFUL: Tactile-Driven Exploration For Object Localization and Identification in Confined Environments
Jun 23, 2026Shivani Kamtikar, Chung Hee Kim, Camilla Tabasso +3Tactile Perception Generalizable Robotic Manipulations
ObsGraph: Hierarchical Observation Representation for Embodied Reasoning and Exploration
Jun 23, 2026Taekbeom Lee, Youngseok Jang, Jeonghwa Heo +2Hierarchical 3D Scene Graphs Scene Representation
HERCULES: An Open-Source Simulation Framework for Heterogeneous Multi-Robot SLAM, Collaborative Perception, and Exploration
Jun 22, 2026Sandilya Sai Garimella, Daniel Chase Butterfield, Sean Wilson +1Multi-Robot Systems Simultaneous Localization And Mapping
Semantic-Aware Autonomous Exploration for UAVs in Unknown Indoor Environments
Jun 21, 2026Duc-Thien Nguyen, Ngoc Minh Do, Xiem HoangVan +1Unmanned Aerial Vehicles 3D Semantic Occupancy Prediction
Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search
Jun 21, 2026Yashkumar R Lukhi, Harsh Rameshbhai Moradiya, Radu Timofte +1Mixture-of-Experts Models Neural Architecture Search
Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning
Jun 20, 2026Zhao Yang, Yuxuan Jiang, Ting-Chih Chen +18Deep Reinforcement Learning Off-Policy Evaluation
Ranking-and-Selection with Multiple Correct Answers and Non-Answerable Estimates
Jun 20, 2026Qiaoqiao Wang, Wei YouRanking Efficient Exploration
AgentDSE: Reasoning-Augmented Architectural Design Space Exploration
Jun 20, 2026Chenyu Wang, Jiahe Caroline Shi, David Kong +4Neural Architecture Search Agentic Optimization
When Is an LLM Worth It for Hyperparameter Optimization? A Budget-Matched Study on Tabular Data Finds the Warm-Start Is a Default Configuration, Not the Model
Jun 19, 2026Carson Rodrigues, Oysturn Vas, Isaiah Abner DCosta +1Hyperparameter Optimization Cold-Start
Quantile of Means: A Bonus-Free Ensemble Method for Minimax Optimal Reinforcement Learning
Jun 18, 2026Asaf Cassel, Aviv RosenbergEfficient Exploration Multi-Armed Bandits
DF-ExpEnse: Diffusion Filtered Exploration for Sample Efficient Finetuning
Jun 17, 2026Calvin Luo, Chen Sun, Shuran SongEfficient Exploration Autonomous Exploration Strategies
AI4SE and SE4AI Exploration: A Decade Looking Back and Forward
Jun 17, 2026H. Sinan Bank, Daniel R. Herber, Thomas BradleyEngineering New Era
Spotlight: Synergizing Seed Exploration and Spot GPUs for DiT RL Post-Training
Jun 17, 2026Ruiqi Lai, Dakai An, Wei Gao +6Reinforcement Learning Post-Training Multimodal Diffusion Transformers
GraphPO: Graph-based Policy Optimization for Reasoning Models
Jun 17, 2026Yuliang Zhan, Xinyu Tang, Jian Li +7Reasoning Paths Reinforcement Learning With Verifiable Reward
SAGE: Stochastic Prompt Optimization via Agent-Guided Exploration
Jun 17, 2026Ziyi Zhu, Luka Smyth, Saki Shinoda +1Agentic Optimization Prompt Optimization
LLMZero: Discovering Adaptive Training Strategies for RL Post-Training via LLM Agents
Jun 16, 2026Haoyang Fang, Wei Zhu, Boran Han +11Reinforcement Learning Post-Training Exploration-Exploitation Dilemma
EvolveNav: Proactive Preflection and Self-Evolving Memory for Zero-Shot Object Goal Navigation
Jun 16, 2026Qi Chai, Wenhao Shen, Nanjie Yao +5Vision-Language Navigation Self-Evolving Agents
ED3R: Energy-Aware Distributed Disaster Detection Enabled by Cooperative Robotic Agents
Jun 16, 2026Lina Magoula, Nikolaos Koursioumpas, Nancy Alonistioti +1Wildfire Detection Multi-Robot Systems
SPHINX: First Explain, Then Explore
Jun 16, 2026Nguyen Do, Tue M. Cao, Tien Van Do +3Autonomous Driving Simulation Autonomous Driving
Infant Spontaneous Movement Noise Improves Exploration in Deep RL
Jun 15, 2026Francisco M. López, Markus R. Ernst, Francisco Cruz +2Deep Reinforcement Learning Efficient Exploration
SkillWiki: A Living Knowledge Infrastructure for Agent Skills
Jun 15, 2026Dingcheng Huang, Yuda Ding, Bingshuo Liu +8Reusable Agent Skills Wikipedia
NIMO: A Software Platform for Closed-Loop Materials Exploration with Diverse AI Algorithms
Jun 14, 2026Ryo Tamura, Naruki Yoshikawa, Koji Tsuda +1Data-Driven Materials Discovery Autoresearch
Exploring Starts Are Not Enough: Counterexamples and a Fix for Monte Carlo Exploring Starts
Jun 13, 2026Octave Oliviers, Glenn VinnicombeMonte Carlo Autonomous Exploration Strategies
VANDERER: Map-Free Exploration using Future-Aware and Visual-Curiosity-Guided Diffusion Policy
Jun 12, 2026Venkata Naren Devarakonda, Raktim Gautam Goswami, Prashanth Krishnamurthy +1Efficient Exploration Autonomous Exploration Strategies
Discovery under Hypothesis Redundancy: A Geometric Theory of Discovery Bottlenecks
Jun 12, 2026Li Xia, Baoxun WangHypothesis Generation Efficient Exploration
MeEvo: Metacognitive Evolution Combined with Natural Evolution for Automatic Heuristic Design
Jun 12, 2026Zishang Qiu, Xinan Chen, Rong Qu +1Evolutionary Search Llm-Driven
Multi-Modal Multi-Agent Robotic Cognitive Alignment enabled by Non-Invasive Consumer Brain Computer Interfaces: A Proof of Concept Exploration
Jun 11, 2026Nataliya Kosmyna, Liz Jenkins, Anoop K. SinhaMulti-Agent Systems Human-Robot Interaction
Benchmarking AI Agents for Addressing Scientific Challenges Across Scales
Jun 10, 2026Tianyu Liu, Allen Xin Wang, Antonia Panescu +30Agentic Benchmarks Autoresearch
Strategic Decision Support for AI Agents
Jun 10, 2026Shayan Kiyani, Sima Noorani, George Pappas +1Agent Decisions Decision Support
G-MAPP: GPU-accelerated Multi-Agent Planning and Perception for Reactive Motion Generation
Jun 10, 2026Tanmay Bishnoi, Riddhiman Laha, Tobias Löw +3Collision-Free Trajectories Multi-Gpu Systems
Exploration Structure in LLM Agents for Multi-File Change Localization
Jun 10, 2026Akeela Darryl Fattha, Kia Ying Chua, Lingxiao Jiang +1Commits Large Language Model Agents
Explore From Sketch: Accelerating UAV Exploration in Large-scale Environments with Prior Maps
Jun 10, 2026Tiancheng Lai, Yuman Gao, Xiangyu Li +83D Mapping Point Cloud Registration
ConsistencyPlanner: Real-time Planning with Fast-Sampling Consistency Models
Jun 10, 2026Qichao Zhang, Xing Fang, Jiaqi Fang +4Autonomous Driving Planning Methods
A Distributed Multi-UGV Exploration Framework With Loop-Aware Planning and Descriptor-Aided Localization in Resource-Limited Environments
Jun 9, 2026Zhiwei Li, Haiou Liu, Xijun Zhao +3Multi-Uav Systems Drone-View Geo-Localization
Expected Free Energy-based Planning as Variational Inference
Jun 9, 2026Wouter W. L. Nuijten, Thijs van de Laar, Bert de VriesVariational Inference Classical Planning
WebChallenger: A Reliable and Efficient Generalist Web Agent
Jun 9, 2026Jayoo Hwang, Xiaowen Zhang, Vedant PadwalWeb Agents Autonomous Exploration Strategies
SHAPO: Sharpness-Aware Policy Optimization for Safe Exploration
Jun 8, 2026Kaustubh Mani, Yann Pequignot, Vincent Mai +1Multi-Objective Policy Optimization Autonomous Exploration Strategies
Exploration of Foundation Model-Based Robots in Patient and Elderly Care
Jun 8, 2026Zhiwen Qiu, Wei Liu, Yuexing HaoCare Human-Centered Framework
Predictive Assistance and the Temporal Dynamics of Exploratory Compression
Jun 8, 2026Balaraju BattuPredictive Coding Efficient Exploration
Algorithm for Contextual Queueing Bandits with Rate-Optimal Queue Length Regret
Jun 8, 2026Seoungbin Bae, Dabeen LeeLinear Contextual Bandits Efficient Exploration
Amortized Neural Optimization for Pre-Layout Signal Integrity Design Space Exploration using Differentiable Surrogates
Jun 5, 2026Julian Withöft, Werner John, Emre Ecik +2Neural Network Optimization Llm-Based Optimization Modeling
SWE-Explore: Benchmarking How Coding Agents Explore Repositories
Jun 5, 2026Shaoqiu Zhang, Yuhang Wang, Jialiang Liang +8Repository-Level Code Understanding Coding Agents
Human Adults and LLMs as Scientists: Who Benefits from Active Exploration?
Jun 4, 2026Mandana Samiei, Eunice Yiu, Anthony GX-Chen +5Abductive Reasoning Cognitive Science
Retry Policy Gradients in Continuous Action Spaces
Jun 4, 2026Soichiro Nishimori, Paavo ParmasSoft Actor-Critic Efficient Exploration
Agentic Molecular Recovery via Molecule-Aware Exploration
Jun 4, 2026Suwan Yoon, Changhee LeeMolecular Structure Elucidation Autonomous Exploration Strategies
What Type of Inference is Active Inference?
Jun 3, 2026Wouter W. L. Nuijten, Mykola Lukashchuk, Thijs van de Laar +1Classical Planning Free Energy Principle
MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment
Jun 3, 2026Abhishek S, Badrikanath Praharaj, Sreeram MVSocial Robot Navigation Joint Reinforcement Learning
Testing Neural Networks via Bayesian-Guided Exploration of Decision Landscapes
Jun 3, 2026Bin Duan, Meiru Che, Guowei YangBayesian Neural Networks Neural Network Verification
Resource-Constrained Adaptive Inference for Sequential Pricing
Jun 2, 2026Ruicheng Ao, Jiashuo Jiang, David Simchi-LeviPrices Inference-Time Control
Constraint-Enhanced Physical Search through Correlation Matching
Jun 2, 2026Song-Ju KimEfficient Exploration Spatio-Temporal Correlations
ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning
Jun 2, 2026Ziyan Liu, Xueda Shen, Yuzhe Gu +7Large Reasoning Models Efficient Chain-Of-Thought Reasoning
Ask When It Pays: Cost-Aware Open-Ended Interaction for Instance Goal Navigation
Jun 2, 2026Xunyi Zhao, Sihao Lin, Gengze Zhou +5Navigation Efficient Exploration
An Exploration of Collision-based Enemy Morphology Generation
Jun 1, 2026Johor Jara Gonzalez, Matthew GuzdialMotion Generation Collision Prediction
Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models
Jun 1, 2026Wei Deng, Xianlin Zhang, Mengshi QiSpatial Reasoning Cognitive Map

Jun 29, 2026 · cs.LGJ/K move · Enter open · S save

Dual-Flow Reinforcement Learning with State-Aware Exploration

Qijun Li, Zheng Fu, Qi Song, Yifei He+3

In complex continuous-control reinforcement learning tasks, multimodal optimal actions often coincide with uncertain, multimodal return distributions, making reliable value estimation and multimodal exploration challenging. Existing value estimation methods using unimodal Gaussians restrict expressiveness and yield biased estimates. Recent generative policies can represent multimodal actions but often collapse to a few modes and under-explore high-value areas of the action space. Motivated by these challenges, we propose Dual-Flow RL, a unified actor-critic framework that jointly models a continuous return distribution and a multimodal policy distribution using conditional flow matching (CFM). This design supports reliable value estimation and sustained multimodal exploration. To further enhance exploration, we introduce an Entropy-Covariance Exploration Regulator (ECER) that enables state-aware exploration regulation leveraging policy entropy and action-uncertainty covariance. Experiments on DeepMind Control Suite and Humanoid-Bench show that Dual-Flow RL achieves state-of-the-art performance on most tasks, significantly outperforming prior diffusion-based and flow-based methods.

Flow-Based Policy Deep Reinforcement Learning Efficient Exploration Action Space Autonomous Exploration Strategies

Open paper Ask about it PDF