RL for VLMs

RL: Reinforcement Learning · VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

36 papers in the last four weeks, up 227% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 287

All topics

SOLAR-RL: Semi-Online Long-horizon Assignment Reinforcement Learning
Apr 24, 2026Jichao Wang, Liuyang Bian, Yufeng Zhou +9RL for GUI Agents Credit Assignment in RL
1vivo AI Lab · 2Zhejiang Lab · 5Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences +2
ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward
Apr 23, 2026Jingpei Wu, Xiao Han, Weixiang Shen +3Process Reward Models Multimodal QA
LMU Munich · Harvard University · University of Cambridge +2
Incentivizing Neuro-symbolic Language-based Reasoning in VLMs via Reinforcement Learning
Apr 23, 2026Karthic PalaniappanVLM Reasoning Neuro-Symbolic Reasoning
Georgia Institute of Technology
Reinforcing 3D Understanding in Point-VLMs via Geometric Reward Credit Assignment
Apr 23, 2026Jingkun Chen, Ruoshi Xu, Mingqi Gao +23D Spatial Reasoning VLM Hallucination
Northwestern Polytechnical University China · Southern University of Science and Technology China · The University of Sheffield United Kingdom +2
V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization
Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Multimodal Reasoning Reinforcement Learning with Verifiable Rewards
School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China
SSL-R1: Self-Supervised Visual Reinforcement Post-Training for Multimodal Large Language Models
Apr 22, 2026Jiahao Xie, Alessio Tonioni, Nathalie Rauschmayr +2Multimodal Large Language Models Reinforcement Learning with Verifiable Rewards
Max Planck Institute for Informatics, SIC · VIA Research Center · Google
ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards
Apr 22, 2026Wentao Yan, Shengqin Wang, Huichi Zhou +4Multimodal IR Process Reward Models
East China Normal University · Huawei Noah’s Ark Lab · University College London +2
Video-ToC: Video Tree-of-Cue Reasoning
Apr 22, 2026Qizhong Tan, Zhuotao Tian, Guangming Lu +2Video Reasoning VLM Reasoning
Harbin Institute of Technology, Shenzhen
HyLaR: Hybrid Latent Reasoning with Decoupled Policy Optimization
Apr 22, 2026Tao Cheng, Shi-Zhe Chen, Hao Zhang +3Multimodal Large Language Models Multimodal Reasoning
Tencent PCG, China · Tencent CSIG, China
Visual Reasoning through Tool-supervised Reinforcement Learning
Apr 21, 2026Qihua Dong, Gozde Sahin, Pei Wang +4Tool Use in VLMs VLM Reasoning
1Northeastern University · 2Amazon AGI
Rethinking Reinforcement Fine-Tuning in LVLM: Convergence, Reward Decomposition, and Generalization
Apr 21, 2026Carter Adams, Rafael Oliveira, Gabriel Almeida +1Tool Use in VLMs Reinforcement Learning
Federal University of Bahia
Multi-modal Reasoning with LLMs for Visual Semantic Arithmetic
Apr 21, 2026Chuou Xu, Liya Ji, Qifeng ChenLarge Vision-Language Models VLM Reasoning
The Hong Kong University of Science and Technology
EVE: Verifiable Self-Evolution of MLLMs via Executable Visual Transformations
Apr 20, 2026Yongrui Heng, Chaoya Jiang, Han Yang +2Synthetic Data Generation Multimodal Large Language Models
School of Control Science and Engineering, Shandong University Jinan, China · Zeekr, Geely Auto Shanghai, China
RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding
Apr 19, 2026Gaozhi Zhou, Hu He, Peng Shen +8Remote Sensing Image Understanding Visual Question Answering
School of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China · School of Geosciences and Info-Physics, Central South University, Changsha 410083, China
Waking Up Blind: Cold-Start Optimization of Supervision-Free Agentic Trajectories for Grounded Visual Perception
Apr 19, 2026Ashutosh Bajpai, Tamal Majumder, Akshay Nambi +1Reinforcement Learning Tool-Using Vision-Language Agents
Indian Institute of Technology Delhi, India · Microsoft Research, India · Indian Institute of Technology Abu Dhabi, UAE
Freshness-Aware Prioritized Experience Replay for LLM/VLM Reinforcement Learning
Apr 18, 2026Weiyu Ma, Yongcheng Zeng, Yan Song +4Reinforcement Learning RL Post-Training
King Abdullah University of Science and Technology (KAUST) · Chinese Academy of Sciences, Institute of Automation (CASIA) · AI Centre, Department of Computer Science, University College London +1
EasyVideoR1: Easier RL for Video Understanding
Apr 18, 2026Chuanyu Qin, Chenxu Yang, Qingyi Si +6Reinforcement Learning Video-Language Models
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
Q-DeepSight: Incentivizing Thinking with Images for Image Quality Assessment and Refinement
Apr 18, 2026Xudong Li, Jiaxi Tan, Ziyin Zhou +6Tool Use in VLMs Multimodal CoT Reasoning
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, 361005, P.R. China · Beijing Institute of Technology
S-GRPO: Unified Post-Training for Large Vision-Language Models
Apr 17, 2026Yuming Yan, Kai Tang, Sihong Chen +4VLM Adaptation Group Relative Policy Optimization
Tencent Shenzhen, Guangdong, China
UniDoc-RL: Coarse-to-Fine Visual RAG with Hierarchical Actions and Dense Rewards
Apr 16, 2026Jun Wang, Shuo Tan, Zelong Sun +5Document Understanding Multimodal RAG
Glint Lab
Targeted Exploration via Unified Entropy Control for Reinforcement Learning
Apr 16, 2026Chen Wang, Lai Wei, Yanzhi Zhang +5Reinforcement Learning RL for Language Model Reasoning
College of Software, Nankai University · Zhongguancun Academy · Shanghai Jiao Tong University +3
Learning Adaptive Reasoning Paths for Efficient Visual Reasoning
Apr 16, 2026Yixu Huang, Tinghui Zhu, Muhao ChenEfficient VLM Inference Visual Reasoning
♠Fudan University · ♣University of California, Davis
Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
Apr 8, 2026Mengdan Zhu, Senhao Cheng, Liang ZhaoVLM Interpretability Latent Visual Reasoning
Emory University · University of Michigan, Ann Arbor
TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
Mar 29, 2026Guoli Jia, Yisheng Zhang, Haote Hu +11Tool-Using Vision-Language Agents Image Restoration
Tsinghua University, Beijing, China · Data Science & Artificial Intelligence Research Institute, China Unicom, Beijing, China · Hunan University, Changsha, China +2
VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning
Mar 26, 2026Zhe Gao, Shiyu Shen, Taifeng Chai +7Tool Use in VLMs Efficient VLM Inference
Nanjing University, Nanjing, China · Nankai University, Tianjin, China · East China Normal University, Shanghai, China +3
Clinical Cognition Alignment for Gastrointestinal Diagnosis with Multimodal LLMs
Mar 21, 2026Huan Zheng, Yucheng Zhou, Tianyi Yan +6Endoscopy Medical Diagnosis
SKL-IOTSC, CIS, University of Macau · 2Shanghai Jiao Tong University · 3COWARobot Co. Ltd. +1
Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worlds
Mar 19, 2026Andrew Choi, Xinjie Wang, Zhizhong Su +1Sim-to-Real Transfer Vision-Language-Action Models
Horizon Robotics
From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation
Mar 16, 2026Yibin Liu, Yaxing Lyu, Daqi Gao +5Robotics Robotic Manipulation
Shanghai Jiao Tong University · Northeastern University · The University of Hong Kong +2
Are Video Reasoning Models Ready to Go Outside?
Mar 11, 2026Yangfan He, Changgyu Boo, Jaehong YoonVLM Robustness Video Reasoning
NTU Singapore · Korea University
Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum
Mar 5, 2026Shan Ning, Longtian Qiu, Xuming HeVisual Question Answering Reinforcement Learning
ShanghaiTech University, Shanghai, China · Lingang Laboratory, Shanghai, China · Shanghai Engineering Research Center of Intelligent Vision and Imaging

Apr 24, 2026, cs.LGJ/K move · Enter open · S save

SOLAR-RL: Semi-Online Long-horizon Assignment Reinforcement Learning

Jichao Wang, Liuyang Bian, Yufeng Zhou, Han Xiao+8

1vivo AI Lab · 2Zhejiang Lab · 5Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences+2

RL for GUI Agents Credit Assignment in RL Offline RL Long-Horizon Agent Tasks RL for VLMs

Open paper AskPDF arXiv

As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learning (RL) has emerged as a promising paradigm for training MLLM agents on dynamic GUI tasks, its effective application faces a dilemma. Standard Offline RL often relies on static step-level data, neglecting global trajectory semantics such as task completion and execution quality. Conversely, Online RL captures the long-term dynamics but suffers from high interaction costs and potential environmental instability. To bridge this gap, we propose SOLAR-RL (Semi-Online Long-horizon Assignment Reinforcement Learning). Instead of relying solely on expensive online interactions, our framework integrates global trajectory insights directly into the offline learning process. Specifically, we reconstruct diverse rollout candidates from static data, detect the first failure point using per-step validity signals, and retroactively assign dense step-level rewards with target-aligned shaping to reflect trajectory-level execution quality, effectively simulating online feedback without interaction costs. Extensive experiments demonstrate that SOLAR-RL significantly improves long-horizon task completion rates and robustness compared to strong baselines, offering a sample-efficient solution for autonomous GUI navigation.

Momentum

Related topics

Latest papers 287