RL for Video Reasoning

RL: Reinforcement Learning

Follow this topic Ask about this topic

Latest papers

24 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

FrameGRPO: Incentivizing Video Reasoning via Multi-Frame Rollouts and Temporal Credit
Oct 19, 2026Jiaxuan Sun, Biao Wang, Shuai LiRL for Video Reasoning Video Reasoning
Shanghai Jiao Tong University · Shanghai Innovation Institute · Tencent Hy
OWLET: On-Policy Weighted Learning via Evidence Transfer for Video Large Language Model Post-Training
Oct 9, 2026Qitan Lv, Ke Fan, Hong Wang +5Video-Language Models Large Vision-Language Models
University of Science and Technology of China · Shanghai AI Laboratory · Tsinghua University
Frame Differential On-Policy Self-Distillation for Video Reasoning
Sep 30, 2026Haiying He, Xin Zheng, Shaoli Hu +4On-Policy Self-Distillation Video Reasoning
HKUST · NKU · SEU +1
Watch-Think-Interact: Bootstrapping Long-Horizon Multi-Turn Streaming Video Reasoning with Reinforcement Learning
Sep 29, 2026Ziheng Huang, Yicheng Bao, Xueheng Li +8Streaming Video Understanding Video QA
East China Normal University · University of Science and Technology of China · Xiamen University
Video-HopChain: Multi-Hop Questions and Confidence-Gated Exploration for Video Reasoning Models
Sep 22, 2026Trung Nguyen Quang, Yuhao Dong, Shuo Sun +4Group Relative Policy Optimization Video Reasoning
S-Lab, Nanyang Technological University (NTU) · Johns Hopkins University · NTU
Long-to-Short Video Evidence Reasoning for Grounded Question Answering
Sep 14, 2026Kaiyan Chen, Junbin Xiao, Xun YangTemporal Video Grounding Video QA
University of Science and Technology of China
VLX-VR: An Agentic-Aware Video Reasoning Model
Sep 9, 2026Sheng Li, Peng Liu, Qianqian Zhang +1Video Reasoning Memory-Augmented Video Understanding
Om AI Research
Video-FLAIR: Not Whether to Reason, But How
Aug 27, 2026Yogesh Kulkarni, Pooyan FazliVLM Reasoning Video Reasoning
Arizona State University
AdaThinkV: Adaptive Thinking for Token-Efficient Video Reasoning
Aug 3, 2026Jingqi Tian, Haoji Zhang, Lin Chen +7Efficient VLM Inference RL for Language Model Reasoning
Tsinghua Shenzhen International Graduate School, Tsinghua University · Alibaba Group · Peking University
TimeThink: Reasoning with Time for Video LLMs
Jul 6, 2026Handong Li, Longteng Guo, Zikang Liu +8Temporal Video Grounding Process Reward Models
School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · OPPO AI Center, OPPO Inc.
CARE: Competence-Aware Reward Shaping for Adaptive Reasoning Length in Video-MLLMs
Jun 18, 2026Chengwen Liu, Hao Peng, Jisheng Dang +3Reward Shaping Video Reasoning
School of Information Science and Engineering, Lanzhou University, Lanzhou, China · School of Medical Technology, Beijing Institute of Technology, Beijing, China · School of Computing, National University of Singapore, Singapore
Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
Jun 16, 2026Chengwen Liu, Zhe Huang, Jisheng Dang +3Multimodal Reward Modeling Video Reasoning
School of Information Science and Engineering, Lanzhou University, Lanzhou, China · Beijing University of Posts and Telecommunications, Beijing, China · Cloud and AI BU, Huawei, Shenzhen, China +1
CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning
Jun 7, 2026Muge Qi, Rong Fu, Pengbin Feng +7Temporal Video Grounding Video Understanding
National Biomedical Imaging Center, Peking University, Beijing, China · University of Macau, Macau, China · University of Southern California, Los Angeles, USA +3
Video Models Can Reason with Verifiable Rewards
May 14, 2026Tinghui Zhu, Sheng Zhang, James Y. Huang +5Video Diffusion Models RL for Video Generation
University of California, Davis · Microsoft Research · University of Southern California +1
VISD: Enhancing Video Reasoning via Structured Self-Distillation
May 7, 2026Hao Lin, Kunyang Lv, Xu Jiang +5Video-Language Models Video Reasoning
1HUST · 2Wuhan University · 3Peking University +1
Beyond Perceptual Shortcuts: Causal-Inspired Debiasing Optimization for Generalizable Video Reasoning in Lightweight MLLMs
May 2, 2026Jingze Wu, Quan Zhang, Hongfei Suo +2VLM Robustness Video Reasoning
Sun Yat-sen University, China
ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward
Apr 23, 2026Jingpei Wu, Xiao Han, Weixiang Shen +3Multimodal Understanding Multimodal QA
LMU Munich · Harvard University · University of Cambridge +2
EasyVideoR1: Easier RL for Video Understanding
Apr 18, 2026Chuanyu Qin, Chenxu Yang, Qingyi Si +6Reinforcement Learning Video-Language Models
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
Find, Fix, Reason: Context Repair for Video Reasoning
Apr 17, 2026Haojian Huang, Chuanyu Qin, Yinchuan Li +1Video Reasoning RL for Video Reasoning
The Hong Kong University of Science and Technology (Guangzhou) · Knowin AI · Institute of Information Engineering, Chinese Academy of Sciences
When Rewards Disagree: Reward Weighting for Token-Efficient Video Reasoning
Apr 6, 2026Zinuo Li, Yongxin Guo, Jun Liu +6Video Reasoning VLM Reasoning
University of Western Australia · Tencent Youtu Lab · CUHKSZ +2
Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning
Apr 6, 2026Songyuan Yang, Weijiang Yu, Jilin Ma +5Video Reasoning VLM Inference
National University of Defense Technology · Sun Yat-sen University
STRIVE: Structured Spatiotemporal Exploration for Reinforcement Learning in Video Question Answering
Apr 2, 2026Emad Bahrami, Olga Zatsarynna, Parth Pathak +3Video QA RL for Video Reasoning
University of Bonn · Lamarr Institute for Machine Learning and Artificial Intelligence · Meta +1
Wan-R1: Verifiable-Reinforcement Learning for Video Reasoning
Mar 29, 2026Ming Liu, Yunbei Zhang, Shilong Liu +2RL for Video Reasoning Video Reasoning
Iowa State University, Ames, IA 50011, USA · Tulane University, New Orleans, LA 70118, USA · Princeton University, Princeton, NJ 08544, USA
VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting
Mar 15, 2026Daeun Lee, Shoubin Yu, Yue Zhang +1RL for Video Reasoning Video Reasoning
University of North Carolina, Chapel Hill, USA

Oct 19, 2026J/K move · Enter open · S save

FrameGRPO: Incentivizing Video Reasoning via Multi-Frame Rollouts and Temporal Credit

Jiaxuan Sun, Biao Wang, Shuai Li

Shanghai Jiao Tong University · Shanghai Innovation Institute · Tencent Hy

RL for Video Reasoning Video Reasoning Group Relative Policy Optimization Reinforcement Learning with Verifiable Rewards Temporal Credit Assignment

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards, particularly Group Relative Policy Optimization (GRPO), has improved video reasoning in multimodal large language models. However, standard video GRPO varies only linguistic trajectories while conditioning every rollout in a group on the same sampled frames, which can produce homogeneous rewards and weaken group-relative learning when the shared visual evidence is insufficient or distracting. We propose FrameGRPO, a simple and effective reinforcement-learning framework that requires neither auxiliary networks nor changes to the model architecture. Specifically, FrameGRPO combines two lightweight components: (1) Multi-Frame Rollouts, which use only uniform temporal subsampling of a single maximal-frame decode to construct aligned views that diversify visual evidence and reasoning trajectories; and (2) Gated Temporal Efficiency Credit, which selectively reinforces a correct lower-ratio trajectory when all rollouts in a fixed full-ratio reference subset fail, without imposing an unconditional preference for fewer frames. Extensive experiments across diverse video understanding and reasoning benchmarks demonstrate robust overall improvements over standard GRPO, highlighting temporal-view diversification as an effective mechanism for exploration and credit assignment in video MLLMs.