Multimodal Reward Modeling

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 59

All topics

Think Before You Score: Thinking Reward Model for Visual Generation
Sep 29, 2026Xuehai Bai, Zhenchen Tang, Yang Shi +9Reward Modeling Multimodal Reward Modeling
HDU · SenseTime · CASIA +5
SkillRubric: Co-Evolving Actor Guidance and Evaluator Rubrics for Multimodal Agents
Sep 28, 2026Bingqing Jiang, Guoxi Zhang, Jasper Wang +7Multimodal Reward Modeling Rubric-Based RL
The University of Hong Kong · WeChat, Tencent · Peking University +2
ARS: Agentic Reward System for Robot Learning
Sep 28, 2026Sheng Hu, Weiyi Lu, Lingbing Zeng +5RL for Robotics Process Reward Models
AIRC, Midea Group
Diffusion Reward Models
Sep 27, 2026Xiangyang Wang, Bingxiang He, Zeyuan Liu +13Reward Modeling Multimodal Reward Modeling
Tsinghua University · University of Illinois Urbana-Champaign
RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling
Sep 19, 2026Zhenchen Tang, Yang Li, Songlin Yang +6Reward Modeling Multimodal Reward Modeling
New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Tencent +1
WorldReward: Reward Modeling for Camera-Conditioned World Models
Sep 3, 2026Yibin Wang, Zehan Wang, Junshu Tang +13Reward Modeling Camera-Conditioned Video Generation
Fudan University · Tencent Hunyuan · Shanghai Innovation Institute +3
RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance
Aug 10, 2026Dongchi Huang, Hongyin Zhang, Bohan Hou +11Reward Modeling Robot Foundation Models
DAMO Academy, Alibaba Group · Hupan Lab
TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models
Aug 9, 2026Yidong Wang, Yan Zhan, Ziteng Feng +16Reward Modeling Pairwise Preference Evaluation
Peking University · University of Science and Technology of China · Southeast University +6
GeoReward: Mitigating Contextual Variable Overestimation in Vision-Language Models for Cross-Market Preference Prediction
Aug 5, 2026Shuo Liu, Huixiang Cai, Weiru Zhang +1Vision-Language Models VLM Adaptation
Alibaba International Digital Commerce Group
Enhancing VLM Reward Models Through Structure-Aware Fine-Tuning
Aug 4, 2026Pyrros Koussios, Chenhao Li, Xin Chen +1Self-Supervised Learning VLM Adaptation
ETH Zürich
Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
Jul 31, 2026Yingmao Miao, Pengfei Zhang, Xiaochen Lv +5Image Editing Evaluation Multimodal Reward Modeling
Xi’an Jiaotong University · DreamX Team, Alibaba Group · Shanghai Jiaotong University
OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
Jul 30, 2026Qiushi Sun, Kanzhi Cheng, Yian Wang +20VLM Evaluation Computer-Use Agent Benchmarks
The University of Hong Kong · Nanjing University · National University of Singapore +4
DenseReward: Dense Reward Learning via Failure Synthesis for Robotic Manipulation
Jul 14, 2026Yu Fang, Wanxi Dong, Jiaqi Liu +7RL for Robotics Reward Modeling
University of North Carolina at Chapel Hill · Carnegie Mellon University · Shanghai Jiao Tong University +1
Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation
Jul 13, 2026Runhui Huang, Qihui Zhang, Zhe Liu +3T2I Generation Multimodal Reward Modeling
The University of Hong Kong · Peking University · ByteDance Seed
Multimodal Reward Hacking in Reinforcement Learning
Jul 10, 2026Jiayu Yao, Yiwei Wang, Anmeng Zhang +5Multimodal Large Language Models Multimodal Reward Modeling
Institute of Computing Technology, Chinese Academy of Sciences · University of California, Merced · Southeast University
CoRe: Combined Rewards with Vision-Language Model Feedback for Preference-Aligned Reinforcement Learning
Jul 2, 2026Hexian Ni, Tao Lu, Yinghao CaiRobotic RL Multimodal Reward Modeling
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.
VLM-AR3L: Vision-Language Models for Absolute and Relative Rewards in Reinforcement Learning
Jul 1, 2026Kuan-Chen Chen, Winston Chen, Wei-Fang Sun +1Multimodal Reward Modeling Reward Design for RL
Department of Computer Science, National Tsing Hua University · NVIDIA AI Technology Center (NVAITC)
Vision-Language Procedural Reasoning for Context-Aware Reward Modeling of Robotic Endovascular Guidewire Navigation
Jun 29, 2026Wentong Tian, Jiyuan Zhao, Tianliang Yao +4RL for Robotics Robotic Endovascular Intervention
Department of Control Science and Engineering, College of Electronic and Information Engineering, and Shanghai Institute of Intelligent Science and Technology, Tongji University, Shanghai 200092, China. · Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong, Hong Kong SAR 999077, China. · Shanghai Operation Robot Co., Ltd., Shanghai 201318, China.
RMTL: Reinforced Micro-task Learning for Long-Horizon Manipulation with VLM Rewards
Jun 24, 2026Anıl Can Ateş, Orhan Kahraman, Cihan TopalRL for Robotics Long-Horizon Robotic Manipulation
Istanbul Technical University
VisCritic: Visual State Comparison as Process Reward for GUI Agents
Jun 23, 2026Jiachen QianProcess Reward Models GUI Agents
City University of Hong Kong
DiT-Reward: Generative Representations for Text-to-Image Reward Modeling
Jun 22, 2026Yuanming Yang, Guoqing Ma, Bo Wang +5Representation Learning Diffusion Transformer
JD Explore Academy, JD.com, Beijing, China · Tsinghua University, Beijing, China · Beijing Institute of Technology, Beijing, China +1
Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views
Jun 22, 2026Jiho Choi, Seonho Lee, Seojeong Park +1Visual Question Answering Active Perception
Graduate School of Artificial Intelligence, KAIST, Republic of Korea · KRAFTON, Republic of Korea
Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
Jun 16, 2026Chengwen Liu, Zhe Huang, Jisheng Dang +3Multimodal Reward Modeling Video Reasoning
School of Information Science and Engineering, Lanzhou University, Lanzhou, China · Beijing University of Posts and Telecommunications, Beijing, China · Cloud and AI BU, Huawei, Shenzhen, China +1
MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning
Jun 16, 2026Wanshi Xu, Haokun Zhao, Haidong Yuan +2Multimodal Reasoning Multimodal Reward Modeling
School of ECE, Peking University · College of Computer Science and Artificial Intelligence, Fudan University · School of Software and Microelectronics, Peking University +1
CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
Jun 12, 2026Jiayue Cao, Zhicong Lu, Xuehan Sun +6Multimodal Reward Modeling VLM Reasoning
University of Chinese Academy of Sciences · 2Wuhan University · 3Tsinghua University +1
HPSv3++: Scaling Reward Models Across the Full Spectrum of Diffusion Model Capabilities
Jun 12, 2026Yijun Liu, Jie Huang, Zeyue Xue +5Diffusion Model Alignment Multimodal Reward Modeling
Tsinghua University · JD Explore Academy · Peking University +1
SARM2: Multi-Task Stage Aware Reward Modeling for Self Improving Robotic Manipulation
Jun 9, 2026Qianzhong Chen, Hau Zheng, Justin Yu +8RL for Robotics Reward Modeling
Stanford University · UC Berkeley · Shanghai Jiao Tong University
Z-Reward: Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions
Jun 8, 2026Xin Jin, Huanqia Cai, Zhen Li +9Reward Modeling Reasoning Distillation
Z-Image Team, Alibaba Group · VCIP, CS, Nankai University
DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving
Jun 7, 2026Qimao Chen, Fang Li, Yuechen Luo +11Autonomous Driving Datasets Autonomous Driving Benchmarks
1Tsinghua University · 2Xiaomi EV
Improving Multimodal Reasoning via Worst Dimension Optimization
Jun 5, 2026Haocheng Lv, Huaping Zhang, Qiuchi Li +2Process Reward Models Multimodal Reasoning
Beijing Institute of Technology
MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching
Jun 1, 2026Jiahui Huang, Yasi Zhang, Tianyu Chen +6Multimodal Reward Modeling RL for Generative Models
Apple · University of California, Los Angeles · University of Texas at Austin +1
MuPHI: Learning Implicit Multimodal Harm Reasoning via Semantically Grounded Reward Optimization
May 28, 2026Anisha Saha, Varsha Suresh, Teodora Kamova +3VLM Robustness Multimodal Reasoning
Max Planck Institute for Informatics, Saarland Informatics Campus · Saarland University · The University of Edinburgh +1
Refining Multidimensional Video Reward Models via Disentangled Influence Functions
May 27, 2026Muyao Wang, Zeke Xie, Hideki NakayamaReward Modeling Training Data Selection
The University of Tokyo · HKUST (Guangzhou)
VCap: Hypergeometric Rewards for Weak-to-Strong Visual Captioning
May 27, 2026Xingyu Lu, Jinpeng Wang, Yi-Fan Zhang +13Image Captioning Object Hallucination in VLMs
1Tsinghua Shenzhen International Graduate School · 2Harbin Institute of Technology, Shenzhen · 3Chinese Academy of Sciences +1
DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation
May 25, 2026Jiaying Qian, Ziheng Jia, Qian Zhang +5Reward Modeling T2I Generation
Shanghai Jiao Tong University
From Demonstrations to Rewards: Test-Time Prompt Optimization for VLM Reward Models
May 22, 2026Christian Gumbsch, Leonardo Barcellona, Lennard Schünemann +7RL for Robotics Multimodal Reward Modeling
University of Amsterdam · 2Catholic University of Leuven · 3Toyota Research Institute +1
Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
May 13, 2026Xuehai Bai, Yang Shi, Yi-Fan Zhang +7Reward Modeling Image Editing Evaluation
HDU · PKU · Kling Team +1
CaC: Advancing Video Reward Models via Hierarchical Spatiotemporal Concentrating
May 12, 2026Jiyuan Wang, Huan Ouyang, Jiuzhou Lin +15Temporal Video Grounding Multimodal Reward Modeling
BJTU · NTU · BUPT +1
DeltaRubric: Generative Multimodal Reward Modeling via Joint Planning and Verification
May 10, 2026Rui Liu, Dian Yu, Zhenwen Liang +6Multimodal Large Language Models Multimodal Reward Modeling
1Tencent Hunyuan · University of Maryland, College Park · University of North Carolina, Chapel Hill
ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation
May 9, 2026Youhe Feng, Hansen Shi, Haoyang Li +7Long-Horizon Robotic Manipulation Multimodal Reward Modeling
School of Information, Renmin University of China · Work done during the internship at Zhipu AI. · Zhipu AI +1
RewardHarness: Self-Evolving Agentic Post-Training
May 9, 2026Yuxuan Zhang, Penghui Du, Bo Li +11Reward Modeling Image Editing Evaluation
University of British Columbia · Kolors Team, Kuaishou Technology · University of Waterloo +4
Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria
May 8, 2026Juanxi Tian, Fengyuan Liu, Jiaming Han +6Policy Optimization Multimodal Reward Modeling
1Nanyang Technological University · 2Ant Group · 3MMLab, The Chinese University of Hong Kong +1
Video Understanding Reward Modeling: A Robust Benchmark and Performant Reward Models
May 8, 2026Yuancheng Wei, Linli Yao, Lei Li +4Reward Modeling Multimodal Reward Modeling
South China University of Technology · Peking University · The University of Hong Kong +1
ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning
May 8, 2026Honghua Chen, Zitong Xu, Huiyu Duan +3Image Editing Evaluation Text-Guided Image Editing
University of Electronic Science and Technology of China · 2Shanghai Jiao Tong University
Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling
May 7, 2026Yuan Wang, Ouxiang Li, Yulong Xu +8Reward Modeling Multimodal Reward Modeling
University of Science and Technology of China · Kling Team, Kuaishou Technology · Institute of Software Chinese Academy of Sciences
RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Models
May 5, 2026Hao Wu, Yuqi Li, Yuan Gao +10Multimodal Reward Modeling World Model Evaluation
Tencent · Tsinghua University · Department of Computer Science, City University of New York +3
ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards
Apr 22, 2026Wentao Yan, Shengqin Wang, Huichi Zhou +4Multimodal IR Process Reward Models
East China Normal University · Huawei Noah’s Ark Lab · University College London +2
DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling
Apr 21, 2026Zhihong Zhang, Jie Zhao, Xiaojian Huang +5Multimodal Reward Modeling Preference Learning
University of Science and Technology of China
Lost in Translation: Do LVLM Judges Generalize Across Languages?
Apr 21, 2026Md Tahmid Rahman Laskar, Mohammed Saidul Islam, Mir Tafseer Nayeem +5VLM Evaluation Multilingual VLM Evaluation
York University · University of Alberta · Nanyang Technological University +1
Prioritizing the Best: Incentivizing Reliable Multimodal Reasoning by Rewarding Beyond Answer Correctness
Apr 20, 2026Mengzhao Jia, Zhihan Zhang, Meng JiangMultimodal Reasoning Multimodal Reward Modeling
University of Notre Dame
DriveVLM-RL: Neuroscience-Inspired Reinforcement Learning with Vision-Language Models for Safe and Deployable Autonomous Driving
Mar 18, 2026Zilin Huang, Zihao Sheng, Zhengyang Wan +4VLMs for Autonomous Driving LLM-Guided RL
Department of Civil and Environmental Engineering, University of Wisconsin-Madison, Madison, WI, 53706, USA · Lyles School of Civil and Construction Engineering, Purdue University, West Lafayette, IN 47907, USA · Department of Civil Engineering, McGill University, Montreal, QC, H3A 0C3, Canada
Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models
Mar 17, 2026Yanru Wu, Weiduo Yuan, Esteban Martinez Licon +4Long-Horizon Robotic Manipulation Robot Skill Learning
USC Physical Superintelligence Lab
Joint Reward Modeling: Internalizing Chain-of-Thought for Efficient Visual Reward Models
Feb 7, 2026Yankai Yang, Yancheng Long, Hongyang Wei +12Reward Modeling Multimodal Reward Modeling
Harbin Institute of Technology, Shenzhen. · Kuaishou Technology.
Omni-RRM: Advancing Omni Reward Modeling via Automatic Rubric-Grounded Preference Synthesis
Jan 31, 2026Zicheng Kong, Dehua Ma, Zhenbo Xu +9Reward Modeling RL for Language Models
Beijing University of Posts and Telecommunications, Beijing, P.R. China · ShiFang Technology Inc., Hangzhou, P.R. China · Tsinghua University, Beijing, P.R. China +1
Understanding Reward Hacking in Text-to-Image Reinforcement Learning
Jan 6, 2026Yunqi Hong, Kuei-Chun Kao, Hengguang Zhou +1Reward Hacking Multimodal Reward Modeling
Department of Computer Science, University of California, Los Angeles
RubricRL: Simple Generalizable Rewards for Text-to-Image Generation
Nov 25, 2025Xuelu Feng, Yunsheng Li, Ziyu Wan +4Reward Modeling T2I Generation
University at Buffalo · Microsoft AI · Nikola Tesla STEM High School
Rethinking Reward Signals in Video GRPO: When Scores Become Targets
Nov 24, 2025Rui Li, Yuanzhi Liang, Ziqi Ni +3Reward Hacking RL for Video Generation
University of Science and Technology of China, Hefei, China · Institute of Artificial Intelligence (TeleAI), China Telecom, Shanghai, China · Southeast University, Nanjing, China
SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Models
Oct 14, 2025Weiyang Jin, Yuwei Niu, Jiaqi Liao +4Unified Multimodal Models T2I Generation
HKU MMLab · The University of Hong Kong · Shenzhen Loop Area Institute +2
GUI-PRA: Process Reward Agent for GUI Tasks
Sep 27, 2025Tao Xiong, Xavier Hu, Yurun Chen +6Process Reward Models GUI Agents
Zhejiang University · MiLM Plus, Xiaomi Inc.

Sep 29, 2026, cs.CVJ/K move · Enter open · S save

Think Before You Score: Thinking Reward Model for Visual Generation

Xuehai Bai, Zhenchen Tang, Yang Shi, Dianyi Wang+8

HDU · SenseTime · CASIA+5

Reward Modeling Multimodal Reward Modeling

Open paper AskPDF arXiv

Visual reward models are essential for evaluating and improving visual generation models, yet existing approaches typically map task conditions and candidate outputs directly to scalar rewards, leaving implicit what should be evaluated for each individual case. We introduce Think Before You Score, a paradigm that explicitly determines what matters for each case before judging how well the candidate performs. Following this principle, we propose the Thinking Reward Model (TRM), which formulates case-adaptive rubrics, performs rubric-guided assessment, and produces fine-grained pointwise rewards. We further observe that conventional pairwise preference optimization can induce score polarization, and introduce Pairwise Dual-Group Relative Policy Optimization (PD-GRPO), which leverages pairwise supervision to improve reward discrimination while preserving fine-grained pointwise scoring. Extensive experiments on image generation and editing reward-modeling benchmarks demonstrate that TRM achieves state-of-the-art performance among open-source reward models while remaining highly competitive with proprietary alternatives. Moreover, using TRM as a reward for reinforcement learning consistently improves diverse visual generation models, demonstrating that its fine-grained, case-adaptive rewards translate into effective optimization signals for visual generation.

Momentum

Related topics

Latest papers 59