Multimodal Reward Modeling

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 59

All topics

Think Before You Score: Thinking Reward Model for Visual Generation
Sep 29, 2026Xuehai Bai, Zhenchen Tang, Yang Shi +9Reward Modeling Multimodal Reward Modeling
HDU · SenseTime · CASIA +5
SkillRubric: Co-Evolving Actor Guidance and Evaluator Rubrics for Multimodal Agents
Sep 28, 2026Bingqing Jiang, Guoxi Zhang, Jasper Wang +7Multimodal Reward Modeling Rubric-Based RL
The University of Hong Kong · WeChat, Tencent · Peking University +2
ARS: Agentic Reward System for Robot Learning
Sep 28, 2026Sheng Hu, Weiyi Lu, Lingbing Zeng +5RL for Robotics Process Reward Models
AIRC, Midea Group
Diffusion Reward Models
Sep 27, 2026Xiangyang Wang, Bingxiang He, Zeyuan Liu +13Reward Modeling Multimodal Reward Modeling
Tsinghua University · University of Illinois Urbana-Champaign
RewardVerse: Rubric-Guided Policy Optimization for Video Reward Modeling
Sep 19, 2026Zhenchen Tang, Yang Li, Songlin Yang +6Reward Modeling Multimodal Reward Modeling
New Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Tencent +1
WorldReward: Reward Modeling for Camera-Conditioned World Models
Sep 3, 2026Yibin Wang, Zehan Wang, Junshu Tang +13Reward Modeling Camera-Conditioned Video Generation
Fudan University · Tencent Hunyuan · Shanghai Innovation Institute +3
RynnValue: Scaling Robotic Value Foundation Models with Temporal Distance
Aug 10, 2026Dongchi Huang, Hongyin Zhang, Bohan Hou +11Reward Modeling Robot Foundation Models
DAMO Academy, Alibaba Group · Hupan Lab
TrustRoboReward: Preference-Ordered Isotonic Score Editing for Multi-Paradigm Robot Reward Models
Aug 9, 2026Yidong Wang, Yan Zhan, Ziteng Feng +16Reward Modeling Pairwise Preference Evaluation
Peking University · University of Science and Technology of China · Southeast University +6
GeoReward: Mitigating Contextual Variable Overestimation in Vision-Language Models for Cross-Market Preference Prediction
Aug 5, 2026Shuo Liu, Huixiang Cai, Weiru Zhang +1Vision-Language Models VLM Adaptation
Alibaba International Digital Commerce Group
Enhancing VLM Reward Models Through Structure-Aware Fine-Tuning
Aug 4, 2026Pyrros Koussios, Chenhao Li, Xin Chen +1Self-Supervised Learning VLM Adaptation
ETH Zürich
Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
Jul 31, 2026Yingmao Miao, Pengfei Zhang, Xiaochen Lv +5Image Editing Evaluation Multimodal Reward Modeling
Xi’an Jiaotong University · DreamX Team, Alibaba Group · Shanghai Jiaotong University
OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
Jul 30, 2026Qiushi Sun, Kanzhi Cheng, Yian Wang +20VLM Evaluation Computer-Use Agent Benchmarks
The University of Hong Kong · Nanjing University · National University of Singapore +4
DenseReward: Dense Reward Learning via Failure Synthesis for Robotic Manipulation
Jul 14, 2026Yu Fang, Wanxi Dong, Jiaqi Liu +7RL for Robotics Reward Modeling
University of North Carolina at Chapel Hill · Carnegie Mellon University · Shanghai Jiao Tong University +1
Read It Back: Pretrained MLLMs Are Zero-Shot Reward Models for Text-to-Image Generation
Jul 13, 2026Runhui Huang, Qihui Zhang, Zhe Liu +3T2I Generation Multimodal Reward Modeling
The University of Hong Kong · Peking University · ByteDance Seed
Multimodal Reward Hacking in Reinforcement Learning
Jul 10, 2026Jiayu Yao, Yiwei Wang, Anmeng Zhang +5Multimodal Large Language Models Multimodal Reward Modeling
Institute of Computing Technology, Chinese Academy of Sciences · University of California, Merced · Southeast University
CoRe: Combined Rewards with Vision-Language Model Feedback for Preference-Aligned Reinforcement Learning
Jul 2, 2026Hexian Ni, Tao Lu, Yinghao CaiRobotic RL Multimodal Reward Modeling
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.
VLM-AR3L: Vision-Language Models for Absolute and Relative Rewards in Reinforcement Learning
Jul 1, 2026Kuan-Chen Chen, Winston Chen, Wei-Fang Sun +1Multimodal Reward Modeling Reward Design for RL
Department of Computer Science, National Tsing Hua University · NVIDIA AI Technology Center (NVAITC)
Vision-Language Procedural Reasoning for Context-Aware Reward Modeling of Robotic Endovascular Guidewire Navigation
Jun 29, 2026Wentong Tian, Jiyuan Zhao, Tianliang Yao +4RL for Robotics Robotic Endovascular Intervention
Department of Control Science and Engineering, College of Electronic and Information Engineering, and Shanghai Institute of Intelligent Science and Technology, Tongji University, Shanghai 200092, China. · Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong, Hong Kong SAR 999077, China. · Shanghai Operation Robot Co., Ltd., Shanghai 201318, China.
RMTL: Reinforced Micro-task Learning for Long-Horizon Manipulation with VLM Rewards
Jun 24, 2026Anıl Can Ateş, Orhan Kahraman, Cihan TopalRL for Robotics Long-Horizon Robotic Manipulation
Istanbul Technical University
VisCritic: Visual State Comparison as Process Reward for GUI Agents
Jun 23, 2026Jiachen QianProcess Reward Models GUI Agents
City University of Hong Kong
DiT-Reward: Generative Representations for Text-to-Image Reward Modeling
Jun 22, 2026Yuanming Yang, Guoqing Ma, Bo Wang +5Representation Learning Diffusion Transformer
JD Explore Academy, JD.com, Beijing, China · Tsinghua University, Beijing, China · Beijing Institute of Technology, Beijing, China +1
Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views
Jun 22, 2026Jiho Choi, Seonho Lee, Seojeong Park +1Visual Question Answering Active Perception
Graduate School of Artificial Intelligence, KAIST, Republic of Korea · KRAFTON, Republic of Korea
Reasoning as Intersection: Consensus-Frame Alignment for Visual Focus in Video-MLLMs
Jun 16, 2026Chengwen Liu, Zhe Huang, Jisheng Dang +3Multimodal Reward Modeling Video Reasoning
School of Information Science and Engineering, Lanzhou University, Lanzhou, China · Beijing University of Posts and Telecommunications, Beijing, China · Cloud and AI BU, Huawei, Shenzhen, China +1
MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning
Jun 16, 2026Wanshi Xu, Haokun Zhao, Haidong Yuan +2Multimodal Reasoning Multimodal Reward Modeling
School of ECE, Peking University · College of Computer Science and Artificial Intelligence, Fudan University · School of Software and Microelectronics, Peking University +1
CORA: Analyzing and bridging thinking-answer gap in Multimodal RLVR via Consistency-Oriented Reasoning Alignment
Jun 12, 2026Jiayue Cao, Zhicong Lu, Xuehan Sun +6Multimodal Reward Modeling VLM Reasoning
University of Chinese Academy of Sciences · 2Wuhan University · 3Tsinghua University +1
HPSv3++: Scaling Reward Models Across the Full Spectrum of Diffusion Model Capabilities
Jun 12, 2026Yijun Liu, Jie Huang, Zeyue Xue +5Diffusion Model Alignment Multimodal Reward Modeling
Tsinghua University · JD Explore Academy · Peking University +1
SARM2: Multi-Task Stage Aware Reward Modeling for Self Improving Robotic Manipulation
Jun 9, 2026Qianzhong Chen, Hau Zheng, Justin Yu +8RL for Robotics Reward Modeling
Stanford University · UC Berkeley · Shanghai Jiao Tong University
Z-Reward: Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions
Jun 8, 2026Xin Jin, Huanqia Cai, Zhen Li +9Reward Modeling Reasoning Distillation
Z-Image Team, Alibaba Group · VCIP, CS, Nankai University
DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Driving
Jun 7, 2026Qimao Chen, Fang Li, Yuechen Luo +11Autonomous Driving Datasets Autonomous Driving Benchmarks
1Tsinghua University · 2Xiaomi EV
Improving Multimodal Reasoning via Worst Dimension Optimization
Jun 5, 2026Haocheng Lv, Huaping Zhang, Qiuchi Li +2Process Reward Models Multimodal Reasoning
Beijing Institute of Technology

Sep 29, 2026, cs.CVJ/K move · Enter open · S save

Think Before You Score: Thinking Reward Model for Visual Generation

Xuehai Bai, Zhenchen Tang, Yang Shi, Dianyi Wang+8

HDU · SenseTime · CASIA+5

Reward Modeling Multimodal Reward Modeling

Open paper AskPDF arXiv

Visual reward models are essential for evaluating and improving visual generation models, yet existing approaches typically map task conditions and candidate outputs directly to scalar rewards, leaving implicit what should be evaluated for each individual case. We introduce Think Before You Score, a paradigm that explicitly determines what matters for each case before judging how well the candidate performs. Following this principle, we propose the Thinking Reward Model (TRM), which formulates case-adaptive rubrics, performs rubric-guided assessment, and produces fine-grained pointwise rewards. We further observe that conventional pairwise preference optimization can induce score polarization, and introduce Pairwise Dual-Group Relative Policy Optimization (PD-GRPO), which leverages pairwise supervision to improve reward discrimination while preserving fine-grained pointwise scoring. Extensive experiments on image generation and editing reward-modeling benchmarks demonstrate that TRM achieves state-of-the-art performance among open-source reward models while remaining highly competitive with proprietary alternatives. Moreover, using TRM as a reward for reinforcement learning consistently improves diverse visual generation models, demonstrating that its fine-grained, case-adaptive rewards translate into effective optimization signals for visual generation.

Momentum

Related topics

Latest papers 59