RL for Language Models

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

36 papers in the last four weeks, up 71% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 271

All topics

Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation
Aug 11, 2026Chris Han, Pengzhi Gao, Pei Fu +1Multilingual Language Models RL for Language Models
Xiaomi Inc., Beijing, China
SKILLER: Language-Level Reinforcement Learning for Reusable Skill Extraction in Small Language Models
Aug 11, 2026Chenhao Dang, Siyuan Xiong, Conghui He +1RL for Language Models Small Language Models
1Shanghai Jiao Tong University · 2Shanghai Artificial Intelligence Laboratory · 3Harbin Institute of Technology, Shenzhen +1
Evaluation-Conditioned Training: Teaching Models to Generalize to Stronger Oversight Regimes
Aug 10, 2026Alec Harris, Kasey Corra, Archie Chaudhury +1RL for Language Models LLM Alignment
AI Safety Initiative at Georgia Tech · University of Chicago · Independent
REATS: LLM Reasoning-based Ensemble Learning for Adaptive Time Series Forecasting
Aug 10, 2026Xu Zhang, Chang Xu, Hui Sun +5RL for Language Models Explainable Time Series Forecasting
Fudan University Shanghai, China · Microsoft Research Beijing, China · Jilin University Jilin, China
CoRE: Consensus Rewards via Equilibrium for Test-Time Reinforcement Learning
Aug 10, 2026Ambuj Mehrish, Sebastiano VasconReward Modeling RL for Language Models
CVML Lab Ca’ Foscari University of Venice
RISE-RL: Rubric-Informed Selective Exploration for Open-Ended Reinforcement Learning
Aug 10, 2026Jinkun Hou, Zhuo Liu, Huimin Ren +3Open-Ended Generation RL for Language Models
1Peking University · 2Beijing Institute of Technology · 3Li Auto Inc.
RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction
Aug 6, 2026Chenglong Wang, Ziming Zhu, Yifu Huo +9Reward Modeling RL for Language Models
School of Computer Science and Engineering, Northeastern University, Shenyang, China · 2NiuTrans Research, Shenyang, China · 3Independent Researcher, Beijing, China +1
Optimizing What Policies Learn From: Recoverability-aware Rollout Intervention Learning
Aug 5, 2026Zheyuan Zhang, Manqing Mao, Hong Wang +8RL for Language Models RL Post-Training
University of Notre Dame · Amazon, Inc
Teaching MLLMs to Say No: Generalized Referring Expression Comprehension via Refusal Calibrated GRPO
Aug 5, 2026Xuzheng Yang, Jun Ling, Tao Huang +2RL for Language Models Group Relative Policy Optimization
School of Computer Science and Engineering, University of Electronic Science and Technology of China
Internalizing Academic Writing Workflows for Introduction Generation via Struct-Aware Policy Learning
Aug 4, 2026Meicong Zhang, Tiancheng Su, Jiahao Cheng +3RL for Language Models AI-Assisted Scientific Research
School of Economics and Management, East China Normal University, Shanghai, China · Xiaohongshu Inc., Shanghai, China
Towards More Expressive Spoken LLMs: Fine-Grained Intent Benchmarking and Acoustic-Lexical Decoupled Policy Optimization
Aug 4, 2026Xiang Lin, Tian-Hao Zhang, Chunfeng Wang +3RL for Language Models Spoken Dialogue Systems
Li Auto Inc., Beijing, China · Tsinghua University, Beijing, China
HindSearch: Trajectory-Level Hindsight Critique for Search-Augmented Reinforcement Learning
Aug 3, 2026Haowei Liu, Jiamian Wang, Hsin-Tai Wu +2RL for Language Models Agentic Search
Santa Clara University Santa Clara, CA · Rochester Institute of Technology Rochester, NY · Independent Researcher Sunnyvale, CA
Don't Mix Rewards, Mix Policies: Policy Decomposition and Optimization for Multi-Reward RL
Jul 31, 2026Ruiming Liang, Yi Zhong, Yizhen Yuan +6Multi-Objective Reinforcement Learning RL for Language Models
1Fundation Model Research Center, CASIA · School of Artificial Intelligence, UCAS · Institute for AI Industry Research (AIR), Tsinghua University +1
HARGO: Heterogeneity-Aware Reward-Guided Optimization for RL Post-Training of LLMs on HPC Tasks
Jul 30, 2026Tiangang Li, Xiangbo TianRL for Language Models LLM Alignment
School of Computer Science, Wuhan University, Wuhan, China
FinSMART: Financial Sentiment Analysis for Algorithmic Trading through Market-Aligned Reinforcement Learning
Jul 30, 2026Giorgos Iacovides, Wuyang Zhou, Danilo MandicRL for Language Models Reinforcement Learning
Imperial College London · London, UK
Towards Robust Reinforcement Learning for Small-Scale Language Model Agents
Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarrayRL for Language Models LLM Alignment
Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo, N2L 3G1, Ontario, Canada · Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, Bangladesh · Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates
Inverse RL Helps Align AI by Imitating Humans
Jul 27, 2026Michał Wiliński, Liu Leqi, Chirag NagpalRL for Language Models LLM Alignment
Carnegie Mellon University · The University of Texas at Austin · Independent Researcher
ACRL: Adaptive Control of Training-Inference Discrepancy for Stable Reinforcement Learning
Jul 27, 2026Wenwu Fan, Qihong Lin, Zhijie Xia +4RL Control RL for Language Models
Computing Product Line, Huawei
LA-RL: Label-Aware Self-Reflection for Reinforcement Learning in Information Extraction
Jul 26, 2026Xiao You, Tianwei Yan, Zixu Shan +2LLM Self-Correction RL for Language Models
Hefei University of Technology, Hefei, China · Chongqing Jiaotong University, Chongqing, China
In-Context Learning as Implicit Policy Gradient
Jul 25, 2026Masahiro Kaneko, Timothy BaldwinRL for Language Models Policy Gradient
MBZUAI
Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs
Jul 24, 2026Zixuan Ren, Jinliang Lu, Junhong Wu +5RL for Language Models Language Model Merging
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, CAS, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · Baidu Inc., Beijing, China
EmoAgent-R1: Towards Multimodal Emotion Understanding with Reinforcement Learning-based Dynamic Agent Specialization
Jul 23, 2026Lihuang Fang, Yuchen Zou, kebing Jin +1RL for Language Models Agentic RL
Guangdong University of Technology Guangzhou, China · Southern University of Science and Technology Shenzhen, China · Xi’an Jiaotong University Xi’an, China +1
Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results
Jul 22, 2026Yanyu Chen, Yue Li, Yongyi Cui +2RL for Language Models Retrieval-Augmented Generation
East China Normal University · Shandong University
Co-Evolving LLM Evaluators and Policies via DynamicRubric
Jul 22, 2026Beining Wang, Weihang Su, Hongtao Tian +8RL for Language Models LLM Evaluation
Department of Computer Science and Technology, Tsinghua University · 2WeChat, Tencent
The Price of Reasoning: Cost-Quality Tradeoffs in Reinforcement Learning for Neural Machine Translation
Jul 21, 2026Michael Jungo, Aixiu AnRL for Language Models RL for Language Model Reasoning
AIBEX, University of Fribourg Fribourg, Switzerland · iCoSys, University of Applied Sciences and Arts Western Switzerland Fribourg, Switzerland
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
Jul 21, 2026Aixiu An, Michael Jungo, Eloi Eynard +4RL for Language Models Legal NLP
iCoSys, University of Applied Sciences and Arts Western Switzerland, Fribourg, Switzerland · AIBEX, University of Fribourg, Fribourg, Switzerland · Neur.on, Fribourg, Switzerland +1
REGEN: Replay-recycling for Expert-to-Generalist distillation with Offline Reinforcement Learning
Jul 21, 2026Yunjie Chen, Xiaoxin Chen, Fang WangRL for Language Models RL for Language Model Reasoning
vivo AI Lab, Shenzhen, China · Department of Computer Science, Sun Yat-Sen University, Guangzhou, China
Measuring Reward-Seeking via Contrastive Belief Updates
Jul 21, 2026Axel Højmark, Jérémy Scheurer, Evgenia Nitishinskaya +5RL for Language Models LLM Alignment
Apollo Research · OpenAI
OR Else: A Differentiable Trust Region for Policy Optimization
Jul 20, 2026Chinmay Rane, Kanishka Tyagi, Michael ManryRL for Language Models Group Relative Policy Optimization
Quantiphi Inc Marlborough, MA, 01752 · Self Machines Inc San Francisco, California, 94402 · Department of Electrical Engineering The University of Texas at Arlington Arlington, TX, 76010
Group Entropy-Controlled Policy Optimization
Jul 18, 2026Guangran Cheng, Chengqi Lyu, Songyang Gao +2RL for Language Models Group Relative Policy Optimization
Shanghai AI Laboratory

Aug 11, 2026, cs.CLJ/K move · Enter open · S save

Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation

Chris Han, Pengzhi Gao, Pei Fu, Jian Luan

Xiaomi Inc., Beijing, China

Multilingual Language Models RL for Language Models Language Model Post-Training Machine Translation

Open paper AskPDF arXiv

We study reference-free post-training for multilingual machine translation with open large language models. Starting from the supervised-finetuned MiLMMT-46-v0.1 models, we apply Group Relative Policy Optimization (GRPO) with a reward that averages two reference-free quality estimation models and is gated by language identification. We then linearly interpolate the supervised fine-tuning (SFT) and reinforcement learning (RL) model checkpoints to obtain MiLMMT-46-v1.0. Across 46 languages, the resulting models consistently improve translation quality over their SFT counterparts, outperform strong recent open baselines, including Seed-X, HY-MT2, and TranslateGemma, and achieve leading reference-free scores against evaluated proprietary systems such as Google Translate, Gemini 3 Pro, and GPT-5. We further investigate on-policy distillation (OPD) and find that it reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation. We release the models and code to facilitate future research.

Momentum

Related topics

Latest papers 271