RL for Language Models

RL: Reinforcement Learning

Follow this topic Ask about this topic

Momentum

36 papers in the last four weeks, up 71% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 271

All topics

Post-Training Speech Enhancement Language Models with Perceptual Rewards
Jun 19, 2026Frédéric Berdoz, Luca A. Lanzendörfer, Antonis Asonitis +1Multi-Objective Reinforcement Learning RL for Language Models
ETH Zürich, Switzerland
Learning User Simulators with Turing Rewards
Jun 17, 2026Yingshan Susan Wang, Cedegao E. Zhang, Linlu Qiu +5Reward Modeling RL for Language Models
Massachusetts Institute of Technology · Stanford University · MIT-IBM Watson AI Lab
EfficientRollout: System-Aware Self-Speculative Decoding for RL Rollouts
Jun 17, 2026Minseo Kim, Minjae Lee, Seunghyuk Oh +7RL for Language Models Reinforcement Learning
FuriosaAI · University of California, Berkeley
Be Your Own Teacher: Steering Protein Language Models via Unsupervised Reward Optimization
Jun 17, 2026Lanqing Li, Shentong Mo, Yang Yu +1RL for Language Models Reinforcement Learning
The Chinese University of Hong Kong · MBZUAI · Hong Kong University of Science and Technology
Self-CTRL: Self-Consistency Training with Reinforcement Learning
Jun 16, 2026Itamar Pres, Laura Ruis, Melat Ghebreselassie +2RL for Language Models Faithfulness of Language Model Explanations
MIT CSAIL
SuCo: Sufficiency-guided Continuous Adaptive Reasoning
Jun 16, 2026Jiahao Wang, Bingyu Liang, Chenhao Hu +5RL for Language Models Large Reasoning Models
Harbin Institute of Technology (Shenzhen), Guangdong, China. · TeleAI of China Telecom, China.
Using Cognitive Models to Improve Language Model Simulation of Human Persuasion Games
Jun 16, 2026Zirui Cheng, Zeyu Shen, Thomas L. Griffiths +1RL for Language Models Cognitive Modeling
1Princeton University
GD $^2$ PO: Mitigating Multi-Reward Conflicts via Group-Dynamic reward-Decoupled Policy Optimization
Jun 15, 2026Haotian Liu, Yihao Liu, Jingwei Ni +11Multi-Objective Reinforcement Learning RL for Language Models
Alibaba · Renmin University of China · Peking University +3
A First-Principles Derivation of LLM Policy Optimization: From Expected Reward to GRPO and Its Structural Extensions
Jun 15, 2026Jianghan Shen, Siqi Luo, Yue Li +9RL for Language Models Group Relative Policy Optimization
1Nanjing University · 2Shanghai Artificial Intelligence Laboratory · 3Shanghai Jiao Tong University +4
Teaching agentic AI to generalize expert diagnostic reasoning in rare diseases
Jun 15, 2026Minh-Ha Nguyen, Erica Gray, Bryce A. Schuler +16RL for Language Models Rare Disease Diagnosis
Department of Epidemiology, Vanderbilt University, Nashville, TN, USA · Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA · Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA +4
Reinforcement Learning for LLM-based Event Forecasting
Jun 14, 2026Amit Arnold LevyEvent Time Prediction RL for Language Models
University of Oxford
BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation
Jun 14, 2026Ning Li, Zixuan Guo, Yan Xu +7RL for Language Models LLM Hallucination Mitigation
1Shanghai Jiao Tong University · 2Tencent · 3The
AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction
Jun 14, 2026Pengfei Zhang, Hoang H Nguyen, Yutong Song +6RL for Language Models Speech Processing
University of California Irvine · University of Illinois Chicago · Kennesaw State University
EIBench: A Simulator-Based Benchmark and Turn-Credit RL for Emotion Management
Jun 14, 2026Rongzhi Zhu, Xiang Huang, Yuchuan Wu +8RL for Language Models LLM Evaluation
State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, China · Qwen-Character Team , Alibaba Group
Generalization Hacking: Models Can Game Reinforcement Learning by Preventing Behavioral Generalization
Jun 10, 2026Frank Xiao, Mary PhuongReward Hacking RL for Language Models
California Institute of Technology
ReCal: Reward Calibration for RL-based LLM Routing
Jun 10, 2026Qihang Yu, Hanwen Tong, Zhengqi Zhang +5Multi-Objective Reinforcement Learning RL for Language Models
Zhejiang University · Ant Group · Shanghai AI Laboratory
Representation-Aware Advantage Estimation: Your Reward Model Provides More Than A Scalar Output
Jun 9, 2026Guozheng Li, Xiyan Fu, Yiwen GuoRL for Language Models Sample-Efficient RL
Southeast University · Nanyang Technological University · Independent Researcher
Rethinking the Divergence Regularization in LLM RL
Jun 8, 2026Jiarui Yao, Xiangxin Zhou, Penghui Qi +3RL for Language Models Policy Optimization
1Tencent Hunyuan · 2UIUC · 3NUS
One Model, Multiple Goals: Adaptive Multi-Objective Learning for E-commerce Dialogue Systems
Jun 8, 2026Mingzhe Li, Jing Xiang, Enguo Zhou +5Multi-Objective Reinforcement Learning RL for Language Models
Baichuan-M4: A Clinical-Grade Medical Agent System for Continuous Care
Jun 8, 2026Aiyuan Yang, Canbin Piao, Chengfeng Dou +25RL for Language Models Healthcare
Baichuan AI and THUBPM Group, Tsinghua University
Reformulate LLM Reinforcement Learning for Efficient Training under Black-box Discrepancy
Jun 7, 2026Jiashun Liu, Runze Liu, Xu Wan +3RL for Language Models Constrained RL
1Hong Kong University of Science and Technology · 2Zhejiang University · 3Tianjin University
Towards Long-Horizon Vessel Trajectory and Destination Forecasting with Reasoning Large Language Models
Jun 7, 2026Hongwei Wang, Miao Zhou, Fengde Wang +10RL for Language Models Vessel Trajectory Prediction
Institute of High Performance Computing (IHPC), A*STAR, Singapore 138632, Singapore. · The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, China. · Meituan Inc., Shenzhen, China. +3
CATPO: Critique-Augmented Tree Policy Optimization
Jun 6, 2026Ayush Singh, Umang Goyal, Ankur DahiyaRL for Language Models Reinforcement Learning
Vision and Language Group Indian Institute of Technology Roorkee Roorkee, Uttarakhand, India
LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection
Jun 6, 2026David Eje, Tanmay Sharma, Khush Patel +2RL for Language Models Online Anomaly Detection
Department of Computer Science, Innopolis University, Innopolis, Russia
Rewrite to Translate, Translate to Reward: Reinforcement Learning for Source Rewriting in Machine Translation
Jun 6, 2026Boxuan Lyu, Haiyue Song, Zhi Qu +3RL for Language Models Machine Translation
Institute of Science Tokyo · Preferred Networks, Inc. · Nara Institute of Science and Technology
SAW: Stage-Aware Dynamic Weighting for Multi-Objective Reinforcement Learning in Large Language Models
Jun 5, 2026Yuchen He, Baolong Bi, Shenghua Liu +7Multi-Objective Reinforcement Learning RL for Language Models
Institute of Computing Technology, Chinese Academy of Sciences · University of Electronic Science and Technology of China
Translate-R1: Cost-Aware Translation Tool Use via Reinforcement Learning
Jun 5, 2026Pratik Jayarao, Chaitanya Dwivedi, Himanshu Gupta +5RL for Language Models LLM Tool Use
Amazon Stores Foundation AI
Progress-SQL: Improving Reinforcement Learning for Text-to-SQL via Progressive Rewards
Jun 5, 2026Shihao Zhang, Xiaoman Wang, Yuan Liu +2RL for Language Models Reinforcement Learning
East China Normal University
Improving Cross-Lingual Factual Recall via Consistency-Driven Reinforcement Learning
Jun 4, 2026Jonathan von Rad, Louis Arts, George Burgess +6Multilingual Language Model Evaluation RL for Language Models
University College London, Centre for Artificial Intelligence
Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation
Jun 4, 2026Hanxu Hu, Zdeněk Šnajdr, Pinzhen Chen +2RL for Language Models In-Context Learning
University of Zurich · ETH Zurich · Queen’s University Belfast

Jun 19, 2026, cs.LGJ/K move · Enter open · S save

Post-Training Speech Enhancement Language Models with Perceptual Rewards

Frédéric Berdoz, Luca A. Lanzendörfer, Antonis Asonitis, Roger Wattenhofer

ETH Zürich, Switzerland

Multi-Objective Reinforcement Learning RL for Language Models Speech Enhancement Speech Language Models Language Model Post-Training

Open paper AskPDF arXiv

Speech enhancement language models achieve strong results when trained on discrete audio tokens, but their optimization relies on token-level cross-entropy rather than the perceptual metrics used for evaluation. We introduce a post-training stage for autoregressive speech enhancement language models using Group Sequence Policy Optimization (GSPO) with multi-metric perceptual rewards. Our method directly optimizes non-differentiable quality metrics (DNSMOS, WER, and UTMOS) as reward signals, without learned surrogates or offline preference pairs. Applied to two autoregressive base models, UniSE and GenSE, our approach achieves state-of-the-art results on the DNS2020 benchmark. A human evaluation ablation further shows that the composite multi-metric reward is preferred over any single-metric variant, confirming that multi-reward optimization avoids the reward hacking observed with single-metric training.

Momentum

Related topics

Latest papers 271