Test-Time RL

RL: Reinforcement Learning

Overview

Test-time reinforcement learning studies how models and agents can improve their decisions on encountered problems using feedback available during inference, rather than relying only on a conventional labeled training set. For language models, common approaches use majority-vote pseudo-labels, confidence or external verification, process rewards, and policy-gradient updates; other systems retrieve experience or steer frozen policies with value gradients, search, or execution feedback. These methods are applied to reasoning, code generation, web agents, multimodal tasks, and robot control, drawing feedback from test cases, tools, simulators, or interaction. A central challenge is that self-generated rewards can reinforce wrong consensus, suppress rare correct answers, or destabilize behavior, making reliable verification, exploration, and compute-efficient gains key open concerns.

Latest papers

CardsList

54 papers7 papers in the last four weeks, down 30% on the four weeks before. 0.1% of all new papers.

  1. Branch-and-Commit for Frozen RL Agents: When and Where to Spend Test-Time Compute

    Nov 8, 2026Sahar Admoni, Assaf Hallak, Yftah Ziser +1Reinforcement LearningTest-Time RL

  2. The Race Is Decided Early! A Kernel Law Predicts Lock-In in Majority-Vote Test-Time RL

    Nov 8, 2026Jaeho Hwang, Sehong Park, Daejin Choi +1Test-Time RL

  3. On the Reliability of Majority-Vote Pseudo-Labels in Test-Time Reinforcement Learning

    Nov 6, 2026Haoyu Wang, Ru Wang, Yuanyuan Wang +2Test-Time RLRL for Language Model Reasoning

  4. When Does Exploration Prevent Collapse? Three Regimes and the Path of the Reward in Self-Consistency Training

    Oct 31, 2026Jaeho Hwang, Uiwon HwangTest-Time RLRL Exploration

  5. MS-TTRL: Breaking the Frequency Conflict in Multiple-Solution Test-Time Reinforcement Learning

    Oct 23, 2026Zhixia Zhang, Binqian Xu, Huaiyang Wang +2Test-Time RLRL for Language Model Reasoning

  6. METTA: Memory-Enhanced Test-Time Adaptation for Meta-Reinforcement Learning

    Oct 22, 2026Ali Najar, Hosein Hasani, Amir Kooshan Fattah +2Meta-Reinforcement LearningTest-Time RL

  7. Continual Test-Time Learning with Evolution Strategies

    Oct 16, 2026Guangya Hao, Yiting Duan, Longyan Tan +5Continual Learning for LLMsContinual Test-Time Adaptation

  8. Efficient Test-Time Adaptation For Robot Policies

    Oct 14, 2026Motasem Alfarra, Pietro Mazzaglia, Markus Peschl +2Robot Policy AdaptationTest-Time RL

  9. SelectTTRL: Representation-Guided Data Selection for Efficient Test-Time Reinforcement Learning

    Oct 12, 2026Yi Li, Linan Yue, Weibo GaoTest-Time RLRL for Language Model Reasoning

  10. Evolving in Thought Space: Training a Small Model at Test Time Unlocks Better Discoveries

    Oct 5, 2026Chonghe Jiang, Ao Qu, Siyuan Liu +9Large Language Model-Guided OptimizationTest-Time RL

  11. CURIO: Curiosity-Driven Test-Time Learning for Open-Ended Discovery

    Oct 4, 2026Tao Feng, Fangxu Yu, Zijie Lei +5Test-Time RLRL for Language Models

  12. Test-time Multi-agent Coordination by Decomposed Value Gradient Flow

    Oct 1, 2026Dongsu Lee, Haoran Xu, Amy ZhangMulti-Agent CoordinationOffline MARL

  13. Sharpen Before You Adapt: Data-Free Entry-State Sharpening for Test-Time Reinforcement Learning

    Oct 1, 2026Zhanming Zhang, Vinoth SelvendranRL for Language Model ReasoningTest-Time RL

  14. Noisy Test-Time Reinforcement Learning for Code LLMs

    Sep 26, 2026Xikai Yang, Hieu Trung Nguyen, Dunyuan Xu +4Language Model RobustnessRL for Code Generation

  15. G2MAF: Test-Time Gradient Guidance for Multi-Agent Flow Policies

    Sep 25, 2026Guowei Zou, Haitao Wang, Guoxin Wang +4Cooperative MARLTest-Time RL

  16. Label-free steering: Compressing test-time reinforcement learning into bias-only subspaces

    Sep 16, 2026Naveen Vakada, Mingyuan Li, Shaoxiong JiFine-TuningTest-Time Adaptation of VLMs

  17. Rewarding Reasoning, Not Answers: Fixing and Bounding Test-Time Reinforcement Learning on Medical QA

    Sep 15, 2026Kailong Fan, Anqi Pu, Yichen Wu +7Process Reward ModelsRL for Language Model Reasoning

  18. APEx: Distillation of Agent Procedural Experience for Adaptive Deep Research Question Answering

    Sep 2, 2026Jie Ding, Rui Sun, Xinyuan Zhang +2LLM AgentsAgent Memory

  19. TTPO: Test-Time Policy Optimization

    Aug 27, 2026Aozhe Wang, Zhengxi Lu, Jianze Wang +8Test-Time TrainingTest-Time RL

  20. Test-time Reinforcement Learning for Anomalous Video Understanding

    Aug 18, 2026Huining Li, Yuxiang Duan, Jiyang Tan +5Test-Time RLVideo Anomaly Detection

  21. CoRE: Consensus Rewards via Equilibrium for Test-Time Reinforcement Learning

    Aug 10, 2026Ambuj Mehrish, Sebastiano VasconReward ModelingRL for Language Models

  22. Hi-TTRL: Regulating Consensus with Hints for Test-Time Reinforcement Learning

    Aug 4, 2026Kunbin Xu, Xingzuo Li, Xuefeng Bai +1RL for Language Model ReasoningTest-Time RL

  23. SERPO: Self-Evolving Rubric Policy Optimization for Open-Ended Test-Time Reinforcement Learning

    Jul 29, 2026Jianze Wang, Kunwang Zheng, Ying Liu +5Reinforcement LearningTest-Time RL

  24. AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

    Jul 16, 2026Susan Liang, Chao Huang, Filippos Bellos +3Test-Time ScalingTool-Using Vision-Language Agents

  25. Trust Your Instincts: Confidence-Driven Test-Time RL for Vision-Language-Action Models

    Jun 29, 2026Siyao Chen, Jiakang Yuan, Jiaxin Wang +1Intrinsic Reward MethodsReinforcement Learning

  26. ReGuide: From Test-Time Guidance to Self-Improving Diffusion Policies

    Jun 27, 2026Tzu-Hsiang Lin, Srinivas Shakkottai, Dileep Kalathil +1Robot Policy AdaptationRobot Failure Recovery