LLM Post-Training

LLM: Large Language Model

Overview

LLM post-training studies how to shape a pretrained model’s behavior and capabilities after its initial training. Common approaches include supervised fine-tuning, preference optimization such as DPO, reinforcement learning with verifiable rewards, and distillation; they use human feedback, synthetic examples, rubrics, or execution results from tools and environments. Researchers evaluate these methods on tasks such as mathematical reasoning, coding, tool use, and domain-specific question answering, while also measuring safety, calibration, and performance after deployment. A central challenge is gaining targeted abilities without sacrificing prior capabilities, diversity, or reliability, and evidence about which training recipes generalize best remains mixed.

Latest papers

CardsList

258 papers14 papers in the last four weeks, down 72% on the four weeks before. 0.1% of all new papers.

  1. RSI-Prime: Training Models to Train Models

    Nov 17, 2026Dewu Zheng, Yang Ye, Hongyu Zhang +2Language Model Self-ImprovementLLM Post-Training

  2. TrainExplorer: Autonomous LLM Post-Training via Plan-and-Decouple Exploration

    Nov 16, 2026Xuannan Liu, Tian Lan, Zekun Li +9LLM Post-TrainingLanguage Model Post-Training

  3. Human or Synthetic? What a Fixed Budget Buys for Post-Training

    Nov 12, 2026Shourik Banerjee, Ethan Mendes, Mohit Raghavendra +2LLM Post-TrainingPreference Learning for LLMs

  4. The Surprising Effectiveness of Deleting Weights in LLM Post-Training

    Nov 7, 2026Jack Lu, Zhenbang Yang, Mike Lasby +3LLM Post-TrainingParameter-Efficient Fine-Tuning

  5. Don't Blame The Preferences: Examining The Emergence of Sycophancy in LLM Training

    Nov 5, 2026Chao Peter Yang, Catherine Zehr, Pranav Bijith +1LLM SycophancyLLM Post-Training

  6. Steering Vectors as a Training Signal in LLM Post-Training

    Oct 29, 2026Tiejin Chen, Maunil Vyas, Huaiyuan Yao +1LLM Post-TrainingActivation Steering

  7. Training LLM Agents to Automate LLM Post-Training with RSI-Dojo

    Oct 29, 2026Shuzheng Gao, Zhaojian Yu, Penghao Yin +4LLM Post-TrainingLLM Agent Self-Improvement

  8. Learning to Reason from Reference Samples Alone: Reinforced Adversarial Learning for Modern LLM Post-Training

    Oct 28, 2026Albert Bou, Javier Valdes-Aleman, Jon M. Laurent +4RL for Language Model ReasoningLLM Post-Training

  9. Post-Training Large Language Models with LLMON

    Oct 28, 2026Basel Shbita, Michael Hind, Chad DeLuca +8LLM Post-TrainingPrompt Injection Defense

  10. How Does Post-Training Shape LLM Value Preferences?

    Oct 23, 2026Yang Liu, Shaoyang Xu, Masahiro Kaneko +3LLM Post-TrainingSocial Bias in Language Models

  11. Building Presentation Intelligence for High-Quality Slide Generation

    Oct 22, 2026Yuhang Xie, Cheng Li, Chenliang Li +6LLM Post-Training

  12. Monitorability Is Trainable: Post-Training for Chain-of-Thought Monitorability

    Oct 21, 2026Usman Anwar, Tim Bakker, Christos Louizos +1CoT MonitoringLLM Post-Training

  13. The Shape of the DPO Hyperparameter Landscape: What to Measure, How It Moves with Scale, and When Not to Transfer It

    Oct 20, 2026Hannan Mahadik, David Salinas, Jacek Golebiowski +1Direct Preference OptimizationHyperparameter Optimization

  14. Typed Decision Models under Prevalence Shift and Label Budgets: Decision Training, Calibration, and Implicit Priors

    Oct 19, 2026Abdul Rahman Iqbal, Muhammad Fawad Nasim, Amir SaleemTyped Decision ModelsLanguage Model Calibration

  15. UpLoop: Upcycling Large Language Models with Gated Loop

    Oct 18, 2026Tieyuan Chen, Huabin Liu, Yingtao Zhang +4Recurrent Language ModelsRecurrent Transformers

  16. Coopshift: Post-Training Amplifies The Memory Curse In LLM Cooperation

    Oct 16, 2026Jiayuan Liu, Shiyi Du, Tianqin Li +3LLM Post-TrainingSocial Dilemmas

  17. The Ephemeral Cost of Switching Optimizers Across LLM Training Stages

    Oct 15, 2026Xinyu Zhao, Davis Wertheimer, Ashutosh Sharma +2LLM TrainingLLM Post-Training

  18. Incentivizing Tool-Use Reinforcement Learning for Post-Arrival Emergency Care Prediction

    Oct 15, 2026Pengfei Hu, Chenwei Wu, Qiao Jin +4Clinical Outcome PredictionClinical Risk Prediction

  19. Athanor: An Agent-Native System for Autonomous Post-Training Research

    Oct 15, 2026Yufa Zhou, Yichen Wang, Jiakun Fan +5LLM Post-TrainingLanguage Model Post-Training

  20. One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness

    Oct 14, 2026Artin Tajdini, Manpreet Kaur, Peng QiLLM Post-TrainingTool Use

  21. LLM Agents for Automated Post-Training via Structured Recipe Optimization

    Oct 13, 2026Ruohong Liu, Bohan Tang, Lekang Jiang +2LLM Post-TrainingLarge Language Model-Guided Optimization

  22. Efficient Resource-Shiftable RL Post-training with Generative Rewards

    Oct 12, 2026Yanfeng Zhao, Haoyang Li, Sheng Lin +4RL Post-TrainingLLM Post-Training

  23. WildTrace: Evaluating Training Data Detection in Realistic Large-Scale LLM Post-Training

    Oct 12, 2026Hengxiang Zhang, Junxian Liu, Hongxin WeiData Contamination in Language ModelsLLM Evaluation

  24. Continually Post-training Small Models via Synthetic Self-distillation

    Oct 9, 2026Woosung Koh, Hyunsoo Lee, Kyungjae Lee +4LLM Post-TrainingContinual Learning for LLMs