RL for Knowledge Distillation

RL: Reinforcement Learning

Latest papers

CardsList

19 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

  1. RAIL: Representation-Aligned Imitation Learning for Student-Compatible Teacher Policies

    Nov 9, 2026Meraj Mammadov, Pedro Zuidberg Dos Martires, Johannes Andreas StorkImitation LearningRL for Knowledge Distillation

  2. On-Policy Self-Distillation with Teacher Evolution

    Oct 28, 2026Shufan Shen, Zhongni Hou, Chao Bi +3On-Policy Self-DistillationLanguage Model Distillation

  3. From Solver Trajectories to Teaching Trajectories: Cognition-Aligned Reasoning Distillation

    Oct 27, 2026Yashuo Luo, Qianren Mao, Ziqi Qin +6Reasoning DistillationLanguage Model Distillation

  4. TAD: Distilling Vision-Language-Action Policies from Teacher Trajectories Alone

    Oct 24, 2026Yun Zhu, Da WangVisuomotor Policy LearningKnowledge Distillation

  5. Reward-Aligned Distillation

    Oct 10, 2026Yilan Chen, Zian Su, Manish Prajapat +4RL for Knowledge DistillationKnowledge Distillation

  6. Reward-Aligned Reweighting for On-Policy Distillation

    Sep 28, 2026Haofeng Xu, Junwei Su, Lansong Diao +2RL for Knowledge DistillationLanguage Model Distillation

  7. Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation

    Sep 28, 2026Xin Li, Hao Jiang, Xin Gao +6Knowledge DistillationOn-Policy Distillation

  8. Distilled Reinforcement Learning for LLM Post-training

    Jul 19, 2026Chen Wang, Zhaochun Li, Jionghao Bai +4RL for Language Model ReasoningCross-Architecture Knowledge Distillation

  9. ARKD: Adaptive Reinforcement Learning-Guided Bidirectional KL Divergence Distillation for Text Generation

    Jun 29, 2026Zilong Liu, Xuewen Zhang, Jinrui Xing +3RL for Knowledge DistillationLanguage Model Distillation

  10. SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation

    Jun 13, 2026Mohamed Jismy Aashik Rasool, Shabir Ahmad, Gisong Oh +1RL for Knowledge DistillationQuantization-Aware Training

  11. Decoupling KL and Trajectories: A Unified Perspective for SFT, DAgger, Offline RL, and OPD in LLM Distillation

    May 16, 2026Anhao Zhao, Haoran Xin, Yingqi Fan +3Reasoning DistillationOn-Policy Distillation

  12. KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillation

    Apr 26, 2025Jiabin Fan, Guoqing Luo, Michael Bowling +1RL for Knowledge DistillationLanguage Model Distillation

  13. LLMR: Knowledge Distillation with a Large Language Model-Induced Reward

    Sep 19, 2024Dongheng Li, Yongchang Hao, Lili MouRL for Knowledge DistillationLanguage Model Distillation