On-Policy Distillation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-14

20 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Inside this field

Focused directions

437 papers

Latest in On-Policy Distillation

Browse all topics →
CardsList

  1. Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment

    Jul 9, 2026Vinay Kumar ChagantiTeacherEnrichment

  2. Geometric Self-Distillation for Reasoning Generalization

    Jul 7, 2026Josip Jukić, Ivan TitovUnsupervised On-Policy Self-DistillationOn-Policy Distillation

  3. Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

    Jul 7, 2026Jincheng Ying, Li Wenlin, Minghui Xu +1TeacherInference Cost

  4. TurnOPD: Making On-Policy Distillation Turn-Aware for Efficient Long-Horizon Agent Training

    Jul 7, 2026Yuhang Zhou, Kai Zheng, Haoling Li +3On-Policy DistillationLong-Horizon Agents

  5. Self-Review Reinforcement Learning (SRRL) with Cross-Episode Memory and Policy Distillation

    Jul 6, 2026Muhammad Zain Amin, Kibele Sebnem YildirimReinforcement Learning With Verifiable RewardUnsupervised On-Policy Self-Distillation

  6. Weak-to-Strong Generalization via Direct On-Policy Distillation

    Jul 6, 2026Shiyuan Feng, Huan-ang Gao, Haohan Chi +7On-Policy DistillationDeep Reinforcement Learning

  7. Rethinking On-Policy Self-Distillation for Thinking Models

    Jul 6, 2026Simran Kaur, Narutatsu Ri, Yinghui He +2Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  8. Multi-Turn On-Policy Distillation with Prefix Replay

    Jul 6, 2026Baohao Liao, Hanze Dong, Christof Monz +3On-Policy DistillationUnsupervised On-Policy Self-Distillation

  9. Trust Region Policy Distillation

    Jul 6, 2026Zhengpeng Xie, Li Lyna Zhang, Zeke Xie +1On-Policy DistillationConvergence Analysis

  10. LP-SFT: Local-Preserving Supervised Fine-Tuning via Multimodal Entropy Structure

    Jul 6, 2026Yueyang Wang, Baolong Bi, Shuo Lu +1Supervised Fine-TuningFinetuning

  11. A Few Teacher Steps Go a Long Way: Cost-Efficient On-Policy Data Augmentation for Agent Post-Training

    Jul 6, 2026Junze Ye, Jiayi Cheng, Miao Lu +3On-PolicyTeacher

  12. Operator-on-F complements value-equivalence: a planning-time diagnostic for latent world models

    Jul 5, 2026Donna VakalisReward-Prediction ErrorLatent World Models

  13. dOPSD: On-Policy Self-Distillation for Diffusion Language Models

    Jul 5, 2026Phuong Tuan Dat, Qi Li, Xinchao WangUnsupervised On-Policy Self-DistillationDiffusion Language Models

  14. UI-MOPD: Multi-Platform On-Policy Distillation for Continual GUI Agent Learning

    Jul 5, 2026Niu Lian, Alan Chen, Zhehao Yu +8Graphical User Interface AgentsGraphical User Interface

  15. Reward-Gated On-Policy Distillation

    Jul 4, 2026Mohammad Sadegh Akhondzadeh, Vijay Lingam, Atula Tejaswi +3On-Policy DistillationRp-Opsd

  16. Teacher Supervision over Representation Equivalence Classes

    Jul 3, 2026Sang Il HanTeacherEquivalence

  17. DemoPSD: Disagreement-Modulated Policy Self-Distillation

    Jul 2, 2026Yunhe Li, Hao Shi, Wenhao Liu +5Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  18. Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation

    Jul 2, 2026Zhuowei Chen, Xiang Lorraine LiUnsupervised On-Policy Self-DistillationLarge Language Model Post-Training

  19. Purified OPSD: On-Policy Self-Distillation Without Losing How to Think

    Jul 2, 2026Zhanming Shen, Jintao Tong, Shaotian Yan +9Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  20. Bridge-WA: Predicting Where and How the World Changes for Robotic Action

    Jul 2, 2026Yongjie Bai, Hanting Wang, Mingtong Dai +3Efficient World-Action ModelExecutable Robot Behavior

  21. Denser ≠\neq Better: Limits of On-Policy Self-Distillation for Continual Post-Training

    Jul 2, 2026Meng Wang, Haohan Zhao, Wenzhuo Liu +7Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  22. Procedural Memory Distillation: Online Reflection for Self-Improving Language Models

    Jul 1, 2026Ye Liu, Srijan Bansal, Bo Pang +6Unsupervised On-Policy Self-DistillationVerifiable Rewards

  23. Diffusion-GR2: Diffusion Generative Reasoning Re-ranker

    Jul 1, 2026Zhuoxuan Zhang, Kangqi Ni, Yuhang Chen +12RerankingDiffusion Language Models

  24. H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation

    Jul 1, 2026Qixiang Yin, Huanjin Yao, Yuchen Cai +5Multimodal ReasoningOn-Policy Distillation

  25. GR2 Technical Report

    Jun 30, 2026Yufei Li, Zaiwei Zhang, Mingfu Liang +68RerankingOn-Policy Distillation

  26. CHERRY: Compressed Hierarchical Experts with Recurrent Representational Yield

    Jun 30, 2026Dohyeon Kwon, Youngjin ParkLarge Language Model CompressionToken-Level Supervision

  27. On the Convergence of Self-Improving Online LLM Alignment

    Jun 30, 2026Xudong Wu, Pangpang Liu, Vaneet Aggarwal +1Large Language Model AlignmentUnsupervised On-Policy Self-Distillation

  28. Behavior Cloning is Not All You Need: The Optimality of On-Policy Distillation for Noisy Expert Feedback

    Jun 29, 2026Ved Sriraman, Peihan Liu, Daniel Hsu +1On-Policy DistillationImitation Learning

  29. DOPD: Dual On-policy Distillation

    Jun 29, 2026Xinlei Yu, Gen Li, Qingyi Si +13On-Policy DistillationPrivilege Illusion

  30. Regime-Aware Peer Specialization for Robust RAG under Heterogeneous Knowledge Conflicts

    Jun 29, 2026Bo Wang, Heyan Huang, Yaolin Li +5Retrieval-Augmented Generation SystemsKnowledge Conflicts

  31. When Does Online Imitation Learning Help in LLM Post-Training? The Role of (Non-)Realizability Beyond Horizon

    Jun 29, 2026Huaqing Zhang, Jingchu Gai, Juno Kim +2Imitation LearningLarge Language Model Post-Training

  32. MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training

    Jun 29, 2026Wenhan Ma, Jianyu Wei, Liang Zhao +10Large Language Model Post-TrainingOn-Policy Distillation

  33. DRIFT: Difficulty Routing Self-DIstillation with Rhythm-Gated Exploration and Success BuFfer Training

    Jun 29, 2026Haisen Luo, Yiwei Liu, Haoning Wang +13Unsupervised On-Policy Self-DistillationGroup Relative Policy Optimization

  34. Building Multi-Task Agentic LLMs via Two-Phase Distillation

    Jun 29, 2026Huaijie Wang, Shusheng Xu, Yi Wu +1On-Policy DistillationAgentic Reinforcement-Learning Framework

  35. UCOB: Learning to Utilize and Evolve Agentic Skills via Credit-Aware On-Policy Bidirectional Self-Distillation

    Jun 28, 2026Songjun Tu, Chengdong Xu, Qichao Zhang +6Agentic Reinforcement-Learning FrameworkUnsupervised On-Policy Self-Distillation

  36. CRAFT: Counterfactual Credit Assignment from Free Sibling Rollouts for Self-Distilled Agentic Reinforcement Learning

    Jun 28, 2026Zibin Meng, Kani ChenCritic-Free Reinforcement LearningCredit Assignment

  37. PHF: Privileged Hidden Flow for On-Policy Self-Distillation

    Jun 28, 2026Yuhan Li, Mingxu Zhang, Dazhong Shen +1On-Policy DistillationImitation Learning

  38. Process Advantage Signal Shaping: A Paradigm-Agnostic Middleware for Process-Supervised RL in LLM Reasoners

    Jun 28, 2026Chao Wang, Hongtao Tian, Tao Yang +3Reliable Medical Process-Level Reward Model Evaluation FrameworkGroup Relative Policy Optimization

  39. SEAD: Competence-Aware On-Policy Distillation via Entropy-Guided Supervision

    Jun 26, 2026Chia-Hsuan Lee, Zelei Cheng, Yu Wang +4On-Policy DistillationCurriculum

  40. ATOD: Annealed Turn-aware On-policy Distillation for Multi-turn Autonomous Agents

    Jun 26, 2026Qitai Tan, Zefang Zong, Yang Li +1On-Policy DistillationOntology-Amplified Distillation

  41. Qwen-Image-2.0-RL Technical Report

    Jun 25, 2026Yixian Xu, Kaiyuan Gao, Yuxiang Chen +25On-Policy DistillationDeep Reinforcement Learning

  42. DanceOPD: On-Policy Generative Field Distillation

    Jun 25, 2026Wei Zhou, Xiongwei Zhu, Zelin Xu +8Large-Scale Image GenerationDuet

  43. OPID: On-Policy Skill Distillation for Agentic Reinforcement Learning

    Jun 25, 2026Shuo Yang, Jinyang Wu, Zhengxi Lu +8On-Policy DistillationAgentic Reinforcement-Learning Framework

  44. On-Policy Self-Distillation with Sampled Demonstrations Reduces Output Diversity

    Jun 24, 2026Andrei Liviu Nicolicioiu, Mohammad Pezeshki, Aaron CourvilleOn-Policy DistillationDiversity

  45. ROAD-VLA: Robust Online Adaptation via Self-Distillation for Vision-Language-Action Models

    Jun 24, 2026Kejing Wang, Toan Nguyen, Minh Hoang Nguyen +2Vision-Language-Action ModelsVision-Language Model Adaptation

  46. Teach-to-Reason: Competition-Guided Reasoning with a Self-Improving Teacher

    Jun 24, 2026Xiao Han, Hao Liu, Zhimin Bao +5Chain-of-Thought ReasoningChest X-Ray

  47. V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning

    Jun 24, 2026Haoxiang Sun, Zhihang Yi, Langxuan Deng +6Visual ReasoningLarge Vision Language Models

  48. Escaping the Self-Confirmation Trap: An Execute-Distill-Verify Paradigm for Agentic Experience Learning

    Jun 23, 2026Shiding Zhu, Yudi Qi, Yajie Wang +6Self-Evolving AgentsExperience

  49. AsyncOPD: How Stale Can On-Policy Distillation Be?

    Jun 23, 2026Wonjun Kang, Kevin Galim, Seunghyuk Oh +9On-Policy DistillationAsynchronous Execution

  50. Blockwise Policy-Drift Gating for On-Policy Distillation

    Jun 23, 2026Liwen Zheng, Haiyun JiangOn-Policy Distillation

  51. Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoning

    Jun 23, 2026Tianyuan Shi, Canbin Huang, Bei Li +4Unsupervised On-Policy Self-DistillationLarge Language Model Reasoning

  52. ARIA: Adaptive Region-Based Importance Allocation for Conditional Diffusion Distillation

    Jun 22, 2026Loay Mualem, Vinh Tong, Samir Darouich +1Knowledge DistillationDiscrete Diffusion Model

  53. ReNIO: Reweighting Negative Trajectory Importance for LLM On-Policy Distillation

    Jun 22, 2026Chen Lin, Kedi Chen, Wei ZhangOn-Policy DistillationTrainability

  54. Finding the Evidence: Discovering Decision-Supporting Tokens for On-Policy Reasoning Distillation

    Jun 22, 2026Jinwei Xiao, Zhuowen Han, Yueqing Sun +6On-Policy Distillation

  55. A Formula-Driven Survey and Research Agenda for On-Policy Distillation

    Jun 22, 2026Bowen ZhangOn-Policy DistillationInformation Gain

  56. On the Position Bias of On-Policy Distillation

    Jun 21, 2026Yan Xie, Sijie Zhu, Tiansheng Wen +2On-Policy DistillationImplicit Bias

  57. Prefix-Guided On-Policy Distillation: Mining Golden Trajectories from Rollouts

    Jun 20, 2026Qingfei Zhao, Huan Song, Shuyu Tian +2On-Policy DistillationRollout

  58. Marginal Advantage Accumulation for Memory-Driven Agent Self-Evolution

    Jun 18, 2026Mingyu Yang, Keye Zheng, Congchao Cheng +4Batch DistillationOn-Policy Distillation

  59. SAGE-OPD: Selective Agent-Guided Intervention for Multi-Turn On-Policy Distillation

    Jun 17, 2026Yuhang Zhou, Lizhu Zhang, Yifan Wu +5On-Policy DistillationRp-Opsd

  60. Scaling Self-Play for End-to-End Driving

    Jun 17, 2026Luke Rowe, Roger Girgis, Rodrigue de Schaetzen +6Autonomous Driving SimulationAutonomous Driving