On-Policy Distillation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-14

20 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Inside this field

Focused directions

437 papers

Latest in On-Policy Distillation

Browse all topics →
CardsList

  1. RL Starts before RL: On Policy Distillation for Better Reinforcement Learning

    Sep 23, 2026Shuai Dong, Yongfu Zhu, Yuqi Xu +26On-Policy Distillation

  2. Counterfactual Constraint-Conditioned On-Policy Distillation for Multi-Constraint Instruction Following

    Sep 23, 2026Yanzhao Zheng, Yuanqiang Yu, Tianze Xu +6On-Policy Distillation

  3. What Should a Self-Teacher See? Privileged Context Design for On-Policy Self-Distillation

    Sep 22, 2026Kanghui Tian, Siyuan Liu, Tianxiang Jiang +8Unsupervised On-Policy Self-Distillation

  4. RRSI: Regularized Recursive Self-Improvement of Agent Harnesses

    Sep 21, 2026Peng Xia, Rujun Han, Zifeng Wang +11Agentic Reinforcement-Learning FrameworkAgent Harness

  5. 1% of Tokens Can Be Enough: On Gradient Estimation in On-Policy Distillation

    Sep 21, 2026Huanxin Sheng, Zhiling Ye, Haonan Wang +3On-Policy Distillation

  6. CLOOPD: Closing the Learner Loop in On-Policy Distillation

    Sep 21, 2026Keye Zheng, Hanyu Li, Zhan Cheng +1On-Policy Distillation

  7. RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning

    Sep 17, 2026Yan Yu, Zhengxi Lu, Yizhou Liu +8On-Policy DistillationAgentic Reinforcement-Learning Framework

  8. OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher

    Sep 17, 2026Damiano Da Col, Maximilian Igl, Peter Karkus +5Autonomous DrivingReinforcement Learning Post-Training

  9. What Does Privileged Information Add to On-Policy Self-Distillation?

    Sep 17, 2026XiuYu Zhang, Wei Chow, Junfeng Fang +2Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  10. When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation

    Sep 17, 2026Yuxiao Yang, Tianrun Yu, Shangzhe Li +6On-Policy DistillationTraining-Inference Mismatch

  11. Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement

    Sep 17, 2026Yitong Xing, Yuhao Cheng, Yanping Li +1Rt-DetrObject Detection

  12. Trajectory Learnability for Offline On-Policy Distillation with Imperfect Teachers

    Sep 16, 2026Yihao Ai, Weilong YanOn-Policy Distillation

  13. Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback

    Sep 15, 2026Haichen Hu, Yuheng Zhang, David Simchi-LeviTeacherMulticalibration and Calibration

  14. Beyond Token-Local Imitation: Reward-Compatible Temporal Credit Assignment for On-Policy Distillation

    Sep 15, 2026Shiqi Liu, Zeyu He, Letian Tao +9On-Policy DistillationCredit Assignment

  15. OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

    Sep 15, 2026Chenhao Qiu, Dawei Li, Yechao Zhang +2Multimodal ReasoningOn-Policy Distillation

  16. Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning

    Sep 14, 2026Sophia Tang, Shiyi WangDiffusion Language ModelsAutoregressive Language Models

  17. Who Teaches Which Token? Verifier-Gated Multi-Expert On-Policy Distillation for Scientific Reasoning

    Sep 14, 2026Xun Xu, Zaixi ZhangOn-Policy DistillationScientific Discovery

  18. Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation

    Sep 14, 2026Daxin Tan, Dehua Tao, Chengxi Deng +2Autoregressive GenerationOn-Policy Distillation

  19. Reason What Matters: Retrieval-Grounded Reasoning for Universal Multimodal Embeddings

    Sep 14, 2026Mingzhou Jiang, Peixi Wu, Hang Cheng +7Multimodal EmbeddingsUniversal Multimodal

  20. SCOPE-OPSD: Fisher-Conditioned Privileged Subspaces for On-Policy Self-Distillation

    Sep 14, 2026Yunmeng Chen (Chongqing Ant Consumer Finance Co., Ltd), Kunyu Wang (Alibaba Cloud Computing Co. +18On-Policy DistillationRp-Opsd

  21. Beyond Verified Answers: Solver-Informed Self-Distillation for Bootstrapping Operations Research Language Models

    Sep 12, 2026Rui Zhu, Minglong Cao, Chenyu Zhou +2Future Llm-Assisted Solver DevelopmentBatch Distillation

  22. A Unified Per-Token Gating Family for On-Policy Distillation: FKL/RKL Mixing with Multi-Channel and Bias Coefficients

    Sep 12, 2026Suwan Wu, Yumeng Lin, Pengcheng Yuan +1On-Policy DistillationKullback-Leibler Divergence

  23. KuaiRP Series Role-playing Models Technical Report

    Sep 12, 2026Yipeng Wang, Ziwei Zhang, Jiahui Zhang +2Role-Playing AgentsOn-Policy Distillation

  24. SenseNova-U1.5: Towards Native Unified Visual Intelligence

    Sep 11, 2026Haiwen Diao, Jiahao Wang, Chenjing Ding +62On-Policy Distillation

  25. Negative Self-Distillation: Learning to Reason by Avoiding Flaws

    Sep 10, 2026Rongcan Pei, Zhepei Wei, Shuyao Xu +3Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  26. Teacher Geometry Shapes Learnability in Teacher-Student Networks

    Sep 10, 2026Kai J. Sandbrink, Flavio Martinelli, Alexander van Meegen +2Teacher-Student Log-Probability GapTwo-Layer Neural Networks

  27. On-Policy Distillation for Vision-Language Model Adaptation, an Effective Paradigm on Low-Quality Multimodal Data

    Sep 9, 2026Hongyuan Zhang, Xianda Guo, Yanlun Peng +6Vision-Language Model AdaptationOn-Policy Distillation

  28. CompassOPD: Cross-Family On-Policy Distillation via Within-Family Likelihood Shifts

    Sep 9, 2026Naibin Gu, Qingyi Si, Chenxu Yang +5On-Policy DistillationCompass

  29. Improving Cross-Lingual Token Representations by Adding a Pinch of SALT

    Sep 9, 2026Guillem RamírezEncoding ModelsToken-Level Supervision

  30. Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation

    Sep 8, 2026Youngrok Park, Sangmin Bae, Hojung Jung +6On-Policy DistillationMulti-Teacher Distillation

  31. Miles v0.1: Production-Level Post-Training

    Sep 8, 2026RadixArk, :, Tom Chen +11Reinforcement Learning Post-TrainingOn-Policy Distillation

  32. TV-Regulated OPD: Direction Matters in On-Policy Distillation

    Sep 8, 2026Han Xiao, Yifan Niu, Dongyi Liu +2On-Policy DistillationToken-Level Uncertainty

  33. Distillation as Probability Transport: Routed On-Policy Distillation

    Sep 8, 2026Tianle Xia, Lingxiang Hu, Yiding Sun +6On-Policy DistillationTeacher

  34. NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness

    Sep 8, 2026NeoHorse Team, Guoliang Cao, Guohao Dai +34Agentic Reinforcement-Learning FrameworkReinforcement Learning Post-Training

  35. Flow3D-OPD: Multi-Teacher On-Policy Distillation for 3D Geometry Generation with Flow-Matching Diffusion Transformer

    Sep 7, 2026Zhiwei Ning, Zhen Zhou, Puhua Jiang +73D Generative ModelsOn-Policy Distillation

  36. Extremely Sparse Supervision Incentivizes Reasoning Ability

    Sep 7, 2026Zhishuai Liu, Xingzi Xu, Mehmet Saygin Seyfioglu +2Token-Level SupervisionLarge Language Model Post-Training

  37. VERPO: Verified Evidence Regularized Policy Optimization

    Sep 5, 2026Haijiang Li, Chengyu Lv, Yi Zhang +8Reinforcement Learning With Verifiable RewardToken-Level Supervision

  38. Rethinking On-Policy Distillation of Large Language Models II: One Training Example

    Sep 3, 2026Zixuan Fu, Bingxiang He, Yuxin Zuo +10On-Policy DistillationModel Training

  39. Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR

    Sep 3, 2026Boyan Li, Bingsen Chen, Chenghao Yang +3Reinforcement Learning With Verifiable RewardOn-Policy Distillation

  40. Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation

    Sep 2, 2026Zhiwei Zhang, Zechen Sun, Fei Zhao +6On-Policy DistillationTeacher

  41. Structure and Implementation of New Practical English Textbooks Driven by Artificial Intelligence

    Sep 2, 2026Ya Wang, Lei Zhang, Xueguang Yang +1TutorsAdaptive Learning

  42. On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers

    Sep 1, 2026Vignesh Prabhakar, Jialing Pan, Anil Babu AnkisettipalliOn-Policy DistillationReranking

  43. Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

    Sep 1, 2026Jacqueline He, Howard Yen, Shuyue Stella Li +9Knowledge DistillationTeacher

  44. From Rollouts to Recipes: Self-Contained Post-Training for LLMs

    Sep 1, 2026Yifei Li, Lingling Zhang, Muye Huang +3Large Language Model Post-TrainingLLM Post-Training Methods

  45. Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

    Aug 31, 2026Yi Ding, Ruqi ZhangOn-Policy DistillationTeacher

  46. Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation

    Aug 30, 2026Run Yang, Runpeng Dai, Jie Sun +5On-Policy DistillationOntology-Amplified Distillation

  47. Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher

    Aug 27, 2026Shiyi Zhang, Mushui Liu, Yunze Tong +8On-Policy DistillationRp-Opsd

  48. Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding

    Aug 26, 2026Kaishen Wang, Dongdi Zhao, Yijun Liang +4Video UnderstandingUnsupervised On-Policy Self-Distillation

  49. D3^3-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation

    Aug 25, 2026Zechen Sun, Zhiwei Zhang, Fei Zhao +7Multi-Teacher DistillationOn-Policy Distillation

  50. Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning

    Aug 17, 2026Ao Shen, Yongheng Zhang, Yinghui Li +3Latent Visual ReasoningVisual Reasoning

  51. Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation

    Aug 13, 2026Hmrishav Bandyopadhyay, Xuanchi Ren, Zijian Huang +7Autoregressive Video GenerationPrompt Distillation

  52. CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation

    Aug 13, 2026Enhan Li, Junhao He, Hongyang DuOn-Policy DistillationToken-Level Supervision

  53. Teach the Magnitude, Not the Direction: Verifier-Bounded Credit Assignment for Multi-Turn Multi-step LLM Agents

    Aug 13, 2026Zechuan Wang, Siyuan Lu, Hongxuan Zhang +3Credit AssignmentReinforcement Learning With Verifiable Reward

  54. Latent On-Policy Self-Distillation

    Aug 13, 2026Guibin Zhang, Jiayang Lyu, Ran Sun +4Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  55. I-SDPO: Instance-Level Adaptive Self-Distillation Policy Optimization

    Aug 13, 2026Yubo Zhang, Xinhong Ma, Zezhong Tan +1Unsupervised On-Policy Self-DistillationGroup Relative Policy Optimization

  56. Towards Understanding On-Policy Distillation through the Lens of Test-Time Scaling

    Aug 12, 2026Xinmu Ge, Zizhuo Zhang, Yu Huang +9On-Policy DistillationRp-Opsd

  57. REOPD: Reliability-Adaptive Reward Extrapolation for On-Policy Distillation

    Aug 12, 2026Yang Sun, Lichao Ma, Houyuan Qin +5On-Policy DistillationReward Gradients

  58. Hybrid-Policy Self-Editing for Composable Unstructured Knowledge Editing

    Aug 12, 2026Tianci Liu, Zihan Dong, Tianchun Li +8Multimodal Knowledge EditingKnowledge Distillation

  59. Learning from Online User Feedback for Shopping Agents

    Aug 12, 2026Haobo Zhang, Kelong Mao, Sulong Xu +2Agentic CommerceFeedback Learning

  60. Gloss-Free Representation Learning for Cross-Dataset Sign Spotting

    Aug 11, 2026Oğuz Akif Tüfekcioğlu, Ezgi Ekin, Mustafa Kaan Çevik +1Sign Language RecognitionToken-Level Supervision