On-Policy Distillation

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-14

20 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Inside this field

Focused directions

437 papers

Latest in On-Policy Distillation

Browse all topics →
CardsList

  1. Rethinking Reward Supervision: Rubric-Conditioned Self-Distillation

    Jun 17, 2026Siyi Gu, Jialin Chen, Sophia Zhou +2Rubric-Based Reinforcement LearningUnsupervised On-Policy Self-Distillation

  2. Seeing Before Reasoning: Decoupling Perception and Reasoning for Shortcut-Resilient Multimodal On-Policy Self-Distillation

    Jun 17, 2026Sihan Wang, Xiyao Liu, Lianqing Liu +1On-Policy DistillationLarge Language Model Reasoning

  3. Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning

    Jun 17, 2026Pengyu Li, Zhitao Gao, Lingling Zhang +5Multimodal ReasoningVisual Reasoning

  4. Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation

    Jun 17, 2026Zhilin Huang, Hang Gao, Ziqiang Dong +6Unsupervised On-Policy Self-DistillationIterative Self-Correction

  5. Learning from Own Solutions: Self-Conditioned Credit Assignment for Reinforcement Learning with Verifiable Rewards

    Jun 17, 2026Yingyu Shan, Yuhang Guo, Zihao Cheng +7Reinforcement Learning With Verifiable RewardCredit Assignment

  6. Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients

    Jun 16, 2026Byung-Kwan Lee, Ximing Lu, Shizhe Diao +6On-Policy DistillationProximal Policy Optimization

  7. Learning from the Self-future: On-policy Self-distillation for dLLMs

    Jun 16, 2026Yifu Luo, Zeyu Chen, Haoyu Wang +4Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  8. Trust the Right Teacher: Quality-Aware Self-Distillation for GUI Grounding

    Jun 16, 2026Jingyuan Huang, Zuming Huang, Yucheng Shi +4Graphical User InterfaceTeacher

  9. When English Isn't the Best Teacher: Source Language Effects in Cross-Lingual In-Context Learning

    Jun 16, 2026Fred Philippy, Siwen Guo, Jacques Klein +1Cross-Lingual TransferEnglish

  10. MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model

    Jun 16, 2026Lichen Bai, Tianhao Zhang, Shitong Shao +14Visual Autoregressive ModelsReal-Time Systems

  11. OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation

    Jun 16, 2026Guibin Zhang, Xun Xu, Yanwei Yue +4Self-Evolving AgentsUnsupervised On-Policy Self-Distillation

  12. TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations

    Jun 16, 2026Zikang Xiong, Weixin Li, Zhouchonghao Wu +6Autonomous DrivingImitation Learning

  13. PowerOPD: Stabilizing On-Policy Distillation with Bounded Power Transformation

    Jun 15, 2026Anhao Zhao, Junlong Tong, Yingqi Fan +3On-Policy DistillationRp-Opsd

  14. OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing

    Jun 14, 2026Zebang Cheng, Shuimu Chen, Boxue Yang +7On-Policy DistillationOmni

  15. On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents

    Jun 14, 2026Gengsheng Li, Mao Zheng, Mingyang Song +8On-Policy DistillationTeacher

  16. Localizing Credit at the Divergence: Path-Conditioned Self-Distillation for LLM Reasoning

    Jun 14, 2026Yu Li, Shu Hong, Tian LanUnsupervised On-Policy Self-DistillationOn-Policy Distillation

  17. SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation

    Jun 13, 2026Mohamed Jismy Aashik Rasool, Shabir Ahmad, Gisong Oh +1Knowledge DistillationSelf-Supervised Reconstruction Method

  18. Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection

    Jun 13, 2026Elham Abolhasani, Maryam Ramezani, Hamid R. RabieeDomain AdaptationEnsemble

  19. Be My Tutor: On-Policy Co-Distillation for Mutual LLM Improvement via Peer Feedback

    Jun 12, 2026Woohyeon Byeon, Jiwon Jeon, Jeonghye Kim +1On-Policy DistillationIterative Co-Training

  20. SuperThoughts: Reasoning Tokens in Superposition

    Jun 11, 2026Zheyang Xiong, Shivam Garg, Max Yu +4ThinkingLLM Inference Efficiency

  21. Dense Supervision, Sparse Updates: On the Sparsity and Geometry of On-Policy Distillation

    Jun 11, 2026Guo Yu, Wenlin Liu, Yulan Hu +3On-Policy DistillationRp-Opsd

  22. RLCSD: Reinforcement Learning with Contrastive On-Policy Self-Distillation

    Jun 10, 2026Leyi Pan, Shuchang Tao, Yunpeng Zhai +5Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  23. When Context Returns: Toward Robust Internalization in On-Policy Distillation

    Jun 10, 2026Xun Wang, Ruishuo Chen, Zhuoran Li +2On-Policy DistillationIn-Context Learning

  24. Beyond the Golden Teacher: Enhancing Graph Learning through LLM-GNN Co-teaching

    Jun 10, 2026Zhuoyi Peng, Hanlin Gu, Lixin Fan +1Gnn-Based DetectorsPseudo-Labeling

  25. HERO: Hindsight-Enhanced Reflection from Environment Observations for Agentic Self-Distillation

    Jun 10, 2026Haoran Liu, Yuwei Zhang, Xiyao Li +2Unsupervised On-Policy Self-DistillationHindsight

  26. Beyond Absolute Imitation: Anchored Residual Guidance for Privileged On-Policy Distillation

    Jun 9, 2026Wenhao ZhangOn-Policy DistillationTeacher

  27. PADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student Learning

    Jun 9, 2026Xinyue Peng, Yi Qian, Jiaojiao Lin +2Ontology-Amplified DistillationTeacher

  28. A Guiding Framework for K-12 Teachers in Creating AI-powered Learning Technologies through Vibe Coding

    Jun 9, 2026Yukyeong Song, Seoyeon Choi, Jinhee Kim +3Artificial Intelligence LiteracyClassrooms

  29. AI tools in Arab University English classrooms: Looking back and forward

    Jun 8, 2026Mohammed Q. Shormani, Muneef Yehia AlshawshArtificial Intelligence LiteracyClassrooms

  30. Escaping the KL Agreement Trap in On-Policy Distillation

    Jun 8, 2026Haoran Xin, Anhao Zhao, Ying Sun +3On-Policy DistillationToken-Level Supervision

  31. Breaking the Tokenizer Barrier: On-Policy Distillation across Model Families

    Jun 8, 2026Yifan Niu, Han Xiao, Dongyi Liu +4On-Policy Distillation

  32. SG-OPD: Sign-Gated On-Policy Distillation via Sign-Consistency Gating and Phased Teacher Sampling

    Jun 8, 2026Haoran Xu, Hongyu Wang, Yifei Gao +3On-Policy Distillation

  33. Stabilizing On-Policy Distillation for MLLM Reasoning with Global Normalization

    Jun 8, 2026Dongze Hao, Zhiwei Jin, Chen Chen +1On-Policy DistillationLLM Post-Training Methods

  34. Thinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation

    Jun 7, 2026Yishuo Cai, Jiahui Liu, Yuanxin Liu +9Visual ReasoningFine-Grained Perception

  35. Trajectory-Refined Distillation

    Jun 7, 2026Li Jiang, Haoran Xu, Yichuan Ding +1On-Policy DistillationTool Failures

  36. X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting

    Jun 6, 2026Jen-Wei Wang, Sarthak Kaingade, Andrea Tagliabue +1TeleoperationModel Predictive Control

  37. Self-evolving LLM agents with in-distribution Optimization

    Jun 5, 2026Yudi Zhang, Meng Fang, Zhenfang Chen +1Self-Evolving AgentsUnsupervised On-Policy Self-Distillation

  38. On the Geometry of On-Policy Distillation

    Jun 5, 2026Zhennan Shen, Yanshu Li, Qingyu Yin +6On-Policy DistillationLarge Language Model Reasoning

  39. Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation

    Jun 4, 2026Xingyu Su, Jacob Helwig, Shubham Parashar +6Diffusion Language ModelsOn-Policy Distillation

  40. HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers

    Jun 4, 2026Lizhi Yang, Junheng Li, Nehar Poddar +5Long-Tail Humanoid Whole-Body ControlHandoff

  41. OPRD: On-Policy Representation Distillation

    Jun 4, 2026Shenzhi Yang, Guangcheng Zhu, Bowen Song +8On-Policy DistillationHidden States

  42. SagnacAssisted Enhanced OTDR for Distributed Acoustic Sensing: A Standardized Benchmark and Engineering Evaluation Framework

    Jun 4, 2026Weiguang Wang, Fugen Wu, Hailing Wang +4Doppler Velocity LogPassive Acoustic Monitoring

  43. ViCuR: Visual Cues as Recoverable Privilege for Multimodal On-Policy Distillation

    Jun 4, 2026Kanghui Tian, Siyuan Liu, Ziang Yan +3On-Policy DistillationMulti-Teacher Distillation

  44. Reinforcement Learning from Rich Feedback with Distributional DAgger

    Jun 3, 2026Rishabh Agrawal, Jacob Fein-Ashley, Paria RashidinejadReinforcement Learning With Verifiable RewardUnsupervised On-Policy Self-Distillation

  45. Language Models Need Sleep: Learning to Self-Modify and Consolidate Memories

    Jun 2, 2026Ali Behrouz, Farnoosh Hashemi, Adel Javanmard +1Continual Learning MethodsSleep

  46. Covert Influence Between Language Models

    Jun 2, 2026Avidan Shah, Jay Chooi, Jinghua Ou +1InfluenceTraining Language Models

  47. Physics-Guided Policy Optimization with Self-Distillation

    Jun 2, 2026Ke Wang, Yuning Wu, Haoran Liu +3Unsupervised On-Policy Self-DistillationMulti-Objective Policy Optimization

  48. When Should the Teacher Move? Temporal Coupling and Stability in Self On-Policy Distillation

    Jun 2, 2026Haowei Guo, Baolong Bi, Ruicheng Zhang +2On-Policy DistillationTeacher

  49. Constitutional On-Policy Safe Distillation

    Jun 2, 2026Ming Wen, Yuxuan Liu, Kun Yang +8On-Policy DistillationUnsupervised On-Policy Self-Distillation

  50. Self-Distilled Policy Gradient

    Jun 2, 2026Yifeng Liu, Shiyuan Zhang, Yifan Zhang +1Unsupervised On-Policy Self-DistillationOn-Policy Distillation

  51. Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation

    Jun 1, 2026Yuying Li, Leqi Zheng, Yongzi Yu +6On-Policy DistillationKullback-Leibler Divergence

  52. VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization

    Jun 1, 2026Junhao Cheng, Liang Hou, Tianxiong Zhong +4Visual ReasoningTeacher

  53. SafeSteer: Localized On-Policy Distillation for Efficient Safety Alignment

    Jun 1, 2026Hao Li, Jingkun An, Zijun Song +8Safety AlignmentLarge Language Model Alignment

  54. When Rating Scales Fall Short: LLM-Assisted Discovery of ADHD Signals in Turkish Teacher Narratives

    Jun 1, 2026Baris Karacan, Irem Aktar Songur, Ahmet Ozaslan +1Autism Spectrum DisorderComputerized Adaptive Testing

  55. SIRI: Self-Internalizing Reinforcement Learning with Intrinsic Skills for LLM Agent Training

    Jun 1, 2026Zhongyu He, Yuanfan Li, Fei Huang +9Agentic Reinforcement-Learning FrameworkSkill Evolution

  56. OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification

    May 31, 2026Yuhang Zhou, Lizhu Zhang, Yifan Wu +5On-Policy DistillationToken-Level Uncertainty

  57. Trust Region On-Policy Distillation

    May 31, 2026Xingrun Xing, Haoqing Wang, Boyan Gao +2On-Policy DistillationToken-Level Supervision

  58. OPD+: Rethinking the Advantage Design for On-Policy Distillation

    May 31, 2026Hanyang Zhao, Haoxian Chen, Han Lin +3On-Policy DistillationRp-Opsd

  59. Subliminal Learning Is Steering Vector Distillation

    May 31, 2026Camila Blank, Agam Bhatia, Senthooran Rajamanoharan +2Ontology-Amplified DistillationTeacher

  60. Internalize the Temperature: On-Policy Self-Distillation as Policy Reheater for Reinforcement Learning

    May 30, 2026Xuewei Yang, Jiachen Yu, Jie Wu +3On-Policy DistillationInternalization