On-Policy Distillation

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-14

20 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in On-Policy Distillation.

Inside this field

Focused directions

Focused topic

On-Policy Distillation

Within On-Policy Distillation

291 papersExplore

Focused topic

Unsupervised On-Policy Self-Distillation

Within On-Policy Distillation

116 papersExplore

Focused topic

Teacher

Within On-Policy Distillation

81 papersExplore

Focused topic

Rp-Opsd

Within On-Policy Distillation

52 papersExplore

Focused topic

Token-Level Supervision

Within On-Policy Distillation

44 papersExplore

Focused topic

Teacher-Student Log-Probability Gap

Within On-Policy Distillation

19 papersExplore

437 papers

Latest in On-Policy Distillation

Browse all topics →

How to Choose Your Teacher for Fine Grained Image Recognition
May 15, 2026Oswin Gosal, Edwin Arkel Rios, Augusto Christian Surya +3Knowledge Distillation Fine-Grained Perception
DeltaPrompts: Escaping the Zero-Delta Trap in Multimodal Distillation
May 15, 2026Jaehun Jung, Hyunwoo Kim, Brandon Cui +4Chain-Of-Thought Distillation On-Policy Distillation
Self-Distilled Agentic Reinforcement Learning
May 14, 2026Zhengxi Lu, Zhiyuan Yao, Zhuowen Han +8Unsupervised On-Policy Self-Distillation On-Policy Distillation
Learning from Language Feedback via Variational Policy Distillation
May 14, 2026Yang Li, Erik Nijkamp, Semih Yavuz +1Unsupervised On-Policy Self-Distillation On-Policy Distillation
Reducing the Safety Tax in LLM Safety Alignment with On-Policy Self-Distillation
May 14, 2026Yu Fu, Longxuan Yu, Haz Sameen Shahgir +4Unsupervised On-Policy Self-Distillation Safety Alignment
Prefix Teach, Suffix Fade: Local Teachability Collapse in Strong-to-Weak On-Policy Distillation
May 13, 2026Kaiyuan Liu, Ziyuan Zhuang, Yang Bai +3On-Policy Distillation Feedback Learning
Reward-Weighted On-Policy Distillation with an Open Property-Equivalence Verifier for NL-to-SVA Generation
May 13, 2026Qingyun Zou, Yingze Li, Tianen Liu +2Systemverilog Assertions Reinforcement Learning With Verifiable Reward
Respecting Self-Uncertainty in On-Policy Self-Distillation for Efficient LLM Reasoning
May 13, 2026Junlong Ke, Zichen Wen, Weijia Li +2Unsupervised On-Policy Self-Distillation On-Policy Distillation
Teacher-Guided Policy Optimization for On-Policy Reasoning Distillation under Large Policy Divergence
May 13, 2026Xinyu Liu, Kechen Jiao, Chunyang Xiao +10On-Policy Distillation Multi-Objective Policy Optimization
ICRL: Learning to Internalize Self-Critique with Reinforcement Learning
May 13, 2026Jianbo Lin, Xiaomin Yu, Yi Xin +7Critique Unsupervised On-Policy Self-Distillation
Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time
May 13, 2026Michael Y. Hu, Apurva Gandhi, Kyunghyun Cho +2Continual Learning Methods On-Policy Distillation
Learning with Rare Success but Rich Feedback via Reflection-Enhanced Self-Distillation
May 12, 2026Yuwei Zhang, Sha Li, Changlong Yu +9Unsupervised On-Policy Self-Distillation Reinforcement Learning Post-Training
Multi-Rollout On-Policy Distillation via Peer Successes and Failures
May 12, 2026Weichen Yu, Xiaomin Li, Yizhou Zhao +8On-Policy Distillation Token-Level Supervision
Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Training
May 12, 2026Yuanda Xu, Hejian Sang, Zhengze Zhou +3Token-Level Supervision On-Policy Distillation
OGLS-SD: On-Policy Self-Distillation with Outcome-Guided Logit Steering for LLM Reasoning
May 12, 2026Yuxiao Yang, Xiaoyun Wang, Weitong ZhangUnsupervised On-Policy Self-Distillation On-Policy Distillation
Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation
May 12, 2026Yuchen Cai, Ding Cao, Liang Lin +9On-Policy Distillation Large Language Model Post-Training
GRAFT: Graph-Tokenized LLMs for Tool Planning
May 12, 2026Xinyi Gao, Xinyu Ren, Junliang Yu +3Large Language Model Planning Graph Language Models
From Generic Correlation to Input-Specific Credit in On-Policy Self Distillation
May 12, 2026Guobin Shen, Lei Huang, Xiang Cheng +4Unsupervised On-Policy Self-Distillation On-Policy Distillation
Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information
May 12, 2026Guobin Shen, Xiang Cheng, Chenxiao Zhao +4Unsupervised On-Policy Self-Distillation Batch Distillation
Hindsight Hint Distillation: Scaffolded Reasoning for SWE Agents from CoT-free Answers
May 12, 2026Shengjie Wang, Guanghe Li, Zonghan Yang +1Hindsight Long-Horizon Tasks
Adaptive Teacher Exposure for Self-Distillation in LLM Reasoning
May 12, 2026Zihao Han, Tiangang Zhang, Huaibin Wang +1Unsupervised On-Policy Self-Distillation On-Policy Distillation
Internalizing Curriculum Judgment for LLM Reinforcement Fine-Tuning
May 11, 2026Han Zheng, Yining Ma, Karthick Gunasekaran +4Curriculum Reinforcement Learning Reinforcement Fine-Tuning
The Many Faces of On-Policy Distillation: Pitfalls, Mechanisms, and Fixes
May 11, 2026Siqi Zhu, Xuyan Ye, Hongyu Lu +2On-Policy Distillation Teacher
Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why
May 11, 2026Mohammadreza Armandpour, Fatih Ilhan, David Harrison +6On-Policy Distillation Token-Level Supervision
Rebellious Student: Reversing Teacher Signals for Reasoning Exploration with Self-Distilled RLVR
May 11, 2026Jeonghye Kim, Jiwon Jeon, Dongsheng Li +1Unsupervised On-Policy Self-Distillation Reinforcement Learning With Verifiable Reward
Evolving-RL: End-to-End Optimization of Experience-Driven Self-Evolving Capability within Agents
May 11, 2026Zhiyuan Fan, Wenwei Jin, Feng Zhang +4Self-Evolving Agents Experience
Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing
May 11, 2026Jinchang Zhu, Jindong Li, Chengyu Zou +4Efficient Long-Context Inference Token-Level Supervision
TRACE: Distilling Where It Matters via Token-Routed Self On-Policy Alignment
May 11, 2026Jiaxuan Wang, Xuan Ouyang, Zhiyu Chen +4Unsupervised On-Policy Self-Distillation On-Policy Distillation
ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
May 11, 2026Yulin Zhang, He Cao, Zihao Jiang +6Protein Design Preference Alignment
Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
May 11, 2026Wu Li, Yigeng Zhou, Zesheng Shi +3Large Language Model Alignment Self-Play
On-Policy Distillation with Best-of-N Teacher Rollout Selection
May 10, 2026Ke Zhang, Yunjie Tian, Dongdi Zhao +4On-Policy Distillation
Crosslingual On-Policy Self-Distillation for Multilingual Reasoning
May 10, 2026Yihong Liu, Raoyuan Zhao, Michael A. Hedderich +1Multilingual Reasoning Large Language Model Reasoning
Cornerstones or Stumbling Blocks? Deciphering the Rock Tokens in On-Policy Distillation
May 10, 2026Yuxuan Jiang, Runchao Li, Shubhashis Roy Dipta +2On-Policy Distillation Teacher
Reasoning Compression with Mixed-Policy Distillation
May 9, 2026Han Yang, Mingyan Wu, Bailan He +4Large Language Model Reasoning On-Policy Distillation
Training with Harnesses: On-Policy Harness Self-Distillation for Complex Reasoning
May 9, 2026Zhengyang Zhao, Lu Ma, Wentao ZhangUnsupervised On-Policy Self-Distillation Inference-Time
The Extrapolation Cliff in On-Policy Distillation of Near-Deterministic Structured Outputs
May 9, 2026Xin Li, Hao Jiang, Annan Wang +2On-Policy Distillation Large Language Model Post-Training
Flow-OPD: On-Policy Distillation for Flow Matching Models
May 8, 2026Zhen Fang, Wenxuan Huang, Yu Zeng +8Hierarchical Flow Matching Video-Text Alignment
KL for a KL: On-Policy Distillation with Control Variate Baseline
May 8, 2026Minjae Oh, Sangjun Song, Gyubin Choi +2On-Policy Distillation Kullback-Leibler Divergence
Prune-OPD: Efficient and Reliable On-Policy Distillation for Long-Horizon Reasoning
May 8, 2026Zhicheng Yang, Zhijiang Guo, Yifan Song +5On-Policy Distillation Rp-Opsd
SOD: Step-wise On-policy Distillation for Small Language Model Agents
May 8, 2026Qiyong Zhong, Mao Zheng, Mingyang Song +5On-Policy Distillation Large Language Model Reasoning
SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation
May 8, 2026Jie Sun, Mao Zheng, Mingyang Song +6On-Policy Distillation
LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
May 8, 2026Yubin Wu, Zicheng Cai, Liping Ning +4Graphical User Interface Agents Agentic Reinforcement-Learning Framework
Rubric-based On-policy Distillation
May 8, 2026Junfeng Fang, Zhepei Hong, Mao Zheng +7On-Policy Distillation Rubrics
UniSD: Towards a Unified Self-Distillation Framework for Large Language Models
May 7, 2026Yiqiao Jin, Yiyang Wang, Lucheng Fu +7Unsupervised On-Policy Self-Distillation Large Language Model Adaptation
Asymmetric On-Policy Distillation: Bridging Exploitation and Imitation at the Token Level
May 7, 2026Nan Jia, Haojin Yang, Xing Ma +6On-Policy Distillation Policy Gradient
OPSD Compresses What RLVR Teaches: A Post-RL Compaction Stage for Reasoning Models
May 7, 2026Jaehoon Kim, Dongha LeeUnsupervised On-Policy Self-Distillation On-Policy Distillation
Near-Policy: Accelerating On-Policy Distillation via Asynchronous Generation and Selective Packing
May 7, 2026Miao Rang, Zhenni Bi, Hang Zhou +6On-Policy Distillation Chain-Of-Thought Distillation
D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models
May 6, 2026Dengyang Jiang, Xin Jin, Dongyang Liu +9On-Policy Distillation Rp-Opsd
Preference-Based Self-Distillation: Beyond KL Matching via Reward Regularization
May 6, 2026Xin Yu, Liuchen Liao, Yiwen Zhang +3Unsupervised On-Policy Self-Distillation On-Policy Distillation
Power Distribution Bridges Sampling, Self-Reward RL, and Self-Distillation
May 6, 2026Akiyoshi Tomihari, Issei SatoUnsupervised On-Policy Self-Distillation Large Language Model Performance
Stream-R1: Reliability-Perplexity Aware Reward Distillation for Streaming Video Generation
May 5, 2026Bin Wu, Mengqi Huang, Shaojin Wu +4Autoregressive Video Diffusion On-Policy Distillation
Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe
May 5, 2026Wenjin Hou, Shangpin Peng, Weinong Wang +13On-Policy Distillation Multi-Teacher Distillation
MAD-OPD: Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debate
May 2, 2026Jianze Wang, Ying Liu, Jinlong Chen +7On-Policy Distillation Token-Level Supervision
Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Grounding
May 1, 2026Yan Zhang, Daiqing Wu, Huawen Shen +2Graphical User Interface Graphical User Interface Agents
Healthcare AI GYM for Medical Agents
May 1, 2026Minbyul JeongClinical Reasoning Multi-Turn Tool-Use Agent
AI Adoption Among Teachers: Insights on Concerns, Support, Confidence, and Attitudes
May 1, 2026Vanessa B. Sibug, Maria Anna D. Cruz, Vicky P. Vital +6Education Institutional Composition
Beyond SFT-to-RL: Pre-alignment via Black-Box On-Policy Distillation for Multimodal RL
Apr 30, 2026Sudong Wang, Weiquan Huang, Xiaomin Yu +9Multimodal Reasoning Supervised Fine-Tuning
PAINT: Partial-Solution Adaptive Interpolated Training for Self-Distilled Reasoners
Apr 29, 2026Zhiquan Tan, Yinrong HongUnsupervised On-Policy Self-Distillation Large Language Model Reasoning
Teacher Forcing as Generalized Bayes: Optimization Geometry Mismatch in Switching Surrogates for Chaotic Dynamics
Apr 28, 2026Andre Herz, Daniel Durstewitz, Georgia KoppeLearning Dynamics Likelihood
TCOD: Exploring Temporal Curriculum in On-Policy Distillation for Multi-turn Autonomous Agents
Apr 27, 2026Jiaqi Wang, Wenhao Zhang, Weijie Shi +2On-Policy Distillation Curriculum

May 15, 2026 · cs.CVJ/K move · Enter open · S save

How to Choose Your Teacher for Fine Grained Image Recognition

Oswin Gosal, Edwin Arkel Rios, Augusto Christian Surya, Fernando Mikael+2

National Tsing Hua University, Taiwan · National Yang Ming Chiao Tung University, Taiwan

Fine-grained image recognition classifies subcategories such as bird species or car models. While state-of-the-art (SOTA) models are accurate, they are often too resource-intensive for deployment on constrained devices. Knowledge distillation addresses this by transferring knowledge from a large teacher model to a smaller student model. A key challenge is selecting the right teacher, as it heavily impacts student performance. This paper introduces a teacher selection metric, \textbf{Ratio 1-2}, based on teacher prediction ratios. Extensive analysis of over one thousand experiments across 3 students, 8 teachers, and 8 datasets under 4 training strategies demonstrates that our metric improves teacher selection by 18% over previous methods, enabling small student models to achieve up to 17% accuracy gains. Experiment codebase is available at: \href{https://github.com/arkel23/FGIR-KD-Teacher}{https://github.com/arkel23/FGIR-KD-Teacher}.

Knowledge Distillation Fine-Grained Perception Teacher Image Classification

Open paper Ask about it PDF