Teacher

Ask about this topic

Momentum

51 papers in the last four weeks, up 219% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 203

All topics
CardsList

  1. From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation

    Oct 1, 2026Siqi Zhu, Suozhi Huang, Kaixuan Zhang +4Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    University of Illinois Urbana-Champaign · Princeton University · Westlake University

  2. SALD: Self-Referenced Advantage Learning for Diffusion Models

    Oct 1, 2026Aryan Das, Surjo Dey, Koushik Biswas +4Diffusion ModelsLarge Language Model Adaptation

    Indian Institute of Technology Kanpur, India · Rajiv Gandhi Institute of Petroleum Technology, India · IIIT Delhi, India +2

  3. Reason in Style: Discovering and Controlling Style in Language Models

    Sep 30, 2026Ioana Marinescu, Eric Karl Oermann, Kyunghyun ChoStylistic FidelityStyle

    NYU · NYU & NYU Langone Health

  4. Awakening of the Buddha: Subspace Learning During Population-Loss Plateaus

    Sep 30, 2026Akash KumarAnisotropic Loss LandscapesSingular Learning Theory

    Department of Computer Science & Engineering University of California-San Diego

  5. K2P: Label-Free Knowledge to Prompt Distillation

    Sep 30, 2026Yingchuan Zhang, Haoran Lu, Wenxuan Zhong +1Knowledge DistillationTeacher

    Department of Statistics University of Georgia Athens, GA 30602

  6. On the Off-Policy Teacher in On-Policy Distillation

    Sep 29, 2026Langlin Huang, Hao Liu, Mononito Goswami +5Efficient On-Policy DistillationTeacher

    Washington University in St. Louis · AWS AI Labs · Carnegie Mellon University +1

  7. Pretraining Latent Information Feedback Transformers with Teacher Supervision

    Sep 29, 2026Dor Tirosh, Ido Amos, Mor GevaTransformer ArchitecturesPretraining

    Blavatnik School of Computer Science and AI, Tel Aviv University · The Hebrew University of Jerusalem

  8. Improving OCR Faithfulness via Gated and Attenuated On-Policy Distillation

    Sep 29, 2026Baode Wang, Zuming Huang, Kexuan Ren +2Teacher

  9. Guide, Then Let Go: Gap-Adaptive Teacher Scheduling for Sparse-Reward Agentic RL

    Sep 29, 2026Youling Huang, Tiankuo Xu, Jiaji Liu +10Repair-Based Group-Relative Policy OptimizationTeacher

    DUT · Kuaishou · XJTU +5

  10. From Dissonance to Orchestration: Teacher Intervention in On-Policy Distillation

    Sep 29, 2026Yuhao Wang, Ruiyang Ren, Yinan Zhang +3TeacherMathematical Reasoning Benchmarks

    Nanyang Technological University, Singapore · Baidu Inc.

  11. Beyond Prompt Count: How Data Shapes Transfer in On-Policy Distillation

    Sep 29, 2026Jiaxuan Wang, Jiafei Lyu, Yuchen Cai +8TeacherCounting

    State Key Laboratory of Novel Software Technology, Nanjing University · School of Intelligence Science and Technology, Nanjing University · LLM Department, Tencent +1

  12. Solving Without Stopping: On-Policy Distillation at Small Scale

    Sep 29, 2026Hongyang Li, Yiming Zhu, Xiao Li +3Efficient On-Policy DistillationTeacher

    University of Luxembourg · Seafill Open-Source Community · Universit´e Paris-Saclay

  13. Codebook-Guided Cross-Modal Knowledge Distillation for Structurally Heterogeneous Features

    Sep 29, 2026Dae Ung Jo, Jongin Lim, YoungJoon Yoo +1Cross-Modal DistillationCross-Modal

    Kyungpook National University · AX/PI Center, Samsung Electronics · Chung-Ang University, SNUAILAB +1

  14. Train Ahead, Distill Back: Bootstrapping On-Policy Self-Distillation for Large Language Models

    Sep 29, 2026Zheng Zhang, Xinyue Tan, Lufei Li +3Unsupervised On-Policy Self-DistillationTeacher

    School of Information Science and Technology, ShanghaiTech University · State Key Laboratory of General Artificial Intelligence, BIGAI · Hefei University of Technology

  15. Distilling Agentic Systems: A Roadmap across Models, Artifacts, and Harnesses

    Sep 29, 2026Ziluowen Luo, Senzhang Wang, Chaozhuo Li +9Knowledge DistillationProduction Agentic Systems

    Central South University, ChangSha, Hunan, China · Beijing Academy of Artificial Intelligence, Beijing, China · Hong Kong Polytechnic University, Hongkong, China +2

  16. SAKI: Maximal-Coupling-Routed Teacher Supervision for On-Policy Distillation

    Sep 29, 2026Miteto Wei, Xiaohan Wang, Zehao Chen +7TeacherToken-Level Supervision

    Meituan · KTH Royal Institute of Technology

  17. Interactive-Policy Distillation with Bidirectional Propose-and-Verify

    Sep 29, 2026Shutong Wu, Xiwen Chen, Brendan Rappazzo +4Efficient On-Policy DistillationTeacher

    Department of Computer Sciences, University of Wisconsin–Madison · Machine Learning Research, Morgan Stanley · Department of Electrical and Computer Engineering, Rutgers University–New Brunswick

  18. What Makes High-Magnification Knowledge Transferable? A Study of Cross-Resolution Distillation in Whole-Slide Imaging

    Sep 29, 2026Zhiyuan Yang, Jiahao Cheng, Mahdi S. HosseiniWhole-Slide ImagesCross-Task Knowledge Transfer

    Department of Computer Science and Software Engineering (CSSE) Concordia University Montreal, Canada · Department of Computer Science and Software Engineering (CSSE) Concordia University Montreal, Canada Mila – Quebec AI Institute Montreal, Canada

  19. Learning from Teacher Continuations at Student States

    Sep 28, 2026Haojin Wang, Dylan Zhang, Huaibo Chen +8TeacherContinuation

    University of Illinois at Urbana-Champaign · Massachusetts Institute of Technology · University of Pennsylvania +2

  20. Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation

    Sep 28, 2026Xin Li, Hao Jiang, Xin Gao +6Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    Nanyang Technological University · Yale University · University of Manchester

  21. Teacher-Student Gaps Are Not Enough: Outcome-Guided On-Policy Distillation for Multi-Turn Autonomous Agents

    Sep 28, 2026Tong Zhang, Zhou Liu, Yihao Liu +8Efficient On-Policy DistillationTeacher

    Qwen Large Model Application Team, Alibaba · Peking University · University of Chinese Academy of Sciences +1

  22. Understanding On-Policy Distillation: A Mechanistic Interpretability Perspective via Sparse Crosscoders

    Sep 28, 2026Zichao Yu, Qianshuo Ye, Xu Wang +1Efficient On-Policy DistillationOnline-Policy Distillation

    School of Computing and Data Science, The University of Hong Kong · Department of Computer Science and Technology, University of Cambridge · Shenzhen Loop Area Institute

  23. TIDE: Teacher-Student Transition via Informative Distillation and Exploration for Agentic RL

    Sep 28, 2026Yibin Huang, Xinming Xu, Conghui ZhuAgentic Reinforcement LearningTeacher

    Faculty of Computing, Harbin Institute of Technology · Tsinghua University

  24. Can We Trust the Teacher? Decoupled Credit Direction-Magnitude for Self-Distillation

    Sep 28, 2026Yugu Li, Zehong Cao, Peizhen Li +3Credit AssignmentTeacher

    School of CSIT, Adelaide University, Adelaide, SA 5000, Australia · CAIAA, University of North Texas, Denton, TX 76203, USA · School of EECMS, Curtin University, Bentley, WA 6102, Australia +1

  25. No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation

    Sep 28, 2026Seonghyeon Kim, Chaeyun Jang, Noah Lee +2Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    KAIST AI · Kakao

  26. Beyond Token Alignment: Event Completion for Cross-Tokenizer On-Policy Distillation

    Sep 28, 2026Jiacheng Liu, Jingwei Song, Qituan Zhang +2TeacherProcess-Level Supervision

    Shanghai Jiao Tong University · Fudan University

  27. What Visual Generators Need from Teachers: Rethinking Representation Alignment

    Sep 28, 2026Yongcong Wang, Hingchin Chen, Mingyu Fan +6Diffusion AlignmentDiffusion Transformers

    Central South University · The Hong Kong University of Science and Technology · Tsinghua University +7

  28. When Less Data Favors Smaller Teachers: Rethinking Teacher Capacity and Data Selection for Knowledge Distillation

    Sep 28, 2026Minjae Park, Taesun Yeom, Jaeho LeeKnowledge DistillationTeacher

    Pohang University of Science and Technology (POSTECH)

  29. The Devil is in the Spectrum Bias: Spectrum-Balanced Feature Matching for Robust Representation Distillation

    Sep 28, 2026Kuniaki Saito, Yoshitaka UshikuHarder Better Faster Denser Feature MatchingRecent Vision Foundation Models

    OMRON SINIC X Corporation

  30. A Statistical Perspective on Knowledge Distillation: Foundations, Classical Methods, and Large Language Model Extensions

    Sep 27, 2026Luyang Fang, Haoran Lu, Jiazhang Cai +4Knowledge DistillationResidual Distillation

    Department of Statistics, University of Georgia, Athens, Georgia 30602, USA · Department of Biostatistics, Boston University, Boston, Massachusetts 02118, USA

  31. What Shared Prefixes Hide: Trajectory Dropout for On-Policy Distillation

    Sep 27, 2026Zizhuo Lin, Quanling Liu, Yi Yang +1TeacherProcess-Level Supervision

    Zhejiang University

  32. TeacherGRPO: Closing the Capacity Gap in Reasoning Distillation via Teacher Alignment

    Sep 27, 2026Zhenyu Lei, Zihan Chen, Yaochen Zhu +5Teacher-Student DistillationTeacher

    University of Virginia · Netflix · University of Washington +2

  33. Dense Is Not Enough: Hierarchical Supervision Allocation for Long-Horizon On-Policy Distillation

    Sep 27, 2026Yuhao Sun, Binrui Wu, Zhuoer Xu +5Efficient On-Policy DistillationTeacher

    Ant Group · University of Science and Technology of China · Alibaba International Digital Commerce Group +2

  34. MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation

    Sep 25, 2026Tianze Xu, Yanzhao Zheng, Zhentao Zhang +10Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    Shanghai Jiao Tong University · GAIR · Alibaba Group +2

  35. LastOPD: Taming Collapse in Latent On-Policy Distillation

    Sep 23, 2026Jie Yang, Zhengyu Fang, Zelin Xu +7Uni-OpdTeacher

    University of Illinois at Chicago · Visa Research · Case Western Reserve University +2

  36. The Fellowship of the Query: Learning Retrieval Actions

    Sep 23, 2026Mohammed Al-Maamari, Saber Zerhoudi, Michael Granitzer +1Fine-Grained ActionsModel Fine-Tuning

    University of Passau Passau, Germany

  37. When and Where to Trust the Teacher: Unifying On-Policy Distillation and GRPO through Entropy-Calibrated Credit Assignment

    Sep 23, 2026Jie Zhang, Jingxiao Yang, Zhehao Huang +2Reinforcement Learning With Verifiable RewardTeacher

    Shanghai Jiao Tong University · Zhejiang University

  38. BAS-OPD: Budget-Aware Selective On-Policy Self-Distillation for Fine-Grained Multimodal Perception

    Sep 22, 2026Zihan Chen, Hengguang Zhou, Yuan Kang +5Unsupervised On-Policy Self-DistillationRecent Vision-Language Models

    HFIPS, Chinese Academy of Sciences · University of Science and Technology of China · University of California, Los Angeles

  39. What Should a Self-Teacher See? Privileged Context Design for On-Policy Self-Distillation

    Sep 22, 2026Kanghui Tian, Siyuan Liu, Tianxiang Jiang +8Self-TeacherTeacher

    Fudan University · Shanghai Artificial Intelligence Laboratory · Nanjing University +4

  40. iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs

    Sep 21, 2026Ahmed Khaled Khamis, Xiaotong Ji, Hassan Jaber +4Self-Distillation FrameworkSelf-Teacher

    Imperial College London · Politecnico di Torino · UCL Centre for AI

  41. Distill What You Trust: Reliability-Aware Multi-Teacher On-Policy Distillation

    Sep 20, 2026Jie Sun, Mao Zheng, Mingyang Song +8Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    University of Science and Technology of China · Foundation Model Department, Tencent · Tsinghua University +4

  42. OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher

    Sep 17, 2026Damiano Da Col, Maximilian Igl, Peter Karkus +5Autonomous DrivingReinforcement Learning Post-Training

    KE:SAI · ETH Zürich · NVIDIA Research +2

  43. Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement

    Sep 17, 2026Yitong Xing, Yuhao Cheng, Yanping Li +1Rt-DetrDetection Transformer

    School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China

  44. Trajectory Learnability for Offline On-Policy Distillation with Imperfect Teachers

    Sep 16, 2026Yihao Ai, Weilong YanOnline-Policy DistillationTeacher

    National University of Singapore

  45. Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback

    Sep 15, 2026Haichen Hu, Yuheng Zhang, David Simchi-LeviDataset DistillationTeacher

    MIT · UIUC

  46. Verbalizing Subliminal Learning Effects Using Text Optimization

    Sep 15, 2026Nathan Hu, Sanmi Koyejo, Christopher PottsMultiple Prompt Learning FrameworksDataset Distillation

    Stanford University

  47. OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

    Sep 15, 2026Chenhao Qiu, Dawei Li, Yechao Zhang +2Multimodal ReasoningTeacher

    Arizona State University · University of Virginia · Stevens Institute of Technology

  48. Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning

    Sep 14, 2026Sophia Tang, Shiyi WangDiffusion Language ModelsAutoregressive Language Models

    University of Pennsylvania · Harvard University · Kempner Institute +1

  49. Reproducing and Evaluating the Generalizability of Subliminal Learning in Open-Weight Models

    Sep 14, 2026Daan van der Weijden, Nathan Brack, Selene Baez SantamariaModel WeightsTeacher

    University of Zurich

  50. Teacher Geometry Shapes Learnability in Teacher-Student Networks

    Sep 10, 2026Kai J. Sandbrink, Flavio Martinelli, Alexander van Meegen +2Two-Layer Neural NetworksTeacher

    Department of Experimental Psychology, University of Oxford · Department of Physics, RWTH Aachen

  51. Distillation as Probability Transport: Routed On-Policy Distillation

    Sep 8, 2026Tianle Xia, Lingxiang Hu, Yiding Sun +6TeacherStudent-Generated Trajectories

    Tencent

  52. Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG

    Sep 4, 2026Shuyu Guo, Shuo Zhang, Zhaochun RenSearch-Augmented ReasoningData Compression Methods

    Shandong University Qingdao, China · Bloomberg London, United Kingdom · Leiden University Leiden, The Netherlands

  53. Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation

    Sep 2, 2026Zhiwei Zhang, Zechen Sun, Fei Zhao +6Efficient On-Policy DistillationTeacher

    AllSpark Team

  54. Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

    Sep 1, 2026Jacqueline He, Howard Yen, Shuyue Stella Li +9Knowledge DistillationTeacher

    Meta AI · University of Washington · Princeton University

  55. Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

    Aug 31, 2026Yi Ding, Ruqi ZhangOnline-Policy DistillationTeacher

    Department of Computer Science, Purdue University, USA

  56. CoJEPA: Combining Contrastive Learning and JEPA for Global-Local Music Representations

    Aug 31, 2026Gabriel Meseguer-Brocal, Yuexuan Kong, Romain HennequinJoint-Embedding Predictive ArchitecturesContrastive Learning

    Deezer Research, Paris, France

  57. Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation

    Aug 30, 2026Run Yang, Runpeng Dai, Jie Sun +5TeacherDiversity Collapse

    University of North Carolina at Chapel Hill · University of Science and Technology of China · Shanghai University of Finance and Economics

  58. Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher

    Aug 27, 2026Shiyi Zhang, Mushui Liu, Yunze Tong +8Uni-OpdTeacher

    1Tsinghua University · 2Zhejiang University · 3Alibaba Group

  59. Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation

    Aug 27, 2026Ziyuan Liu, Jiao Ou, Jian Liang +2Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher

    Kuaishou Technology Beijing, China

  60. D3^3-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation

    Aug 25, 2026Zechen Sun, Zhiwei Zhang, Fei Zhao +7Aware Heterogeneous Multi-Teacher Multimodal On-Policy DistillationTeacher-Student Distillation

    AllSpark Team