Supervised Fine-Tuning

Ask about this topic

Recent momentum

+30%

13 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Low-Rank Adaptation

Neighbouring directions

Low-Rank AdaptationFinetuningLarge Language Model Fine-TuningLarge Language Model AdaptationParameter-Efficient Fine-TuningLow-Rank Adaptation AdaptersContinual Fine-Tuning

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Supervised Fine-Tuning.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Supervised Fine-Tuning.

Period ending 2026-09-07

7 new papers

A weekly snapshot of new work published in Supervised Fine-Tuning.

109 papers

Latest in Supervised Fine-Tuning

Browse all topics →
CardsList

  1. A Practical Recipe for Semi-Supervised Federated ASR: Online Pseudo-Labels with Server Update Stabilization

    Sep 21, 2026Wonho Bae, Zakaria Aldeneh, Martin Pelikan +3Supervised Fine-Tuning

  2. HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface

    Sep 17, 2026Zimu Han, Yiming Zeng, Jiyao Zhang +9Vision-Language-Action ModelsHuman-In-The-Loop

  3. Form Over Content In Gradient-Based Data Attribution Methods

    Sep 17, 2026Sunwoo Kim, Seokwon Jung, Sohyung Kim +2Training Data AttributionSupervised Fine-Tuning

  4. Generative Query Suggestion via Intent Coverage and Query-Level Credit Assignment

    Sep 16, 2026Xinpeng Liu, Lu Ma, Jiayi Qiao +6Complex Query AnsweringAnalytics

  5. SFT or RL for Tool-Calling Agents? A Controlled Study Across Data, Method, and Scale

    Sep 15, 2026Md Tahmid Rahman Laskar, Xue-Yong Fu, Shashi Bhushan TNSupervised Fine-TuningAgentic Tool Use

  6. Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning

    Sep 9, 2026Zhirayr Hayrapetyan, Andrei Kalmykov, Denis Kokosinskii +2Finance DomainSupervised Fine-Tuning

  7. Which Tokens Should SFT Actually Learn? A Token-Trimming Perspective on Mathematical Reasoning

    Sep 9, 2026Yaning Jia, Chunhui Zhang, Wenxuan Xu +3Supervised Fine-TuningMathematical Reasoning

  8. Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs

    Sep 1, 2026Jingtan Wang, Arun Verma, Xiaoqiang Lin +4Supervised Fine-Tuning

  9. Post-Training Science for Supervised Fine-Tuning

    Sep 1, 2026Charles O'Neill, Mudith Jayasekara, Harry PartridgeSupervised Fine-TuningLLM Post-Training Methods

  10. Context-Grounding Gains Are Mediated by Pre-existing Machinery: Auditing GRPO, SFT, and DPO

    Sep 1, 2026Prakhar Gupta, Vaibhav GuptaLLM Post-Training MethodsSupervised Fine-Tuning

  11. Elite-Weighted Supervised Fine-tuning for Goal-Directed Molecular Optimization

    Aug 31, 2026Shiyun Wa, Yifei Wang, Anna G. Green +2Molecular OptimizationSupervised Fine-Tuning

  12. Stick to What You Know: A Study of Knowledge-Aligned Supervised Fine-Tuning

    Aug 31, 2026Arthur Becker, Jakob Kemmler, David Thulke +3Supervised Fine-TuningLarge Language Model Alignment

  13. Learning to Reason and Use Tools through Unsupervised Fine-Tuning in Task-Oriented Dialog Systems

    Aug 31, 2026Markel Ferro, Oier Lopez de LacalleLarge Language Model ReasoningConversational Artificial Intelligence

  14. CPR for LLMs: Critical-Point Routing against Catastrophic Forgetting in Domain Adaptation

    Aug 31, 2026Kwangmin Ki, Yunhun Nam, Jongheon Jeong +1Large Language Model AdaptationSupervised Fine-Tuning

  15. When the API Speaks the Wrong Language: Revisiting Post-Training for Multilingual Tool Use

    Aug 12, 2026Siddharth Chauhan, Thomas Butler, Abhishek Singhania +2Multilingual Large Language ModelsMultilingual

  16. Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport

    Aug 11, 2026Bohan Zhang, Anqi Ni, Yixin Wang +1Supervised Fine-TuningContinual Fine-Tuning

  17. Stockmark-Nemotron-3-Nano-Omni-JapanDocReader: Structured Document Parsing via Capability Injection and Forgetting Control

    Aug 7, 2026Shi Chen, Hayato Aida, Makoto Morinaga +2Multimodal DocumentsStructure-Aware

  18. Beyond Full-Model Rollback: AuroSFT for Adapter-State Multi-Task Fine-Tuning

    Aug 5, 2026Yue Han, Ziniu LiuSupervised Fine-TuningMulti--Task Learning

  19. SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs

    Aug 4, 2026Kejian Zhu, Zhuoran Jin, Shangqing Tu +5Multi-Task Reinforcement LearningMulti--Task Learning

  20. HARGO: Heterogeneity-Aware Reward-Guided Optimization for RL Post-Training of LLMs on HPC Tasks

    Jul 30, 2026Tiangang Li, Xiangbo TianReinforcement Learning Post-TrainingSupervised Fine-Tuning

  21. Objective-Aligned Direct Answer SFT for Robust Multi-Frame Medical VQA

    Jul 30, 2026Site Li, Jianyi Hao, Xiaofeng LiuMedical Visual Question AnsweringSupervised Fine-Tuning

  22. Shared SFT Lessons Across Alignment, Model Organisms, and Toy Models

    Jul 28, 2026Anton de la Fuente, Arthur ConmySupervised Fine-TuningValue Alignment

  23. Probing the Origins of Reasoning Performance: Representational Quality for Mathematical Problem-Solving in RL vs. SFT Fine-Tuned Models

    Jul 28, 2026Antyabha Rahman, Akshaj Gurugubelli, Omar Ankit +2Large Reasoning ModelsSupervised Fine-Tuning

  24. Similar Models Learn Differently: Final-Window Pretraining Shapes Post-Training Beyond SFT

    Jul 27, 2026Cen Lu, Yung-Chen Tang, Andrea CavallaroLLM Post-Training MethodsSupervised Fine-Tuning

  25. ObsDriveBench: Benchmarking Multimodal Understanding under Adverse Weather with Observability Awareness

    Jul 26, 2026Qiao Yan, Yihan Wang, Zhenghao Xing +2Autonomous DrivingMultimodal Benchmarks

  26. When Reasoning Narrows the Move: Diversity Collapse in LLM Game Play

    Jul 21, 2026Junyi Sha, Renfei Tan, David Simchi-LeviLarge Language Model Decision-MakingSupervised Fine-Tuning

  27. SFGA: A Statistics-First Gating Architecture with Adjudicative Escalation for Trustworthy SFT Data Procurement

    Jul 21, 2026Arther Tian, Alex Ding, Simon Wu +1Supervised Fine-TuningDecision Thresholds

  28. A Systematic Evaluation of Trajectory Data Curation for LoRA Fine-Tuning of Code Agents

    Jul 19, 2026Yunze HanCoding AgentsInteraction Trajectories

  29. Supervised Fine-Tuning vs. In-Context Learning: An Equilibrium Analysis of LLM Personalization under Congestion

    Jul 15, 2026Fengzhuo Zhang, Zhuoran Yang, Dirk BergemannPersonalizationFinetuning

  30. Rethinking Speech Foundation Model Fine-tuning: Better SFT or Better Match?

    Jul 15, 2026Wangjin Zhou, Yizhou Zhang, Yichi Wang +1Discrete Speech RepresentationsSpeech Large Language Models

  31. Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration

    Jul 15, 2026Shuhao Li, Guodong Du, Anhao Zhao +3Confidence CalibrationLLM Post-Training Methods

  32. LP-SFT: Local-Preserving Supervised Fine-Tuning via Multimodal Entropy Structure

    Jul 6, 2026Yueyang Wang, Baolong Bi, Shuo Lu +1Supervised Fine-TuningFinetuning

  33. Epistemic Goggles: A Pretrained Module that Induces an Epistemic Frame via Gradient Editing

    Jul 2, 2026Joshua PenmanLarge Language Model HallucinationEpistemic Actions

  34. Can Agents Generalize to the Open World? Unveiling the Fragility of Static Training in Tool Use

    Jul 1, 2026Song-Lin Lv, Weiming Wu, Rui Zhu +2Supervised Fine-TuningTool

  35. Defending Against Harmful Supervision Hidden in Benign Samples

    Jun 29, 2026Bang An, Yibo Yang, Dandan Guo +3Harmful Fine-TuningSupervised Fine-Tuning

  36. Semi-Supervised Sound Event Detection with Conditional Mixup and Embedding-Level Contrastive Loss

    Jun 29, 2026Nian Shao, Xian Li, Xiaofei LiContrastive LossSupervised Fine-Tuning

  37. Reasoning Quality Emerges Early: Data Curation for Reasoning Models

    Jun 25, 2026Hongyi Henry Jin, Wenhan Yang, Meysam Ghaffari +2Large Reasoning ModelsReasoning Traces

  38. Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently

    Jun 22, 2026Stanley Wei, Juno KimLarge Reasoning ModelsReinforcement Learning With Verifiable Reward

  39. Fara-1.5: Scalable Learning Environments for Computer Use Agents

    Jun 18, 2026Ahmed Awadallah, Sahil Gupta, Yash Lara +12Computer-Use AgentsData Generation

  40. ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL

    Jun 17, 2026Mukund Khanna, Raj Singh Yadav, Kunal SinghImage EditingFrozen Contrastive Language-Image Pre-Training Visual Encoder

  41. SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR

    Jun 16, 2026Siddharth Aphale, Kelly LiuEntropy CollapseDeepseek

  42. WAM-RL: World-Action Model Reinforcement Learning with Reconstruction Rewards and Online Video SFT

    Jun 16, 2026Zezhong Qian, Xiaowei Chi, Yu Qi +3Efficient World-Action ModelFaster-Wam

  43. DRIFT: Refining Instruction Data via On-Policy Data Attribution

    Jun 16, 2026Zefan Wang, Lincheng Li, Tianyu Yu +1Supervised Fine-TuningReinforcement Fine-Tuning

  44. Hy-Embodied-0.5-VLA: From Vision-Language-Action Models to a Real-World Robot Learning Stack

    Jun 12, 2026He Zhang, Lingzhu Xiang, Haitao Lin +23Scalable Robot LearningVision-Language-Action Models

  45. A Unifying Lens on Supervised Fine-Tuning Through Target Distribution Design

    Jun 9, 2026Tong Xie, Yuanhao Ban, Yunqi Hong +3Supervised Fine-TuningToken-Level Uncertainty

  46. Supervised Fine-tuning with Synthetic Rationale Data Hurts Real-World Disease Prediction

    Jun 9, 2026Buxin Su, Bingxuan Li, Cheng Qian +3Clinical PredictionSupervised Fine-Tuning

  47. PriFT: Prior-Support Guided Supervised Fine-Tuning

    Jun 8, 2026Ke Wang, Shuangqi Li, Mathieu Salzmann +1Supervised Fine-TuningToken-Level Uncertainty

  48. When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff

    Jun 7, 2026Runze Liu, Jiashun Liu, Xu Wan +2Supervised Fine-TuningPlasticity

  49. RASFT: Rollout-Adaptive Supervised Fine-Tuning for Reasoning

    Jun 5, 2026Yongliang Miao, Fengyuan Liu, Wei Shi +4Supervised Fine-Tuning

  50. A Close Look At World Model Recovery In Supervised Fine-Tuned LLM Planners

    Jun 2, 2026Patrick Emami, Nan Qiang, Peter GrafLarge Language Model PlanningLatent World Models

  51. BYORn: Bootstrap Your Own Responses to Defend Large Vision-Language Models Against Backdoor Attacks

    Jun 1, 2026Ivan Sabolić, Marin Oršić, Josip Šarić +1Large Vision Language ModelsBackdoor Attacks

  52. DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization

    May 29, 2026Jian Mu, Tianyi Lin, Chengwei Qin +2Reinforcement Fine-TuningSupervised Fine-Tuning

  53. Reinforcement Learning Can Amplify Emergent Misalignment from Harmless Rewards

    May 29, 2026Magnus Jørgenvåg, David Kaczér, Lasse Ruttert +3Training-Free Reward AlignmentMisalignment

  54. RAFT: Data Refinement and Adaptive Distillation for Domain Fine-Tuning with Alleviated Forgetting

    May 29, 2026Yuduo Li, Xiaofeng Shi, Qian Kou +2Supervised Fine-TuningRefinement

  55. On-Policy Replay for Continual Supervised Fine-Tuning

    May 28, 2026Yan Chen, Taojie Zhu, Meng Zhang +4Supervised Fine-TuningCatastrophic Forgetting

  56. Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark

    May 28, 2026Rahul Bissa, Abhishek Vyas, Yash JainSupervised Fine-TuningFine-Grained Actions

  57. Learning to Adapt SFT Data for Better Reasoning Generalization

    May 26, 2026Lisong Sun, Li Wang, Chen Zhang +4Supervised Fine-TuningLLM Post-Training Methods

  58. CosyEdit2: Speech-Editing-Oriented Reinforcement Learning Unlocks Better Zero-Shot TTS

    May 25, 2026Junyang Chen, Yuhang Jia, Hui Wang +3Zero-Shot Text-To-SpeechMusic Editing

  59. When In-Distribution Gains Fail: Evaluating Weak-to-Strong Reward Models under Preference Shift

    May 25, 2026Khoi Le, Tri Cao, Phong Nguyen +5Preference LearningWeak Supervision

  60. Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT?

    May 21, 2026Jeanmely Rojas Nunez, Viraj Sawant, Nathan Allen +4Catastrophic ForgettingSupervised Fine-Tuning