mid-training for language models

Latest papers

CardsList

8 papers1 paper in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving

    Nov 12, 2026Wenhong Zhu, Xuefeng Li, Jiashuo Zhang +4mid-training for language modelsLarge Language Model-Guided Theorem Proving

  2. MiST: Mid-Training LLMs for Cybersecurity

    Sep 16, 2026Oded Ovadia, Elad Ben Zaken, Elad Guttman +1Synthetic Data PretrainingDomain-Adaptive Pretraining

  3. Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

    Sep 1, 2026Jacqueline He, Howard Yen, Shuyue Stella Li +9Language Model DistillationFactual Knowledge in Language Models

  4. MIRA: Mid-training Rubric Anchoring for Source-Aware Data Selection

    May 28, 2026Haowen Wang, Yaxin Du, Jian Yang +9Data SelectionEfficient Language Model Training

  5. Mid-Training with Self-Generated Data Improves Reinforcement Learning in Language Models

    May 8, 2026Aswin RRV, Jacob Dineen, Divij Handa +4Synthetic Data GenerationRL for Language Model Reasoning

  6. PRISM: Demystifying Retention and Interaction in Mid-Training

    Mar 17, 2026Bharat Runwal, Ashish Agrawal, Anurag Roy +1mid-training for language modelsLLM Training

  7. Self-Improving Training & Thinking

    Jan 29, 2026Ellen Xiaoqing Tan, Jack Lanchantin, Zichun Yu +11mid-training for language modelsLLM Training