Language Model Merging

Latest papers 69

All topics
CardsList
  1. ααTransfer: Coefficient Transfer for Efficient Model Merging

    Oct 6, 2026Shih-Cheng Huang, Zhi Rui Tam, Chieh-Yen Lin +3Hyperparameter TransferLanguage Model Merging

  2. Training-Free Transformer Merging via Sequential Local Operator Alignment

    Oct 5, 2026Akansh Maurya, Ya-Wei Eileen Lin, Stefanie Jegelka +2Language Model MergingModel Merging

  3. Mixture-Trained Merging for Unified Multi-Objective Models

    Oct 1, 2026SeongHyeon Kim, Chaeyun Jang, Seungyoo Lee +4Multi-Task LearningLanguage Model Merging

  4. SLIM: Simplex-Lattice Interpolation Merging

    Oct 1, 2026Seongcheol Jeong, Masahiro Suzuki, Yutaka MatsuoSurrogate-Assisted OptimizationLanguage Model Merging

  5. ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs

    Sep 30, 2026Hang Yin, Haozhe Wang, Yuhua Luo +3Continual Learning for LLMsLow-Rank Adaptation

  6. Exploring Heterogeneous Model Merging Approach for Complex Knowledge Transfer

    Sep 30, 2026Jiahe Fan, Si Chen, Yinghao Hou +4Transfer LearningLanguage Model Merging

  7. QAM: Quadratic-Accurate Checkpoint Merging via Sequential Consistency

    Sep 28, 2026Shihao Wang, Rui Kong, Xinran Chen +7Language Model MergingModel Merging

  8. SMAT: Simple and Efficient Merge-Aware Training

    Sep 27, 2026Yanggan Gu, Yuanyi Wang, Zhen Li +5Language Model MergingModel Merging

  9. Train4Merge: A Controlled Single-Teacher Study of RL vs. SFT Teachers for OPD-Based Model Merging

    Sep 26, 2026Jingyuan Huang, Zuming Huang, Yucheng Shi +4Language Model MergingLanguage Model Distillation

  10. On Emergent Capabilities and Model Merging

    Sep 21, 2026Luca Zhou, Emanuele RodolàEmergent Misalignment in Language ModelsLanguage Modeling

  11. From Parameters to Behaviors: A Survey of Model Fusion for Large Language Models

    Sep 17, 2026Shuo Cai, Yanggan Gu, Zihao Wang +8Language Model MergingModel Merging

  12. Merging the Knowledge of LLMs for Automatic Speech Recognition

    Sep 14, 2026Hayato Futami, Tatsuya KawaharaDomain Adaptation for ASRAutomatic Speech Recognition

  13. CABS+: Efficient and Scalable Model Merging via Conflict-Aware Sparsification and Adaptive Weight Allocation

    Aug 13, 2026Yuchen Liu, Zongzhen Yang, Binhang Qi +2Language Model MergingModel Merging

  14. Signature-Guided Capacity Occupancy for Dense Expert Merging

    Aug 10, 2026Lingching Tung, Chi-Jui Kim, Beicheng Xu +2Task Vector MergingLanguage Model Merging

  15. When Skills Meet Safety: Benchmarking and Characterizing the Adaptive Jailbreak Robustness of Skill-Merged LLMs

    Aug 9, 2026Yu Ma, Hongli Shi, Jing Li +2LLM Safety BenchmarksLanguage Model Safety Evaluation

  16. A Unified Model for Cross-Domain Clone Detection via Model Merging

    Aug 4, 2026Palash R. Roy, Banani Roy, Kevin A. Schneider +1Static Code AnalysisCross-Domain Generalization

  17. SAFE-Merge: Data-Free Continual Model Merging with General Knowledge Preservation

    Aug 2, 2026Zihuan Qiu, Zhiyang Liao, Chiyuan He +5Language Model MergingModel Merging

  18. Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation

    Jul 28, 2026Huwei Ji, Jiajie Su, Yuyuan Li +2Sequential RecommendationCross-Domain Transfer Learning

  19. Asymmetric Collapse in Model Merging: When Refusal Over- writes Recognition

    Jul 26, 2026Aarnav Choudhary, Matheus Fonseca Rocha, Jiwon Seo +2Language Model Safety EvaluationTask Vector Merging

  20. Biomedical Machine Translation for Low-Resource Arabic-Script Languages via Cross-Lingual Transfer and LoRA Adapter Merging

    Jul 24, 2026Abdullah Alabdullah, Arash Eslamighayour, Sarp Harbalioglu +1Low-Resource MTLanguage Model Merging

  21. Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs

    Jul 24, 2026Zixuan Ren, Jinliang Lu, Junhong Wu +5RL for Language ModelsLanguage Model Merging

  22. Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective

    Jul 20, 2026Jiahe Fan, Yinghao Hou, Si Chen +3Ensemble LearningLanguage Model Merging

  23. DeltaMerge-LowRes: Composing Language and Task Deltas for Low-Resource Adaptation

    Jul 15, 2026Son Ha Xuan, Xuan-Bach Le, Phat T. Tran-TruongMultilingual Language ModelsTask Vector Merging

  24. Cache Merging as a Convergent Replicated State for Multi-Agent Latent Reasoning

    Jul 1, 2026Carlos Baquero, Luís BritoKV CachingLanguage Model Merging