Language Model Generalization

Ask about this topic

Latest papers

CardsList

31 papers7 papers in the last four weeks, up 17% on the four weeks before. 0.0% of all new papers.

  1. Exploring Weight-Space Programming: Capabilities, Generalization, and Limitations

    Nov 6, 2026Junru Hu, Cheng Tang, Wei Li +5Weight-Space LearningWeight-Space Analysis

    Shanghai Artificial Intelligence Laboratory · Tongji University · Fudan University

  2. Understanding the Out-of-Distribution Generalization of Chain-of-Thought Reasoning in LLMs

    Nov 4, 2026Nuo-Jing Liang, Xiao-Tong Yuan, Pan ZhouCoT ReasoningOOD Generalization

    School of Intelligence Science and Technology, Nanjing University · Singapore Management University

  3. Quantitative Generalization Bounds for Multi-Layer Transformers: A Few Long Strings can Beat Many Short Ones

    Oct 26, 2026Marius Henry, Michael Rizvi-Martel, Michael HahnLanguage Model GeneralizationGeneralization Bounds

    LaCoCo, Saarland University, Saarland Informatics Campus · Zuse School ELIZA · Mila & Université de Montréal

  4. Rethinking Evaluation for Principled Generalization Using a Kripkean Challenge to Meaning as Use

    Oct 26, 2026Niyar R Barman, Omar Naim, Nicholas AsherLanguage Model Generalization

    Université de Toulouse

  5. Generalization properties of the token perceptron: the role of embedding and vocabulary

    Oct 23, 2026Dario Bocchi, Matteo Negri, Flavio Nicoletti +1Language Model GeneralizationRepresentation Geometry in Language Models

    Physics Department, University of Rome Sapienza, Rome, Italy · Institute of Nanotechnology, CNR-NANOTEC, Rome, Italy · Laboratoire de Physique Théorique et Modélisation, CY Cergy Paris Université +1

  6. Once a Tree, Always a Tree? Cross-lingual Transfer of Hierarchical Generalization in Language Models

    Oct 22, 2026Shin Yamaguchi, Masaya Taniguchi, Tatsuki Kuribayashi +2Cross-Lingual TransferLanguage Model Generalization

    NAIST · RIKEN · MBZUAI +2

  7. Knowledge That Is Linear Before Fine-Tuning Generalizes After It

    Oct 15, 2026Faridoun Mehri, Hinrich SchützeLanguage Model GeneralizationFactual Knowledge in Language Models

    Center for Information and Language Processing, LMU Munich Munich Center for Machine Learning (MCML)

  8. Generalizable Model Editing Could Be More Than Direct Generalization

    Oct 11, 2026Xiaotian Ye, Chunyao Yang, Xiaohan Wang +4Model EditingLanguage Model Editing

    University of Cambridge · NLPR, MAIS, Institute of Automation, Chinese Academy of Sciences · School of Advanced Interdisciplinary Sciences, University of the Chinese Academy of Sciences +3

  9. Predicting how model propensities generalize out of distribution

    Oct 10, 2026June Hunter, Lily Wen, Owen Terry +3OOD GeneralizationLanguage Model Generalization

  10. Length Generalization Needs Proper Regularization

    Oct 3, 2026Pavlo Vasylenko, Matthias Lindemann, André F. T. Martins +1Length GeneralizationLanguage Model Generalization

    Instituto Superior Técnico, Universidade de Lisboa · Instituto de Telecomunicações · ELLIS Unit Lisbon +1

  11. Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks

    Oct 1, 2026Fahmid Shahriar Iqbal, Ritam Dutt, Soumitra Das +2Language Model GeneralizationTemporal Reasoning in Language Models

    University of North Texas · Carnegie Mellon University · University of Massachusetts Amherst +1

  12. Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs

    Oct 1, 2026Nagham Omar, Mahmoud Jabarin, Maya Rozenshtein +3Prompt SensitivityLLM Evaluation

    Technion – Israel Institute of Technology

  13. Generalization Dynamics of LM Pre-training

    Sep 27, 2026Jiaxin Wen, Zhengxuan Wu, Dawn Song +1Language Model PretrainingLanguage Model Generalization

    UC Berkeley · Stanford University, Google DeepMind

  14. How Far Do Persona Effects Generalize in Language Models?

    Sep 26, 2026Yufan Zhou, Yuxuan Liu, Enze Ma +6LLM PromptingLanguage Model Generalization

    KU Leuven · East China University of Science and Technology · University of Illinois Chicago +4

  15. Persistent Recurrent Memory Between Transformer Layers - Improves Language Model Generalization

    Sep 15, 2026Eduardo Novaes HeringMemory-Augmented Language ModelsDecoder-Only Language Models

    FITec Labs / Ericsson São Paulo

  16. Shared circuits predict whether LLMs generalize across formats in arithmetic reasoning

    Sep 3, 2026Andrea Gregor de Varda, Sana Pandey, Pengrui Han +2Language Model GeneralizationLLM Mathematical Reasoning

    Massachusetts Institute of Technology

  17. Why Knowing Both Hops Is Not Enough: Understanding Two-Hop Generalization in Language Models

    Aug 7, 2026Zili Zhang, Yilin Wang, Heng Wang +2Transformer InterpretabilityOOD Generalization

    1Xi’an Jiaotong University · University of Illinois Urbana-Champaign

  18. Similarity All The Way Up: Multilingual Generalization in LLMs Relies on Language-Level Similarity Structures

    Jul 18, 2026Supantho Rakshit, Adele Goldberg, Henry ConklinMultilingual Language Model EvaluationCross-Lingual Reasoning in Language Models

    Department of Electrical and Computer Engineering Princeton University · Department of Psychology Princeton University · Laboratory for Artificial Intelligence Princeton University

  19. Requential Coding: Pushing the Limits of Model Compression with Self-Generated Training Data

    Jul 13, 2026Shikai Qiu, Marc Finzi, Yujia Zheng +2Model CompressionNeural Network Generalization

    New York University · Carnegie Mellon University

  20. Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning

    Jul 9, 2026Lu Dai, Ziyang Rao, Yili Wang +3Knowledge DistillationLLM Fine-Tuning

    HKUST · HKUST(GZ)

  21. Forecasting With LLMs: Improved Generalization Through Feature Steering

    Jun 25, 2026Humzah Merchant, Bradford LevyLook-Ahead Bias in Language ModelsLLM Interpretability

    University of Chicago, Illinois, United States.

  22. A Training-Time Diagnostic for Generalization via the Log-Alignment Ratio

    May 27, 2026Ali Shehper, Ashish VaswaniNeural Network GeneralizationLanguage Model Generalization

    Work done at Essential AI.

  23. InfoSFT: Learn More and Forget Less with Information-Aware Token Weighting

    May 14, 2026Mahdi Sabbaghi, George Pappas, Adel Javanmard +1Supervised Fine-TuningLanguage Model Generalization

    University of Pennsylvania · University of Southern California

  24. Language Diffusion Models are Associative Memories Capable of Retrieving Unseen Data

    Apr 29, 2026Bao Pham, Mohammed J. Zaki, Luca Ambrogioni +2Memorization in Generative ModelsNeural Network Memorization

    1Rensselaer Polytechnic Institute (RPI) · 2Donders Institute for Brain, Cognition, and Behaviour, Radboud University · 3Dynamical Mind +1

  25. Generalization Boundaries of Fine-Tuned Small Language Models for Graph Structural Inference

    Apr 20, 2026Michal PodstawskiSupervised Fine-TuningSmall Language Models

    NASK National Research Institute Warsaw, Poland

  26. Generalization in LLM Problem Solving: The Case of the Shortest Path

    Apr 16, 2026Yao Tong, Jiayuan Ye, Anastasia Borovykh +1Inference-Time ScalingLanguage Model Generalization

    National University of Singapore · Capital Fund Management · Google Research

  27. General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks

    Apr 13, 2026Junlin Liu, Shengnan An, Shuang Zhou +10LLM ReasoningLanguage Model Generalization

    University of Chinese Academy of Sciences · Meituan

  28. The Validity of Coreference-based Evaluations of Natural Language Understanding

    Feb 18, 2026Ian PoradaLanguage Model GeneralizationCoreference Resolution

    School of Computer Science, McGill University, Montreal, Quebec

  29. Disentangling generalization and memorization in large language models using chess

    Jan 23, 2026Leonard S. Pleiss, Maximilian Schiffer, Robert K. von WeizsaeckerLanguage Model GeneralizationMemorization in Language Models

    Technical University of Munich

  30. Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors

    May 29, 2025Harish Tayyar Madabushi, Melissa Torgbi, Claire BonialLanguage Model Reasoning EvaluationLanguage Model Generalization

    University of Bath Bath, United Kingdom · DEVCOM Army Research Laboratory United States of America