Language Model Robustness

Ask about this topic

Momentum

35 papers in the last four weeks, up 46% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 338

All topics
CardsList

  1. Dialect-Robust Speech Language Models with Synthetic Pseudo-Dialect Augmentation

    Oct 7, 2026Shunsuke Mitsumori, Tomoya Mizumoto, Yusuke FujitaSpeech Language ModelsLanguage Model Robustness

    SB Intuitions · Waseda University, Tokyo, Japan

  2. Conditional Accuracy Profiles: Diagnosing LLM Judges across Deployment Conditions

    Oct 6, 2026Wenqi Li, Bin Liu, Mindi Ruan +3LLM EvaluationLLM-as-a-Judge

    University at Albany, State University of New York · West Virginia University

  3. The Dichotomy Between Pattern Recognition and Step-by-Step Reasoning

    Oct 6, 2026Amrut Nadgir, Pratik Chaudhari, Vijay BalasubramanianLLM ReasoningEfficient Language Model Reasoning

    University of Pennsylvania

  4. A Systematic Study of Small Language Models on Abstract Reasoning Tasks

    Oct 6, 2026Nur A Zarin Nishat, Jens Lehmann, Andrei Aioanei +1OOD GeneralizationLanguage Model Robustness

    Leibniz University of Hanover TIB – Leibniz Information Centre for Science and Technology and University Library · Amazon

  5. Large language models are vulnerable to incidental information in clinical documentation and reasoning

    Oct 6, 2026Krithik Vishwanath, Brandon Ye, Anton Alyakin +4Medical Report GenerationClinical Language Model Evaluation

    Department of Neurosurgery, NYU Langone Health, New York, NY, USA · Johns Hopkins University School of Medicine, Baltimore, MD, USA · Washington University School of Medicine in St. Louis, St. Louis, MO, USA +7

  6. You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue

    Oct 5, 2026Junle Chen, Wei Chen, Zhengjun Huang +5Intent ClassificationInstruction Following

    HKUST · Tencent

  7. The Hidden States Cookbook: A Large-Scale Ablation Study for Noise-Robust Conversational Intent Classification in Industry

    Oct 4, 2026Bogdan Bogachov, Nikita Letov, Yaoyao Fiona ZhaoIntent ClassificationLanguage Model Robustness

    Department of Mechanical Engineering, McGill University, Montréal, Québec, Canada · Axya Inc., Montréal, Québec, Canada

  8. When Verifiable Counts Depend on Wording: Auditing Wording Robustness in Instruction Following

    Oct 4, 2026Qishi Zhan, Seoyeon Jang, Zihan Dong +3LLM EvaluationInstruction Following

    Marquette University · University of California, San Diego · Georgia Tech +3

  9. Generalization Is Stability, Not Accuracy: Multi-Axis Evaluation of LLMs

    Oct 1, 2026Nagham Omar, Mahmoud Jabarin, Maya Rozenshtein +3Prompt SensitivityLLM Evaluation

    Technion – Israel Institute of Technology

  10. Evaluating the Robustness of Japanese LLMs to IME-Related and Typographical Errors

    Oct 1, 2026Ryota Mibayashi, Hiroaki OhshimaLLM EvaluationLanguage Modeling

    Kobe University, Hyogo, Japan · University of Hyogo, Hyogo, Japan

  11. Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts

    Sep 29, 2026Abinitha Gourabathina, Haoran Zhang, Yuexing Hao +2Clinical TriageClinical Decision-Making

    Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science · Worcester Polytechnic Institute, Department of Computer Science

  12. TALK-Dem: Benchmarking Embodied Task Planning under Dementia-Associated Communication Patterns

    Sep 29, 2026Guangxin Zhao, Yiran Hu, Yuan Cao +7Large Language Model-Based Robot PlanningRobot Task Planning

    University of Notre Dame · Nanyang Technological University · Tohoku University

  13. Spontaneous Context Restoration: How Language Models Recover from Corrupted Inputs

    Sep 28, 2026Pranjal Garg, Jacob BeckLanguage Model Error DetectionMechanistic Interpretability

    Independent Researcher

  14. Tool Mediation Alters Refusal Mechanisms in Large Language Models

    Sep 28, 2026Abel Rodríguez, Giuseppe Garofalo, Lieven Desmet +1Language Model Safety EvaluationLLM Agent Safety

    DistriNet, KU Leuven

  15. Decoupling Token Roles in Autoregressive Pretraining

    Sep 27, 2026Suqin Yuan, Runqi Lin, Kevin Qinghong Lin +4Language Model PretrainingAutoregressive Language Modeling

    University of Sydney · University of Oxford · Southeast University

  16. JevOut: Natural Context Can Flip Decision Models

    Sep 24, 2026Zixiang Xu, Zirui Song, Chiyu Zhang +4Adversarial Attacks on LLMsLLM Decision-Making

    University of Southern California

  17. ENDOPROMPT: Victim-Side Pseudo-References for Utility Degradation

    Sep 24, 2026Qingyu Wu, Zeyu Feng, Yongda Yu +2Adversarial Prompt GenerationPrompt Injection Attacks

    Defense Innovation Institute, Academy of Military Science, Beijing, China · Nanjing University, Nanjing, China

  18. Robust Detection of LLM-Generated Text under Contamination

    Sep 24, 2026Jiaxun Li, Saptarshi Chakraborty, Ambuj TewariAI-Generated Text DetectionLanguage Model Robustness

    Department of Statistics, University of Michigan

  19. AEGIS: Audio Endogenous Guarding via Internal Signals Against Large Audio-Language Model Jailbreaks

    Sep 24, 2026Yu-Ling Liao, Tzu-Chin Chiu, Zong-You Chen +2Audio-Language ModelsJailbreak Defense

    National Taiwan University

  20. Evaluation of pre-trained models for pedagogical assessment of novel AI-assisted educational questions

    Sep 23, 2026Michael Lawrence Castanares, Princess Ventures, Allan TanEducational AssessmentOOD Generalization

    Predictive Systems Inc, Ortigas, Pasig City, Philippines, 1605 · Better Labs Oy, Helsinki, Finland

  21. Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understanding

    Sep 23, 2026Fan Zhang, Yankai Chen, Zhuohan Xie +11LLM EvaluationEfficient Language Model Inference

    The University of Tokyo · MBZUAI · McGill University +8

  22. When Context Misleads: In-context Learning with Jurisdiction in Large Language Models

    Sep 23, 2026Pei-lin Li, Qingle Liu, Junyang Feng +4LLM EvaluationIn-Context Learning

    Department of Computer Science and Technology, Tsinghua University · School of Integrated Circuits, Huazhong University of Science and Technology

  23. EquivSVA: A Formally Verified Dataset of Behavioral Assertions Across Equivalent RTL Implementations

    Sep 22, 2026FNU AditiFormal Hardware VerificationLanguage Model Robustness

  24. On the Lexical Superstition of Large Language Models for Code Comprehension: Re-evaluation on Code of Low Lexical Quality

    Sep 22, 2026Xin Shen, San-Zhuo Xi, Yali Du +1Language Model RobustnessCode Language Models

    Nanjing University, Nanjing, China

  25. Universal Fractal Natural Language Decision Map: Real-Time Edge Triage Across Heterogeneous Domains

    Sep 21, 2026Volkan Dağlı, Zerrin Dağlı, Dağhan DağlıOn-Device Language Model InferenceEfficient Language Model Inference

    Anadolu University, Eski¸sehir, Turkey · ITouch Systems, Mersin, Turkey · Mersin University, Mersin, Turkey +1

  26. Conduct Under Pressure: What Sixty Language Models Do When a User Pushes

    Sep 21, 2026Tapan ParikhLanguage Model Safety EvaluationPersuasion in Language Models

    Cornell Tech

  27. HerHealthEval: Evaluating Multilingual and Register-Sensitive Understanding of Women's Health Communication

    Sep 17, 2026Hassan Saeed Hassan Albattra, Mazen Mohammed Bahgat, Rahatara Ferdousi +2Multilingual Language Model EvaluationHealthcare

    SD-AI ERA, School of Computing, Queen’s University, Kingston, Ontario, Canada.

  28. AUDITPLAN: Commit, Then Answer for Auditable Safety Alignment

    Sep 16, 2026Sai Sri Pushpa Jampani, Kshitij Mishra, Asif EkbalLLM AlignmentLLM Auditing

    Indian Institute of Technology Patna, Bihar, India

  29. A Four-Stage Decomposition of Word-Problem Solving and Mechanistic Fragility in LLM Math Reasoning

    Sep 15, 2026Zhongdi Qu, Carla P. GomesMathematical ReasoningCircuits in Language Models

    Cornell University

  30. Can LLMs Follow the Pulse of a Crisis? Evaluating Crisis Sentiment in Bangladesh's July Uprising

    Sep 15, 2026Md. Samiul Alim, Mahir Shahriar Tamim, Tanvir Ahmed Khan +4LLM EvaluationSentiment Analysis

    North South University, Dhaka, Bangladesh · Charles Sturt University, Australia