Overview

Language model robustness asks whether a model gives dependable answers when meaning-preserving changes, noise, misleading context, or adversarial inputs challenge it. Evaluations use paraphrases, reordered answer choices, typos, multilingual and dialectal text, noisy retrieval, and multi-turn interactions, often measuring per-example consistency as well as accuracy. Approaches include perturbation and adversarial training, consistency-based fine-tuning, calibration and selective prediction, and symbolic verification or mechanistic analysis of model internals. A central tension is that strong performance on standard benchmarks often hides fragile behavior, while fixes that improve stability can reduce clean-task utility, over-refuse, or fail to transfer across tasks and deployment settings.

Latest papers

CardsList

521 papers35 papers in the last four weeks, down 43% on the four weeks before. 0.3% of all new papers.

  1. Bounds of Chain-of-Thought Robustness: Reasoning Steps, Embed Norms, and Beyond

    Sep 25, 2025Dingzirui Wang, Xuanliang Zhang, Keyan Xu +3CoT ReasoningLanguage Model Robustness

  2. From Construction to Injection: Edit-Based Fingerprints for Large Language Models

    Sep 3, 2025Yue Li, Xin Yi, Dongsheng Shi +3Model Ownership VerificationLanguage Model Fingerprinting

  3. Enhancing Speech Large Language Models through Reinforced Behavior Alignment

    Aug 25, 2025Yansong Liu, Yuan LiuSpeech Language ModelsLanguage Model Robustness

  4. Data Security in Large Language Models: Risks, Defense, and Directions

    Aug 4, 2025Kang Chen, Xiuze Zhou, Yuanhui Yu +4Adversarial Attacks on LLMsLLM Security

  5. Measuring Intent Comprehension in LLMs

    Jun 19, 2025Nadav Kunievsky, James A. EvansPrompt SensitivityLLM Evaluation

  6. LLMs are Brittle to Simple Code Transformations: Introducing CETBench - A Benchmark for Code-Equivalence Checking

    Jun 4, 2025Neeva Oza, Ishaan Govil, Parul Gupta +3LLM EvaluationLanguage Model Robustness

  7. RAFP: Identifying LLM Lineages via Rare-Region Fingerprints

    May 19, 2025Yun-Yun Tsai, Jia Hao Liang, Chuan Guo +2Language Model FingerprintingLanguage Model Robustness

  8. Say It Another Way: Auditing LLMs with a User-Grounded Automated Paraphrasing Framework

    May 6, 2025Cléa Chataigner, Rebecca Ma, Prakhar Ganesh +4LLM AuditingLanguage Model Robustness

  9. Unified Enhancement of the Generalization and Robustness of Language Models via Bi-Stage Optimization

    Mar 19, 2025Yudao Sun, Juan Yin, Juan Zhao +3Adversarial TrainingNeural Network Generalization

  10. BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models

    Aug 8, 2024Yupeng Chang, Yi Chang, Yuan WuSocial Bias in Language ModelsLow-Rank Adaptation