Language Model Robustness

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 46% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 338

All topics

A Robust Evaluation of Probe Robustness: Lessons for Reliable OOD Uncertainty Quantification
Apr 13, 2026Joe Stacey, Hadas Orgad, Kentaro Inui +2LLM Evaluation Uncertainty Quantification
University of Sheffield · Kempner Institute at Harvard University · MBZUAI +2
Activation Steering for Aligned Open-ended Generation without Sacrificing Coherence
Apr 9, 2026Niklas Herbster, Martin Zborowski, Alberto Tosato +2LLM Safety Alignment Language Model Robustness
1Tara Research · 2Technical University of Munich · 3Mila Quebec AI Institute
DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects
Apr 7, 2026Jason Lucas, Matt Murtagh, Ali Al-Lawati +3Fake News Detection Automated Fact-Checking
The Pennsylvania State University, USA · Trinity College Dublin, Ireland · MIT Lincoln Laboratory, USA
Where Does Robustness Live? Neuron-Guided Adaptation for Retrieval-Augmented Language Models
Apr 2, 2026Jae O Lee, Jaemin Kim, Sumyeong Ahn +1Retrieval-Augmented Generation Fine-Tuning
1Hanyang University · 2KENTECH
Contrast Matters: Understanding Robustness of In-Context Fine-Tuning to Target-Context Relatedness
Apr 2, 2026Deeptanshu Malu, Deevyanshu Malu, Aditya Nemiwal +1In-Context Example Selection LLM Fine-Tuning
IIT Bombay
Reasoning Shift: How Context Silently Shortens LLM Reasoning
Apr 1, 2026Gleb Rodionov, Roman Garipov, George YakushevLanguage Model Robustness LLM Context Management
Yandex · HSE University
Beyond Idealized Patients: Evaluating LLMs under Challenging Patient Behaviors in Medical Consultations
Mar 31, 2026Yahan Li, Xinyi Jie, Wanjia Ruan +5Healthcare Clinical Reasoning
University of Southern California
JFTA-Bench: Evaluate LLM's Ability of Tracking and Analyzing Malfunctions Using Fault Trees
Mar 24, 2026Yuhui Wang, Zhixiong Yang, Ming Zhang +10LLM Evaluation Multi-Turn Dialogue Evaluation
1Fudan University
SeaAlert: Robust Severity Classification and LLM-Based Information Extraction for Noisy Maritime Distress Communications
Mar 23, 2026Tomer Atia, Yehudit Aperstein, Alexander ApartsinLLM Information Extraction Language Model Robustness
School of Computer Science, Faculty of Sciences, HIT-Holon Institute of Technology, Holon 58102, Israel · Intelligent Systems, Afeka Academic College of Engineering, Tel Aviv 69988, Israel
Endogenous Resistance to Activation Steering in Language Models
Feb 6, 2026Alex McKenzie, Keenan Pepper, Stijn Servaes +6Language Model Steering Language Model Robustness
AE Studio · Princeton Neuroscience Institute & Department of Psychology, Princeton University, Princeton, NJ.
SalamahBench: Dialect and Category Level Safety Evaluation of Arabic Language Models
Feb 3, 2026Omar Abdelnasser, Fatemah Alharbi, Khaled Khasawneh +2LLM Safety Benchmarks Multilingual Language Model Evaluation
Compumacy for Artificial Intelligence Solutions, Cairo, Egypt · Computer Science Department, College of Computer Science and Engineering, Taibah University, Yanbu 46522, KSA · Electrical and Computer Engineering Department, George Mason University, VA, USA +2
Robustness as an Emergent Property of Task Performance
Feb 3, 2026Shir Ashury-Tahan, Ariel Gera, Elron Bandel +2Neural Network Robustness Language Model Robustness
IBM Research · MIT · Weizmann Institute of Science
MGSM-Pro: A Simple Strategy for Robust Multilingual Mathematical Reasoning Evaluation
Jan 29, 2026Tianyi Xu, Kosei Uemura, Alfred Malengo Kondoro +6Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks
McGill University · Mila-Quebec AI Institute · University of Toronto +7
ReportLogic: Evaluating Logical Quality in Deep Research Reports
Jan 27, 2026Jujia Zhao, Zhaoxin Huan, Zihan Wang +4LLM-as-a-Judge Automated Evaluation
1Leiden Institute of Advanced Computer Science, Leiden University · 2Ant Group · 3CISPA Helmholtz Center for Information Security
The Effect of Scripts and Formats on LLM Numeracy
Jan 21, 2026Varshini Reddy, Craig W. Schmidt, Seth Ebner +3Numerical Reasoning in Language Models Multilingual Language Model Evaluation
Kensho Technologies · Ben-Gurion University · MIT Cambridge, MA
Vulnerability of LLMs' Stated Beliefs? LLMs Belief Resistance Check Through Strategic Persuasive Conversation Interventions
Jan 20, 2026Fan Huang, Haewoon Kwak, Jisun AnLLM Evaluation Fine-Tuning
Indiana University Bloomington, United States
ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation
Jan 19, 2026Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta +1Data Visualization Adversarial Attacks on VLMs
INSAIT · KU Leuven · Arizona State University +2
NOVA: NOise-aware Verbal Confidence CAlibration for Robust Large Language Models in RAG Systems
Jan 16, 2026Jiayu Liu, Rui Wang, Qing Zong +9Retrieval-Augmented Generation Confidence Estimation in Language Models
HKUST · UIUC · Northwestern University
Lost in Execution: On the Multilingual Robustness of Tool Calling in Large Language Models
Jan 8, 2026Zheng Luo, T Pranav Kutralingam, Ogochukwu N Okoani +3Multilingual Language Model Evaluation LLM Tool Use
University of Southern California · 2Arizona State University
Hidden State Poisoning Attacks against Mamba-based Language Models
Jan 5, 2026Alexandre Le Mercier, Chris Develder, Thomas DemeesterAdversarial Attacks on LLMs Language Modeling
IDLab–T2K, Ghent University–imec
MERGE: Minimal Expression-Replacement GEneralization Test for Natural Language Inference
Oct 28, 2025Mădălina Zgreabăn, Tejaswini Deoskar, Lasha AbzianidzeLanguage Model Robustness Natural Language Inference
Utrecht Institute of Linguistics OTS, Utrecht University, The Netherlands
Flip-Flop Consistency: Unsupervised Training for Robustness to Prompt Perturbations in LLMs
Oct 16, 2025Parsa Hejabi, Elnaz Rahmati, Alireza S. Ziabari +1Unsupervised Learning Language Model Robustness
University of Southern California
VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents
Oct 13, 2025Jiliang Hu, Wenfu Wang, Zuchao Li +6Audio-Language Model Evaluation Voice Agent Evaluation
School of Artificial Intelligence, Wuhan University, Wuhan, China · Tencent AI Lab, Beijing, China
Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergence
Oct 8, 2025Shuangyi Chen, Ashish KhistiAI-Generated Text Detection Language Model Robustness
Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada.
Are LLMs Reliable Rankers? Rank Manipulation via Two-Stage Token Optimization
Oct 8, 2025Tiancheng Xing, Jerry Li, Yixuan Du +1Adversarial Attacks on LLMs LLM Reranking
National University of Singapore · University of Southern California · Georgetown University +1
Robustness assessment of large audio language models in multiple-choice evaluation
Oct 6, 2025Fernando López, Santosh Kesiraju, Jordi LuqueAudio-Language Model Evaluation Audio QA
Scientific Research, Telef´onica Innovaci´on Digital, Spain · Brno University of Technology, Czech Republic
VietBinoculars: A Zero-Shot Approach for Detecting Vietnamese LLM-Generated Text
Sep 30, 2025Trieu Hai Nguyen, Sivaswamy AkileshAI-Generated Text Detection Language Model Robustness
Faculty of Information Technology, Nha Trang University, 02 Nguyen Dinh Chieu Street, North Nha Trang 57100, Vietnam · Faculty of Business Administration, Swiss School of Business and Management Geneva, 12 Avenue des Morgines, Geneva 1213, Switzerland
From Construction to Injection: Edit-Based Fingerprints for Large Language Models
Sep 3, 2025Yue Li, Xin Yi, Dongsheng Shi +3Language Model Fingerprinting LLM Security
East China Normal University · Hasso Plattner Institute/University of Potsdam
Data Security in Large Language Models: Risks, Defense, and Directions
Aug 4, 2025Kang Chen, Xiuze Zhou, Yuanhui Yu +4Adversarial Attacks on LLMs LLM Security
School of Computer Engineering, Jimei University, Xiamen, 361021, China · The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, 511453, China · School of Informatics, Xiamen University, Xiamen, 361102, China +1
Measuring Intent Comprehension in LLMs
Jun 19, 2025Nadav Kunievsky, James A. EvansPrompt Sensitivity LLM Evaluation
Knowlesdge Lab, University of Chicago, Chicago, Illinois, USA · Knowledge Lab, Data Science Institute, Department of Sociology, University of Chicago, Chicago, Illinois, USA.

Apr 13, 2026, cs.CLJ/K move · Enter open · S save

A Robust Evaluation of Probe Robustness: Lessons for Reliable OOD Uncertainty Quantification

Joe Stacey, Hadas Orgad, Kentaro Inui, Benjamin Heinzerling+1

University of Sheffield · Kempner Institute at Harvard University · MBZUAI+2

LLM Evaluation Uncertainty Quantification LLM Uncertainty Estimation Language Model Robustness Robust Estimation

Open paper AskPDF arXiv

Recent work has shown that the hidden states of large language models contain signals useful for uncertainty estimation, motivating a growing interest in efficient probe-based approaches. Yet it remains unclear how robust existing methods are, with prior work reporting conflicting conclusions under substantially different evaluation settings. We address this by introducing ProbeDrift, a systematic evaluation framework for supervised uncertainty probes covering a wide range of OOD settings across models, tasks, and distributional shifts. Using ProbeDrift, we train over 2,000 probes to disentangle the effect of key design choices, showing poor robustness of current methods beyond near-OOD settings. We find that robustness is driven by design decisions that have a largely invisible effect in-distribution, including the choice of feature type, aggregation strategy, and training signal. We argue that robust uncertainty estimation requires robust evaluation. To support this, we release ProbeDrift as a lightweight Python library that contains the train and test splits underpinning our extensive evaluation. We also show how insights from our evaluation can directly lead to more robust methods through a simple Hybrid Back-Off (HBO) strategy.

Momentum

Related topics

Latest papers 338