Language Model Robustness

Follow this topic Ask about this topic

Momentum

37 papers in the last four weeks, up 54% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 338

All topics

Improving Cross-Format Robustness in Language Models with Multi-Format Training
Jun 10, 2026June M. Liu, Shaomian Zheng, He Cao +3Language Model Robustness LLM Training
Ant Group · International Digital Economy Academy (IDEA)
When Context Returns: Toward Robust Internalization in On-Policy Distillation
Jun 10, 2026Xun Wang, Ruishuo Chen, Zhuoran Li +2On-Policy Distillation Context Distillation
1IIIS, Tsinghua University
When Probing Accuracy Saturates, Fragility Resolves: A Complementary Metric for LLM Pre-Training Analysis
Jun 9, 2026Orion Reblitz-RichardsonLanguage Model Pretraining Noise Robustness
Distiller Labs.
Are We Evaluating Knowledge or Phrasing? Mitigating MCQA Sensitivity with ParaEval
Jun 9, 2026João Maria Janeiro, Mathurin Videau, Andrea Caciolai +3LLM Evaluation Multiple-Choice Question Answering
FAIR at Meta · Sorbonne Université, CNRS, ISIR, F-75005 Paris, France · Criteo AI Lab, Paris, France
Decoupling Thought from Speech: Knowledge-Grounded Counterfactual Reasoning for Resilient Multi-Agent Argumentation
Jun 9, 2026Jakub Masłowski, Jarosław A. ChudziakMulti-Agent Debate Computational Argumentation
Institute of Computer Science, Warsaw University of Technology, Warsaw, Poland
Reliable to Expressive: A Curriculum for Rubric-Following Safety Judges
Jun 8, 2026Yongtaek Lim, Hyeji Choi, Minwoo KimLLM-as-a-Judge LLM Safety Evaluation
AI Safety Team, DATUMO.INC, Seoul, South Korea.
Friend or Foe? Language as an ideological switch in open-weight LLMs under Russian disinformation stress
Jun 7, 2026Anna Małgorzata Kamińska, Tetiana KlyninaMultilingual Language Model Evaluation Political Bias in Language Models
Institute of Culture Studies, University of Silesia in Katowice, ul. Uniwersytecka 4, 40-007 Katowice, Poland · University of Texas at Austin 2515, TX 78712 Speedway Str., Texas, USA · National Aviation University, Liubomyr Huzar Avenue 1, Kyiv 03058, Ukraine
When Behavioral Safety Evaluation Fails: A Representation-Level Perspective
Jun 6, 2026Enyi Jiang, Anders Gjølbye, Yibo Jacky Zhang +1Language Model Safety Evaluation LLM Auditing
1Stanford University · University of Illinois Urbana-Champaign · 3Technical University of Denmark
Arabic Sentence Segmentation Across Genres and Punctuation Conditions
Jun 6, 2026Mohammed Elkholy, Khalid N. Elmadani, Nizar Habash +1LLM Evaluation Arabic NLP
Mohamed bin Zayed University of Artificial Intelligence · New York University Abu Dhabi
Stress-testing medical large language models reveals latent safety pathology beyond benchmark accuracy
Jun 6, 2026Yuan Shen, Xiaojun Wu, Linghua YuLLM Evaluation Language Model Safety Evaluation
College of Computer Science and Technology, Zhejiang University, PR China · The First Hospital of Jiaxing, Zhejiang Province, PR China
SLMJury: Can Small Language Models Judge as Well as Large Ones?
Jun 5, 2026Anish Laddha, Nitesh Pradhan, Gaurav SrivastavaLLM-as-a-Judge Language Model Generation Evaluation
Department of Computer Science and Engineering, LNMIIT, Jaipur, India · Department of Computer Science, Virginia Tech, Blacksburg, VA, USA
Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval
Jun 5, 2026Sevgi Yigit-SertRetrieval-Augmented Generation Knowledge Conflicts in Language Models
Computer Engineering Department, Ankara University, Golbasi Campus, 06830, Ankara, Turkey · Golbasi Campus, 06830, Ankara, Turkey
When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations
Jun 5, 2026Mahdi AlkaeedPrompt Sensitivity Adversarial Attacks on LLMs
Department of Computer Science and Engineering, Doha, Qatar
When Better Codebooks Are Not Enough: Predictive Performance and Behavioral Reliability in LLM Political Event Coding
Jun 4, 2026Zixian He, Bharath Raahul Murugesan, Patrick Brandt +1LLM Evaluation LLM-Assisted Annotation
Independent Researcher · Illinois Institute of Technology · The University of Texas at Dallas
Revising Context, Shifting Simulated Stance: Auditing LLM-Based Stance Simulation in Online Discussions
Jun 4, 2026Xinnong Zhang, Wanting Shan, Hanjia Lyu +2Counterfactual Evaluation LLM Auditing
1Fudan University · 3Shanghai Innovation Institute · University of Rochester
Decomposing Factual Sycophancy in Language Models: How Size and Instruction Tuning Shape Robustness
Jun 4, 2026Victor De Marez, Luna De Bruyne, Walter DaelemansLLM Evaluation LLM Sycophancy
Centre for Computational Linguistics, Psycholinguistics and Sociolinguistics University of Antwerp Antwerp, Belgium
Consistency Training Along the Transformer Stack
Jun 4, 2026Sukrati Gautam, Neil Shah, Arav Dhoot +7Adversarial Attacks on LLMs LLM Safety Alignment
1Purdue University · 2Independent · 3Columbia University +4
Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges
Jun 3, 2026Srimonti Dutta, Akshata Kishore MoharirLLM-as-a-Judge Language Model Robustness
WAI USA Research Labs
A Systematic Analysis of Linguistic Features in AI-Generated Text Detection Across Domains and Models
Jun 2, 2026Yassir El Attar, Esra Dönmez, Maximilian Maurer +1AI-Generated Text Detection Stylometry
Institute for Natural Language Processing, University of Stuttgart · Interchange Forum for Reflecting on Intelligent Systems, University of Stuttgart · GESIS Leibniz Institute for the Social Sciences +1
Testing LLM Arithmetic Reasoning Generalization with Automatic Numeric-Remapping Attacks
Jun 2, 2026Malia Barker, Bishal Lakha, Edoardo Serra +1Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks
Department of Computer Science, Boise State University, Boise, ID, USA · University of L'Aquila, L'Aquila, Italy
Greener Than Humans? Environmental Attitudes in Large Language Models
Jun 1, 2026Stefanie Kunkel, Tilman Hartwig, Marcus Voss +2LLM Evaluation Language Model Robustness
Research Institute for Sustainability at GFZ Centre for Geosciences, Berliner Straße 130, 14467 Potsdam, Germany · German Environment Agency, Wörlitzer Platz 1, 06844 Dessau-Roßlau, Germany · Birds on Mars, Marienstraße 10, 10117 Berlin, Germany
Not All Errors Are Equal: A Systematic Study of Error Propagation in Large Language Model Inference
Jun 1, 2026Yafan Huang, Sheng Di, Guanpeng LiLLM Inference Language Model Robustness
University of Iowa · Argonne National Laboratory · University of Florida
Consistency Training while Mitigating Obfuscation via Rate Matching
Jun 1, 2026Sohaib Imran, Prakhar Gupta, Jannes Elstner +1LLM Sycophancy Language Model Robustness
Independent · University of Michigan · UK AI Security Institute
CARTE: A Benchmark for Mapping Language Model Knowledge Across France
Jun 1, 2026Sarah Almeida Carneiro, Christos Xypolopoulos, Xiao Fei +2LLM Evaluation Factual Knowledge in Language Models
École Polytechnique, Paris · École Polytechnique, Institut Polytechnique de Paris, France · École Polytechnique, Paris, NTUA +3
Mitigating Hallucinations in Large Language Models Via Decoder Layer Skipping
May 30, 2026Hanze Li, Jinhao You, Yichen Guo +3Language Model Decoding LLM Hallucination Mitigation
De Artificial Intelligence Lab
Robust Reasoning via Dynamic Token Selection for Distribution-Aligned Self-Distillation
May 30, 2026Ruiqi Zhang, Lingxiang Wang, Hainan Zhang Zhiming ZhengLanguage Model Distillation Language Model Robustness
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University · School of Artificial Intelligence, Beihang University
On the Limits of LLM Adaptability: Impact of Model-Internalized Priors on Annotation Task Performance
May 30, 2026Etienne Casanova, Rafal Kocielnik, R. Michael AlvarezLLM Evaluation Zero-Shot Text Classification
California Institute of Technology, Pasadena, CA, USA.
Short-form Text Rewriting with Phi Silica
May 30, 2026Divya Tadimeti, Shawn Pan, Sameera Lanka +2LLM Fine-Tuning Small Language Models
Microsoft · Cambridge, USA · Redmond, USA
EST-PRM: Stress-Testing Process Reward Models Before They Become Load-Bearing
May 30, 2026Ibne Farabi Shihab, Fariya Afrin, Sanjeda Akter +1Process Reward Models Language Model Calibration
Department of Computer Science, Iowa State University · Department of Computer Science, Kalinga Institute of Industrial Technology · Department of Civil, Construction & Environmental Engineering, Iowa State University
On the Robustness of Multilingual Text Embedding Rankings Across Learning Tasks, Languages, and Benchmark Datasets
May 29, 2026Ana Gjorgjevikj, Barbara Koroušić Seljak, Tome EftimovMultilingual Language Model Evaluation Text Embedding Evaluation
Computer Systems Department Jožef Stefan Institute Ljubljana, Slovenia

Jun 10, 2026, cs.CLJ/K move · Enter open · S save

Improving Cross-Format Robustness in Language Models with Multi-Format Training

June M. Liu, Shaomian Zheng, He Cao, Dingnan Jin+2

Ant Group · International Digital Economy Academy (IDEA)

Language Model Robustness LLM Training

Open paper AskPDF arXiv

Large language models often remain sensitive to answer format: a question solved correctly in one form may fail in another semantically equivalent form. To study this gap, we define cross-format robustness as the extent to which a model answers the same underlying question consistently across formats. We then compare full-format training with FormatMix, which expands only a subset of training items into multiple equivalent formats using either random or targeted selection. Across GLM4 and Llama-3.1, multi-format supervision consistently improves both task performance and cross-format robustness, whereas Multiple-choice question (MCQ)-only supervision alone brings little benefit and can even reduce robustness. We further find that expanding only about 30% of the training set into multiple formats often recovers most of the gain from full-format training, and this effect appears across the model families and sizes we study. These results suggest that format diversity, rather than additional supervision alone, is the key driver of robustness. That lightweight multi-format augmentation is a practical way to make LLMs less sensitive to answer format without changing the base model.

Momentum

Related topics

Latest papers 338