cs.AIJan 8, 2026

An Empirical Investigation of Robustness in Large Language Models under Tabular Distortions

Authors: Avik Dutta, Harshit Nigam, Hosein Hasanbeig, Arjun Radhakrishna, Sumit Gulwani

Organizations: Microsoft Corp.

Abstract

Distortions are a natural consequence of tables collected from real-world sources, where scraping, extraction, or manual intervention can introduce semantic and structural inconsistencies. Humans can often identify and mentally correct such errors autonomously before reasoning over the data. In this work, we investigate whether Large Language Models (LLMs) possess a similar capability by evaluating them on 506 distorted table question answering (TQA) samples derived from canonical tables. Our findings reveal systematic weaknesses in current LLM pre-training paradigms, where models exhibit a strong inductive bias toward assuming tables are well-formed, often overlooking distortions or discarding inconsistent entries instead of repairing them. Even frontier models like GPT-5.4 and Opus-4.6 achieve only 68% accuracy under distortion. While distortion-aware prompting partially mitigates these failures, errors persist. Through lightweight finetuning, we demonstrate that models can learn to autonomously detect and repair human-recoverable distorted tables.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Understanding Errors in LLM-Based Question Answering over Imperfect Tables

    Oct 3, 2026Baowen Zhang, Wei Fan, Ruman Wang +1Table QALanguage Model Error Detection

  2. When LLMs Read Tables Carelessly: Measuring and Reducing Data Referencing Errors

    Jun 30, 2026Yuqing Yang, Qi Zhu, Zhen Han +5LLM EvaluationLLM Grounding

  3. The Power of Order: Fooling LLMs with Adversarial Table Permutations

    May 1, 2026Xinshuai Dong, Haifeng Chen, Xuyuan Liu +5Table QAAdversarial Attacks on LLMs