QUIETT: Query-Independent Table Transformation for Robust Reasoning
Organizations: Arizona State University
Abstract
Real-world tables often contain schema inconsistencies, heterogeneous value formats, and implicit relational structures that degrade table reasoning and question answering. Existing approaches address these issues at query time, repeating normalization and restructuring for every new question and producing representations that do not generalize to unseen queries. We introduce QuIeTT, a transform-first, query-later framework that converts each raw table into a single SQL-ready canonical representation before any evaluation query is observed, under three constraints: no evaluation query access, information preservation, and single-table reuse. QuIeTT operates through a three-stage pipeline: issue probing, where synthetic queries surface structural deficiencies such as ambiguous schemas and heterogeneous formats; plan generation; and structured execution. Experiments on four benchmarks across five model families show consistent improvements over strong baselines in both direct prompting and agentic reasoning paradigms, with particularly strong gains on a manually annotated challenge set of structurally diverse unseen questions.
Figures & tables
| Expert Pair | Cohen’s Kappa | Jaccard Coeff. |
| 92.9 | 96.9 | |
| 92.0 | 96.6 | |
| 94.9 | 97.7 | |
| (Fleiss’ ) | 0.9328 | 0.9562 |
| Statistic | Values | Table Dimension |
| Total tables | 529 | Mean: |
| Total questions | 2,500 | Median: |
| Questions per table | 4 / 5 / 7 | Min: |
| (mean / median / max) | Max: |
| Gemini 2.5 | GPT-OSS | ||||||||||||||||
| Category | Method | WikiTQ | NQ-Table | SequentialQA | HiTab | WikiTQ | NQ-Table | SequentialQA | HiTab | ||||||||
| F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | ||
| Direct | CoT | 74.31 | 72.85 | 71.22 | 66.36 | 61.98 | 57.21 | 75.21 | 71.00 | 69.40 | 66.56 | 66.60 | 63.54 | 60.26 | 58.29 | 53.90 | 50.80 |
| CoT + SQL | 54.66 | 52.49 | 36.64 | 30.96 | 58.23 | 53.37 | 69.01 | 67.00 | 43.00 | 42.29 | 47.90 | 33.95 | 55.20 | 49.60 | 31.90 | 30.70 | |
| NormTab | 58.70 | 56.19 | 53.00 | 51.05 | 50.00 | 49.92 | 56.81 | 54.60 | 65.91 | 62.61 | 50.30 | 48.34 | 48.60 | 43.10 | 54.67 | 52.00 | |
| E5 | 74.35 | 70.30 | 55.90 | 52.92 | 31.64 | 29.81 | 78.89 | 75.10 | 56.90 | 52.15 | 54.00 | 51.76 | 43.80 | 40.46 | 77.47 | 75.00 | |
| Dataset | Method | Gemini 2.5 | GPT-OSS | ||
| F1 | EM | F1 | EM | ||
| WikiTQ | CoT | 67.11 | 65.50 | 63.58 | 60.36 |
| NormTab | 62.28 | 61.90 | 61.71 | 57.23 | |
| EEDP | 67.60 | 66.34 | 65.12 | 61.86 | |
| Binder | 65.56 | 63.39 | 65.12 | 64.48 | |
| QuIeTT | 74.41 | 71.37 | 70.06 | 68.59 | |
| Dataset | Gemini 2.5 | GPT-OSS | ||
| F1 | EM | F1 | EM | |
| WikiTQ | 53.22 | 52.06 | 51.40 | 51.15 |
| NQ-Table | 56.80 | 54.37 | 54.90 | 51.82 |
| Dataset | Gemini 2.5 | GPT-OSS | ||
| F1 | EM | F1 | EM | |
| WikiTQ | 60.57 | 58.26 | 58.33 | 57.29 |
| NQ-Table | 63.20 | 60.56 | 61.08 | 58.66 |
| Dataset | Gemini 2.0 | Gemini 2.5 | DeepSeek V3.1 | Qwen 3 | GPT-OSS | |||||
| F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | |
| WikiTQ | 37.61 | 36.34 | 38.92 | 35.12 | 27.65 | 26.78 | 27.19 | 23.50 | 28.21 | 24.59 |
| NQ-Table | 35.42 | 33.32 | 32.49 | 32.03 | 25.38 | 24.23 | 35.31 | 31.21 | 32.44 | 30.46 |
| SequentialQA | 40.71 | 38.90 | 42.97 | 36.32 | 38.98 | 35.33 | 36.67 | 31.12 | 41.98 | 38.48 |
| HiTab | 59.60 | 56.80 | 62.30 | 59.60 | 58.12 | 58.30 | 46.27 | 45.30 | 53.60 | 52.50 |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Operator | Description |
| add_row_id | Adds a unique, stable row identifier column to the table. |
| rename | Renames columns according to a provided name mapping. |
| select | Selects and retains a specified subset of columns. |
| parse_date_text | Parses free-text date strings into a normalized date representation. |
| parse_number | Extracts numeric values (and optional units) from text fields. |
| extract_regex | Extracts structured groups from a column using a regular expression. |
| Model | Context window |
| DeepSeek-V3.1 | Up to 128K tokens |
| Qwen-3-80B | Up to 128K tokens |
| GPT-OSS-120B | Up to 131K tokens |
| Gemini-2.0 | Up to 1,048,576 tokens |
| Gemini-2.5 | Up to 1,048,576 tokens |
| Hyperparameter | Value |
| Decoding | Greedy / temperature |
| Max output tokens (Step 1: Issue) | 8000 |
| Max output tokens (Step 2: Plan) | 6000 |
| Max output tokens (Step 3: Code) | 1024 |
| Max output tokens (Step 4: Q&A) | 4096 |
| Stop sequences: | none (generation is post-processed/validated) |
| Criterion | Description |
| Answer Correctness | The provided answer exactly matches the value(s) supported by the table. |
| Answerability | The question can be answered using only the table content. |
| Clarity | The question is unambiguous and clearly specifies the required reasoning. |
| Structural Reasoning | The question requires aggregation, comparison, filtering, or reasoning over derived or normalized fields. |
| Gemini 2.0 | |||||||||
| Category | Method | WikiTQ | NQ-Table | SequentialQA | HiTab | ||||
| F1 | EM | F1 | EM | F1 | EM | F1 | EM | ||
| Direct | CoT | 61.76 | 60.67 | 68.70 | 67.50 | 62.33 | 59.87 | 76.11 | 72.00 |
| CoT + SQL | 44.43 | 44.02 | 43.29 | 41.45 | 50.06 | 46.83 | 52.10 | 50.00 | |
| NormTab | 55.95 | 52.42 | 51.80 | 49.76 | 47.95 | 42.14 | 56.24 | 53.60 | |
| E5 | 66.60 | 65.90 | 48.40 | 46.34 | 42.75 | 38.18 | 75.83 | 71.40 | |
| Dataset | Gemini 2.5 | GPT-OSS | ||
| F1 | EM | F1 | EM | |
| WikiTQ | 68.34 | 68.14 | 66.72 | 63.57 |
| NQ-Table | 70.11 | 69.34 | 68.20 | 65.56 |
| Dataset | Mean Issues | Median | % in 11-20 |
| WikiTQ | 16.1 | 15 | 98.5% |
| NQ-Table | 16.1 | 15 | 99.4% |
| Transform model: Gemini 2.5 | ||||
| QA model | LLaMA | Mistral | ||
| F1 | EM | F1 | EM | |
| WikiTQ | 59.87 | 57.50 | 65.12 | 62.23 |
| NQ-Table | 59.01 | 53.78 | 63.28 | 58.12 |
| SequentialQA | 46.72 | 43.12 | 47.24 | 44.84 |
| HiTab | 62.30 | 61.20 | 59.61 | 58.40 |
Table QA
Table question answering studies how AI systems retrieve, interpret, and reason over structured data to answer natural-language questions.
See all 66 papers