INDOTABVQA: A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
Organizations: IIT Jodhpur · Punjabi University
Abstract
We introduce INDOTABVQA, a benchmark for evaluating cross-lingual Table Visual Question Answering (VQA) on real-world document images in Bahasa Indonesia. The dataset comprises 1,593 document images across three visual styles (bordered, borderless, and colorful) with one or more than one tables, and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic. This enables evaluation of Vision-Language Models (VLMs) in both monolingual (Bahasa documents with Bahasa questions) and cross-lingual settings (Bahasa documents with questions in other languages). We benchmark leading open-source VLMs (Qwen2.5-VL, Gemma-3, LLaMA-3.2) and GPT-4o and reveal substantial performance gaps, particularly on structurally complex tables and in low-resource languages. Fine-tuning a compact 3B and LoRA-finetuned 7B model on our dataset yields 11.6% and 17.8% improvements in accuracy. Providing explicit table region coordinates as additional input further improves performance by 4-7%, demonstrating the value of Spatial priors for table-based reasoning. Our findings underscore the importance of language-diverse, domain-specific datasets and demonstrate that targeted fine-tuning can significantly enhance VLM performance on specialized document understanding tasks. INDOTABVQA provides a valuable resource for advancing research in cross-lingual, structure-aware document understanding, especially in underrepresented regions of the world. Full dataset can be accessed in huggingface at: https://huggingface.co/datasets/NusaBharat/INDOTABVQA}
Figures & tables
| Property | IndoTabVQA |
| # Document Images | 1,593 |
| # Total Tables | 1,910 |
| Avg. Tables per Image | 1.20 |
| # QA Pairs | 6,372 (Bahasa+English+Hindi+Arabic) |
| QA per Language | 1,593 per language |
| Languages | Bahasa Indonesia, English, Hindi, Arabic |
| In-Match accuracy(%) | STS Accuracy(%) | |||||||||
| Model [#params] | ID | EN | HI | AR | ID | EN | HI | AR | ||
| Open-source | ||||||||||
| Donut | 10.5 | 5.48 | 4.74 | 4.39 | 6.20 | 15.52 | 9.10 | 5.17 | 6.03 | 8.96 |
| Qwen2.5VL [3B] | 37.8 | 28.7 | 4.1 | 16.4 | 21.9 | 29.0 | 44.9 | 4.4 | 27.5 | 26.5 |
| Gemma3 [12B] | 40.9 | 27.4 | 19.5 | 17.4 | 26.1 | 41.4 | 31.0 | 27.3 | 26.5 | 31.6 |
| Qwen2.5VL [7B] | 54.8 | 36.2 | 17.3 | 23.0 | 32.9 | 36.5 | 58.1 | 16.1 | 34.3 | 36.3 |
| In-Match accuracy(%) | STS Accuracy(%) | |||||
| Model [#params] | Bordered | Borderless | Colorful | Bordered | Borderless | Colorful |
| Bahasa Indonesia | ||||||
| Donut | 11.71 | 10.23 | 9.40 | 21.02 | 17.87 | 8.95 |
| Qwen2.5VL-3B | 32.73 | 44.25 | 36.36 | 24.62 | 34.27 | 27.9 |
| Qwen2.5VL-7B | 52.55 | 57.29 | 54.55 | 40.54 | 32.74 | 36.36 |
| Gemma3-12B | 48.05 | 34.78 | 39.81 | 48.35 | 32.74 | 43.26 |
| Model [#params] | Agg. | Comp. | Look. | Str. |
| Indonesia | ||||
| Donut | 13.13 | 0 | 4.89 | 12.33 |
| Qwen2.5VL-3B | 50.59 | 41.18 | 19.14 | 30.14 |
| Qwen2.5VL-7B | 64.58 | 76.47 | 27.56 | 57.53 |
| Gemma3-12B | 40.7 | 47.06 | 38.77 | 47.95 |
| Llama-3.2-11B | 66.23 | 100 | 43.25 | 53.42 |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Question Type | Percentage (%) |
| Aggregation | 58.1 |
| Lookup | 33.2 |
| Comparison | 1.6 |
| Table Structure | 6.9 |
| Benchmark | Cross lingual | QA Language | Visual Language | Table Focus |
| Tabular VQA: | ||||
| DocVQA | ✗ | English | English | Partial |
| TableVQA-B | ✗ | English | English | ✓ |
| TabComp | ✗ | English | English | ✓ |
| ComTQA | ✗ | English | English | ✓ |
| XT-VQA | ✓ | (EN/FR/CH) | English | Partial |
| Aspect | Protocol Summary |
| Question types | Lookup, aggregation, comparison, structure |
| Avg. tokens per question | 7–10 (across languages) |
| Translation workflow | MT → human validation → consistency check |
| Discarded items | 3.1% (ambiguity, mistranslation) |
| Annotators | 3 (Bahasa), 4 validators (EN/HI/AR) |
| Question | Answer | Predicted answer | E |
| Which column has 4 points as its contents? | form of learning | day (hour) (j), weight of value | H |
| What is the most common type of disability in Indonesia? | mentally disabled | physical handicap, multiple.. | I |
| What is the unit of school that receives the l… | school | sekolah | T |
| What description is given from the falcon and eagle? | (all types of the family) | all species from the family | Ty |
| Which province has the highest number of persons with disabilities? | yogyakarta | west java, yogyakarta | P |
Table QA
Table question answering studies how AI systems retrieve, interpret, and reason over structured data to answer natural-language questions.
See all 66 papers