BiST: A Gold Standard Bangla-English Bilingual Corpus for Sentence Structure and Tense Classification with Inter-Annotator Agreement
Organizations: Department of Computer Science and Engineering, Khulna University of Engineering & Technology · Department of Computer Science, Kennesaw State University, United States
Abstract
High-quality bilingual resources remain a critical bottleneck for advancing multilingual NLP in low-resource settings, particularly for Bangla. To mitigate this gap, we introduce BiST, a rigorously curated Bangla-English corpus for sentence-level grammatical classification, annotated across two fundamental dimensions: syntactic structure (Simple, Complex, Compound, Complex-Compound) and tense (Present, Past, Future). The corpus is compiled from open-licensed encyclopedic sources and naturally composed conversational text, followed by systematic preprocessing and automated language identification, resulting in 30,534 sentences, including 17,465 English and 13,069 Bangla instances. Annotation quality is ensured through a multi-stage framework with three independent annotators and dimension-wise Fleiss Kappa () agreement, yielding reliable and reproducible labels with values of 0.82 and 0.88 for structural and temporal annotation, respectively. Statistical analyses demonstrate realistic structural and temporal distributions, while baseline evaluations show that dual-encoder architectures leveraging complementary language-specific representations consistently outperform strong multilingual encoders. Beyond benchmarking, BiST provides explicit linguistic supervision that supports grammatical modeling tasks, including controlled text generation, automated feedback generation, and cross-lingual representation learning. The corpus establishes a unified resource for bilingual grammatical modeling and facilitates linguistically grounded multilingual research.
Figures & tables
| Attribute | Description and possible values | Example |
|---|---|---|
| Sentence | The full Bangla or English sentence collected from raw sources. Each sentence occupies one row. | \fontspec_if_script:nTF beng \addfontfeature Script=Bengali \fontspec_if_language:nTF BEN \addfontfeature Language=Bengali১৯৫২ সালের ২১শে ফেব্রুয়ারিতে এই আন্দোলন চূড়ান্ত রূপ ধারণ করলেও বস্তুত এর বীজ রোপিত হয়েছিল বহু আগে; অন্যদিকে এর প্রতিক্রিয়া এবং ফলাফল ছিল সুদূরপ্রসারী। (Although this movement took its final form on February 21, 1952, its seeds were actually planted much earlier; on the other hand, its reactions and consequences were far-reaching.) |
| Language | Indicates the language of the sentence (English/Bangla). | Bangla |
| Structure | The grammatical sentence structure, determined by clause composition. Possible values include: Simple, Complex, Compound, and Complex-compound. | Complex-compound |
| Tense | The primary tense expressed in the sentence. Includes major tense categories such as Present, Past, and Future. | Past |
| Approach | Model | Tense | Structure | ||||
|---|---|---|---|---|---|---|---|
| Acc | F1 | AUC | Acc | F1 | AUC | ||
| Multilingual Encoders | mBERT | 0.85 | 0.83 | 0.90 | 0.83 | 0.80 | 0.88 |
| XLM-R | 0.87 | 0.85 | 0.91 | 0.84 | 0.81 | 0.89 | |
| Dual Encoders | BERT + BanglaBERTBase | 0.87 | 0.85 | 0.91 | 0.85 | 0.82 | 0.89 |
| BERT + BanglishBERT | 0.89 | 0.87 | 0.92 | 0.87 | 0.84 | 0.90 | |
| DistilBERT + BanglaBERTBase | 0.84 | 0.82 | 0.89 | 0.84 | 0.81 | 0.88 | |
Low-Resource Language Processing
Low-resource language processing builds and evaluates language technologies for languages with limited data, tools, or digital representation.
See all 548 papers