DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengali
Organizations: Bangladesh University of Engineering and Technology (BUET)
Abstract
Reliable medical conversational AI requires authentic expert--patient interaction data, yet such datasets remain scarce, especially for low-resource languages such as Bengali. We present DocTalkBN, a large-scale multimodal dataset of real-world expert telemedicine conversations in Bengali, collected from nationally broadcast telemedicine programs featuring board-certified physicians. DocTalkBN contains 557.63 hours of paired audio and text, 1,515 multi-turn patient calls, 10,274 host--doctor question--answer exchanges, totaling 1.7M tokens, spanning 26 medical specialties. Unlike prior resources derived from medical forums, written health content, or synthetic data, our dataset preserves the spontaneity, contextual richness, and spoken characteristics of authentic medical interactions in a low-resource setting. To support benchmark-driven research, we further construct three downstream tasks from the corpus, medical triage classification, advice safety evaluation, and medical named entity recognition, and benchmark a diverse set of large language models and encoder-based baselines. Our results show that DocTalkBN is a practically useful resource, particularly for clinically grounded reasoning tasks. We release this resource to facilitate future research on reliable medical NLP and safer, more culturally grounded healthcare systems for low-resource languages. Our source codes and dataset are publicly available at https://anonymous.4open.science/r/doctalk.
Figures & tables
| Dataset Name | Source Type | Language | #Dialogues | #Utterances | #Diseases | Department |
|---|---|---|---|---|---|---|
| MZ Wei et al. (2018) | Online Text | Chinese | 710 | - | 4 | Pediatrics |
| DX Xu et al. (2019) | Online Text | Chinese | 527 | 2,186 | 5 | Pediatrics |
| CMDD Lin et al. (2019) | Medical Forum | Chinese | 2,067 | 87,005 | 4 | Pediatrics |
| MedDG Liu et al. (2022) | Online Text | Chinese | 17,864 | 385,951 | 12 | Gastroenterology |
| MedDialog-CN Pal and others (2020) | Online Text | Chinese | 3,407,494 | 11,260,564 | 172 | 51 Departments |
| RealMedDial Xu et al. (2022) | Video Clips | Chinese | 2,637 | 24,255 | 55 | 17 Departments |
| Overall Dataset Statistics | |
|---|---|
| Dataset Duration (Hours) | 557.63 |
| Unique Medical Specialties | 26 |
| Patient Calls Proportion (%) | 12.9 |
| Host-Doctor QA Proportion (%) | 87.1 |
| Patient-Doctor Calls | |
| Total Patient-Doctor Calls | 1,515 |
| Downstream Task | #Videos | Samples | Total Labels | Class | Count |
| Advice Safety | 1,744 | 8,689 | 29,957 | SAFE | 22,513 |
| HARM | 7,444 | ||||
| Medical NER | 1,842 | 11,239 | 105,697 | DIS | 31,680 |
| SYM | 23,385 | ||||
| ANA | 21,624 | ||||
| TRT | 13,802 |
| # Dialogues | 11,789 |
| # Utterances | 25,410 |
| # Tokens | 1,671,210 |
| Avg. # Utterances in a Dialogue | 2.16 |
| Max # Utterances in a Dialogue | 14 |
| Min # Utterances in a Dialogue | 1 |
| Avg. # Tokens in an Utterance | 65.8 |
| Model | Setting | Macro F1 |
|---|---|---|
| DeepSeek V3.2 | Zero-shot | 0.320 |
| DeepSeek V3.2 | Few-shot | 0.383 |
| Gemma 3 27B Instruct | Zero-shot | 0.412 |
| Gemma 3 27B Instruct | Few-shot | 0.422 |
| GPT-4o | Zero-shot | 0.425 |
| GPT-4o | Few-shot | 0.448 |
| Model | Setting | Macro F1 |
|---|---|---|
| DeepSeek V3.2 | Zero-shot | 0.937 |
| DeepSeek V3.2 | Few-shot | 0.949 |
| Gemma 3 27B Instruct | Zero-shot | 0.951 |
| Gemma 3 27B Instruct | Few-shot | 0.955 |
| GPT-4o | Zero-shot | 0.969 |
| GPT-4o | Few-shot | 0.976 |
| Model | Setting | Strict F1 (Macro Avg.) |
|---|---|---|
| BanglaBERT | Fine-tuned | 0.742 |
| mmBERT | Fine-tuned | 0.707 |
| DeepSeek V3.2 | Zero-shot | 0.694 |
| Gemma 3 27B Instruct | Zero-shot | 0.585 |
| GPT-4o | Zero-shot | 0.581 |
| GPT-4o | Few-shot | 0.575 |
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameter | BanglaBERT | mMBERT |
| Learning rate | ||
| Epochs | 100 | 100 |
| Train batch size | 8 | 4 |
| Evaluation batch size | 16 | 8 |
| Gradient accumulation | 2 | 4 |
| Warmup steps | 200 | 200 |
Clinical NLP
Clinical natural language processing (NLP) develops methods to extract, interpret, and generate information from healthcare text and conversations.
See all 142 papers