A Severity-Based Curriculum Learning Strategy for Arabic Medical Text Generation
Organizations: October University for Modern Sciences & Arts, Egypt
Abstract
Arabic medical text generation is increasingly needed to help users interpret symptoms and access general health guidance in their native language. Nevertheless, many existing methods assume uniform importance across training samples, overlooking differences in clinical severity. This simplification can hinder the model's ability to properly capture complex or high-risk cases. To overcome this issue, this work introduces a Severity-based Curriculum Learning Strategy for Arabic Medical Text Generation, where the training process is structured to move gradually from less severe to more critical medical conditions. The approach divides the dataset into ordered stages based on severity and incrementally exposes the model to more challenging cases during fine-tuning, allowing it to first learn basic medical patterns before addressing more complex scenarios. The proposed method is evaluated on a subset of the Medical Arabic Question Answering (MAQA) dataset, which includes Arabic medical questions describing symptoms alongside corresponding responses. In addition, the dataset is annotated with three severity levels (Mild, Moderate, and Critical) using a rule-based method developed in this study. The results demonstrate that incorporating severity-aware curriculum learning leads to consistent performance improvements across all tested models, with gains of around +4% to +7% over baseline models and +3% to +6% compared with conventional fine-tuning approaches.
Figures & tables
| Question | Answer | Severity |
|---|---|---|
| ورم في ارقبه كيف اتعامل معه هل يستدعي جراحه | علي حسب مكانه ونوعه روح لطبيب اورام | حرج |
| A neck lump, how should I deal with it? Does it require surgery? | It depends on its location and type; consult an oncologist. | Critical |
| اعاني من انتفاخ الخد نتيجه التورم اللثه بسبب تسوس الاسنان الماميه | يحتاج الامر لعلاج بمضاد حيوي وعمل علاج عصب | غير حرج |
| I suffer from cheek swelling due to gum inflammation caused by front tooth decay. | The condition requires antibiotic treatment and a root canal procedure. | Mild |
| دايما احس بالم في الصدر من الجهه اليسار فوق الثدي | امرض القلب لاتعاطي الم مستمر ودائم احتمال يكون عندك شد عضلي اي تقلص في عضلات الصدر راجعي اي طبيب للفحص عليك | متوسط |
| I always feel pain in the left side of my chest above the breast. | Heart diseases do not usually cause constant pain; it may be a muscular strain. Consult a doctor for examination. | Moderate |
| Model | Baseline | Standard Fine-Tuning | Curriculum Learning |
|---|---|---|---|
| AraGPT2-Base | 54.04% | 59.71% | 63.21% |
| AraGPT2-Medium | 59.16% | 60.14% | 64.38% |
| Bloomz-560M | 63.59% | 63.65% | 65.57% |
| Al-Atlas-0.5B | 61.03% | 61.52% | 65.65% |
| GPT2-Small-Arabic | 56.40% | 58.88% | 61.02% |
| LFM2-350M | 63.34% | 63.72% | 67.02% |
Text Generation
Text generation studies methods for producing coherent, useful language from prompts, data, and dialogue context.
See all 410 papers