Medical QA

QA: Question Answering

Overview

Medical question answering studies how AI systems answer exam-style questions, patient inquiries, clinical queries, and multi-turn conversations, sometimes using records, images, or audio. Common approaches include retrieval-augmented generation, medical-domain fine-tuning, chain-of-thought and agent-based reasoning, and reinforcement learning with clinical rubrics. Evaluation uses multiple-choice and open-ended benchmarks such as MedQA, PubMedQA, and patient-query datasets, increasingly testing grounding, safety, calibration, multilingual ability, and performance across modalities. A central challenge is that gains on exams or automatic metrics do not guarantee accurate, unbiased, well-calibrated answers in real clinical settings, where uncertainty, missing context, and harmful errors matter.

Latest papers

CardsList

84 papers10 papers in the last four weeks, up 11% on the four weeks before. 0.1% of all new papers.

  1. MediHive: A Decentralized Agent Collective for Medical Reasoning

    Mar 28, 2026Xiaoyang Wang, Christopher C. YangMulti-Agent LLM SystemsMedical QA

  2. When Chain-of-Thought Backfires: Evaluating Prompt Sensitivity in Medical Language Models

    Mar 26, 2026Binesh Sadanandan, Vahid BehzadanPrompt SensitivityLLM Prompting

  3. Multi-Agent Reasoning with Consistency Verification Improves Uncertainty Calibration in Medical MCQA

    Mar 25, 2026John Ray B. MartinezUncertainty CalibrationMedical QA

  4. FDARxBench: Benchmarking Regulatory and Clinical Reasoning on FDA Generic Drug Assessment

    Mar 20, 2026Betty Xiong, Jillian Fisher, Benjamin Newman +5Document QAMedical QA

  5. Hypothesis-Conditioned Query Rewriting for Decision-Useful Retrieval

    Mar 19, 2026Hangeol Chang, Changsun Lee, Seungjoon Rho +2Retrieval-Augmented GenerationQuery Reformulation

  6. MedPriv-Bench: Benchmarking the Privacy-Utility Trade-off of Large Language Models in Medical Open-Ended Question Answering

    Mar 15, 2026Shaowei Guan, Yu Zhai, Hin Chi Kwok +5Privacy-Utility TradeoffPrivacy Leakage in Language Models

  7. ThReadMed-QA: A Multi-Turn Medical Dialogue Benchmark from Real Patient Questions

    Mar 11, 2026Monica Munnangi, Saiph SavageMedical QAMulti-Turn Dialogue Evaluation

  8. RAMoEA-QA: Hierarchical Specialization for Robust Respiratory Audio Question Answering

    Mar 6, 2026Gaia A. Bertolino, Yuwei Zhang, Tong Xia +2Audio QAMedical QA

  9. Agentic retrieval-augmented reasoning reshapes collective reliability under model variability in radiology question answering

    Mar 6, 2026Mina Farajiamiri, Jeta Sopa, Saba Afza +9LLM ReliabilityLLM Agent Reliability

  10. Who Judges the Judge? Evaluating LLM-as-a-Judge for French Medical open-ended QA

    Mar 4, 2026Ikram Belmadani, Oumaima El Khettari, Pacôme Constant dit Beaufils +2LLM-as-a-JudgeBias in LLM-as-a-Judge

  11. Evaluating Large Language Models' Responses to Sexual and Reproductive Health Queries in Nepali

    Mar 4, 2026Medha Sharma, Supriya Khadka, Udit Chandra Aryal +15Language Model Safety EvaluationMedical QA

  12. PanCanBench: A Comprehensive Benchmark for Evaluating Large Language Models in Pancreatic Oncology

    Mar 2, 2026Yimin Zhao, Sheela R. Damle, Simone E. Dekker +13Clinical Language Model EvaluationMedical QA

  13. When Metrics Disagree: Automatic Similarity vs. LLM-as-a-Judge for Clinical Dialogue Evaluation

    Feb 27, 2026Bian Sun, Zhenjian Wang, Orvill de la Torre +1Clinical Language Model EvaluationGenerative AI Evaluation

  14. MediX-R1: Open Ended Medical Reinforcement Learning

    Feb 26, 2026Sahal Shaji Mullappilly, Mohammed Irfan Kurpath, Omair Mohamed +5RL for VLMsMedical VLMs

  15. Assessing Large Language Models for Medical QA: Zero-Shot and LLM-as-a-Judge Evaluation

    Feb 16, 2026Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham +2Medical QAMedical LLMs

  16. RA-QA: A Benchmarking System for Respiratory Audio Question Answering Under Real-World Heterogeneity

    Feb 4, 2026Gaia A. Bertolino, Yuwei Zhang, Tong Xia +2Audio-Language Model EvaluationAudio QA

  17. Safety boundary maintenance in consumer AI systems responding to pediatric health queries: a cross-platform benchmark evaluation under naturalistic and adversarially pressured conditions

    Dec 26, 2025Vahideh Zolfaghari, Leila Mashhadi, Mitra Ahadi +2HealthcareLLM Safety

  18. Multilingual Medical Reasoning for Question Answering with Large Language Models

    Dec 5, 2025Pietro Ferrazzi, Aitor Soroa, Rodrigo AgerriKnowledge Augmentation for Language ModelsHealthcare

  19. RPRO: Ranked Preference Reinforcement Optimization for Enhancing Medical QA and Diagnostic Reasoning

    Aug 31, 2025Chia-Hsuan Hsu, Jun-En Ding, Hsin-Ling Hsu +5Medical LLMsMedical QA

  20. Few shot chain-of-thought driven reasoning to prompt LLMs for open ended medical question answering

    Mar 7, 2024Saeel Sandeep Nachane, Ojas Gramopadhye, Prateek Chanda +5HealthcareMedical Diagnosis