cs.CVSep 8, 2026

RxScribe Bench: A Multi-Axis Benchmark for Evaluating Vision-Language Models on Indian Outpatient Prescriptions

Authors: Somil, Vijay Saini, Vidit Verma, Riya, Aastha Batta, Vibhuti Malhotra, Chayan Khetan, Piyush Mittal, 

Organizations: Zstate AI

Abstract

Prescription transcription errors are not interchangeable. A model that fabricates a drug and a model that misreads a legible dose pose very different clinical risks, yet prescription-transcription accuracy is typically reported as a single blended figure that treats the two as equivalent. We introduce RxScribe Bench, a benchmark for evaluating vision-language models on handwritten prescription digitization that decomposes performance into four axes tied to clinical severity, rather than folding everything into a single aggregated score. Given only a prescription image and an output schema, a model produces a structured record, which is then compared field by field against a human-authored ground truth of identical shape, with each field also labeled for visibility and legibility. The four axes isolate distinct failure modes, namely Correctness, Hallucination, Engagement, and Robustness. The Robustness axis withholds its hard-field results rather than reporting one when the supporting sample falls below a minimum-evidence threshold. We evaluate frontier vision-language models on real prescriptions across independent cold runs per image, and find that no single model wins across all four axes.

Figures & tables

Explore similar work

CardsList
  1. RxEval: A Prescription-Level Benchmark for Evaluating LLM Medication Recommendation

    May 14, 2026Shuhao Chen, Weisen Jiang, Changmiao Wang +4Medication RecommendationHealthcare

  2. ReXInTheWild: A Unified Benchmark for Medical Photograph Understanding

    Mar 19, 2026Oishi Banerjee, Sung Eun Kim, Alexandra N. Willauer +9Medical VLMsMedical Image Benchmarks

  3. MedObvious: Exposing the Medical Moravec's Paradox in VLMs via Clinical Triage

    Mar 24, 2026Ufaq Khan, Umair Nawaz, L D M S S Teja +5VLM EvaluationMedical VLMs