cs.AINov 17, 2026

MedGuardBench: A Patient-Oriented Benchmark for Personalized Guardrail Development

Authors: Sara Khosravi, Xiaofei Wen, Majid Sarrafzadeh, Muhao Chen

Organizations: University of California, Los Angeles · University of California, Davis

Abstract

Safety is personal: the same action can be safe for one person but unsafe for another. Yet current guardrails judge content without considering who is affected. Using medication safety, we introduce patient-conditioned medication guarding, which predicts a safety verdict and 17 risk categories from a patient profile and prescription. We release MedGuardBench, a drug-disjoint benchmark of 5{,}001 scenarios across 87 medications. We find that standard guardrails rely on surface cues, such as wording and profile presence, rather than patient facts. To address this, we develop personalized reasoning guardrails with three components. Personalized Reasoning Distillation links risks to relevant patient fields. Context Unrolling (CU) makes models check each field themselves, reducing false alarms on most backbones; controls show that providing the check does not yield the same benefit. A rule-based reward (guided GRPO) improves unsafe recall and complex-risk detection, including allergies and adverse reactions, on some backbones, but increases false alarms on others. Our models outperform base models and matched no-profile controls in accuracy, while reducing false alarms relative to no-profile controls. Profile removal and swapping confirm that gains come from patient information, not fine-tuning alone.

Figures & tables

Appendix figures & tables16 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Evaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning

    Aug 4, 2026Zhitian Hou, Yuhang Liu, Pengkai Wang +8Counterfactual EvaluationHealthcare

  2. SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation

    May 27, 2026Xinyu Wang, Hanwei Wu, Zhenghan Tai +7Medication RecommendationMulti-Agent LLM Systems

  3. When Medical Safety Alignment Fails: A Benchmark for Evaluating LLMs on High-Risk Medical Queries

    May 26, 2026Yige Li, Jun Sun, Wei Zhao +5LLM Safety BenchmarksHealthcare