PRISMATIC : Prescription Risk Inspection System for Multi-Agent Treatment Interaction in Clinical Decision-Making
Organizations: University of Science and Technology of China, Hefei, China · The University of Texas Health Science Center at Houston, Houston, United States
Abstract
Medical prescribing errors for multimorbid patients, who require complex drug regimens, are a major patient safety concern. These errors often stem from fragmented decision-making across medical specialties, a critical coordination failure that leads to adverse drug events and rehospitalizations. To address this coordination challenge, we introduce PRISMATIC, a multi-agent architecture where specialized agents, each representing a workflow role, collaboratively generate and refine treatment plans. Operating on a blackboard architecture, the system first structures patient information from clinical notes, then iteratively develops safe, rational, and interpretable drug regimens. The agents' collaboration is governed by two novel adaptive coordination mechanisms: (1) Dynamic Self-Updating Weight Adjustment (DSWA), a long-term mechanism that adjusts the influence weights of agents based on historical case outcomes, enabling the system to adapt and trust more reliable specialists over time. (2) Discrepancy Feedback Precise Calibration (DFPC), a short-term mechanism where agents provide iterative feedback to resolve disagreements and eliminate prescription conflicts for the current patient. Experiments on patient records from the MIMIC-IV database show that PRISMATIC significantly reduces drug conflicts, improves prescription coverage, and enhances treatment consistency compared to strong LLM baselines. Our work demonstrates that structuring clinical co-treatment as a multi-agent coordination problem offers a promising path toward safer and more coherent multidisease management.
Figures & tables
PRISMATIC Prescription| Agent | Core Responsibility | Key Function in the Coordination Process |
|---|---|---|
| Information Analysis (IA) | Structure the Input | Establishes the common ground for collaboration by parsing raw clinical text (T) into a structured, shared representation (Chief Complaint ( CP ), Patient Information ( PI ) on the blackboard. |
| Prescription Generation (PG) | Propose a Solution | Acts as the primary reasoner. Synthesizes the structured information {CP, PI, OI} and contextual information from the blackboard to generate an initial candidate prescription ( ). The prescription is then iteratively negotiated with the SC, PR, and EA agents through the inner loop ( DFPC ), undergoing refinement based on their feedback until a consensus is reached. |
| Safety Check (SC) | Critique on Safety | Functions as a specialized critic targeting the Safety Objective. Verifies the candidate prescription against formal safety constraints ( DDI, DPI, Dosage ) 1 1 1 Formally, the safety checks correspond to satisfying the constraints: ; ; and ensuring dosage . and posts specific, actionable violations for collective resolution. |
| Pharm. Rationality (PR) | Critique on Rationality | Functions as a specialized critic targeting the Rationality Objective. Evaluates the prescription’s therapeutic Coverage and Duplication 2 2 2 The rationality objective is formalized as maximizing coverage, where ideally , s.t. while ensuring zero duplication, , for the same complaint. to ensure clinical efficacy and efficiency, posting its findings as feedback. |
| Evaluation Agent (EA) | Adjudicate & Decide | Serves as the coordinator and adjudicator of the inner loop. It aggregates critiques from SC and PR , assesses interpretability, and computes a unified score to decide whether to accept the prescription or trigger a refinement cycle via DFPC . |
| Reflection & Feedback (RF) | Drive Long-Term Learning | Functions as the organizational learning facilitator. It compares the final prescription to a gold standard to generate the discrepancy signal that drives the long-term adaptation of the entire system via the DSWA outer loop. |
| Complexity i(%) | Complexity ii(%) | Complexity iii(%) | Complete Dataset(%) | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | Model | OR | Prec. | EM | ZIR | OR | Prec. | EM | ZIR | OR | Prec. | EM | ZIR | OR | Prec. | EM | ZIR |
| Zero-Shot | GPT-4o | 45.87 | 51.89 | 4.08 | 95.24 | 35.20 | 36.89 | 2.37 | 93.01 | 15.35 | 19.35 | 0.34 | 81.47 | 29.11 | 25.72 | 2.05 | 89.13 |
| Qwen-3 | 41.12 | 44.46 | 4.01 | 95.31 | 32.45 | 38.90 | 0.99 | 92.40 | 16.09 | 20.12 | 0.43 | 81.80 | 21.56 | 28.78 | 1.60 | 89.08 | |
| DeepSeek-R1 | 47.23 | 48.06 | 10.20 | 94.43 | 39.13 | 37.02 | 1.27 | 93.06 | 17.89 | 14.01 | 0.43 | 78.74 | 31.48 | 25.20 | 3.39 | 87.87 | |
| LLaMA3.1 | 45.10 | 43.29 | 6.05 | 94.49 | 29.11 | 31.78 | 1.60 | 91.19 | 13.90 | 19.91 | 0.10 | 79.74 | 32.45 | 36.40 | 2.23 | 87.65 | |
| Few-Shot | GPT-4o | 44.23 | 58.91 | 7.27 | 95.92 | 29.09 | 31.98 | 1.38 | 93.06 | 19.89 | 20.11 | 0.29 | 86.78 | 31.61 | 29.09 | 2.57 | 91.40 |
| Component | OR | Prec. | EM | ZIR |
|---|---|---|---|---|
| w/o IA | 52.43 | 59.34 | 11.98 | 93.43 |
| w/o SC | 41.25 | 50.22 | 10.56 | 78.98 |
| w/o PR | 44.13 | 49.65 | 9.33 | 82.91 |
| w/o DSWA | 48.55 | 55.11 | 8.56 | 91.23 |
| w/o DFPC | 49.56 | 59.22 | 7.42 | 89.35 |
| w/o EA | 54.90 | 67.23 | 12.78 | 95.09 |