cs.CVOct 21, 2026

Reading the Mask: Descriptor-Grounded BI-RADS Rationale Generation for Breast MRI Segmentation

Authors: Hrishikesh Singh, Aarti Sharma, Divyanshu Kumar, Millie Pant

Organizations: Department of Applied Mathematics and Scientific Computing, Indian Institute of Technology Roorkee, Roorkee, India · Indian Institute of Technology Madras, Chennai, India · Also with Mehta Family School of Data Science and Artificial Intelligence, Indian Institute of Technology Roorkee.

Abstract

Deep learning based models accurately delineate tumours on dynamic contrast-enhanced MRI (DCE-MRI), but segmentation masks alone do not provide the rationales or reasoning used by radiologists to assess the lesion suspicion. This limits the explainability as well the clinical integration. We investigate whether clinically relevant descriptors can instead be derived from the segmentation masks and their dynamic contrast-enhancement series. We have used Breast Imaging Reporting and Data System (BI-RADS) guidelines as a structured framework. Using these guidelines we designed a BI-RADS decision tree with eight quantitative measurements using radiomics, together with the lesion size and component count, that determine the descriptors at eight nodes. Using these descriptors we generate natural-language rationale using a large language model. The model was constrained to express only the derived records from the decision tree. After applying this framework to the expert and automatic masks of each of the 1,506 cases in the MAMA-MIA dataset, we generated a reproducible corpus of 3,012 BI-RADS grounded rationales. We obtained a faithfulness score of 99.98% and a counterfactual accuracy of 99.3%, indicating that the generated rationales faithfully verbalises the measured descriptors and correctly reflects changes in the underlying record. Agreement between the descriptors from expert and automatic masks falls from 0.832 to 0.549 as mask quality falls from Good to Missed. The generated rationales are intended as draft representations for radiologist review and final sign-off rather than autonomous clinical reports.

Figures & tables

Explore similar work

CardsList
  1. From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography

    Sep 13, 2026Ali Abbasian Ardakani, Afshin Mohammadi, Taha Yusuf Kuzan +11Medical VLMsMammography Image Classification

  2. A Concept-informed Interpretable Artificial Intelligence Framework for Breast Ultrasound Diagnosis

    Oct 12, 2026Shengzhou Zhong, Ziying Wang, Liang Li +14Clinical Decision SupportExplainable Medical Image Analysis

  3. RadiomicNet: A Hybrid Radiomics-Guided Lightweight Architecture for Interpretable Medical Image Segmentation

    Jul 2, 2026Mohammad Amanour RahmanUltrasound Image SegmentationMedical Image Segmentation