cs.CVAug 25, 2026

Boot-and-Feedback Framework for Generalist-Expert Model Collaboration in Breast Ultrasound Diagnosis

Authors: Ming Cheng, Hongyu Sun, Zhaolin Chen, Jun Liu, Hossein Rahmani, Qiuhong Ke

Organizations: Department of Data Science & AI, Monash University, Australia · Department of Computer Science, Renmin University of China, China · School of Computing and Communications, Lancaster University, UK

Abstract

Breast ultrasound (BUS) is widely used for breast cancer diagnosis yet remains operator-dependent. While deep learning shows promise, ensuring diagnostic reliability and interpretability is challenging. Recent Multimodal Large Language Models (MLLMs) often generate spurious descriptions due to limited domain knowledge, which mislead downstream expert models and compromise clinical validity. To address these challenges, we propose the Boot-and-Feedback (BooF) model collaboration framework for synergistic MLLM-expert interaction. Specifically, in the Boot Stage, the MLLM is guided by the BI-RADS lexicon and preliminary benign-malignant vision-expert predictions, enabling it to transfer general reasoning to BUS analysis while avoiding hallucinations. Subsequently, the Feedback Stage integrates these descriptions with visual features via a lightweight Attention-Gated Cross-Modality Fusion Module. This allows the expert to leverage textual feedback while adaptively filtering noise. Extensive experiments on multiple BUS datasets demonstrate that BooF substantially outperforms state-of-the-art methods in terms of diagnostic accuracy and interpretability.

Figures & tables

Explore similar work

CardsList
  1. A Concept-informed Interpretable Artificial Intelligence Framework for Breast Ultrasound Diagnosis

    Oct 12, 2026Shengzhou Zhong, Ziying Wang, Liang Li +14Clinical Decision SupportExplainable Medical Image Analysis

  2. Latent-CURE for Breast Cancer Diagnosis

    Jun 29, 2026Weiyi Zhao, Xiaoyu Tan, Lu Gan +2Breast CancerLong-Tail Learning