cs.CVJul 18, 2026

Transferable Low-Rank Convolutional Bases for Onboarding Unseen Medical Imaging Modalities

Authors: Ranat Das PrangonIstiaque AhmedShajid Hasan NaimWaseem Mustak ZisanHossain Md Shakhawat

Organizations: Dept. of Chemical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, Bangladesh. · Graduate School of Informatics, Osaka Metropolitan University, Osaka, Japan. · Dept. of Mechanical Engineering, Chittagong University of Engineering and Technology (CUET), Chattogram, Bangladesh. · Dept. of Computer Science and Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, Bangladesh. · School of Informatics, Kochi University of Technology, Kami, Kochi 782-8502, Japan.

Abstract

Deploying a medical imaging model that must later accommodate a modality it has never seen is a recurring practical problem: retraining the shared representation is expensive and destroys performance on the modalities already in service. We study this \emph{onboarding} problem under a strict leave-one-domain-out protocol, in which a convolutional backbone is pre-trained on source modalities (Kidney CT and Brain MRI), frozen permanently, and then required to accommodate an unseen modality (Chest X-ray). Under this protocol we establish three findings. First, decision-layer parameter-efficient fine-tuning is insufficient when the backbone has never observed the target modality: a linear probe and fully-connected LoRA both fall well short, whereas convolutional LoRA recovers most of the achievable accuracy, showing that adaptation must reach the convolutional features. Second, and centrally, the low-rank convolutional \emph{basis} learned on the source modalities \emph{transfers}: freezing that basis and training only its up-projections onboards the unseen modality using just 0.78%0.78\% of full fine-tuning's parameters, at an accuracy 6.116.11 percentage points above a random basis of identical size, while an equivalent decision-layer basis exhibits no reliable transfer. Third, adapter-based onboarding leaves source-modality accuracy exactly unchanged (Δ=0.00Δ= 0.00 pp), whereas full fine-tuning reaches the highest target accuracy only by catastrophically degrading the source modalities. A Mahalanobis score on frozen backbone features detects the unseen modality with high sensitivity at a strict source-retention threshold, providing a practical trigger for when onboarding is required. All results are reported over three seeds with paired bootstrap confidence intervals.

Explore similar work

CardsList
  1. LARGO: Low-Rank Hypernetwork for Handling Missing Modalities

    May 7, 2026Niels Vyncke, Pooya Ashtari, Aleksandra PižuricaMissing ModalitiesMedical Imaging

  2. MultiMedVision: Multi-Modal Medical Vision Framework

    May 9, 2026Frank Li, Bardia Khosravi, Mohammadreza Chavoshi +5Medical ImagingMultimodal Clinical Data