Adaptive Routing for Efficient Diffusion Transformer-Based PNI Prediction
Organizations: Seoul National University, Seoul, Republic of Korea · Kyung Hee University, Seoul, Republic of Korea · OUTTA, Seoul, Republic of Korea · Chung-Ang University, Seoul, Republic of Korea · Seoul National University School of Medicine, Seoul, Republic of Korea · Samsung Changwon Hospital, Changwon, Republic of Korea · Samsung Medical Center, Seoul, Republic of Korea · NVIDIA AI Technology Center, Taipei, Taiwan
Abstract
Perineural invasion (PNI) is a critical prognostic factor in cholangiocarcinoma. However, its preoperative prediction from magnetic resonance imaging (MRI) remains challenging due to subtle imaging features that extend beyond tumor boundaries into surrounding regions. Conventional convolutional neural networks are limited in capturing long-range spatial dependencies. Transformer-based architectures improve global modeling of volumetric MRI by aggregating spatially distributed contextual cues, yet capturing subtle and noise-sensitive patterns in peritumoral regions remains challenging. Diffusion-based classifiers offer an alternative formulation by leveraging denoising-based class scoring to better capture such subtle patterns. However, these approaches introduce substantial computational overhead due to the combination of transformer-based modeling and iterative denoising processes. To address these challenges, we formulate PNI prediction as a diffusion-based classification problem and implement the denoising network using a transformer-based representation. To improve computational efficiency, we introduce adaptive routing across attention heads, spatial tokens, and MLP width. Experimental results demonstrate that the proposed approach achieves an AUC of 0.731 with 257.57 GFLOPs.