cs.CVNov 17, 2026

MI-Hyper: Generating Multiple Instance Models for Weight Space Transfer Learning in Histopathology via Mixed Tasks Pretrained HyperNetwork

Authors: Xitong Ling, Yousef Kotp, Weiming Chen, Yining Li, Jiawen Li, Minxi Ouyang, Xinyi Guo, Mingxi Fu, 

Organizations: Shenzhen International Graduate School, Tsinghua University · Concordia University, Montréal, Canada · South China Normal University

Abstract

Zero-shot whole-slide image (WSI) prediction aims to generalize to new pathology tasks without parameter updates at deployment. MI-Zero makes these predictions by pooling patch-text similarities. Conditional weight generation, combined with supervision from diverse pathology tasks, offers an alternative: learning to construct predictive rules from task descriptions. We introduce MI-Hyper, a hypernetwork pretrained across mixed tasks to generate the aggregation and classification weights of multiple instance learning (MIL) models. We first train the generator and a shared MIL basis jointly using source labels. We then freeze the basis and refine the generator. The generated task weights are reused across cases. Across 308 tasks from 52 pathology datasets, MI-Hyper improves mean AUC, balanced accuracy and macro-F1 over MI-Zero by 1.85, 1.17 and 0.57 percentage points, respectively. On some molecular prediction tasks, both AUC and balanced accuracy improve by more than 20 points. These results support task-conditioned weight generation as a promising approach to weight-space transfer for long-sequence modeling.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Initialization matters in few-shot adaptation of vision-language models for histopathological image classification

    Feb 21, 2026Pablo Meseguer, Rocío del Amor, Valery NaranjoHistopathology Image ClassificationVLM Adaptation

  2. TaxoMIL: Taxonomy-Constrained Learning for Hierarchical Whole Slide Image Analysis

    Jun 30, 2026Chaeyeon Lee, Khang Nguyen Quoc, Jinsol Song +3Computational PathologyHierarchical Classification

  3. Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models

    Jul 16, 2026Mingxi Fu, Jiawen Li, Renao Yan +4Multi-Teacher Knowledge DistillationMultiple Instance Learning