cs.CVNov 13, 2026

Scaling Channel-Adaptive Self-Supervised Learning

Authors: Alice V. De Lorenci, Seungeun Yi, Theo Moutakanni, Piotr Bojanowski, Camille Couprie, Juan C. Caicedo, Wolfgang M. Pernice

Organizations: University of São Paulo, Brasil (Work done during an internship at FAIR, Meta.) · Meta FAIR Paris, France · University of Wisconsin–Madison, USA · Columbia University, New York, USA

Abstract

Recent advances in self-supervised pre-training of foundation models for natural images have made them a popular choice for various visual systems and applications. Self-supervised strategies are also promising in non-RGB scientific imaging domains such as in biology, medical and satellite imagery, but their broader application is hampered by heterogeneity in channel composition and semantics between relevant datasets: two datasets may contain different numbers of channels, and these may reveal distinct aspects of an object or scene. Recent works on channel adaptive strategies report substantial advantages for those that account for variable channel compositions without sacrificing the ability to jointly encode channels; yet, how these strategies behave at scale remains unclear. We here show that, surprisingly, trained across large-scale datasets, independent-encoding of channels outperforms joint-encoding methods by a substantial margin. We validate this result along an extensive set of experiments on various datasets from cell microscopy to geospatial imagery. Our DINO BoC approach sets a new state-of-the-art across challenging benchmarks, including generalization to out-of-distribution tasks and unseen channel combinations. We open-source code and model weights for a new general-purpose feature extractor for fluorescent microscopy.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ChanSFormer: A Channel Agnostic Vision Transformer for Multi-Channel Cell Painting Images

    Nov 4, 2026Jingwei Zhang, Srinivasan Sivanandan, Dimitris SamarasVision TransformerEfficient ViTs

  2. Using Deep Learning Models Pretrained by Self-Supervised Learning for Protein Localization

    Apr 13, 2026Ben Isselmann, Dilara Göksu, Heinz Neumann +1Supervised Fine-TuningSelf-Supervised Pre-Training

  3. One-Shot Adaptive Segmentation For Scientific Images

    Oct 7, 2026Tejaswi V. Panchagnula, Allison M. Davis, Fengqing ZhuImage SegmentationVision Foundation Model Adaptation