cs.CVNov 16, 2026

Interpretable deep concepts of organoid morphology

Authors: Lion Jasper Gleiter, Tingying Peng

Organizations: Helmholtz Munich, Helmholtz AI, Neuherberg, Germany · Technical University of Munich, School of CIT, Munich, Germany

Abstract

Image-based classification of organoid morphologies can indicate drug response, viability, or successful differentiation. In recent work, learned representations outperform handcrafted features as the basis for downstream classifiers. However, their black-box nature hides the morphological cues a classifier relies on. Based on the foundation models DINOv3 (general-purpose) and ViTAMIn-O (organoid-specific), we train sparse autoencoders (SAEs) to learn interpretable concepts related to distinct organoid morphologies. We annotate concepts with spatial labels (organoid, organoid wall, background) and compute their dataset specificity and task relevance across five tasks. The spatial labels of DINOv3 concepts yield coarse organoid segmentations on out-of-domain datasets. Filtering concepts by spatial label in the DINOv3-SAE improves downstream AUROC for three of the five tasks. Qualitative analysis of the most relevant concepts further reveals a confounding factor introduced by our preprocessing in one task. Through such insights, interpretable concepts could help improve the reliability of classifiers and guide the future development of organoid representation models. The trained SAEs will be made available upon publication.

Figures & tables

Explore similar work

CardsList
  1. MorphoOrgaAgent: A Foundation-Model-Based Multi-Agent System for Autonomous Organoid Analysis

    Sep 8, 2026Hanyi Zhang, Maximilian Hoermann, Lion J. Gleiter +5Image SegmentationInstance Segmentation

  2. Sparse Autoencoders for Interpretable Medical Image Representation Learning

    Mar 24, 2026Philipp Wesp, Robbie Holland, Vasiliki Sideri-Lampretsa +1Medical Image RetrievalExplainable Medical Image Analysis

  3. Automatic Image-Level Morphological Trait Annotation for Organismal Images

    Apr 2, 2026Vardaan Pahuja, Samuel Stevens, Alyson East +2