cs.CVFeb 24, 2026

MIP Candy: A Modular PyTorch Framework for Medical Image Processing

Authors: Tianhao Fu, Yucheng Chen

Organizations: University of Toronto, Toronto, ON, Canada · Vector Institute, Toronto, ON, Canada · Project Neura, Toronto, ON, Canada · UTMIST, Toronto, ON, Canada · Amplimit, Toronto, ON, Canada

Abstract

Medical image processing demands specialized software that handles high-dimensional volumetric data, heterogeneous file formats, and domain-specific training procedures. Existing frameworks either provide low-level components that require substantial integration effort or impose rigid, monolithic pipelines that resist modification. We present MIP Candy (MIPCandy), a freely available, PyTorch-based framework designed specifically for medical image processing. MIPCandy provides a complete, modular pipeline spanning data loading, training, inference, and evaluation, allowing researchers to obtain a fully functional process workflow by implementing a single method, \texttt{build_network}, while retaining fine-grained control over every component. Central to the design is LayerT\texttt{LayerT}, a deferred configuration mechanism that enables runtime substitution of convolution, normalization, and activation modules without subclassing. The framework further offers built-in kk-fold cross-validation, dataset inspection with automatic region-of-interest detection, deep supervision, exponential moving average, multi-frontend experiment tracking (Weights & Biases, Notion, MLflow), training state recovery, and validation score prediction via quotient regression. An extensible bundle ecosystem provides pre-built model implementations that follow a consistent trainer--predictor pattern and integrate with the core framework without modification. MIPCandy is open-source under the Apache-2.0 license and requires Python~3.12 or later. Source code and documentation are available at https://github.com/ProjectNeura/MIPCandy.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms

    Jun 29, 2026Juntao Jiang, Jinsheng Bai, Linxuan Fan +3Medical Image Segmentation

  2. PR3DICTR: A modular AI framework for medical 3D image-based detection and outcome prediction

    Apr 3, 2026Daniel C. MacRae, Luuk van der Hoek, Robert van der Wal +5Medical Image Classification3D Medical Imaging

  3. Towards Fully Automated Medical Imaging Code Generation via Validation-based Context Engineering

    Aug 29, 2026Zixiao Zhao, Jing Sun, Zhe Hou +5LLM Code Generation