PR3DICTR: A modular AI framework for medical 3D image-based detection and outcome prediction
Organizations: Department of Radiation Oncology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
Abstract
Three-dimensional medical image data and computer-aided decision making, particularly using deep learning, are becoming increasingly important in the medical field. To aid in these developments we introduce PR3DICTR: Platform for Research in 3D Image Classification and sTandardised tRaining. Built using community-standard distributions (PyTorch and MONAI), PR3DICTR provides an open-access, flexible and convenient framework for prediction model development, with an explicit focus on classification using three-dimensional medical image data. By combining modular design principles and standardization, it aims to alleviate developmental burden whilst retaining adjustability. It provides users with a wealth of pre-established functionality, for instance in model architecture design options, hyper-parameter solutions and training methodologies, but still gives users the opportunity and freedom to ``plug in'' their own solutions or modules. PR3DICTR can be applied to any binary or event-based three-dimensional classification task and can work with as little as two lines of code.
Figures & tables
| Type | Options | Notes |
|---|---|---|
| Image modalities | CT | Standard planning or diagnostic CT used as anatomical input. |
| PET | Functional metabolic imaging; often co-registered with CT. | |
| Radiation dose | 3D dose distribution map, used in radiotherapy settings. | |
| Segmentations | Binary or multi-class masks for organs or targets; used as additional spatial priors. | |
| MRI | Multi-sequence (T1, T2, etc.) structural or functional MRI. | |
| Other | Any additional volumetric image (e.g. perfusion, ADC, or synthetic images) can be added to the PR3DICTR framework. |