Organizations: ECE Department, UCLA, 405 Hilgard Ave., Los Angeles, California 90095, USA · Pinpoint Photonics, Inc., 803 Marine Bldg., 4-23 Kaigan-dori, Naka, Yokohama 231-0002, Japan · Adventure Photonics, 889 N. Douglas Ave, El Segundo, California 90245, USA
Deep learning has achieved remarkable success in medical image analysis, yet its performance remains highly sensitive to the heterogeneity of clinical data. Differences in imaging hardware, staining protocols, and acquisition conditions produce substantial domain shifts that degrade model generalization across institutions. Here we present a physics-based data preprocessing framework based on the PhyCV (Physics-Inspired Computer Vision) family of algorithms, which standardizes medical images through deterministic transformations derived from optical physics. The framework models images as spatially varying optical fields that undergo a virtual diffractive propagation followed by coherent phase detection. This process suppresses non-semantic variability such as color and illumination differences while preserving diagnostically relevant texture and structural features. When applied to histopathological images from the Camelyon17-WILDS benchmark, PhyCV preprocessing improves out-of-distribution breast-cancer classification accuracy from 70.8% (Empirical Risk Minimization baseline) to 90.9%, matching or exceeding data-augmentation and domain-generalization approaches at negligible computational cost. Because the transform is physically interpretable, parameterizable, and differentiable, it can be deployed as a fixed preprocessing stage or integrated into end-to-end learning. These results establish PhyCV as a generalizable data refinery for medical imaging-one that harmonizes heterogeneous datasets through first-principles physics, improving robustness, interpretability, and reproducibility in clinical AI systems.
Figures & tables
Figure 1: Examples of physics-inspired computer vision algorithms in PhyCV. The PhyCV framework includes modules for diverse imaging tasks: super-resolution (PhSAR) enhances structural detail in low-resolution MRI scans; edge and orientation extraction (PAGE) reveals vascular and textural organization in retinal imagery; and exposure enhancement (VEViD) restores visibility in low-contrast microscopy images. Together, these algorithms demonstrate the versatility of physics-based models for image refinement and feature extraction across modalities.
Figure 2: Conceptual overview of PhyCV for data refinement and standardization. During training (top), heterogeneous data from multiple hospitals are refined into standardized feature representations before being used to train a neural network. During inference (bottom), unseen data undergo the same refinement to ensure consistent predictions.
Figure 3: PhyCV improves robustness under non-uniform illumination. Top: Non-uniform illumination is studied by considering 6 levels of illumination (linear) on a single induced pluripotent stem cell (iPS) test image picture from [ 16 ] . For each of the 6 illumination levels, center region is used for texture analysis. Bottom: corresponding image entropy showing that PhyCV maintains information content even under severe illumination degradation. When information is fully lost in the case of image 6, there is a noteacble loss in the PhyCV output, demonstrating that it can act as a delineator for defective or untrustworthy images.
Figure 4: Cross-institutional variability and PhyCV-based refinement. Example histopathology patches from five hospitals showing differences in staining and contrast (top). After PhyCV refinement (bottom), features are standardized, enhancing consistency across sites while preserving tissue structure.
Method
OOD Validation
OOD Test
ERM (baseline)
85.8(1.9)
70.8(7.2)
PAIR
84.3(1.6)
74.0(7.2)
Fish
83.9(1.2)
74.7(7.1)
LISA
81.8(1.2)
77.1(6.9)
ERM + target augmentation
92.7(0.7)
92.1(3.1)
ContriMix
91.9(0.7)
94.6(1.2)
Table 1: Out-of-distribution classification accuracy (%) on the Camelyon17-WILDS dataset. Mean ± standard deviation computed across 10 random seeds. All methods use the same network (DenseNet-121) and data split for fair comparison.