Learning from high-resolution 2D images to reconstruct 3D microstructures
Organizations: Thermo Fisher Scientific, Bordeaux, 33800, France. · DTU Energy, Technical University of Denmark, Kgs. Lyngby, 2800, Denmark. · DTU Wind, Technical University of Denmark, Roskilde, 4000, Denmark. · Henry Royce Institute, Department of Materials, University of Manchester, Manchester, M13 9PL, United Kingdom.
Abstract
High-resolution three-dimensional (3D) microstructure characterization remains difficult to undertake at scale because volumetric imaging at the required spatial resolution is expensive, time-consuming or destructive. In many settings, however, fine-resolution two-dimensional (2D) imaging and lower-resolution volumetric measurements are both readily available. We introduce a Privileged Cross-modal Relational Distillation (PCRD) framework that leverages fine-resolution 2D observations during training to improve specimen-specific 3D reconstruction from lower-resolution volumetric imaging alone. We demonstrate PCRD on pultruded carbon fiber-reinforced polymer composites, using scanning electron microscopy as the privileged modality and micro-CT as the inference input. The framework transfers spatial organization by matching similarity distributions defined around corresponding spatial anchors in the teacher and student representations, avoiding direct alignment of heterogeneous feature vectors. In 2D cross-sectional reconstruction, PCRD improves mAP by 1.66 percentage points over direct micro-CT training. Independent 3D validation against high-resolution synchrotron X-ray CT data shows close agreement in fiber volume fraction, diameter and local spacing. The PCRD reconstruction matches 89.97% of the reference fiber centerline length, compared with 75.08% for the interpolated low-resolution volume.
Figures & tables
| Method | mAP | [email protected] | [email protected] | Binary IoU |
|---|---|---|---|---|
| Direct training | ||||
| Prediction distillation | ||||
| Feature alignment | ||||
| Frequency decomposition | ||||
| Shared-private decomposition | ||||
| Cross-affinity distillation |
| Metric | HR reference | Interpolated LR | PCRD reconstruction |
|---|---|---|---|
| Fiber volume fraction (%) | 71.89 | 74.52 | 71.85 |
| Equivalent fiber diameter ( m) | 7.35 [6.93, 7.74] | – | 7.33 [7.08, 7.58] |
| Nearest-neighbor distance ( m) | 6.61 [6.20, 7.01] | – | 6.83 [6.48, 7.20] |
| Reference centerline coverage (%) | Ref. | 75.08 | 89.97 |
| Centerline position deviation ( m) | Ref. | 0.77 [0.44, 1.32] | 0.98 [0.63, 1.52] |
| Orientation deviation ( ∘ ) | Ref. | 0.78 [0.00, 2.49] | 1.12 [0.00, 2.49] |
3D Reconstruction
3D reconstruction recovers a scene’s shape, appearance, and camera motion from images, video, depth, or other sensor measurements.
See all 1,017 papers