Raysemble: Metric 3D Bone Reconstruction from a Single X-ray
Organizations: ORBIT Lab, College of Medicine and Biomedical Information Engineering, Northeastern University, Shenyang 110016, China · The John Curtin School of Medical Research, College of Science and Medicine, Australian National University, Canberra 2601, Australia
Abstract
Raysemble reconstructs eight lumbar and pelvic bones from a single X-ray by separating shape and placement. Each 3D query samples regional and global features at its image projection. A shared decoder predicts normalized bone shapes. Predicted depth and camera geometry determine 3D centers and scales for resampling these shapes onto a common grid in millimeters. Evaluation uses 23 held-out patients with 43 CT scans, each generating one simulated anteroposterior radiograph. Without rigid alignment to CT,Raysemble leads 15 evaluated methods, averaging 65.24% Dice, 9.09 mm HD95, and 3.32 mm ASSD over three random seeds. With identical inputs, it improves Dice over VolumeNeRF by 5.86 percentage points.
Figures & tables
| Method | Params. (M) | Dice (%) | HD95 (mm) | ASSD (mm) |
|---|---|---|---|---|
| Broadcast U-Net | 36.35 | |||
| Henzler | 8.08 | |||
| PatRecon | 592.52 | |||
| XctNet | 33.94 | |||
| 3DDX-Direct | 142.54 | |||
| X2V | 153.39 |
| Metric | Mean gain | 95% CI | Improved |
|---|---|---|---|
| Dice (pp) | +5.86 | [3.35, 8.94] | 18/23 |
| HD95 (mm) | +10.55 | [5.34, 18.82] | 23/23 |
| ASSD (mm) | +2.44 | [1.37, 4.36] | 23/23 |
| Method | Dice (%) | HD95 (mm) | ASSD (mm) |
|---|---|---|---|
| Initial placement | |||
| Residual placement | |||
| Absolute placement | |||
| Shape stage | |||
| Raw, full frame | |||
| Raw, predicted ROI | |||
| Test group | Dice (%) | HD95 (mm) | ASSD (mm) |
|---|---|---|---|
| Before alignment | |||
| CT-TRI (14) | 57.39 / 63.68 | 24.03 / 9.53 | 6.63 / 3.50 |
| AbdomenCT-1K (9) | 62.49 / 67.66 | 12.80 / 8.40 | 4.42 / 3.05 |
| Rigid alignment without scaling | |||
| CT-TRI (14) | 60.63 / 72.85 | 19.87 / 7.02 | 5.73 / 2.54 |
| AbdomenCT-1K (9) | 66.39 / 74.71 | 11.12 / 6.85 | 3.92 / 2.42 |
3D Medical Imaging
3D medical imaging develops methods to analyze, reconstruct, and visualize volumetric scans such as CT, MRI, PET, and ultrasound.
See all 184 papers