eess.IVNov 18, 2023

Structure-Aware Sparse-View X-ray 3D Reconstruction

Authors: Yuanhao Cai, Jiahao Wang, Alan Yuille, Zongwei Zhou, Angtian Wang

Organizations: Johns Hopkins University

Abstract

X-ray, known for its ability to reveal internal structures of objects, is expected to provide richer information for 3D reconstruction than visible light. Yet, existing neural radiance fields (NeRF) algorithms overlook this important nature of X-ray, leading to their limitations in capturing structural contents of imaged objects. In this paper, we propose a framework, Structure-Aware X-ray Neural Radiodensity Fields (SAX-NeRF), for sparse-view X-ray 3D reconstruction. Firstly, we design a Line Segment-based Transformer (Lineformer) as the backbone of SAX-NeRF. Linefomer captures internal structures of objects in 3D space by modeling the dependencies within each line segment of an X-ray. Secondly, we present a Masked Local-Global (MLG) ray sampling strategy to extract contextual and geometric information in 2D projection. Plus, we collect a larger-scale dataset X3D covering wider X-ray applications. Experiments on X3D show that SAX-NeRF surpasses previous NeRF-based methods by 12.56 and 2.49 dB on novel view synthesis and CT reconstruction. Code, models, and data are released at https://github.com/caiyuanhao1998/SAX-NeRF . Our project page at https://caiyuanhao1998.github.io/project/SAX-NeRF/ shows more video and interactive results. An online Gradio demo is available on HuggingFace at https://huggingface.co/spaces/CaiYuanhao/SAX-NeRF

Figures & tables

Explore similar work

CardsList
  1. OX-NeRF: 3D X-ray Tomography Reconstruction from Sparse Views Using Implicit Neural Representation

    Oct 8, 2026Thomas Welsch, Min-Hsin Tu, David J. Chapman +1Sparse-View CT ReconstructionNeural Radiance Fields

  2. Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis

    Mar 7, 2024Yuanhao Cai, Yixun Liang, Jiahao Wang +5Novel View SynthesisGaussian Splatting

  3. Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction

    Sep 9, 2026Pranav Poudel, Florence Dell'Aniello Picard, Nairouz Shehata +23D Gaussian Splatting3D Medical Imaging