eess.IVNov 12, 2026

A thorough review on Deep Learning approaches to 2D-to-3D Registration in Medical Imaging

Authors: Andrea Borghesi, Julia van Beurden, Maarten van Alphen, Michiel van den Brekel, Luc Karssemakers, Jan-Jakob Sonke, Baris Karakullukcu, Jonas Teuwen, 

Abstract

2D-to-3D image registration is a key component for several medical imaging purposes such as intraoperative guidance, enabling the alignment between preoperative 3D volumes and real-time 2D images. While conventional optimisation-based methods often struggle with non-convex objectives, sensitivity to initialisation, and high computational demands, deep learning (DL) has emerged as a promising alternative, offering improved alignment robustness and the potential for real-time performance. This review provides a comprehensive analysis of DL frameworks developed to address the challenges inherent in 2D-to-3D registration. We first outline how core concepts of DL are adapted to the registration problem. We then examine recent methodological advancements from multiple perspectives, including pipeline design, architectural innovations, and domain adaptation strategies. Particular attention is given to quantitative metrics, highlighting how performance is defined and measured across studies. Across the 41 included studies, we find that direct regression is the most common pipeline (23 studies, against 18 iterative ones), that hybrid CNN-attention architectures are gaining ground, and that research remains heavily concentrated on X-ray-to-CT registration. We conclude by identifying the absence of per-case uncertainty estimation and the strong neglect of temporal or sequential modelling as the two methodological gaps most consequential for clinical readiness, and discuss state-space models as a way to add temporal memory within intraoperative latency budgets. Further opportunities lie in more principled domain adaptation and in the integration of foundation models for representation learning.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LayersReg: A Layer-by-Layer Progressive Regressor for Reliable Intraoperative 3D/2D Registration

    Jun 25, 2026Xiyuan Wang, Zhenchao Wang, Xinran Chen +3Medical Image RegistrationCross-Modal Image Registration

  2. Effective Feature Learning for 3D Medical Registration via Domain-Specialized DINO Pretraining

    Mar 14, 2026Eytan Kats, Mattias P. HeinrichMedical Image RegistrationDeformable Image Registration

  3. Really Need Recursion? Revisiting One-pass Registration with Multi-level Multi-space Contextual Guidance

    Oct 15, 2026Yue Lin, Shenghai Wu, Mingyuan MengMedical Image RegistrationDeformable Image Registration