cs.CVMar 2, 2025

SemICP: Semantic Non-Rigid Point Cloud Registration with Elastic Energy Regularization

Authors: Wanwen Chen, Qi Zeng, Carson Studders, Zongze Li, Jamie J. Y. Kwon, Tara Kemper, Emily H. T. Pang, Eitan Prisman, 

Organizations: Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada. · Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada. · School of Biomedical Engineering, University of British Columbia, Vancouver, BC, Canada.

Abstract

Purpose: Accurate point cloud registration is essential in computer-aided interventions (CAI) to align multi-modal medical images for intraoperative guidance. Classical methods, such as Iterative Closest Point (ICP), remain attractive for their explainability and minimal training requirements, but typically ignore anatomical semantics and biomechanical properties during regularization. Methods: We present Semantic ICP (SemICP), a novel non-rigid point cloud registration framework that combines semantically informed point matching with linear elastic energy regularization. Semantic labels are used to improve correspondence matching by constraining correspondences to be anatomically consistent. A novel control-point deformation representation with linear-elastic energy regularization is introduced to encourage biomechanically plausible deformations. SemICP was evaluated on a simulation phantom and four datasets against established baselines. It was also tested with labels from AI-based segmentation in a fully automatic segmentation-registration pipeline. Results: On the finite element phantom, SemICP recovered 86% of the interior displacement from surface observations alone. On the real datasets, SemICP achieved the lowest target registration error on Liver MR-US and the lowest surface distances on TORS, and ranked second on AbdominalMR-CT and HippocampusMR, where NR-ICP achieved lower surface distances. The fully automatic registration pipeline was shown to be effective for US-MR registration and to improve the alignment of expert-annotated structures. Conclusion: SemICP improves interior accuracy at competitive surface accuracy by combining semantic correspondence constraints and linear energy regularization. Combined with AI-based segmentation, SemICP provides an effective pipeline for multi-modal registration in CAI.

Figures & tables

Appendix figures & tables12 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SAGE: Semantic-Augmented Geometric Experts for Point Cloud Registration

    Oct 27, 2026Tomoyasu Shimada, Kazuhiko Murasaki, Shoichiro Takeda +4Point Cloud RegistrationPoint Cloud Learning

  2. Unsupervised Point Cloud Registration via Training-Time Semantic Guidance

    Sep 14, 2026Kezheng Xiong, Shiyun Xu, Sheng Ao +3Point Cloud Registration

  3. Context without Commitment: Robust Dense Correspondence under Non-Rigid Deformation

    Sep 29, 2026Yuzhen He, Sara HomscheidPoint Cloud LearningNon-Rigid Shape Correspondence