Temporal Periodic Image Registration with Implicit Neural Representations
Organizations: Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kgs. Lyngby, Denmark · Novo Nordisk A/S, Copenhagen, Denmark · Inria Université Côte d’Azur, Nice, France
Abstract
Implicit Neural Representations (INRs) have recently gained popularity for their ability to model functions using simple and lightweight networks. These methods have also proven effective in deformable image registration. In this work, we extend INRs for deformable image registration to the domain of temporal image registration, focusing on periodic temporal image sequences. Our approach, Temporal-IDIR, optimizes a single INR to model deformations across all frames in a temporal image sequence simultaneously, allowing for self-regularization through its own deformation predictions. To achieve this, we introduce a temporal consistency loss that penalizes discrepancies between direct source-to-target transformations and those traversing intermediate frames. We evaluate our framework on the DIR-LAB dataset, using the target registration error (TRE) between annotated and moved landmarks as the metric. Here, we achieve a TRE of 1.03 mm, outperforming other INR-based registration methods. Additionally, our framework supports smooth interpolation between time frames by estimating deformations between the given input frames. Code is publicly available at https://github.com/MMLowes/Temporal_INR.
Figures & tables
| Method | TRE [mm] |
|---|---|
| VoxelMorph+ [ 1 ] | 2.89 |
| GradICON [ 15 ] | 1.31 |
| GraphRegNet [ 5 ] | 1.39 |
| PTVReg [ 19 ] | 0.96 |
| RRN [ 6 ] | 0.83 |
| IDIR [ 20 ] | 1.07 |
| Setting | Direct | Sequential | Combined | Taylor |
|---|---|---|---|---|
| 1.09 | 1.52 | 1.09 | 1.05 | |
| 1.08 | 1.38 | 1.08 | 1.03 | |
| 1.09 | 1.21 | 1.08 | 1.04 | |
| 1.08 | 1.16 | 1.06 | 1.04 | |
| 1.09 | 1.11 | 1.08 | 1.07 | |
| 1.10 | 1.12 | 1.12 | 1.10 |
Deformable Image Registration
Deformable image registration aligns images by estimating local spatial transformations that account for anatomical change, motion, and differences between scans.
See all 77 papers