Shift- and stretch-invariant non-negative matrix factorization with an application to brain tissue delineation in emission tomography data
Authors: Anders S. Olsen, Miriam L. Navarro, Claus Svarer, Jesper L. Hinrich, Morten Mørup, Gitte M. Knudsen
Organizations: Neurobiology Research Unit, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark · Department of Neuroscience, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark · Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kgs. Lyngby, Denmark · Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
Dynamic neuroimaging data, such as emission tomography measurements of radiotracer transport in blood or cerebrospinal fluid, often exhibit diffusion-like properties. These introduce distance-dependent temporal delays, scale-differences, and stretching effects that limit the effectiveness of conventional linear modeling and decomposition methods. To address this, we present the shift- and stretch-invariant non-negative matrix factorization framework. Our approach estimates both integer and non-integer temporal shifts as well as temporal stretching, all implemented in the frequency domain, where shifts correspond to phase modifications, and where stretching is handled via zero-padding or truncation. The model is implemented in PyTorch (https://github.com/anders-s-olsen/shiftstretchNMF). We demonstrate on synthetic data and brain emission tomography data that the model is able to account for stretching to provide more detailed characterization of brain tissue structure.
Figures & tables
Figure 1: SPECT data from an example pig after 99m Tc-DTPA radiotracer injection in the cisterna magna (CM). Time-activity curves in the time-series plot - from selected voxels and timepoints indicated by squares - were normalized to unit norm for visualization.
Figure 2: Two-component NMF models applied to two-component synthetic data with random shifts and stretches. Model performance is measured using matched correlation of the A -matrix to the ground truth design matrix (variance is over 25 repeated model estimates), while the learned profiles (bottom) correspond to the S -matrix of the estimate with the lowest loss.
Figure 3: Effect of model order K on variance explained (shaded area is variance over pigs).
Figure 4: Extracted channel maps (left), temporal profiles (mid), and selected channel reconstructions (right) for pig-5 using K=3 components for the four tested models. CSF: cerebrospinal fluid.
Modeling shared and subject-specific structure in multisubject spatiotemporal data remains challenging, particularly in neuroimaging, where both spatial and temporal patterns exhibit rich variability across subjects. Existing matrix and tensor decompositions provide interpretable factorizations, but rely on fixed multilinear structures or coupling schemes that may limit their flexibility in capturing complex variability. In this work, we introduce a spatiotemporal variational tensor decomposition (ST-VTD) framework that combines a tensor factorization generative model with structured priors to jointly represent spatial maps and temporal dynamics. Spatial factors are regularized to promote a low-rank structure inspired by the LL1 decomposition, while temporal factors are modeled using a learned Long short-term memory (LSTM)-based prior, enabling flexible and adaptive dynamics. Posterior inference is performed using an amortized variational formulation by unrolling iterations of an optimization algorithm, leading to an interpretable and parameter-efficient architecture. The proposed inference framework employs a warm-start strategy based on group independent component analysis, which we found to improve optimization performance. Experiments on a realistic synthetic functional MRI (fMRI) dataset demonstrate that the proposed approach significantly improves latent factor recovery compared with representative classical and probabilistic decomposition benchmarks.
Laura M. Montaldo, Ricardo A. Borsoi, Sebastian Miron +1
CRAN, Université de Lorraine, CNRS, Vandoeuvre-l`es-Nancy, France. · Department of CSEE, University of Maryland Baltimore County, Baltimore, MD 21250, USA.
Longitudinal MRI enables sensitive measurement of structural brain change for studying aging and neurodegenerative disease. Deformable image registration is a key tool for estimating such change by computing a dense deformation that captures geometric differences between longitudinal scans. However, MRI scanners introduce geometric distortions that vary across acquisition systems and protocols, such as gradient non-linearity (GNL) distortion. Existing registration methods estimate a single field that conflates biological and technical effects, potentially biasing downstream morphometric measurements if distortions remain (partially) uncorrected. We propose DisMorph, a registration framework trained entirely on synthetic data that explicitly decomposes longitudinal deformation into technical and anatomical transforms. It predicts two dense deformations, each encoding one effect. During training, a novel generative model synthesizes both effects separately to provide disentanglement supervision, while domain randomization promotes generalization across imaging protocols. We evaluate our method in three complementary settings. On simulated data with known ground truth, our method detects anatomical change more accurately and consistently than conventional registration. On real image pairs that differ only by GNL distortion, our method assigns most geometric change to the distortion field, demonstrating specificity in the absence of anatomical change. On longitudinal Alzheimer's disease (AD) pairs, our method detects anatomical change in AD-related brain structures while identifying residual distortion left after standard correction. By disentangling MRI-induced distortion from biological change in the longitudinal deformation, our method paves the way for more accurate longitudinal morphometry in clinical settings where maintaining acquisition consistency is challenging.
Jingru Fu, Kathleen E. Larson, Douglas N. Greve +2
Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, USA · Department of Radiology, Massachusetts General Hospital, Boston, USA · Department of Radiology, Harvard Medical School, Boston, USA
We present a unified computational approach to tensor-based morphometry in detecting the brain surface shape differences between two clinical groups based on magnetic resonance images. Our approach is novel in a sense that we combined surface modeling, surface data smoothing and statistical analysis in a coherent unified mathematical framework. The cerebral cortex has the topology of a 2D highly convoluted sheet. Between two different clinical groups, the local surface area and curvature of the cortex may differ. It is highly likely that such surface shape differences are not uniform over the whole cortex. By computing how such surface metrics differ, the regions of the most rapid structural differences can be localized. To increase the signal to noise ratio, diffusion smoothing based on the explicit estimation of Laplace-Beltrami operator has been developed and applied to the surface metrics. As an illustration, we demonstrate how this new tensor-based surface morphometry can be applied in localizing the cortical regions of the gray matter tissue growth and loss in the brain images longitudinally collected in the group of children.
Moo K. Chung, Keith J. Worsley, Steve Robbins +1
Department of Statistics, Department of Biostatistics and Medical Informatics Keck Laboratory for Functional Brain Imaging and Behavior University of Wisconsin-Madison Madison, WI 53706. USA · Montreal Neurological Institute, McGill University, Canada