stat.MEJul 21, 2026

Deep Shape Regression for Planar Curves with Multimodal Covariates

Authors: Manuel PfeufferRoshan Prakash RaneHadya YassinKerstin RitterSonja Greven

Organizations: Humboldt-Universität zu Berlin, Berlin, Germany · Hertie Institute for AI in Brain Health, Universität Tübingen, Tübingen, Germany · Universität Tübingen, Tübingen, Germany · Hasso Plattner Institut, Universität Potsdam, Potsdam, Germany

Abstract

The shape of a planar curve is the geometric information that remains once translation, rotation, scale and reparametrisation are removed and is of interest in many health applications, e.g. in neuroimaging. We propose a deep shape regression model for open planar curves that admits multimodal and high-dimensional covariates. Representing curves as complex-valued functions, we show that the conditional full Procrustes mean is the leading eigenfunction of the conditional covariance. To estimate this covariance surface, we propose a novel deep conditional covariance smoother with modality-specific encoders - e.g. splines for scalar covariates and convolutional networks for images, which classical spline smoothers cannot accommodate. Our model is by construction invariant to the translation, rotation and scaling of the input curves and handles sparsely and irregularly sampled curves. We further provide an algorithm for elastic mean estimation that also removes parametrisation by iterating covariance smoothing, rotational alignment and parametrisation alignment. We illustrate the method on simulated outlines with known conditional mean and multimodal covariates, and give a first application to hippocampal outlines from the ADNI cohort, recovering covariate effects consistent with the literature. Code is available at https://github.com/mpff/dnn-shapes.

Explore similar work

Jun 4, 2026cs.LG

Efficient Mean Curvature Computation on High-Dimensional Data Manifolds

Estimating local mean curvature at each point of a high-dimensional dataset is a key ingredient of geometry-aware machine learning algorithms, such as the Mean Curvature Boundary Points (MCBP) method. The naive implementation of this computation, based on a local shape operator approximated from k-nearest neighbor patches, involves an explicit construction of a matrix HH whose trace form yields an O(m4)O(m^4) cost per point, rendering the approach intractable for datasets with more than a few dozen features. This paper introduces two complementary contributions that together reduce this cost by several orders of magnitude. The first contribution is an exact algebraic identity. This identity, derived from the orthogonality of the eigenvectors of the covariance matrix and the cyclicity of the trace operator, eliminates HH entirely and reduces the per-point cost to O(m2)O(m^2) after the eigendecomposition. The second contribution addresses the remaining O(m3)O(m^3) bottleneck of the full eigendecomposition. Since the local covariance matrix has rank at most k1mk-1 \ll m, we replace it with a truncated SVD of the k×mk \times m centered data matrix, an O(k2m)O(k^2 m) operation, and derive an analytical approximation for the contribution of the null-space eigenvectors based on the expected value of their outer product under the Haar measure. The resulting estimator has total cost O(k2m+kmp2)O(k^2 m + k m p^2), where p=k1p = k-1. Experiments on real-world datasets confirm speedups of 50 to 300 times relative to the original implementation, with negligible loss when the fast estimator is used to replace the original version. By providing a scalable and data-driven estimate of local curvature, the proposed method establishes curvature as a practical geometric feature for a broad range of machine learning tasks, from classical to modern deep learning pipelines.
Alexandre L. M. Levada
Aug 5, 2026cs.CV

Predicting Brain Morphometry with MT-GNN: Mesh Evolution in Continuous Time with Graph-Based Metric Tensor Embeddings

Predicting how a subcortical structure's shape will evolve from a few prior scans could support prognosis and clinical-trial enrichment. Existing longitudinal mesh predictors either extrapolate shape trajectories via high-dimensional embeddings or regress vertex deformations directly. We instead predict the surface's intrinsic geometry in continuous time: a single per-structure graph network predicts the future per-vertex first fundamental form (metric tensor) for an arbitrary causal multiple-visit history and an arbitrary prediction horizon, conditioned on a Fourier encoding of the lead time. The predicted metric is decoded into a surface by a differentiable As-Rigid-As-Possible solver, and the model is trained end-to-end on the rigid-aligned vertex error. Training through the reconstruction keeps the decoded prediction a valid surface and consistently improves it. On 14 subcortical structures from the ADNI dataset, the proposed mesh evolution model (MT-GNN) predicts best among the evaluated methods at every horizon (2.29%-2.29\% mean vertex error vs. the temporal mean, p=6.1×105p{=}6.1{\times}10^{-5}, beating it on 14/14 structures), ahead of geodesic shape regression (DCM, 0.19%-0.19\%) and a mesh transformer (TransforMesh, 0.45%-0.45\%; p=1.2×104p{=}1.2{\times}10^{-4}), with the lead widening as the horizon grows.
Hao Ding, Daniel Semchin, Paul M. Thompson +1
Jun 5, 2026cs.LG

Covariance Shrinkage via Stochastic Interpolation

We recast classical shrinkage of high-dimensional covariance estimators as empirical risk minimization over a parametric stochastic interpolant between a source and a target distribution. This formalism recovers known shrinkage estimators as special cases and reveals three distinct mechanisms for reducing statistical risk: (i) Scheduling: the interpolant schedule determines the class of admissible covariances, and hence the achievable risk. (ii) Flow maps and couplings: whereas naive constructions amount to assuming independence between the distributions, specific coupling structures (e.g., solutions of optimal transport problems) can lower the empirical risk. Moreover, non-linear flow maps realizing such couplings free the interpolant covariance from the eigenbasis of the empirical estimate, enabling eigenvector regularization. (iii) Early stopping: estimators defined by integrating a regressed vector field afford an additional bias-variance trade-off through approximation of the true interpolant distribution. We then propose a neural estimator of the interpolant, together with an upper bound on its quadratic risk in terms of the interpolant approximation error, and validate both on synthetic experiments. Finally, we apply the estimator to real neuroimaging data, demonstrating the additional regularization power this approach offers in practice.
Mathieu Chalvidal, Florentin Coeurdoux, Eric Vanden-Eijnden