Neural Latent Gaussian Process for 3D reconstruction of Mouse Brain Lipids
Organizations: Swiss Data Science Center, Switzerland · ETH Zurich, Switzerland · EPFL, Switzerland
Abstract
We address the problem of reconstructing continuous three-dimensional lipid profiles of the mouse brain from lipid measurements acquired only on a sparse set of two-dimensional tissue sections. Using MALDI-MSI measurements from coronal sections of two densely sampled and six sparsely sampled mouse brains, registered to the Allen Mouse Brain Common Coordinate Framework (CCF), we seek to interpolate the measured hundreds of lipid profiles across the unobserved voxels of the reference brain. We introduce a Neural Latent-Space Gaussian Process (LGP) architecture for this task and critically evaluate its ability to reconstruct spatial lipid distributions, using held-out mouse brain sections to assess generalization. We propose a Gaussian Process prior for the distribution of low-dimensional lipid profiles across the mouse brain (with Matérn or a Riemann manifold kernel). This allows us to encode 3D coordinates in a small number of latent 3D volumes that are then mapped to particular lipids using a multilayer perceptron (MLP). We performed an exhaustive analysis over a range of algorithms from simple linear regression, XGBoost, MLP to state of the art models such as Neural Transcriptomic Field, graph-based SPA3D for spatial omics reconstruction and DEEPSPATIAL. We additionally evaluate GPLFR as an alternative Gaussian-process-based approach. Across 173 measured lipids, LGP outperforms all evaluated baselines, including recent spatial-omics models and GPLFR, achieving a mean correlation of 0.613 and demonstrating the effectiveness of our approach for sparse 3D lipid interpolation.
Figures & tables
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameter | Symbol | Swept values | Default |
| Graph construction | |||
| -NN neighbours | |||
| Graph bandwidth | |||
| Laplacian normalization | – | symmetric, random-walk | random-walk |
| Node stride | – | ||
| Tissue threshold | – | ||
| Model | Mechanism | Key hyperparameters |
|---|---|---|
| Baselines | ||
| Mean | per-lipid training mean | — |
| Linear | ridge regression (closed form) | |
| XGBoost | boosted-tree regressors | trees, depth , lr , early stop |
| MLP | coordinate lipid MLP | , SiLU, dropout |
| MLP-bottleneck | MLP with width-5 bottleneck | |
| Regime | Method | RMSE | Pearson | Spearman |
|---|---|---|---|---|
| Dense | euclidean | 0.6735 | 0.316 | 0.286 |
| manifold plain | 0.1279 | 0.984 | 0.976 | |
| Sparse | euclidean | 0.6721 | 0.259 | 0.237 |
| manifold plain | 0.6916 | 0.255 | 0.220 |
Sparse-View 3D Reconstruction
Sparse-view 3D reconstruction recovers scene geometry and appearance from a small number of images for novel-view rendering and 3D use.
See all 196 papers