HyperFitS -- Hypernetwork Fitting Spectra for metabolic quantification of 1H MR spectroscopic imaging
Authors: Paul J. Weiser, Gulnur Ungan, Amirmohammad Shamaei, Georg Langs, Wolfgang Bogner, Malte Hoffmann, Antoine Klauser, Ovidiu C. Andronesi
Organizations: Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA · Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA · Computational Imaging Research Lab – Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria · Electrical and Software Engineering, University of Calgary, Calgary, Canada · Hotchkiss Brain Institute, University of Calgary, Calgary, Canada · High Field MR Center – Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria · Advanced Clinical Imaging Technology, Siemens Healthineers International AG, Lausanne, Switzerland
Purpose: Proton magnetic resonance spectroscopic imaging (1H MRSI) enables the mapping of whole-brain metabolites concentrations in-vivo. However, a long-standing problem for its clinical applicability is the metabolic quantification, which can require extensive time for spectral fitting. Recently, deep learning methods have been able to provide whole-brain metabolic quantification in only a few seconds. However, neural network implementations often lack configurability and require retraining to change predefined parameter settings. Methods: We introduce HyperFitS, a hypernetwork for spectral fitting for metabolite quantification in whole-brain 1H MRSI that flexibly adapts to a broad range of baseline corrections and water suppression factors. Metabolite maps of human subjects acquired at 3T and 7T with isotropic resolutions of 10 mm, 3.4 mm and 2 mm by water-suppressed and water-unsuppressed MRSI were quantified with HyperFitS and compared to conventional LCModel fitting. Results: Metabolic maps show a substantial agreement between the new and gold-standard methods, with significantly faster fitting times by HyperFitS. Quantitative results further highlight the impact of baseline parametrization on metabolic quantification, which can alter results by up to 30%. Conclusion: HyperFitS shows strong agreement with state-of-the-art conventional methods, while reducing processing times from hours to a few seconds. Compared to prior deep learning based spectral fitting methods, HyperFitS enables a wide range of configurability and can adapt to data quality acquired with multiple protocols and field strengths without retraining.
Figures & tables
Figure 1: HyperFitS: Top: The HyperFitS strategy showing a hypernetwork taking baseline and water suppression correction parameters and predicting weights for a quantification network with a physics-based encoder. Bottom: The physical model combining metabolite and macromolecule basis set, baseline spline functions, and water suppression correction factor used to predict the spectral fit.
Figure 2: A qualitative comparison showing metabolic maps of NAA+NAAG, Cr+PCr, GPC+PCh, inositol, and Glu+Gln, at 7T quantified with HyperFitS and LCModel. Individual representative spectra are displayed below. Processing times for a single MRSI volume of HyperFitS and LCModel are 10sec vs ∼ 1h for 3.4mm, and 90sec vs ∼ 8h for 2mm
Figure 3: Metabolic maps of NAA+NAAG, Cr+PCr, GPC+PCh, Inositol, and Glu+Gln quantified with HyperFitS and LCModel from 3D MRSI acquired at 3T in a glioma patient. Maps are compared for different baseline modeling. Individual representative spectra are displayed below.
Figure 4: Top: A representative spectrum fitted by varying the hyperparameters for baseline flexibility (vertical) and spline node distance (horizontal) in increments of 101 of the total range. Three cases are shown enlarged on the right. The original spectrum is white, fit is red, baseline is yellow, and spline nodes are blue. Bottom: Contour plots of metabolite concentrations. A subject acquired at 7T with 3.4mm resolution was evaluated for 100 different baseline configurations. Baseline flexibility and spline node distance were changed over the hyperparameter range with increments of 101 of the total range. Values show the difference to the center value (0.5 flexibility, 0.15 ppm node distance) in percent.
Figure 5: Metabolite concentration boxplots for metabolites NAA+NAAG, Cr+PCr, PCh+GPC, Glu+Gln, Ins, Tau, GSH, and GABA. Evaluations are performed for 7T (top) and 3T (bottom). The 7T was evaluated with water suppression correction by HyperFitS. The 3T was processed with different baseline configurations by HyperFitS. Comparison to LCModel is included.
Figure 6: Uncertainty maps for the metabolites NAA, Glu and Ins at 7T (left) and 3T (right). LCModel uncertainties are computed as CRLBs, HyperFitS uncertainties are shown with Aleatoric and Epistemic uncertainty.
Figure 7: Correlation matrix of in-vivo metabolite concentrations fitted by HyperFitS at a.) 7T and b.) 3T. c.) A spectrum acquired at 7T with its fit and individual metabolite components.
7 Tesla
3 Tesla
15.0/4.0
10.0/3.0
7.0/4.0
24.0/4.0
24.0/3.0
19.0/4.0
16.0/4.0
8.0/4.0
8.0/4.0
18.0/4.0
16.0/7.0
15.0/4.0
13.0/6.0
8.0/4.0
10.0/4.0
7.0/6.0
9.0/6.0
12.0/4.0
Supplementary Table 1: Percent of significantly (more than 0.3 or less than -0.3) correlated or anti-correlated metabolites for increasing baseline flexibility and node distance. Baseline flexibility parameters from top to bottom: 0.0, 0.5, 1.0. Node distance from left to right: 0.1 ppm, 0.15 ppm, 0.2 ppm. 7T left, 3T right. The first value shows the correlated percentage, the second shows the anti-correlation percentage.
Supplementary Figure 1: Top: Correlation matrix of Monte Carlo analysis for subjects acquired at 3T. Each subject was evaluated for 9 different baseline configurations. Bottom: Boxplots showing correlation values of metabolite pairs that are less than -0.2 or larger than 0.2 in all baseline configurations. Glu & Ins and Glu & Gln are plotted separately as diamond/star. The color selection is based on the median values.
Supplementary Figure 2: Top: Correlation matrix of Monte Carlo analysis for subjects acquired at 7T. Each subject was evaluated for 9 different baseline configurations. Bottom: Boxplots showing correlation values of metabolite pairs that are less than -0.2 or larger than 0.2 in all baseline configurations. Glu & Ins and Glu & Gln are plotted separately as diamond/star. The color selection is based on the median values.
Magnetic resonance spectroscopy (MRS) is used to quantify metabolites in vivo and estimate biomarkers for conditions ranging from neurological disorders to cancers. Quantifying low-concentration metabolites such as GABA (γ-aminobutyric acid) is challenging due to low signal-to-noise ratio (SNR) and spectral overlap. We investigate and validate deep learning for quantifying complex, low-SNR, overlapping signals from MEGA-PRESS spectra, devise a convolutional neural network (CNN) and a Y-shaped autoencoder (YAE), and select the best models via Bayesian optimisation on 10,000 simulated spectra from slice-profile-aware MEGA-PRESS simulations. The selected models are trained on 100,000 simulated spectra. We validate their performance on 144 spectra from 112 experimental phantoms containing five metabolites of interest (GABA, Glu, Gln, NAA, Cr) with known ground truth concentrations across solution and gel series acquired at 3 T under varied bandwidths and implementations. These models are further assessed against the widely used LCModel quantification tool. On simulations, both models achieve near-perfect agreement (small MAEs; regression slopes ≈1.00, R2≈1.00). On experimental phantom data, errors initially increased substantially. However, modelling variable linewidths in the training data significantly reduced this gap. The best augmented deep learning models achieved a mean MAE for GABA over all phantom spectra of 0.151 (YAE) and 0.160 (FCNN) in max-normalised relative concentrations, outperforming the conventional baseline LCModel (0.220). A sim-to-real gap remains, but physics-informed data augmentation substantially reduced it. Phantom ground truth is needed to judge whether a method will perform reliably on real data.
Zien Ma, S. M. Shermer, Oktay Karakuş +1
School of Computer Science and Informatics, Cardiff University, Cardiff, CF24 4AG, United Kingdom · Faculty of Science and Engineering, Swansea University, Swansea, SA2 8PP, United Kingdom
Magnetic resonance spectroscopy (MRS) is a non-invasive technique to measure the metabolic composition of tissues, offering valuable insights into neurological disorders, tumor detection, and other metabolic dysfunctions. However, accurate metabolite quantification is hindered by challenges such as spectral overlap, low signal-to-noise ratio, and various artifacts. Traditional methods like linear-combination modeling are susceptible to ambiguities and commonly only provide a theoretical lower bound on estimation accuracy in the form of the Cramér-Rao bound. This work introduces a Bayesian inference framework using Sylvester normalizing flows (SNFs) to approximate posterior distributions over metabolite concentrations, enhancing quantification reliability. A physics-based decoder incorporates prior knowledge of MRS signal formation, ensuring realistic distribution representations. We validate the method on simulated 7T proton MRS data, demonstrating accurate metabolite quantification, well-calibrated uncertainties, and insights into parameter correlations and multi-modal distributions.
Julian P. Merkofer, Dennis M. J. van de Sande, Alex A. Bhogal +1
Eindhoven University of Technology, Eindhoven, The Netherlands · University Medical Center Utrecht, Utrecht, The Netherlands
Understanding the human brain requires access to its microscopic tissue architecture. Diffusion magnetic resonance imaging (MRI) provides the only noninvasive window into whole-brain microstructure in vivo, yet reliable quantitative mapping remains confined to specialized research settings requiring dense sampling and optimized acquisition protocols. To address this gap, we present a physics-informed generative microstructure network (PIGMENT) that learns a universal generative prior of human brain microstructure and adapts it zero-shot to each participant's measured data to recover subject-specific maps. Trained on 11375 scans spanning multiple sites, vendors, and field strengths, PIGMENT enabled reliable quantitative mapping for tensor, kurtosis, and NODDI models across external datasets from five independent centers. It remains effective where conventional fitting becomes unreliable, recovering meaningful maps from extremely sparse acquisitions while supporting downstream tractography and structural connectivity mapping. PIGMENT estimates demonstrated strong biological validity, preserving submillimeter cortical microarchitectural patterns and early-childhood white matter developmental trajectories from 10-fold accelerated scans. Furthermore, PIGMENT enables reliable quantitative tensor mapping on cost-efficient low-field systems and the extraction of tumor-related biomarkers using ultra-fast clinical protocols. Together, these results establish PIGMENT as a physics-informed foundation model that extends quantitative diffusion MRI into regimes traditionally too sparse, heterogeneous, or clinically constrained for reliable analysis.
Zihan Li, Jialan Zheng, Ziyu Li +18
School of Biomedical Engineering, Tsinghua University, Beijing, China. · Oxford Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom. · Department of Radiology, West China Second University Hospital, Sichuan University, Chengdu, China. +4