cs.LGNov 5, 2026

Non-Parametric Mutual Information Estimation with Vine Copulas

Authors: Sigurd Holmsen, Berit Omli Øksnes, Ingrid Hobæk Haff, Sylvia Richardson, Ali Ramezani-Kebrya

Organizations: Department of Informatics, University of Oslo · Integreat – Norwegian Centre for Knowledge-driven Machine Learning · Department of Mathematics, University of Oslo · TRUST – The Norwegian Centre for Trustworthy AI · 

Abstract

We introduce VINE: a non-parametric mutual information (MI) estimator based on simplified D-vine copulas. Approximating the joint density with a simplified D-vine allows the density ratio to simplify to a product of pair copulas, which we can estimate non-parametrically. This structural simplification yields VINE, a flexible and computationally efficient MI estimator. We compare VINE against SotA neural MI estimators on a range of datasets, both under settings where the simplified D-vine assumption holds and where it is violated, demonstrating competitive accuracy at a lower computational cost for low- to medium-dimensional datasets.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Amortized Vine Copulas for High-Dimensional Density and Information Estimation

    Apr 22, 2026Houman SafaaiCopula ModelsAmortized Inference

  2. Towards Diverse and Comprehensive Benchmarks for Mutual Information Estimation

    Jul 3, 2026Alberto Foresti, Ivan Butakov, Alexander Tolmachev +3Copula ModelsBenchmark Design

  3. NMINE: Normalized Mutual Information Neural Estimation

    Jul 30, 2026Petra Eerikinharju, Marko Tuononen, Ville HautamäkiMutual Information Estimation