stat.MLMar 4, 2026

Optimal Prediction-Augmented Algorithms for Testing Independence of Distributions

Authors: Maryam Aliakbarpour, Alireza Azizi, Ria Stevens

Organizations: Department of Computer Science and Ken Kennedy Institute · Rice University

Abstract

Independence testing is a fundamental problem in statistical inference: given samples from a joint distribution pp over multiple random variables, the goal is to determine whether pp is a product distribution or is εε-far from all product distributions in total variation distance. In the non-parametric finite-sample regime, this task is notoriously expensive, as the minimax sample complexity scales polynomially with the support size. In this work, we move beyond these worst-case limitations by leveraging the framework of augmented distribution testing. We design independence testers that incorporate auxiliary, but potentially untrustworthy, predictive information. Our framework ensures that the tester remains robust, maintaining worst-case validity regardless of the prediction's quality, while significantly improving sample efficiency when the prediction is accurate. Our main contributions include: (i) a bivariate independence tester for discrete distributions that adaptively reduces sample complexity based on the prediction error; (ii) a generalization to the high-dimensional multivariate setting for testing the independence of dd random variables; and (iii) matching minimax lower bounds demonstrating that our testers achieve optimal sample complexity.

Explore similar work

CardsList
  1. Testing Distributions Against Bounded Distinguishers

    Jul 17, 2026Mark Bun, Rathin Desai, Renato Ferreira PintoIntegral Probability Metrics

  2. Deep-testing: the case of dependence detection

    Apr 29, 2026Gery Geenens, Pierre Lafaye de Micheaux, Ivan Muyun ZouStatistical Hypothesis Testing

  3. Sequential Kernel-based Conditional Independence Testing via Adaptive Betting

    Jun 17, 2026Zheng He, Danica J. SutherlandKernel MethodsConditional Independence Testing