stat.MLAug 21, 2026

Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate

Authors: Jae Wan Shim

Organizations: Extreme Materials Research Center, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea · Climate and Environmental Research Institute, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea · Division of AI-Robotics, KIST Campus, University of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea

Abstract

Gaussian distributions are used to model uncertainty in signals and states, and Gaussian mixtures are often used when the underlying distribution is multimodal. Unlike a single Gaussian, a Gaussian mixture generally has no closed-form expression for differential entropy and therefore requires numerical approximation. We propose a Gauss--Hermite quadrature method for evaluating Gaussian mixture differential entropy. The quadrature order controls the numerical resolution of the approximation. The method is evaluated on one- and two-dimensional Gaussian mixture benchmarks against Taylor approximations, analytic entropy bounds, and numerical integration references. For repeated optimization over continuous actions, we also propose a Hermite polynomial surrogate in action space. In a radar pointing benchmark, its second-order form achieves substantially lower surrogate error and optimizer regret than a second-order Taylor surrogate based on local derivatives at the nominal action, while both methods use nine direct objective evaluations per replanning step. The Hermite surrogate also improves pointing performance in the tested benchmark.

Explore similar work

CardsList
  1. Revisiting Mixture Policies in Entropy-Regularized Actor-Critic

    May 9, 2026Jiamin He, Samuel Neumann, Jincheng Mei +2RL ControlPolicy Optimization

  2. Monte Carlo with kernel-based Gibbs measures: Guarantees for probabilistic herding

    Feb 18, 2024Martin Rouault, Rémi Bardenet, Mylène MaïdaMarkov Chain Monte CarloMaximum Mean Discrepancy