Gauss--Hermite Quadrature for Gaussian-Mixture Entropy with an Action-Space Hermite Surrogate
Authors: Jae Wan Shim
Organizations: Extreme Materials Research Center, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea · Climate and Environmental Research Institute, Korea Institute of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea · Division of AI-Robotics, KIST Campus, University of Science and Technology, 5 Hwarang-ro 14-gil, Seongbuk, Seoul, 02792, Republic of Korea
Gaussian distributions are used to model uncertainty in signals and states, and Gaussian mixtures are often used when the underlying distribution is multimodal. Unlike a single Gaussian, a Gaussian mixture generally has no closed-form expression for differential entropy and therefore requires numerical approximation. We propose a Gauss--Hermite quadrature method for evaluating Gaussian mixture differential entropy. The quadrature order controls the numerical resolution of the approximation. The method is evaluated on one- and two-dimensional Gaussian mixture benchmarks against Taylor approximations, analytic entropy bounds, and numerical integration references. For repeated optimization over continuous actions, we also propose a Hermite polynomial surrogate in action space. In a radar pointing benchmark, its second-order form achieves substantially lower surrogate error and optimizer regret than a second-order Taylor surrogate based on local derivatives at the nominal action, while both methods use nine direct objective evaluations per replanning step. The Hermite surrogate also improves pointing performance in the tested benchmark.
1Univ. Lille, CNRS, Centrale Lille, UMR 9189 – CRIStAL, 59651 Villeneuve d’Ascq, France · 2Univ. Lille, CNRS, UMR 8524 – Laboratoire Paul Painlev´e, F-59000 Lille, France