math.NANov 17, 2026

Optimal Control of RKHS Diffeomorphic Flows for Classification and Generative Modeling

Authors: Christopher Chukwuemeka, Andreas Mang

Organizations: Department of Mathematics, Tufts University, Medford, MA, USA

Abstract

We develop a unified optimal-control framework that solves supervised classification and likelihood-based density estimation with a single diffeomorphic flow whose velocity lives in a reproducing kernel Hilbert space (RKHS); the two tasks share all structure except the objective. Variable projection eliminates the terminal model (a classifier, or a Gaussian-mixture (GMM) reference), leaving a reduced control problem whose gradient comes from an analytic discrete adjoint. The RKHS parameterization makes the flow's divergence exact and deterministic at the cost of one kernel matrix-vector product, avoiding the stochastic trace estimators and potential-flow restrictions of existing continuous normalizing flows. Because the objective and gradient are deterministic, matrix-free reduced Gauss-Newton (GN) and related second-order solvers are practical for both tasks, which we benchmark against a range of first- and second-order optimizers; the learned map is a diffeomorphism with explicitly controlled regularity. In experiments from dimension 2 to 256, the reduced GN solvers use the fewest iterations of any optimizer tested and, together with joint L-BFGS, the least work; a multiscale kernel improves the density fit, and a trainable GMM reference reduces the deformation needed for multimodal transport at comparable likelihood while lowering the likelihood on real data. The full-model solve is quadratic in the particle count and sub-linear in dimension; a control-point reduction makes the particle-count scaling linear at near-lossless accuracy.

Figures & tables

Appendix figures & tables28 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. On the minimax optimality of Flow Matching through the connection to kernel density estimation

    Apr 17, 2025Lea Kunkel, Mathias TrabsFlow MatchingGenerative Modeling

  2. Explicit Regularization for Flow Matching

    Nov 14, 2026Lars Ruthotto, Eran TreisterFlow MatchingFlow-Based Generative Modeling

  3. Normalizing Flow Maps

    Oct 15, 2026Francesco M. Ruscio, Timothy James Hitge, Fred Zhangzhi Peng +6Normalizing FlowsFlow Map Learning