cs.LGJun 2, 2026

Analytical Evaluation of DCA Convergence Properties for Minimizing Prediction Functions of Gaussian RBF Support Vector Regression

Authors: Yohei KakimotoYuto OmaeHirotaka Takahashi

Organizations: Nihon University · Tokyo City University

Abstract

For nonconvex optimization problems whose objective is the prediction function of a trained Support Vector Regression (SVR) model with the Gaussian radial basis function (RBF) kernel (RBF-SVR), we present a framework that applies the difference of convex functions (DC) algorithm (DCA) by exploiting the analytical structure of the RBF kernel to construct an explicit DC decomposition. Specifically, we derive in closed form both the lower bound μμ of the strong convexity parameter of the DC components and the upper bound LL of the gradient Lipschitz constant of the subproblem. Both μμ and LL are determined solely by the post-training dual-coefficient sum CαC_α and the RBF kernel parameter γγ, together with the DC decomposition parameter ρρ, and they share a common leading term CαρC_αρ. Through numerical experiments on six benchmark functions, we show that CαρC_αρ is the primary single quantity characterizing both the convergence properties and the initial-point dependence of DCA, and further demonstrate that it decomposes into two independent pathways, CCαC \to C_α and γργ\to ρ, with its primary variation governed by the SVR hyperparameters (C,γ)(C, γ). Together, these results allow the convergence properties of DCA on RBF-SVR to be assessed in advance through the single scalar quantity CαρC_αρ: approximately from (C,γ)(C, γ) before training, and exactly in closed form after training.

Explore similar work

CardsList