math.OCNov 5, 2026

A Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least Squares

Authors: Juntao Li, Qihang Guo, Deyuan Meng

Organizations: School of Mathematics and Statistics, Henan Normal University, Xinxiang 453007, P. R. China · Seventh Research Division, School of Automation Science and Electrical Engineering, Beihang University (BUAA), Beijing 100191, P. R. China

Abstract

This paper proposes a bilevel particle swarm optimization (PSO)-neurodynamic method for solving the distributed sparse least-squares problem regularized by the smoothly clipped absolute deviation (SCAD) penalty to global optimality. The SCAD penalty is nonsmooth and nonconvex, so existing distributed neurodynamic methods have not been extended to it directly. Through two-time-scale singular perturbation analysis, a rigorous full-trajectory convergence theory with explicit convergence rates is established for the inner collaborative multi-agent neurodynamic system without requiring the second-order sufficient condition. A theory-guided inner-outer collaborative optimization framework is further developed, in which a red-light green-light sensitivity mechanism is embedded in the outer PSO search to enhance global search while concentrating computational effort on the SCAD shape parameters, thereby improving recovery accuracy and computational efficiency. Simulation results on four sparse-recovery scenarios demonstrate that the proposed method accurately recovers the true sparsity pattern and achieves faster convergence and lower relative error than competing neurodynamic methods.

Figures & tables

Explore similar work

CardsList
  1. Projection-Free Gradient Tracking Neurodynamic for Distributed Nonnegative Sparse Optimization

    Nov 5, 2026Juntao Li, Qihang Guo, Deyuan MengDistributed OptimizationConstrained Optimization

  2. Convergence of Consensus-Based Particle Methods for Nonconvex Bi-Level Optimization

    May 19, 2026Yutong Chao, Xudong Sun, Konstantin Riedl +2Dynamical SystemsZeroth-Order Optimization

  3. SGHA: A Single-Loop Fully First-Order Algorithm for Nonconvex-Strongly-Convex Bilevel Optimization

    Aug 24, 2026Zhihao Gu, Qilong Wu, Junchi YangStochastic Bilevel OptimizationBilevel Optimization