cs.AINov 13, 2026

Federated Soft Poly-Level Learning Over a Distributed Network with Guaranteed Convergence

Authors: Yang Jiao, Kai Yang, Jianwei Huang

Abstract

Multi-level learning/optimization, e.g., bilevel optimization, has been recognized for its versatile applicability across a broad array of domains, spanning from signal processing to machine learning. However, most existing works focus on bilevel and trilevel optimization. In contrast, multi-level optimization problems involving four or more hierarchical levels, which we term poly-level learning (PLL) problems, remain largely unexplored.In addition, in practical PLL, data may be distributed across multiple nodes over a distributed network. Nevertheless, extant studies on PLL predominantly focus on the non-federated setting, necessitating the collection of data to central servers and thereby posing potential privacy risks. To this end, we propose a Federated Poly-Level Learning (FPLL) framework over a distributed network to tackle the PLL problems with soft constraints in a federated manner. FPLL hinges on a novel non-linear cut, i.e., LL-cut, for the level-wise relaxation to the PLL problems. Additionally, the proposed federated algorithm is designed with adjustable parameters that allow for a flexible trade-off between its computational complexity and performance efficiency, enabling users to tune it according to specific application requirements. We also carry out non-asymptotic analysis to derive the iteration complexity for the proposed FPLL to achieve the εε-Pareto stationary point. Extensive experiments have been undertaken to elucidate the superior efficacy of the proposed method.

Figures & tables

Explore similar work

CardsList
  1. Federated Bilevel Performative Prediction

    Jun 18, 2026Liangxin Qian, Chang Liu, Xuanyu Cao +2Bilevel OptimizationPerformative Prediction

  2. Smoothed Gradient Method for Nonconvex Federated Stochastic Bilevel Optimization

    Oct 4, 2026Xinwen Zhang, Peiran Yu, Zhaosong Lu +1Gradient DescentNonconvex Stochastic Optimization

  3. A Locally Penalized Cross-Estimate Federated Method with Guarantees for Constrained Personalized Learning

    Mar 20, 2026Mohammadjavad Ebrahimi, Daniel Burbano, Farzad YousefianFederated LearningHeterogeneous Federated Learning