cs.LGAug 18, 2026

Efficient Resource Optimization for Split Federated Learning

Authors: Wei Wei, Xianhao Chen

Organizations: Department of Electrical and Computer Engineering, the University of Hong Kong, Pok Fu Lam, Hong Kong SAR, 999077

Read PDF
Ask AI
Cite

Copy citation

DOINot available for this paper

Abstract

Split federated learning (SFL) has emerged as a powerful paradigm for model training at the edge. However, SFL inherently involves discrete decision variables for model splitting and resource allocation, resulting in a challenging mixed-integer problem. Consequently, prior optimization schemes for SFL are either heuristic or computationally inefficient, which cannot handle large-scale user populations. To address this limitation, this work establishes an efficient optimization framework for SFL under resource-constrained networks. Our framework jointly optimizes model splitting and resource allocation to minimize training cost, which is defined as the weighted sum of latency and energy costs. We first study the model splitting problem and develop a polynomial-time algorithm that achieves the global optimum. Then, we extend the approach to the joint model splitting and resource allocation problem. In this case, we formulate it as a two-dimensional master problem and develop an efficient approximation method with a (1+ε)(1+ε)-approximation guarantee. Extensive experiments show that the proposed approach provides efficient solutions to strike the optimal energy--latency tradeoff.

Figures & tables

Fig. 1: Illustration of SFL workflow. (a) SFL scenario includes uploading, downloading and aggregation processes. (b) Since the server starts only after all clients finish local FP and activation uploading, and the next round begins only after all clients complete BP and gradient downloading, moderately reducing the GPU frequency and transmission power of faster clients does not affect the overall training time but can save energy.
Fig. 2: Impact of cut layer on energy and latency. The experiments are conducted with ResNet-50 on the CIFAR-10 dataset under non-IID settings. Other configurations are identical to experimental settings in Section VII .
NotationDescription
N\mathcal{N}The set of all clients
NNThe number of clients
LLThe number of layers in the global model
Lc,iL_{c,i}The cut layer of client ii
nin_{i}The number of GPU FLOPs per cycle of client ii
nSn_{\mathrm{S}}The number of GPU FLOPs per cycle of the edge server
TABLE I: Summary of Important Notations.
Fig. 3: Evaluating training performance on CIFAR-10 and MNIST using ResNet-50 and VGG-16 ( λ=100\lambda=100 ).
ParameterValueParameterValue
CC2020N0N_{0}3.98×10−213.98\times 10^{-21} W/Hz\mathrm{W/Hz}
JJ55λ\lambda100100
nin_{i}[0.2,3]×104[0.2,3]\times 10^{4} FLOPs/cycle\mathrm{FLOPs/cycle}nSn_{\mathrm{S}}3×1043\times 10^{4} FLOPs/cycle\mathrm{FLOPs/cycle}
GiG_{i}1×10−261\times 10^{-26} W/(cycle/s)3\mathrm{W/(cycle/s)^{3}}GSG_{\mathrm{S}}2×10−262\times 10^{-26} W/(cycle/s)3\mathrm{W/(cycle/s)^{3}}
fimax⁡f_{i}^{\max}625625 MHz\mathrm{MHz}fimin⁡f_{i}^{\min}5050 MHz\mathrm{MHz}
fSmax⁡f_{\mathrm{S}}^{\max}3.1353.135 GHz\mathrm{GHz}fSmin⁡f_{\mathrm{S}}^{\min}210210 MHz\mathrm{MHz}
TABLE II: Simulation Parameters
Fig. 4: The impact of uplink bandwidth and downlink bandwidth on cost function.
Fig. 5: The impact of GPU frequency on cost function.
Fig. 6: The impact of network resource fluctuation on cost function.
Fig. 7: The impact of number of clients on cost function and running time.
Fig. 8: Performance comparison under λ=0\lambda=0 and λ=∞\lambda=\infty .
More in this topic

Split Federated Learning

Split federated learning divides models between clients and servers to train collaboratively while keeping raw data local.

See all 37 papers

Explore similar work

CardsList

  1. ASFL: An Adaptive Model Splitting and Resource Allocation Framework for Split Federated Learning

    Feb 19, 2026Chuiyang Meng, Ming Tang, Vincent W. S. WongSplit Federated LearningEnergy-Efficient ML

    Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, Canada · Department of Computer Science and Engineering, Southern University of Science and Technology, China

  2. Split Federated Learning Architectures for High-Accuracy and Low-Delay Model Training

    Mar 9, 2026Yiannis Papageorgiou, Yannis Thomas, Ramin Khalili +1Split Federated LearningFederated Learning

    Department of Informatics, Athens University of Economics and Business, Athens, Greece · Huawei Technologies Duesseldorf Gmbh, Munich, Germany

  3. CoASFL: Coupled Consistency Optimization for Asynchronous Split Federated Learning

    Oct 19, 2026Junhao Cheng, Yunming Liao, Hongli Xu +2Split Federated LearningFederated Learning

    School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China, 230027 · Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, China, 215123