Organizations: College of Computer and Information Sciences, Fujian Agriculture and Forestry University, and also with the Engineering Research Center of Smart Sensing and Agricultural Chip Technology, Fujian Province University, Fuzhou 350002, China · R&D Department, Techphant Technologies Company Ltd., Guangzhou 510310, China · School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou 510006, China
Large-scale Internet of Things (IoT) networks enable intelligent services such as smart cities and autonomous driving, but often face resource constraints. Collecting heterogeneous sensory data, especially in small-scale datasets, is challenging, and independent edge nodes can lead to inefficient resource utilization and reduced learning performance. To address these issues, this paper proposes a collaborative optimization framework for energy-efficient federated edge learning with small-scale datasets. We first derive an expected learning loss to quantify the relationship between the number of training samples and learning objectives. A stochastic online learning algorithm is then designed to adapt to data variations, and a resource optimization problem with a convergence bound is formulated. Finally, an online distributed algorithm efficiently solves large-scale optimization problems with high scalability. Extensive simulations and autonomous navigation case studies with collision avoidance demonstrate that the proposed approach significantly improves learning performance and resource efficiency compared to state-of-the-art benchmarks.
Figures & tables
Symbol
Definition
K,Ki
User set; user set at edge node i
X(t),Xi(t)
Collected dataset (all devices); dataset at node i
w(t),wi(t+1)
Global model; local model at node i
A(t),Ai(t)
Initial number of collected samples at epoch t (all nodes; node i )
F(w),Fi(w)
Global loss; local loss at node i
D,Di
The whole data distribution, data distribution at edge node i
TABLE I: Summary of main notations.
Fig. 1: The cloud-edge-end collaborative system in resource-constrained large-scale IoT networks.
Fig. 3: Learning loss vs. the number of training samples.
Fig. 4: Expected learning loss/Power utilization ratio vs. the number of edge nodes.
Fig. 5: Learning loss vs. the transmission time.
Fig. 6: Mean squared errors (MSE) vs. the number of iterations, with the learning step η=1×10−3 .
Fig. 7: Average CPU time vs. the number of edge nodes, with ∣K1∣=∣K2∣=⋯=∣KI∣=10 .
Fig. 8: The training behavior in autonomous navigation.
Fig. 9: Visualization of autonomous navigation in the CARLA simulator. Each subfigure pair displays the navigation trajectories (main panels) and final states (top-right panels) of the autonomous vehicles. Black and red vehicles indicate agents and obstacles, gray regions represent roads, red dashed lines show trajectories, blue polygons denote obstacles, and white circular markers indicate vehicle positions.
Tampere University, Tampere, Finland · Tampere Institute for Advanced Study, Tampere University, Finland · Intel Corporation, Santa Clara, CA, United States
Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, H3G 1M8, Canada · School of Automation, Guangdong University of Technology, China