cs.LGMay 26, 2026

HEAL: Resilient and Self-* Hub-based Learning

Authors: Mohamed Amine LegherabaStefan GalkiewiczMaria Gradinariu Potop-ButucaruSébastien Tixeuil

Organizations: NPA · Sorbonne University, CNRS, LIP6, F-75005 Paris, France · NPA, IUF, LINCS · Institut Universitaire de France, Paris, France

Abstract

Decentralized learning enhances privacy, scalability, and fault tolerance by distributing data and computation across nodes. A popular approach is Federated learning, which relies on a central aggregator, yet faces challenges such as server vulnerabilities, scalability issues, privacy risks and most importantly, the single point of failure. Alternatively Gossip Learning and Epidemic Learning offer fully decentralization through peer-to-peer exchanges of model updates, ensuring robustness and privacy, at the price of slower model convergence. In this work, we introduce a novel decentralized learning framework called HEAL. HEAL is the first cross-layer decentralized learning framework that exploits an optimized self-organizing and self-healing underlying P2P overlay combining the strengths of Federated Learning, Gossip and Epidemic Learning. Leveraging the recently proposed Elevator algorithm, HEAL promotes dynamically chosen nodes to act as aggregators. Through simulations, we demonstrate that HEAL has similar performances to that of Federated Learning in crash-free settings, while being fully decentralized and fault-tolerant. In crash and churn prone environments HEAL outperforms Gossip and Epidemic Learning.

Explore similar work

CardsList