Overview

Decentralized learning studies how multiple devices or organizations can learn together while keeping data and computation local, which is useful when privacy, connectivity, or centralized infrastructure is limited. Methods include gossip averaging, decentralized stochastic gradient descent, knowledge distillation, random-walk updates, and communication-efficient model sharding, with applications from edge devices to large language model pretraining. Work evaluates these approaches on image, text, graph, and time-series benchmarks, as well as dynamic and wireless networks, and develops convergence and generalization guarantees. A central tension is balancing communication and computation costs with learning quality under non-IID data, changing network topologies, privacy requirements, and malicious participants.

Latest papers

CardsList

106 papers8 papers in the last four weeks, down 11% on the four weeks before. 0.1% of all new papers.

  1. DPA: Decentralized Primal Averaging with Quasi-Global Momentum for Highly Heterogeneous Data

    Nov 12, 2026Diyako Ghaderyan, Stefan WernerDecentralized LearningDecentralized Optimization

  2. FedSharp: Byzantine Robust Decentralized Federated Learning Under Noisy Channel

    Nov 3, 2026Ojaswi Sinha, Amin Farajzadeh, Animesh Yadav +1Byzantine-Robust Federated LearningDecentralized Learning

  3. When Does Spatial Cooperation Help? Contamination Regimes in Decentralized Online Spectrum Anomaly Learning

    Oct 31, 2026Alp Berke Ardic, Erdem KoyuncuOnline Anomaly DetectionAnomaly Detection

  4. Connectivity-Aware Client Selection in Decentralized Federated Learning

    Oct 30, 2026Usevalad Milasheuski, Monica Nicoli, Stefano SavazziClient Selection in Federated LearningDecentralized Learning

  5. Optimal Regret for Communication-Efficient Decentralized Online Learning

    Oct 28, 2026Sifan Yang, Wenhao Yang, Wei Jiang +2Decentralized OptimizationOnline Convex Optimization

  6. PULSE: Personalized Opportunistic Learning for Wearable Devices

    Oct 20, 2026Mattia Giovanni Campana, Dariush Salami, Hüseyin Yiğitler +1Personalized LearningDecentralized Learning

  7. Learning to Refer: Inference-Time Collaboration in Decentralized Federated Learning

    Oct 19, 2026Yuheng Ma, Chendi Wang, Qiong ZhangFederated LearningDecentralized Learning

  8. Multi-Token Random-Walk Learning via Meeting-Triggered Information Exchange

    Oct 10, 2026Taichun Yeh, Xingran ChenDecentralized LearningDecentralized Optimization

  9. Decentralized collaborative continual learning: A multi-objective minimization-based technique

    Oct 7, 2026Yara Zgheib, Marc Antonini, Roula NassifDecentralized LearningReplay-Based Continual Learning

  10. MetaLearnNCA: Few-Shot Offline Meta-Learning via Interacting Neural Cellular Automata

    Oct 6, 2026Etienne Guichard, Stefano NicheleNeural Cellular AutomataMeta-Learning

  11. Unapologetically Distributed: A Call for Decentralized Document Analysis

    Sep 30, 2026Adrià Molina, Oriol Ramos Terrades, Josep LladósOOD GeneralizationDecentralized Learning

  12. SPADE-DFL: Communication-Efficient Decentralized Federated Learning via Derivative-Free Linearized ADMM

    Sep 24, 2026Mengli Wei, Mengkai Zhu, Jiawen Chen +2Communication-Efficient Distributed TrainingBlack-Box Optimization

  13. PROSE: A Theory of Optimal Stopping with Perishable Evidence for Peer Selection in Intermittently Connected Decentralised Learning

    Sep 20, 2026Christos AnagnostopoulosOptimal StoppingDecentralized Learning

  14. Serverless gossip training of LSTM failure detectors: A matched-protocol comparison with federated, local and centralized learning on NASA C-MAPSS

    Sep 17, 2026Yusuf Öztürk, Enes Göktekin, Bengisu Atlı +3Decentralized LearningFault Detection

  15. Decentralized Gossip Learning and Federated Averaging for Histopathology Image Classification

    Sep 15, 2026Yusuf Ozturk, Bengisu Atli, Enes Goktekin +2Federated Learning AggregationNon-IID Federated Learning

  16. Privacy Preserving Gossip Learning

    Sep 13, 2026Erkan Bayram, Mohamed-Ali Belabbas, Tamer BaşarContinual LearningDecentralized Learning

  17. Decentralized Optimal Equilibrium Learning Over Dynamic Networks

    Sep 13, 2026Seref Taha Kiremitci, Muhammed O. SayinDecentralized LearningGame Theory

  18. Trustworthy, Explainable, and Sustainable Decentralized Intelligence for 6G Networks

    Sep 12, 2026Giovanni Perin, Michele Rossi, Enrique Tomás Martínez Beltrán +13Trustworthy AI6G Networks

  19. Byzantine-Robust Federated Fire Detection with a Rotating Coordinator

    Sep 9, 2026Georgia Argyrou, Aymen Bahroun, Hedi Fendri +1Federated Learning AggregationByzantine-Robust Federated Learning

  20. Robust Decentralized Personalized Federated Learning via Prediction-Constrained Neighborhood Collaboration

    Sep 7, 2026Xiao Ma, Hong Shen, Hui Tian +2Federated Learning AggregationByzantine-Robust Federated Learning

  21. Robust Decentralized Federated Distillation via Multi-Modality Knowledge Collaboration

    Sep 7, 2026Xiao Ma, Hong Shen, Hui Tian +2Byzantine-Robust Federated LearningFederated Knowledge Distillation

  22. Trust-But-Verify: Poisoning-Resilient Locally Private Graph Learning Protocols

    Sep 7, 2026Longzhu He, Li Sun, Hao Peng +3Data Poisoning AttacksDecentralized Learning

  23. Optimal Rates for Agentic Networked Information Aggregation

    Sep 4, 2026MohammadHossein Bateni, Zahra Hadizadeh, MohammadTaghi Hajiaghayi +2Statistical Learning TheoryDecentralized Learning

  24. From Euclidean to Graph-Structured Data: A Survey of Collaborative Learning

    Sep 2, 2026Rémi Bourgerie, Šarūnas Girdzijauskas, Viktoria FodorFederated Graph LearningDecentralized Learning