Decentralized Optimization

Overview

Decentralized optimization studies how networked agents can jointly minimize an objective or coordinate decisions while each uses local data and communicates with neighbors rather than relying on a central coordinator. Common approaches include gossip and consensus, decentralized stochastic gradient descent with gradient tracking, primal-dual and ADMM methods, and local updates paired with compressed or intermittent communication. These methods are tested in settings such as image and language-model training, online and bilevel learning, power systems, and multi-robot estimation. A central challenge is balancing communication cost, network topology, data heterogeneity, and robustness against noise or adversaries while retaining fast convergence and reliable solutions.

Latest papers

CardsList

63 papers7 papers in the last four weeks, down 46% on the four weeks before. 0.0% of all new papers.

  1. DPA: Decentralized Primal Averaging with Quasi-Global Momentum for Highly Heterogeneous Data

    Nov 12, 2026Diyako Ghaderyan, Stefan WernerDecentralized LearningDecentralized Optimization

  2. Variance Reduction for Decentralized Stochastic Optimization with Multiple Local Updates

    Oct 30, 2026Jie Liu, Nicola Bastianello, Wenying Xu +2Decentralized OptimizationVariance Reduction

  3. Optimal Regret for Communication-Efficient Decentralized Online Learning

    Oct 28, 2026Sifan Yang, Wenhao Yang, Wei Jiang +2Decentralized OptimizationOnline Convex Optimization

  4. On the Limits of Stochastic Push-Pull over Time-Varying Digraphs

    Oct 23, 2026Feiming Wang, Yutong He, Sulaiman Alghunaim +1Decentralized OptimizationStochastic Optimization Convergence

  5. Decentralized Bi-Level Optimization for Cooperative Orbital Transportation of a Rigid Payload

    Oct 22, 2026Sidhdharth D. Sikka, Revathy Ravuri, Hei Yin Jowett Chan +2Trajectory OptimizationMulti-Robot Cargo Transportation

  6. Group Distributionally Robust Optimization over Decentralized Networks

    Oct 21, 2026Haomin Bai, Junyan Sun, Quan Cheng +2Group Distributionally Robust OptimizationDistributionally Robust Optimization

  7. Decentralized Online Exp-Concave Optimization

    Oct 18, 2026Hao Qiu, Mengxiao Zhang, Yuanyu WanDecentralized OptimizationOnline Convex Optimization

  8. Multi-Token Random-Walk Learning via Meeting-Triggered Information Exchange

    Oct 10, 2026Taichun Yeh, Xingran ChenDecentralized LearningDecentralized Optimization

  9. Decentralized SGD under Heavy-Tailed Noise: Optimal Convergence Rates and the Role of Gradient Clipping

    Oct 7, 2026Aleksandar Armacki, Haoyuan Cai, Ali H. SayedDecentralized OptimizationStochastic Gradient Descent

  10. Network Intervention by Polling Strategic Agents

    Oct 6, 2026Chenyu Zhang, Rohit Parasnis, Saurabh AminMechanism DesignGame Theory

  11. Towards Decentralized Formation of Minimum-Length Communication Networks Using Robot Swarms

    Oct 5, 2026Genki Miyauchi, Mohamed S. Talamali, Julian Rau +1Swarm RoboticsCombinatorial Optimization

  12. Dimension-Free Decentralized Nonsmooth Nonconvex Stochastic Optimization

    Oct 5, 2026Yuanyu Wan, Lan Xue, Haomin Bai +2Nonconvex Stochastic OptimizationDecentralized Optimization

  13. Scalar Communication via Random Direction Refreshing for Distributed Optimization

    Oct 5, 2026Mohammadreza Rostami, Solmaz S. KiaDistributed OptimizationDecentralized Optimization

  14. From Mixing to Tearing: Graph Decomposition in Decentralized Optimization via Message Passing

    Oct 2, 2026Kuangyu Ding, Gesualdo ScutariDecentralized OptimizationPrimal-Dual Optimization

  15. Decentralized Power-Optimal Coordination for Spacecraft Swarms Using Time-Varying Magnetorquer Actuation

    Oct 1, 2026Yuta Takahashi, Shin-ichiro SakaiMulti-Agent CoordinationFeedback Control

  16. MANET-GNN: Learned Decentralized Optimization of Power Allocation in Multi-Channel MANETs

    Sep 30, 2026Tomer Alter, Nir Shlezinger, Michael SegalGraph Neural NetworksWireless Communications

  17. Decentralized Optimization with Cross-Coupled Mixed Affine Constraints

    Sep 26, 2026Ewsey Obzherin, Ilya Khomchenko, Natalia Shelegeda +4Decentralized OptimizationConstrained Optimization

  18. Private Decentralized Optimization with Noise Reduction and Bias Correction

    Sep 23, 2026Yizhao Fan, Wenjian Luo, Jiaojiao ZhangDifferential PrivacyVariance Reduction

  19. ZO-COSMO: Index-Free One-Hop Mixing for Decentralized Zeroth-Order Optimization

    Sep 23, 2026Shengjun Zhang, Tingyi Liu, Heng Zhang +1Communication-Efficient Distributed TrainingMulti-Agent Consensus

  20. Curvature-Independent Regret Bounds for Distributed Online Optimization on Hadamard Manifolds

    Sep 12, 2026Zhanyuan Cai, Emre Sahinoglu, Shahin ShahrampourRiemannian OptimizationDecentralized Optimization

  21. Dec-BFTRL: Squre-Root Regret for Decentralized Online Upper-Linearizable Optimization under Separation Access with Application to Continuous Submodular Maximization

    Aug 31, 2026Yiyang Lu, Mohammad Pedramfar, Vaneet AggarwalSubmodular OptimizationFollow-the-Regularized-Leader

  22. Resilient Decentralized Wireless Federated Learning via Gradient Tracking with AdamW

    Aug 26, 2026Nguyen Van Thieu, Ti Ti Nguyen, Ons Aouedi +2Decentralized LearningCommunication-Efficient Distributed Training

  23. Distributed Optimization with Streaming Data: A Temporal Weighting Perspective

    Aug 10, 2026Muhammad Faraz Ul Abrar, Nicolò Michelusi, Erik G. LarssonOnline Convex OptimizationDecentralized Optimization

  24. Argonaut: Interactive Visual Exploration for Distributed Optimization

    Jul 30, 2026Srijoni Majumdar, Chuhao Qin, Evangelos PournarasMulti-Agent System OptimizationVisual Analytics

  25. Distributed Convolutional Rank Regression over Decentralized Networks

    Jul 26, 2026Chunjing Li, Tiange Zhao, Xiaohui YuanDecentralized LearningDecentralized Optimization

  26. Decentralized Online Riemannian Optimization for Strongly Geodesically Convex Functions

    Jul 22, 2026Zhanyuan Cai, Emre Sahinoglu, Shahin ShahrampourOnline Convex OptimizationRiemannian Optimization

  27. The Optimization Trilemma: Efficiency, Comfort and Fairness in Decentralized Multi-agent Coordination

    Jul 19, 2026Jovan Nikolic, Maciej Krzysztof Zuziak, Evangelos PournarasMulti-Agent CoordinationFair Resource Allocation