Overview

Distributed optimization studies how multiple machines, clients, or robots can solve a shared problem using local data and limited communication. Common approaches include consensus and decentralized gradient methods, local or federated SGD, ADMM and primal-dual algorithms, and asynchronous updates; communication can be reduced through compression, quantization, or less frequent synchronization. These methods support settings from large-model training and statistical learning to robot coordination, energy systems, and networked control. A central challenge is balancing communication and computation against convergence when data and worker speeds differ, messages are delayed, or participants may be unreliable or adversarial.

Latest papers

CardsList

99 papers9 papers in the last four weeks, down 10% on the four weeks before. 0.1% of all new papers.

  1. Fair and Efficient Distributed EV Charging Coordination Using Threshold Cryptography and Machine Learning

    Nov 12, 2026Md. Mainul Islam, Muhammad Ismail, Hasan Kurban +2Electric Vehicle ChargingDistributed Optimization

  2. KKT-Perturbation-Aware Communication for Fully Distributed Online Convex Optimization with Nonseparable Coupling

    Nov 9, 2026Zhaoye Pan, Tao Li, Yunjie Guo +1Online Convex OptimizationDistributed Optimization

  3. DisMUSE: An Efficient Distributed Singular-Spectrum-Based Optimization Approach with Theoretical Convergence Guarantee

    Nov 6, 2026Zhen Qin, Zhiyao Zhang, Yingbin Liang +1Distributed OptimizationSpectral Optimization

  4. Projection-Free Gradient Tracking Neurodynamic for Distributed Nonnegative Sparse Optimization

    Nov 5, 2026Juntao Li, Qihang Guo, Deyuan MengDistributed OptimizationConstrained Optimization

  5. A Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least Squares

    Nov 5, 2026Juntao Li, Qihang Guo, Deyuan MengSparse RecoveryDistributed Optimization

  6. Distributed Grid Search for Hyperparameter Tuning

    Oct 30, 2026Constança De Herdeiro Cachim, Andrea Martin, Nicola BastianelloHyperparameter OptimizationDistributed Optimization

  7. Dobb: Shard-Local Preconditioning in Block-Diagonal Eigenbases

    Oct 29, 2026Shi-Yuk Fong, Shuhua Yu, Jiawei ZhangDistributed OptimizationCommunication-Efficient Distributed Training

  8. Parallel AI Agent Collaboration as Graph-Structured Distributed Block Optimization

    Oct 21, 2026Hanmin Li, Yury Demidovich, Peter RichtárikMulti-Agent CollaborationMulti-Agent System Optimization

  9. On Johnson-Lindenstrauss Transforms for Byzantine-Robust Optimization

    Oct 20, 2026Aleksandr Shestakov, Vladimir Aletov, Aleksandr BeznosikovRobust OptimizationDistributed Optimization

  10. Beyond Aggregate Drift: Optimal Client-Specific Windows in Federated Learning

    Oct 11, 2026Yuriy Dorn, Dmitrii Vishovan, Kirill Novoselov +3Federated LearningOnline Federated Learning

  11. Scalar Communication via Random Direction Refreshing for Distributed Optimization

    Oct 5, 2026Mohammadreza Rostami, Solmaz S. KiaDistributed OptimizationDecentralized Optimization

  12. Distributed Learning of αα-Potential Functions in Strategic Multi-agent Systems

    Oct 4, 2026Yifei Chen, Chinmay MaheshwariDistributed OptimizationGeneral-Sum Games

  13. Robustifying Asynchronous SGD via Soft Throttling

    Sep 30, 2026Kaoru Otsuka, Maxime Meyer, Yuki Takezawa +2Distributed OptimizationFault-Tolerant Distributed Training

  14. MegaGraph: Towards Efficient Training of Large-Scale Graph Transformers with Automated Hybrid Parallelism

    Sep 28, 2026Tong Qiao, Ao Zhou, Yingjie Qi +2Distributed OptimizationHigh-Performance Computing

  15. Resource-Efficient Distributed Recursive Gaussian Processes

    Sep 22, 2026Josephine King, Ali Emre Balci, Raj Thilak RajanDistributed OptimizationGaussian Processes

  16. Revisiting Distributed Sign-Based Variance Reduction

    Sep 16, 2026Wei Jiang, Zechao Li, Lijun ZhangSign-Based OptimizationCommunication-Efficient Distributed Training

  17. Fully Distributed GNE Algorithms for Multi-Robot Placement without Consensus on Multipliers

    Aug 29, 2026Shao-An Yin, Mingyi Hong, Nicola EliaNash Equilibrium ComputationDistributed Optimization

  18. SSTQ:Privacy-Preserving Vector Quantization via Subsampled Stochastic TurboQuant

    Aug 5, 2026Adel Javanmard, David P. Woodruff, Vahab MirrokniDistributed OptimizationVector Quantization

  19. A Spectral Filtering Approach to Regret Analysis of Distributed Online Control for Linear Dynamical Systems

    Aug 3, 2026Ting-Jui ChangDynamical SystemsDistributed Optimization

  20. Using Non-Lipschitz Signum-based Functions for Distributed Optimization and Machine Learning: Trade-off Between Con-vergence Rate and Optimality Gap

    Aug 2, 2026Mohammadreza Doostmohammadian, Amir Ahmad Ghods, Alireza Aghasi +2Sign-Based OptimizationDistributed Optimization

  21. Data-Driven Pinball-Loss Selection for Vertically Distributed Elastic-Net SVMs

    Aug 2, 2026Xiaofei Wu, Kai Qi, Rongmei LiangDistributed OptimizationAdaptive Loss Weighting

  22. First-order Constrained Trilevel Optimization Over Distributed Networks for Robust Coreset Selection

    Jul 30, 2026Yang Jiao, Kaixuan Jiao, Kai Yang +4Distributed OptimizationRobust Optimization

  23. Distributed Constraint Optimization via Online Learning and Iterative Pricing with Application to Large-Scale Satellite Scheduling

    Jul 28, 2026Itai Zilberstein, Pranav Rajbhandari, Steve Chien +1Distributed OptimizationPotential Games

  24. Distributed Model-Based Diffusion For Scalable Multi-Robot Trajectory Optimization

    Jul 23, 2026Haejoon Lee, Xinyi Wang, Taekyung Kim +1Multi-Robot Motion PlanningDistributed Optimization