Distributed Training

Latest papers 82

All topics
CardsList
  1. Privacy-Preserving Distributed Learning in IoT Systems: A Unified Threat Model and Evaluation Framework

    May 10, 2026John Cartmell, Alexander WilliamsInternet of ThingsPrivacy-Preserving ML

  2. CCL-D: A High-Precision Diagnostic System for Slow and Hang Anomalies in Large-Scale Model Training

    May 6, 2026Yida Gu, Fakang Wang, Jianhao Fu +17Anomaly LocalizationDistributed Training

  3. Resilient AI Supercomputer Networking using MRC and SRv6

    May 5, 2026Joao Araujo, Alex Chow, Mark Handley +47Distributed Training

  4. DBLP: Phase-Aware Bounded-Loss Transport for Burst-Resilient Distributed ML Training

    May 3, 2026Zechen Ma, Zixi Qu, Jinyan Yi +2Communication-Efficient Distributed TrainingDistributed Training

  5. Accelerating Long-Tail Generation in Synchronous RLHF Training via Adaptive Tensor Parallelism

    May 3, 2026Long Zhao, Qinghe Wang, Jiaan Zhu +5Tensor ParallelismLLM Inference Acceleration

  6. Adaptation of AI-accelerated CFD Simulations to the IPU platform

    May 1, 2026P. Rosciszewski, A. Krzywaniak, S. Iserte +2AI for SciencePDE Surrogate Modeling

  7. FloatSOM: GPU-Accelerated, Distributed, Topology-Flexible Self-Organizing Maps

    Apr 29, 2026Tony Xu, Sarah Klamt, Katherine Turner +3GPU AccelerationHigh-Performance Computing

  8. TACO: Efficient Communication Compression of Intermediate Tensors for Scalable Tensor-Parallel LLM Training

    Apr 27, 2026Man Liu, Xingchen Liu, Xingjian Tian +8Communication-Efficient Distributed TrainingTensor Parallelism

  9. Decoupled DiLoCo for Resilient Distributed Pre-training

    Apr 23, 2026Arthur Douillard, Keith Rush, Yani Donchev +14Language Model PretrainingDistributed Optimization

  10. Towards Energy Impact on AI-Powered 6G IoT Networks: Centralized vs. Decentralized

    Apr 21, 2026Anjie Qiu, Donglin Wang, Sanket Partani +2Energy-Efficient MLInternet of Things

  11. Scalable and Adaptive Parallel Training of Graph Transformer on Large Graphs

    Apr 17, 2026Jun-Liang Lin, Kamesh Madduri, Mahmut Taylan KandemirDistributed TrainingGraph Transformer

  12. Training Time Prediction for Mixed Precision-based Distributed Training

    Apr 17, 2026Minchul Kang, Changyong Shin, Jinwoo Jeong +5Deep Learning OptimizationDistributed Training

  13. PINNACLE: An Open-Source Computational Framework for Classical and Quantum PINNs

    Apr 17, 2026Shimon Pisnoy, Hemanth Chandravamsi, Ziv Chen +4Neural PDE SolversPDE Surrogate Modeling

  14. Scalable Synthesis of distributed LLM workloads through Symbolic Tensor Graphs

    Nov 13, 2025Changhai Man, Joongun Park, Hanjiang Wu +3LLM InferenceDistributed Training

  15. Tight Stability Bounds for Robust Distributed Learning: Byzantine Failures Hurt Generalization More than Data Poisoning

    Jun 22, 2025Thomas Boudou, Batiste Le Bars, Nirupam Gupta +1Byzantine-Robust Federated LearningAlgorithmic Stability

  16. Chisme: Heterogeneity-Aware Gossip Learning

    May 14, 2025Harikrishna Kuttivelil, Katia ObraczkaEdge ComputingDecentralized Learning

  17. Split-n-Chain: Privacy-Preserving Multi-Node Split Learning with Blockchain-Based Auditability

    Mar 10, 2025Mukesh Sahani, Binanda SenguptaPrivacy-Preserving MLDistributed Training