Distributed Inference

Ask about this topic

Momentum

8 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 55

All topics
CardsList

  1. Cascadia: A Control-Plane-Free Alternative to Hyperconverged AI Infrastructure

    Sep 30, 2026Matias Parij, Pawan Paudel, Tate Berenbaum +1LLM ServingLLM Inference Scheduling

    Not Community Labs Inc. · Intel Corporation

  2. Purlin: Separating Orchestration from the Datapath of Collectives

    Sep 29, 2026Osayamen Jonathan Aimuyo, Swapnil Gandhi, Christos KozyrakisLLM Inference EfficiencyHigh-Performance Computing

    Stanford University · NVIDIA & Stanford University

  3. Reliability Testing of Medical Model Performance under Distributed Deployment

    Sep 29, 2026Yifei Wang, Xiaohan Zhang, Youtao Ding +4Multimodal Model EvaluationDistributed Inference

    Shanghai Jiao Tong University, China · Beihang University, China · Nanyang Technological University, Singapore +1

  4. Kafila: Serving Large Language Models on a Trusted Set of Heterogeneous Commodity Machines

    Sep 28, 2026Murtaza Rangwala, Richard O. Sinnott, Rajkumar BuyyaLLM InferenceLLM Inference Scheduling

    Quantum Cloud Computing and Distributed Systems (qCLOUDS) Lab, School of Computing and Information Systems, The University of Melbourne, Australia

  5. vidax: A Unified JAX Framework for Video Generative Models on Accelerator Meshes

    Sep 16, 2026Congyue DengVideo Diffusion ModelsTensor Parallelism

    Massachusetts Institute of Technology

  6. Recovering Governing Dynamics from Distributed Observations via Exact Spline Merging

    Sep 15, 2026Naveen MysorePDE DiscoveryDistributed Inference

    University of California, Santa Barbara · Dyssonance AI

  7. Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

    Sep 9, 2026Hongjian Fan, Kevin Zhang, David Habinsky +1LLM Inference EfficiencyKV Caching

    Research Group, Seagate Technology, LLC

  8. A Fundamental Limit in Decentralized Decision-Making

    Sep 7, 2026Marco Carpentiero, Felice Scala, Vincenzo Matta +1ClassificationDistributed Inference

    Department of Information and Electrical Engineering and Applied Mathematics (DIEM), University of Salerno, I-84084 Fisciano (SA), Italy · Institute of Electrical and Micro Engineering, EPFL, CH-1015 Lausanne, Switzerland

  9. Manifold-Aware General Coded Computing for Straggler-Resilient Distributed Computing

    Sep 1, 2026Parsa Moradi, Mohammad Ali Maddah-AliDistributed Inference

    University of Minnesota, Twin Cities Minneapolis, MN, USA

  10. User-Assisted Collaborative Distributed Inference for Efficient QoS-Aware Autoscaling

    Aug 12, 2026Alfreds Lapkovskis, Ali Beikmohammadi, Sindri Magnússon +1Distributed InferenceOnline Resource Allocation

    Department of Computer Systems and Sciences, Stockholm University SE-106 91 Stockholm, Sweden

  11. HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference

    Aug 1, 2026Xin Yuan, Ning Li, Wenchao Xu +2Edge InferenceCost-Aware Inference

    School of Ocean Engineering, Harbin Institute of Technology, Heilongjiang, China · School of Artificial Intelligence, University of Science and Technology Beijing, China · Division of Integrative Systems and Design, Hong Kong University of Science and Technology, Hong Kong +1

  12. Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines

    Jul 27, 2026Jhonatan Tavori, Gur-Eyal Sela, Ion Stoica +1Adversarial AttacksEdge Computing

    Columbia University · UC Berkeley

  13. Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

    Jul 25, 2026Zhihao Xu, Hao Zhong, Zeting Zhou +9Heterogeneous ComputingDistributed Inference

    Shanghai Jiao Tong University · Lenovo Information Products (Shenzhen) Ltd · Lenovo (Beijing) Ltd

  14. Integrity of peer-to-peer distributed LLM inference under malicious nodes

    Jul 21, 2026Mert Cihangiroglu, Antonino NoceraLLM SecurityDistributed Inference

    DCALab, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy

  15. DiTango: Cost-Effective Parallel Diffusion Generation with Selective Attention State Reuse

    Jul 17, 2026Yuyang Chen, Runxin Zhong, Zan Zong +3Diffusion TransformerEfficient Attention

    Shanghai Jiao Tong University, Shanghai AI Laboratory Shanghai, China · Tsinghua University Beijing, China · University of Science and Technology Beijing Beijing, China +1

  16. Decomposing Runtime, Kernel, and Quantization Speedups via a Matched FP16 Intermediate: A Hardware-Conditioned Case Study on Four NVIDIA RTX A5000 GPUs

    Jul 13, 2026Weijia Han, Lisha QuLLM QuantizationGPU Kernel Optimization

    University of Washington

  17. Stateful Worlds, Stateless Elasticity: Exact-State Serving for Interactive World Models

    Jul 11, 2026Jin Li, Jiawei ChenDistributed InferenceOnline Resource Allocation

    Harvard University · Harvard University Cambridge, MA, USA · Independent Researcher

  18. D-CLIPSE: Distributed Consensus-based Localization with Passive Listening on Shared State Exchange

    Jul 9, 2026Kyle Biron-Gricken, James Richard ForbesCooperative LocalizationRobot State Estimation

  19. CTA-Pipelining: A Latency-Oriented Spatial Scaling Method for Multi-GPU Systems

    Jul 8, 2026Tingkai Liu, Muralidhar Andoorveedu, Sanjoy Das +2GPU Kernel OptimizationHigh-Performance Computing

    University of Illinois Urbana-Champaign · NVIDIA Corporation

  20. Design-CP: Context Parallelism for Design of Protein Nanoparticles

    Jul 3, 2026Lorenzo Tarricone, Helen E. Eisenach, Aiko Muraishi +1GPU AccelerationHigh-Performance Computing

    Department of Statistics, University of Oxford, Oxford, UK · Ellison Institute of Technology Oxford, Oxford, UK · Institute for Protein Design, University of Washington, Seattle, USA +2

  21. From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving

    Jun 30, 2026Jie Li, Tongyang Wang, Yong ChenLLM Inference EfficiencyLLM Serving

    Texas Tech University, Department of Computer Science, Lubbock, Texas, USA

  22. Decentralised AI Training and Inference with BlockTrain

    Jun 23, 2026Peter Toth, Dan OprisaEfficient Transformer InferenceDecentralized Learning

    Spheroid Labs∗

  23. Privacy-preserving federated tensor decomposition of single-cell immune data: recovering multicellular programs across institutions

    Jun 22, 2026Axel Faes, Stephanie M. van den Berg, Maryam Amir HaeriFederated Learning AggregationTensor Decomposition

    Data Science Institute, Hasselt University, Belgium · University of Twente, The Netherlands · Learning, Data Analytics and Technology, University of Twente, The Netherlands

  24. BatchGen: An Architecture for Scalable and Efficient Batch Inference

    Jun 19, 2026Tairan Xu, Leyang Xue, Zhan Lu +7Efficient Neural Network InferenceEfficient Inference

    University of Edinburgh · Tencent

  25. Mesh Inference: A Formal Model of Collective Inference Without a Center

    Jun 17, 2026Hongwei XuPrivacy-Preserving MLMulti-Agent Reasoning

  26. AoiZora: Topology-Aware Auto-Parallel Optimization for Inference of Diffusion Transformers

    Jun 16, 2026Kaijian Wang, Yuanyuan Xu, Fanjiang Ye +5AI Accelerator InferenceVideo Diffusion Models

    Rice University · Independent Researcher · Google

  27. Director: Accelerating Distributed MoE Serving via Online Proactive Expert Placement

    Jun 13, 2026Qianli Liu, Kaibin Guo, Zicong Hong +5Expert ParallelismLLM Serving

    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong · School of Software Engineering, Sun Yat-Sen University, China · School of Cyber Science and Engineering, Xi’an Jiaotong University, China +1

  28. The Price of Anarchy in Disaggregated Inference

    Jun 11, 2026Athos GeorgiouLLM Inference EfficiencyGame Theory

    NCA

  29. M*: A Modular, Extensible, Serving System for Multimodal Models

    Jun 10, 2026Atindra Jha, Naomi Sagan, Keisuke Kamahori +9Efficient Multimodal InferenceDistributed Inference

    Stanford University · University of Washington · Carnegie Mellon University

  30. Multi-SPIN: Multi-Access Speculative Inference for Cooperative Token Generation at the Edge

    Jun 3, 2026Haotian Zheng, Zhanwei Wang, Mingyao Cui +3On-Device Language Model InferenceEdge Computing

    Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China