Multi-Gpu Systems

Ask about this topic

Recent momentum

-50%

4 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Multi-Gpu Systems

Neighbouring directions

Graphics Processing Unit MemoryNvidia NemotronSingle Graphics Processing UnitConsumer Graphics Processing Units

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

1 new paper

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Multi-Gpu Systems.

84 papers

Latest in Multi-Gpu Systems

Open your feed →
CardsList

  1. Shared KV Caching for Replicated 27B Inference: Correctness Failures and Performance Boundaries

    Sep 14, 2026Frank LiKv-Cache BlocksCache

  2. Numbat: Building and Verifying a Self-Contained Machine-Learning Stack

    Sep 9, 2026Thang Tran, Lan DangMachine LearningModel Training

  3. GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra

    Sep 8, 2026Pratik Rathore, Zachary Frangella, Parth Nobel +2Multi-Gpu SystemsRiemannian Optimization

  4. CRESSim-Neo: A Batched GPU Simulation Engine for Surgical Robotics and Robot Learning

    Aug 25, 2026Yafei Ou, Ahnaf Naheen, Tleukhan Mussin +3Robot-Assisted Minimally Invasive SurgeryPhysics Simulation

  5. TEMPO: Makespan-Aware Expert-Parallel Load Balancing Across Memory- and Compute-Bound Regimes

    Aug 13, 2026Jie Li, Chenxin Jia, Jinliang Shen +5Load BalancingMulti-Gpu Systems

  6. Ready Cohorts: Bounding GPU Opportunity and Avoiding Host Round Trips in LLM-Agent Control

    Aug 12, 2026Josef Liyanjun ChenMulti-Gpu SystemsConsumer Graphics Processing Units

  7. CARB: A Characterization-Guided Framework for CNN Inference Cost Prediction and Deployment Screening

    Aug 11, 2026Linh Nguyen, Zhixin PanGraph Neural Network InferenceInference Workloads

  8. Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

    Aug 10, 2026Matt J. Borowski, Blazej OsinskiTensor ProgramsGraphics Processing Unit Kernels

  9. SwiftQK: Fast and Communication-Efficient Tensor Parallelism for Query-Key Normalization

    Aug 10, 2026Gyudong Kim, Wonjun Han, Young Geun KimTensor ProgramsQuadratic Attention

  10. LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs

    Aug 7, 2026Liad Gerstman, Aditya Dhakal, Dejan Milojicic +1Graph Neural NetworksMulti-Gpu Systems

  11. LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation

    Aug 4, 2026Fan Yang, Yuting Su, Xiaobo Wang +7Efficient World-Action ModelLatent World Models

  12. HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference

    Aug 1, 2026Xin Yuan, Ning Li, Wenchao Xu +2Mixture-Of-Expert InferenceHeterogeneous Edge Devices

  13. Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

    Jul 25, 2026Zhihao Xu, Hao Zhong, Zeting Zhou +9Multi-Gpu SystemsOnline Inference

  14. Singular value soft-thresholding via the polar decomposition

    Jul 24, 2026Stephen BeckerSingular Value DecompositionMulti-Gpu Systems

  15. FusionML: Prefill, Not Decode - Mechanism and Boundaries of CPU+GPU Co-Execution on Unified-Memory Apple Silicon

    Jul 24, 2026Om MohiteMulti-Gpu SystemsPrefill

  16. Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts

    Jul 21, 2026Minyu Cui, Anna Wingkvist, Morgan EricssonMixture-Of-Expert InferenceMixture-of-Experts Models

  17. FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

    Jul 20, 2026Krish Agarwal, Zhuoming Chen, Yanyuan Qin +3FlashMulti-Gpu Systems

  18. AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker

    Jul 16, 2026Zixin Jiang, Bing He, Chaoran Xiong +3Unmanned Aerial Vehicle TrackingUncrewed Aerial Vehicles

  19. Compression of 3D Gaussian Splatting Data Using GPU-friendly Graphics Texture Coding

    Jul 16, 2026Amir Said, Randall Rauwendaal3D Gaussian SplatsMulti-Gpu Systems

  20. FlashDiff: Efficient Regional Execution and Scheduling for Diffusion Model Serving

    Jul 13, 2026Yaqi Qiao, Ping He, Songrun Xie +4Multi-Gpu SystemsFlash

  21. WarpMPC: Large-Batch MPC on GPU via ADMM with Unrolled LDL^\top Factorization

    Jul 13, 2026Henrik Hose, Se Hwan Jeon, Charles Khazoom +2Quadratic ProgramsAlternating Direction Method Of Multiplier

  22. Automated Tensor Scheduling for Hybrid CPU-GPU LLM Inference on Consumer Devices

    Jul 11, 2026Yangyijian Liu, Hongyi Ye, Mingyang Li +1Multi-Gpu SystemsLLM Inference Efficiency

  23. FlashTrie: A GPU-Accelerated Constrained Beam Search for Generative Retrieval

    Jul 10, 2026Dakshitha Anandakumar, Anurag Mukkara, Wenxiang Hu +5Beam SearchRetrieval Task

  24. CTA-Pipelining: A Latency-Oriented Spatial Scaling Method for Multi-GPU Systems

    Jul 8, 2026Tingkai Liu, Muralidhar Andoorveedu, Sanjoy Das +2Multi-Gpu SystemsNeural Scaling Laws

  25. OrchardBench: A Physically-Grounded, GPU-Parallel Apple-Orchard Simulation Benchmark for Agricultural Robotics

    Jul 7, 2026Humphrey MunnAgricultural RobotsPhysics Simulation

  26. UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

    Jul 7, 2026Yipeng Liu, Chang Liu, Si Shen +16Mixture-Of-Expert InferenceMixture-of-Experts Models

  27. FAST: A Holistic Framework for Optimizing Memory-I/O, Computation, and Sampling in Temporal GNN Training

    Jul 6, 2026Yushu Cai, Qingrui Zhu, Lei Liu +3Temporal Graph Neural NetworksMulti-Gpu Systems

  28. Design-CP: Context Parallelism for Design of Protein Nanoparticles

    Jul 3, 2026Lorenzo Tarricone, Helen E. Eisenach, Aiko Muraishi +1Protein DesignMulti-Gpu Systems

  29. WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

    Jul 2, 2026Mauricio Fadel Argerich, Jonathan Fürst, Marta Patiño-MartínezLLM Inference EfficiencyInference Workloads

  30. GPU-Parallel Linearization Error Bounds for Real-Time Robust Optimal Control of Nonlinear and Neural Network Dynamics

    Jul 1, 2026Jeffrey Fang, Keyi Shen, Anutam Srinivasan +1Multi-Gpu SystemsCondition Number

  31. Scaling Weisfeiler-Leman Expressiveness Analysis to Massive Graphs with GPUs

    Jul 1, 2026Filippo Biondi, Mirco Tribastone, Max TschaikowskiGraph Neural NetworksGraph Representations

  32. KernelSight-LM: A Kernel-Level LLM Inference Simulator

    Jun 26, 2026Xiteng Yao, Taeho Kim, Hengzhi Pei +7LLM Inference EfficiencyEfficient Inference

  33. Scaling Nonlinear Optimization: Many Problems One GPU

    Jun 24, 2026John Viljoen, Johanna Haffner, Masayoshi Tomizuka +1Multi-Gpu SystemsTrajectory Optimization

  34. \chisao{}: A GPU-Native Parallel Optimizer for Multimodal Black-Box Functions via Convergence-Anticonvergence Oscillation

    Jun 24, 2026Ira WolfsonBlack-Box OptimizationMulti-Gpu Systems

  35. L20-Edu-135M: An Auditable Single-GPU Study of Data-Efficient Small Language Modeling

    Jun 20, 2026Yin LiSmall Language ModelsMulti-Gpu Systems

  36. Splaxel: Efficient Distributed Training of 3D Gaussian Splatting for Large-scale Scene Reconstruction via Pixel-level Communication

    Jun 17, 2026Wenqi Jia, Zhewen Hu, Ying Huang +103D Gaussian SplatsDynamic Scene Reconstruction

  37. Mixed-Precision Communication-Avoiding SGD for Generalized Linear Models on GPUs

    Jun 16, 2026Aditya Devarakonda, Irene Simó Muñoz, Giulia GuidiStochastic Gradient DescentMulti-Gpu Systems

  38. SMEPilot: Characterizing and Optimizing LLM Inference with Scalable Matrix Extensions

    Jun 15, 2026Feiyang Chen, Haibo ChenLLM Inference EfficiencyMatrix Multiplication

  39. Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices

    Jun 13, 2026Tao Lu, Haoyu Wang, Zonghui Wang +3LLM Inference EfficiencyMatrix Multiplication

  40. Enabling Real-Time Point-of-Care Ultrasound Segmentation: A GPU-Free Deployment in Resource-Limited Settings

    Jun 13, 2026Weihao GaoUltrasoundExtreme Ultraviolet

  41. Robustness without Wrinkles: Parallel Simulation and Robust MPC for Certified Deformable Manipulation

    Jun 12, 2026Wei-Chen Li, Jeffrey Fang, Sasanka Polisetti +2Deformable ObjectsRobotic Arms

  42. A fully GPU-based workflow for building physics emulators of hypersonic flows

    Jun 11, 2026Fabian Paischer, Dylan Rubini, Deniz A. Bezgin +6Computational Fluid DynamicEmulators

  43. G-MAPP: GPU-accelerated Multi-Agent Planning and Perception for Reactive Motion Generation

    Jun 10, 2026Tanmay Bishnoi, Riddhiman Laha, Tobias Löw +3Collision-Free TrajectoriesMulti-Gpu Systems

  44. Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

    Jun 9, 2026Wenxin Wang, Yule Hou, Yu Ji +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  45. ASTRA-sim 3.0: Next-Level Distributed Machine Learning Simulations via High-Fidelity GPU and Infrastructure Modeling

    Jun 9, 2026William Won, Jinsun Yoo, Tuan Ta +16Multi-Gpu SystemsScalability

  46. Resource-aware Computation-Communication Overlap for multi-GPU ML Workloads

    Jun 8, 2026Minyu Cui, Miquel PericasMulti-Gpu SystemsInference Workloads

  47. Accelerated Fourier SAT (AFSAT): Fully Realising a GPU-based Symmetric Pseudo-Boolean SAT Solver

    Jun 4, 2026Cody J Christopher, Charles GrettonSatisfiabilityField-Programmable Gate Arrays

  48. GS-NFS: Bandwidth-adaptive Streaming of Dynamic Gaussian Splats and Point Clouds

    Jun 4, 2026Rajrup Ghosh, Haodong Wang, Haoran Hong +63D Gaussian SplatsGaussian Splatting

  49. Fitting scattered data with optional monotonicity constraints on GPU: LipFit package

    Jun 3, 2026Gleb BeliakovLipschitz ConstantInterpolation

  50. UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing

    Jun 2, 2026Xinming Wei, Chao Jin, Tuo Dai +10Load BalancingMixture-Of-Expert Inference

  51. GPU-Parallel Multi-Task Reinforcement Learning with Demonstration Guided Policy Optimization

    Jun 2, 2026Rui Zhang, Qiwei Wu, Zhengyu Zhang +5Multi-Task Reinforcement LearningMulti-Objective Policy Optimization

  52. Don't Let a Few Network Failures Slow the Entire AllReduce

    Jun 1, 2026Peiqing Chen, Jiedong Jiang, Nengneng Yu +4Distributed OptimizationMulti-Gpu Systems

  53. HASTE: Hardware-Aware Dynamic Sparse Training for Large Output Spaces

    May 31, 2026Nasib Ullah, Jinbin Zhang, Jean Lucien Randrianantenaina +2SparsityMulti-Label Classification

  54. Beyond Task-Agnostic: Task-Aware Grouping for Communication-Efficient Multi-Task MoE Inference

    May 31, 2026Zhiyao Xu, Aoxue Liu, Zhanjie Ding +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  55. SUPREME: A Multi-GPU Framework for Reproducible Image Unlearning Method Evaluation

    May 29, 2026Petros Andreou, Jamie Lanyon, Axel Finke +1Machine UnlearningUnlearning Aims

  56. GP-GOMEA with GPU-Based Fitness Evaluations: Design and Performance Analysis

    May 29, 2026Jasper Post, Johannes Koch, Anton Bouter +2Symbolic RegressionMulti-Gpu Systems

  57. UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

    May 28, 2026Yufei Jia, Zhanxiang Cao, Mingrui Yu +48Simulation-Based Reinforcement LearningScalable Robot Learning

  58. SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning

    May 26, 2026Wenyuan Zhao, Rui Tuo, Chao TianGaussian ProcessMulti-Gpu Systems

  59. Fine-Tuning and Serving Gemma 4 31B on Google Cloud TPU: A Technical Comparison with GPU Baselines

    May 25, 2026Jatin Kishnani, Mayank Goel, Amit Singh +2Multi-Gpu SystemsSingle Graphics Processing Unit

  60. roto 2.0: The Robot Tactile Olympiad

    May 20, 2026Elle Miller, Jayaram Reddy, Ayush Deshmukh +4Tactile PerceptionMulti-Gpu Systems