Multi-Gpu Systems

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

8 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Inside this field

Focused directions

274 papers

Latest in Multi-Gpu Systems

Browse all topics →
CardsList

  1. Detecting Hidden ML Training With Zero-Overhead Telemetry

    Jun 17, 2026Robi Rahman, Sabiha TajdariSingle Graphics Processing UnitEvasion

  2. Spotlight: Synergizing Seed Exploration and Spot GPUs for DiT RL Post-Training

    Jun 17, 2026Ruiqi Lai, Dakai An, Wei Gao +6Reinforcement Learning Post-TrainingMultimodal Diffusion Transformers

  3. Splaxel: Efficient Distributed Training of 3D Gaussian Splatting for Large-scale Scene Reconstruction via Pixel-level Communication

    Jun 17, 2026Wenqi Jia, Zhewen Hu, Ying Huang +103D Gaussian SplatsDynamic Scene Reconstruction

  4. Mixed-Precision Communication-Avoiding SGD for Generalized Linear Models on GPUs

    Jun 16, 2026Aditya Devarakonda, Irene Simó Muñoz, Giulia GuidiStochastic Gradient DescentMulti-Gpu Systems

  5. Communication-Efficient Verifiable Attention for LLM Inference

    Jun 15, 2026Ziqun Chen, Ming Wu, Michael Heinrich +4LLM Inference EfficiencyNvidia Nemotron

  6. SMEPilot: Characterizing and Optimizing LLM Inference with Scalable Matrix Extensions

    Jun 15, 2026Feiyang Chen, Haibo ChenLLM Inference EfficiencyMatrix Multiplication

  7. Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices

    Jun 13, 2026Tao Lu, Haoyu Wang, Zonghui Wang +3LLM Inference EfficiencyMatrix Multiplication

  8. Enabling Real-Time Point-of-Care Ultrasound Segmentation: A GPU-Free Deployment in Resource-Limited Settings

    Jun 13, 2026Weihao GaoUltrasoundExtreme Ultraviolet

  9. Exploring a Layer-Wise Design Space for KV Cache Eviction

    Jun 13, 2026Chao Fei, Kaihua Liang, Hanzhi Hu +4Key-Value Cache CompressionCache

  10. Realizing Native INT8 Compute for Diffusion Transformers on Consumer GPUs: A Fused INT8 GEMM Kernel for Ideogram 4.0

    Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiMultimodal Diffusion TransformersSystematic Fp16 Divergence

  11. Robustness without Wrinkles: Parallel Simulation and Robust MPC for Certified Deformable Manipulation

    Jun 12, 2026Wei-Chen Li, Jeffrey Fang, Sasanka Polisetti +2Deformable ObjectsRobotic Arms

  12. The Price of Anarchy in Disaggregated Inference

    Jun 11, 2026Athos GeorgiouGame TheoryNvidia Nemotron

  13. GF-DiT: Scheduling Parallelism for Diffusion Transformer Serving

    Jun 11, 2026Xinwei Qiang, Yifan Hu, Shixuan Sun +6Single Graphics Processing UnitParallel

  14. A fully GPU-based workflow for building physics emulators of hypersonic flows

    Jun 11, 2026Fabian Paischer, Dylan Rubini, Deniz A. Bezgin +6Computational Fluid DynamicEmulators

  15. MiniPIC: Flexible Position-Independent Caching in <100LOC

    Jun 11, 2026Nathan Ordonez, Thomas ParnellPrefillCache

  16. Performance Analysis and Optimization of 3D Generative Diffusion Models across GPU Architectures

    Jun 11, 2026Jeeho Ryoo, Yongchan Jung, Muhammad Ali Khaliq +33D Latent Diffusion ModelTensor Programs

  17. G-MAPP: GPU-accelerated Multi-Agent Planning and Perception for Reactive Motion Generation

    Jun 10, 2026Tanmay Bishnoi, Riddhiman Laha, Tobias Löw +3Collision-Free TrajectoriesMulti-Gpu Systems

  18. Holding the FP8 Quality Ceiling at 8-Bit Weights and Activations: INT8 and GGUF Post-Training Quantization of Ideogram 4.0 for Consumer GPUs

    Jun 10, 2026Deep Gandhi, Ali Asaria, Tony SalomoneWeight-Only QuantizationW4A4 Quantization

  19. Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

    Jun 9, 2026Wenxin Wang, Yule Hou, Yu Ji +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  20. ASTRA-sim 3.0: Next-Level Distributed Machine Learning Simulations via High-Fidelity GPU and Infrastructure Modeling

    Jun 9, 2026William Won, Jinsun Yoo, Tuan Ta +16Multi-Gpu SystemsScalability

  21. Resource-aware Computation-Communication Overlap for multi-GPU ML Workloads

    Jun 8, 2026Minyu Cui, Miquel PericasMulti-Gpu SystemsInference Workloads

  22. FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention

    Jun 8, 2026Yan Wang, Qifan Zhang, Jiachen Yu +12Efficient Long-Context InferenceDynamic Sparse Attention

  23. vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models

    Jun 6, 2026Khanh D. Nguyen, Hung T. Ho, Chinh T. Nguyen +5Real-Time InferenceExecutable Robot Behavior

  24. EvoGS: Constructing Continuous-Layered Gaussian Splatting with Evolution Tree for Scalable 3D Streaming

    Jun 5, 2026Yuang Shi, Simone Gasparini, Géraldine Morin +13D Gaussian SplatsGaussian Splatting

  25. Accelerated Fourier SAT (AFSAT): Fully Realising a GPU-based Symmetric Pseudo-Boolean SAT Solver

    Jun 4, 2026Cody J Christopher, Charles GrettonSatisfiabilityField-Programmable Gate Arrays

  26. Tangram: Unlocking Non-Uniform KV Cache Compression for Efficient Multi-turn LLM Serving

    Jun 4, 2026Hyungmin Kim, Minsoo Kim, Hongseok Kim +1Key-Value Cache CompressionLarge Language Model Serving

  27. RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

    Jun 4, 2026Yang Liu, ZhaoKai Luo, HuaYi Jin +5Key-Value CacheLarge Language Model Serving

  28. Inverting the Streaming-Diffusion Bottleneck: Video-Rate MLLM-Conditioned Edit Diffusion on a Consumer GPU

    Jun 4, 2026Yoshiyuki OotaniText-To-ImageProgressive Distillation

  29. GS-NFS: Bandwidth-adaptive Streaming of Dynamic Gaussian Splats and Point Clouds

    Jun 4, 2026Rajrup Ghosh, Haodong Wang, Haoran Hong +63D Gaussian SplatsGaussian Splatting

  30. MusaCoder: Native GPU Kernel Generation with Full-Stack Training on Moore Threads GPU

    Jun 3, 2026Kun Cheng, Songshuo Lu, Sicong Liao +7Graphics Processing Unit KernelsLarge Models

  31. Fitting scattered data with optional monotonicity constraints on GPU: LipFit package

    Jun 3, 2026Gleb BeliakovLipschitz ConstantInterpolation

  32. UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing

    Jun 2, 2026Xinming Wei, Chao Jin, Tuo Dai +10Load BalancingMixture-Of-Expert Inference

  33. GPU-Parallel Multi-Task Reinforcement Learning with Demonstration Guided Policy Optimization

    Jun 2, 2026Rui Zhang, Qiwei Wu, Zhengyu Zhang +5Multi-Task Reinforcement LearningMulti-Objective Policy Optimization

  34. NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation

    Jun 2, 2026NVIDIA, :, Aarti Basant +32Autonomous Driving SimulationAutonomous Driving

  35. Multi-Segment Attention: Enabling Efficient KV-Cache Management for Faster Large Language Model Serving

    Jun 1, 2026Chunan Shi, Yilei Chen, Yilin Chen +2CacheLLM Inference Efficiency

  36. STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models

    Jun 1, 2026Yuhang Han, Wenzheng Yang, Yujie Chen +4Key-Value Cache CompressionGraphics Processing Unit Memory

  37. Don't Let a Few Network Failures Slow the Entire AllReduce

    Jun 1, 2026Peiqing Chen, Jiedong Jiang, Nengneng Yu +4Distributed OptimizationMulti-Gpu Systems

  38. HASTE: Hardware-Aware Dynamic Sparse Training for Large Output Spaces

    May 31, 2026Nasib Ullah, Jinbin Zhang, Jean Lucien Randrianantenaina +2SparsityMulti-Label Classification

  39. Beyond Task-Agnostic: Task-Aware Grouping for Communication-Efficient Multi-Task MoE Inference

    May 31, 2026Zhiyao Xu, Aoxue Liu, Zhanjie Ding +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  40. ViBE: Co-Optimizing Workload Skew and Hardware Variability for MoE Serving

    May 30, 2026Seokjin Go, Marko Scrbak, Ephrem Wu +2Mixture-Of-Expert InferenceInference Workloads

  41. LP5X-PIM Sim: A High-Fidelity HW/SW Integrated Simulator for LPDDR5X-PIM

    May 30, 2026SangHoon Cha, Jaewan Choi, Byeongho Kim +3Nvidia Isaac SimNvidia Nemotron

  42. Threshold-Based Exclusive Batching for LLM Inference

    May 30, 2026Weifang Zhang, Yuzhou Nie, Bowen Pang +2Well-Tuned Static Batching PolicyLLM Inference Efficiency

  43. SUPREME: A Multi-GPU Framework for Reproducible Image Unlearning Method Evaluation

    May 29, 2026Petros Andreou, Jamie Lanyon, Axel Finke +1Machine UnlearningUnlearning Aims

  44. Bit-Exact AI Inference Verification Without Performance Tradeoffs

    May 29, 2026Naci CankayaOnline InferenceVerifier

  45. GRKV: Global Regression for Training-Free KV Cache Compression in Long-Context LLMs

    May 29, 2026Junjie Peng, You Wu, Haoyi Wu +4Key-Value Cache CompressionKey-Value Cache

  46. GP-GOMEA with GPU-Based Fitness Evaluations: Design and Performance Analysis

    May 29, 2026Jasper Post, Johannes Koch, Anton Bouter +2Symbolic RegressionMulti-Gpu Systems

  47. DSD-GS: Dynamic-Static Decomposition of Gaussian Splatting for Efficient and High-Fidelity Dynamic Scene Reconstruction

    May 29, 2026Youngtae Han, Sung-hwan Han, Youngmin YiDynamic Scene Reconstruction3D Gaussian Splats

  48. BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding

    May 29, 2026Liang He, Jingbo Wen, Qishi Zhan +4Speculative DecodingGraphics Processing Unit Memory

  49. Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended

    May 29, 2026Aditya K Kamath, Arvind Krishnamurthy, Marco Canini +1Large Language Model CompressionContext Compression

  50. Caspar: CUDA Accelerator for Symbolic Programming with Adaptive Reordering

    May 28, 2026Emil Martens, Aaron Miller, Matias Varnum +1CudaClassical Solvers

  51. Memory-Bound but Not Bandwidth-Limited: The Physical AI Inference Gap in Batch-1 LLM Decode

    May 28, 2026Josef ChenLLM Inference EfficiencyInference Workloads

  52. UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

    May 28, 2026Yufei Jia, Zhanxiang Cao, Mingrui Yu +48Simulation-Based Reinforcement LearningScalable Robot Learning

  53. Learning When to Optimize: Verified Optimization Skills from Expert GPU-Kernel Lineages

    May 27, 2026Shuoming Zhang, Qiuchu Yu, Yangyu Zhang +6Graphics Processing Unit KernelsCode Optimization

  54. The Energy Blind Spot: NVIDIA's Flagship Edge AI Hardware Cannot Support Process-Level Energy Attribution

    May 26, 2026Deepak Panigrahy, Aakash TyagiNvidia NemotronArtificial Intelligence Infrastructure

  55. SIKA-GP: Accelerating Gaussian Process Inference with Sparse Inducing Kernel Approximations for Bayesian Deep Learning

    May 26, 2026Wenyuan Zhao, Rui Tuo, Chao TianGaussian ProcessMulti-Gpu Systems

  56. Fine-Tuning and Serving Gemma 4 31B on Google Cloud TPU: A Technical Comparison with GPU Baselines

    May 25, 2026Jatin Kishnani, Mayank Goel, Amit Singh +2Multi-Gpu SystemsSingle Graphics Processing Unit

  57. CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM

    May 24, 2026Yubo Li, Yidi MiaoKv-Cache BlocksKey-Value Cache Eviction

  58. XWind: A Cross-site Router for Large Language Model Inference Serving at Renewable Energy Farms

    May 22, 2026Tella Rajashekhar Reddy, Atharva Deshmukh, Liangcheng Yu +7Artificial Intelligence Data CentersData Centers

  59. Convex Optimization for Alignment and Preference Learning on a Single GPU

    May 22, 2026Miria Feng, Mert PilanciPreference AlignmentDirect Preference Optimization

  60. Adaptive Mass-Segmented KV Compression for Long-Context Reasoning

    May 22, 2026Junzhe Yang, Xiaoyu ShenKey-Value Cache CompressionKey-Value Cache