Multi-Gpu Systems

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

8 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Inside this field

Focused directions

274 papers

Latest in Multi-Gpu Systems

Browse all topics →
CardsList

  1. From Tokens to Watt-hours: Analytical Energy Estimation for LLM Inference on Modern GPUs

    Jul 29, 2026Tina Vartziotis, Rodopi Kosteli, Elli Vartziotis +5LLM Inference EfficiencyNvidia Nemotron

  2. Cutting AI Datacenter Energy with Reinforcement Learning: Measured Power Control of LLM Training from One GPU to the Fleet

    Jul 27, 2026Eliseo CurcioReinforcement Learning Post-TrainingArtificial Intelligence Data Centers

  3. Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

    Jul 25, 2026Zhihao Xu, Hao Zhong, Zeting Zhou +9Multi-Gpu SystemsOnline Inference

  4. Real2Sim2Real for Vision-Language-Action Manipulation: An AMD ROCm-Based Pipeline

    Jul 25, 2026Qing Yang, Xun Wang, Ziguan Wang +3Vision-Language-Action ModelsSim-To-Real Gap

  5. Singular value soft-thresholding via the polar decomposition

    Jul 24, 2026Stephen BeckerSingular Value DecompositionMulti-Gpu Systems

  6. HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding

    Jul 24, 2026Chao Fang, Jun Yin, Man Shi +1Key-Value CacheGraphics Processing Unit Memory

  7. FusionML: Prefill, Not Decode - Mechanism and Boundaries of CPU+GPU Co-Execution on Unified-Memory Apple Silicon

    Jul 24, 2026Om MohiteMulti-Gpu SystemsPrefill

  8. Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts

    Jul 21, 2026Minyu Cui, Anna Wingkvist, Morgan EricssonMixture-Of-Expert InferenceMixture-of-Experts Models

  9. ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

    Jul 21, 2026Fan Jiang, Zhaoxu Sun, Mengchao Wang +38Video World ModelsAgentic Control

  10. From a Multilingual Streaming ASR Backbone to Kenyan-Language Systems: Data-Centric Adaptation of Nemotron 3.5 for Kikuyu, Dholuo, and Kalenjin

    Jul 21, 2026Mark GatereAfrican LanguagesMultilingual Language Models

  11. FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

    Jul 20, 2026Krish Agarwal, Zhuoming Chen, Yanyuan Qin +3FlashMulti-Gpu Systems

  12. A Hardware-oriented Approach for Efficient Bayesian Inference Computation and Deployment

    Jul 20, 2026Nikola Pižurica, Matteo Risso, Nikola Milović +4BayesianResource-Constrained Edge Devices

  13. MegaSlide-DiT: Memory-Centric Adaptation and Deformable Local Attention for Efficient Video Diffusion

    Jul 17, 2026Jiacheng Liu, Jason LiuPre-Trained Video Diffusion ModelsSpatial Attention

  14. PagedWeight: Efficient MoE LLM Serving with Dynamic Quality-Aware Weight Quantization

    Jul 17, 2026Yuchen Yang, Yifan Zhao, Anisha Dasgupta +1Mixture-Of-Expert Language ModelsGraphics Processing Unit Memory

  15. Rendering 3D Gaussians on a Graph Processor

    Jul 17, 2026Nicholas Fry, Ignacio Alzugaray, Mark Pupilli +23D GaussianConsumer Graphics Processing Units

  16. LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget

    Jul 16, 2026Changhai Zhou, Kieran Liu, Yuhua Zhou +17Efficient Long-Context InferenceLLM Inference Efficiency

  17. AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker

    Jul 16, 2026Zixin Jiang, Bing He, Chaoran Xiong +3Unmanned Aerial Vehicle TrackingUncrewed Aerial Vehicles

  18. A Modern Multimodal Assistant on a 6 GB 2011 GPU: Stage-Validated, All-GPU CUDA Inference for Fermi

    Jul 16, 2026A. C. Opus, J. Q. LuNvidia NemotronCuda

  19. Compression of 3D Gaussian Splatting Data Using GPU-friendly Graphics Texture Coding

    Jul 16, 2026Amir Said, Randall Rauwendaal3D Gaussian SplatsMulti-Gpu Systems

  20. Agora: Collective and Permissionless Internet-Scale Pretraining of Large Language Models

    Jul 14, 2026Gil Avraham, Violetta Shevchenko, Hadi Mohaghegh Dolatabadi +9Large ModelsParallel

  21. EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting

    Jul 14, 2026Mingxing Xu, Rakesh Chowdary Machineni, Ke Liu +7Accurate Traffic ForecastingHeterogeneous Graph Transformers

  22. FlashDiff: Efficient Regional Execution and Scheduling for Diffusion Model Serving

    Jul 13, 2026Yaqi Qiao, Ping He, Songrun Xie +4Multi-Gpu SystemsFlash

  23. WarpMPC: Large-Batch MPC on GPU via ADMM with Unrolled LDL⊤LDL^\top Factorization

    Jul 13, 2026Henrik Hose, Se Hwan Jeon, Charles Khazoom +2Quadratic ProgramsAlternating Direction Method Of Multiplier

  24. Automated Tensor Scheduling for Hybrid CPU-GPU LLM Inference on Consumer Devices

    Jul 11, 2026Yangyijian Liu, Hongyi Ye, Mingyang Li +1Multi-Gpu SystemsLLM Inference Efficiency

  25. FlashBEV: Fast and Memory-Efficient Exact BEV Transformation with IO-Awareness

    Jul 11, 2026Shunsuke Yokokawa, Hironori KasaharaBird'S-Eye ViewSelf-Supervised Vision Transformers

  26. FlashTrie: A GPU-Accelerated Constrained Beam Search for Generative Retrieval

    Jul 10, 2026Dakshitha Anandakumar, Anurag Mukkara, Wenxiang Hu +5Beam SearchRetrieval Task

  27. Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Key-Value CacheLarge Language Model Serving

  28. CTA-Pipelining: A Latency-Oriented Spatial Scaling Method for Multi-GPU Systems

    Jul 8, 2026Tingkai Liu, Muralidhar Andoorveedu, Sanjoy Das +2Multi-Gpu SystemsNeural Scaling Laws

  29. An Introduction and Tutorial for the Beagle Framework

    Jul 7, 2026Ilya Basin, Nathan HautGenetic AlgorithmsSymbolic Regression

  30. DepthWeave-KV: Token-Adaptive Cross-Layer Residual Factorization for Long-Context KV Cache Compression

    Jul 7, 2026Anna Cordoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionEfficient Long-Context Inference

  31. FreqDepthKV: Frequency-Guided Depth Sharing for Robust KV Cache Compression in Long-Context LLM Inference

    Jul 7, 2026Anna Córdoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionLLM Inference Efficiency

  32. OrchardBench: A Physically-Grounded, GPU-Parallel Apple-Orchard Simulation Benchmark for Agricultural Robotics

    Jul 7, 2026Humphrey MunnAgricultural RobotsPhysics Simulation

  33. UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

    Jul 7, 2026Yipeng Liu, Chang Liu, Si Shen +16Mixture-Of-Expert InferenceMixture-of-Experts Models

  34. Energy-Efficient GPU DVFS for Fine-Tuning of SLMs on Resource-constrained Embedded Devices

    Jul 7, 2026Jurn-Gyu Park, Sanzhar Zholdybayev, Aidar Amangeldi +1Single Graphics Processing UnitResource-Constrained Edge Devices

  35. FAST: A Holistic Framework for Optimizing Memory-I/O, Computation, and Sampling in Temporal GNN Training

    Jul 6, 2026Yushu Cai, Qingrui Zhu, Lei Liu +3Temporal Graph Neural NetworksMulti-Gpu Systems

  36. Design-CP: Context Parallelism for Design of Protein Nanoparticles

    Jul 3, 2026Lorenzo Tarricone, Helen E. Eisenach, Aiko Muraishi +1Protein DesignMulti-Gpu Systems

  37. Microcosmos: Reimagining Artificial Life for the GPU Era

    Jul 3, 2026Mark Tensen, Ciaran Regan, Bert Wang-Chak Chan +3Physics SimulationEvolution

  38. WattGPU: Predicting Inference Power and Latency on Unseen GPUs and LLMs

    Jul 2, 2026Mauricio Fadel Argerich, Jonathan Fürst, Marta Patiño-MartínezLLM Inference EfficiencyInference Workloads

  39. GPU-Parallel Linearization Error Bounds for Real-Time Robust Optimal Control of Nonlinear and Neural Network Dynamics

    Jul 1, 2026Jeffrey Fang, Keyi Shen, Anutam Srinivasan +1Multi-Gpu SystemsCondition Number

  40. Scaling Weisfeiler-Leman Expressiveness Analysis to Massive Graphs with GPUs

    Jul 1, 2026Filippo Biondi, Mirco Tribastone, Max TschaikowskiGraph Neural NetworksGraph Representations

  41. MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

    Jul 1, 2026Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5Key-Value Cache CompressionEfficient Long-Context Inference

  42. From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving

    Jun 30, 2026Jie Li, Tongyang Wang, Yong ChenCacheLarge Language Model Serving

  43. SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference

    Jun 30, 2026Amirhossein Abaskohi, Giuseppe Carenini, Peter West +1Key-Value Cache CompressionKey-Value Cache

  44. The FIL Hypothesis: Inductive Biases Help with Kernel Engineering

    Jun 29, 2026Nikolai Rozanov, Subhabrata Dutta, Preslav Nakov +1Inductive BiasHypothesis

  45. RiverONE: Generating Knowledge-Intensive VLM by Simulated Quantum Machines

    Jun 29, 2026Xindian Ma, Xinyu Long, Yefei Zhang +11Large Language Model QuantizationLarge Vision Language Models

  46. HARD-KV: Head-Adaptive Regularization for Decoding-time KV Compression

    Jun 27, 2026Yuxuan Yang, Feiyang Ren, Bowen Zeng +4Key-Value Cache CompressionLLM Inference Efficiency

  47. KernelSight-LM: A Kernel-Level LLM Inference Simulator

    Jun 26, 2026Xiteng Yao, Taeho Kim, Hengzhi Pei +7LLM Inference EfficiencyEfficient Inference

  48. PersistentKV: Page-Aware Decode Scheduling for Long-Context LLM Serving on Commodity GPUs

    Jun 25, 2026Muhammad AhmedGraphics Processing Unit MemoryQuadratic Attention

  49. CAT-Q: Cost-efficient and Accurate Ternary Quantization for LLMs

    Jun 25, 2026Shigeng Wang, Chao Li, Yangyuxuan Kang +2Large Language Model QuantizationQuantization

  50. Scaling Nonlinear Optimization: Many Problems One GPU

    Jun 24, 2026John Viljoen, Johanna Haffner, Masayoshi Tomizuka +1Multi-Gpu SystemsTrajectory Optimization

  51. \chisao{}: A GPU-Native Parallel Optimizer for Multimodal Black-Box Functions via Convergence-Anticonvergence Oscillation

    Jun 24, 2026Ira WolfsonBlack-Box OptimizationMulti-Gpu Systems

  52. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Kv-Cache BlocksLarge Language Model Serving

  53. Teaching LLMs String Matching, Backtracking, and Error Recovery to Deduce Bases and Truth Tables for the Combinatorially Exploding Bit Manipulation Puzzles

    Jun 22, 2026Prateek Agnihotri, Sanchit Jain, Prabhat Agnihotri +2Large Language Model PerformanceCombinations

  54. GRINQH: Graded Input-based Quantization Hierarchy for Efficient LLM Generation

    Jun 22, 2026Jette Oberländer, Jan Finkbeiner, Catherine M. Schöfmann +1Large Language Model QuantizationExtreme Low-Bit Quantization

  55. MINCE: Shrinking LLM Evaluation Datasets via Few-Model Monte Carlo Calibration

    Jun 22, 2026Devleena Das, Rajeev Patwari, Vikram Kumar Bukka +3Large Language Model EvaluationMonte Carlo

  56. L20-Edu-135M: An Auditable Single-GPU Study of Data-Efficient Small Language Modeling

    Jun 20, 2026Yin LiSmall Language ModelsMulti-Gpu Systems

  57. Load Testing for Machine Learning Model Serving Systems at Scale

    Jun 20, 2026Amr S. Abdelfattah, Nakul Tirumalai, Indu Mohanan +4Machine LearningSingle Graphics Processing Unit

  58. SPOTR: Spatio-temporal Pooling One-Token Reconstruction for Universal Physiological Signal Self-supervised Learning

    Jun 20, 2026Yiyu Gui, Mingzhi Chen, Yuesheng Zhu +2Physiological DataSelf-Supervised

  59. HERALD: High-Throughput Block Diffusion LLM Serving via CPU-GPU Cooperative KV Cache Retrieval

    Jun 19, 2026Omin Kwon, Doyeon Kim, Jongseok Park +3LLM Inference EfficiencyGraphics Processing Unit Memory

  60. SSH-Net: A Deep Neural Network for Predicting Failure Time Distribution Functions under Competing Risks with Application to GPU Data

    Jun 18, 2026Jie Min, Yueyao Wang, Mengkun ChenTime-To-Event DataEarly Failure Prediction