Multi-Gpu Systems

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Period ending 2026-09-07

10 new papers

A weekly snapshot of new work published in Multi-Gpu Systems.

Inside this field

Focused directions

217 papers

Latest in Multi-Gpu Systems

Open your feed →
CardsList

  1. AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization

    Sep 14, 2026Ji Liu, Saptarshi Majumder, Yiqing Huang +14Graphics Processing Unit Kernels

  2. Numbat: Building and Verifying a Self-Contained Machine-Learning Stack

    Sep 9, 2026Thang Tran, Lan DangMachine LearningMulti-Gpu Systems

  3. GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra

    Sep 8, 2026Pratik Rathore, Zachary Frangella, Parth Nobel +2Multi-Gpu SystemsSpectral Preconditioning

  4. MaxKernel: Agentic Kernel Generation for TPUs

    Sep 7, 2026Shangkun Wang, Nina Cai, Charles Hoong +7Graphics Processing Unit KernelsAgentic AI Systems

  5. Efficient Constant Optimization for Symbolic Regression with GPU-Accelerated Tree-Based Genetic Programming

    Sep 3, 2026Hao Mao, Xu Tony Liu, Shuai Lu +3Symbolic RegressionGenetic Algorithms

  6. LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference

    Sep 2, 2026Renyuan Liu, Yuyang Leng, Kaiyan Liu +7LLM Inference EfficiencyStreaming

  7. InKAN: B-Spline KANs via Truncated Power Form

    Sep 2, 2026Naveen MysoreKolmogorov-Arnold NetworksB-Spline

  8. CacheBridge: Efficient Cross-Model KV Cache Transfer

    Sep 1, 2026Xingyu Qu, Siyuan Lu, Zhiyu Chen +2Graphics Processing Unit KernelsAffine

  9. Workload Identification with Physical Side Channels for AI Governance

    Aug 31, 2026Simone Gargiulo, Gabriel KulpWorkloadRtx

  10. Deploying DeepSeek 175B Locally on a Single Consumer-Grade RTX 4060 Laptop with 32GB RAM for 200k-Scale Protein-Ligand Virtual Screening

    Aug 31, 2026Rui Xiao, Yili XuDrug DesignRtx

  11. Amortized Anchor Refinement for Deployable Continuous-Time 4D Gaussian Reconstruction

    Aug 31, 2026Jingong Chen, Qingwen Zhang, Sanghyeon Jun +34D ReconstructionIndependent Anchor Network

  12. Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

    Aug 27, 2026Kairong Luo, Jiarui Cui, Yaorui Yin +8Large Language Model Post-TrainingQwen3

  13. CRESSim-Neo: A Batched GPU Simulation Engine for Surgical Robotics and Robot Learning

    Aug 25, 2026Yafei Ou, Ahnaf Naheen, Tleukhan Mussin +3Robot-Assisted Minimally Invasive SurgeryPhysics Simulation

  14. TEMPO: Makespan-Aware Expert-Parallel Load Balancing Across Memory- and Compute-Bound Regimes

    Aug 13, 2026Jie Li, Chenxin Jia, Jinliang Shen +5Multi-Gpu SystemsParallel Decoding and Training

  15. DMDIntel: Interpreting Large Language Models via Dynamic Mode Decomposition

    Aug 13, 2026Amogh Joshi, Animesh Mukherjee, Sergey UtyuzhnikovFeature AttributionRtx

  16. A Contract-Grade Verifier for LLM-Generated GPU Kernels, and a Native Blackwell Backward for the Gated-Linear-Recurrence Family

    Aug 13, 2026Rishi Shah, Rishav ShresthaGraphics Processing Unit KernelsCorrectness

  17. CAKE: Compiler-Agent Co-Design for Frontier Kernel Evolution

    Aug 12, 2026Zihao Ye, Yingyi Huang, Hongyi Jin +11Graphics Processing Unit KernelsGraphics Processing Unit Utilization

  18. Ready Cohorts: Bounding GPU Opportunity and Avoiding Host Round Trips in LLM-Agent Control

    Aug 12, 2026Josef Liyanjun ChenGraphics Processing Unit GenerationsTransitions

  19. RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

    Aug 12, 2026Jinjun Huang, Zhongzhen Wen, Tongtong Xu +3Graphics Processing Unit KernelsLarge Language Model Benchmarks

  20. CARB: A Characterization-Guided Framework for CNN Inference Cost Prediction and Deployment Screening

    Aug 11, 2026Linh Nguyen, Zhixin PanGraph Neural Network InferenceMulti-Gpu Systems

  21. Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

    Aug 10, 2026Matt J. Borowski, Blazej OsinskiTensor ProgramsMulti-Gpu Systems

  22. SwiftQK: Fast and Communication-Efficient Tensor Parallelism for Query-Key Normalization

    Aug 10, 2026Gyudong Kim, Wonjun Han, Young Geun KimTensor ProgramsBatch Normalization

  23. Gradient Under Microscope: Benchmarking Resource Utilization of Memory-Efficient Gradient Computation Methods

    Aug 9, 2026Sarthak Mahapatra, Zihan Zhou, Khatoon Khedri +2Graphics Processing Unit UtilizationLow-Precision Training

  24. Gaming Without an Attacker: Benchmark Fingerprinting in LLM-Driven Search Under Selection Pressure

    Aug 9, 2026Víctor GallegoGraphics Processing Unit KernelsBenchmark Suite

  25. What Irregularity Costs: CUDA C++, Rust, and Triton on a Hash-Blocked GPU Workload

    Aug 8, 2026Petr KorolevCudaGraphics Processing Unit Utilization

  26. LGNNIC: Acceleration of Large-Scale GNN Training using SmartNICs

    Aug 7, 2026Liad Gerstman, Aditya Dhakal, Dejan Milojicic +1Graph Neural NetworksMulti-Gpu Systems

  27. Dual-Node NVIDIA DGX Spark over Tailscale: A Remote-Access Testbed for Distributed LLM Training and Cyber-Threat-Intelligence Fine-Tuning

    Aug 7, 2026Vasanth IyerRtxAccelerator

  28. Multi-Level Modeling of Large Language Model Inference Latency and Energy via Hybrid Analytical--Machine-Learning Predictors

    Aug 7, 2026Saeid Shokoufa, Mohammad Erfan Sadeghi, Mehdi Kamal +1LLM Inference EfficiencyArtificial Intelligence Infrastructure

  29. Operating Multi-Node Full Fine-Tuning on NVIDIA B300: A Field Report on Telemetry-Based Triage, Negative Results, and Operational Hardening

    Aug 6, 2026Seon Ho Kim, Ui Jeong Jeon, Su Hyeon Kim +1RtxAccelerator

  30. SparseDitto: An Agentic Sparse Compilation Framework through Architecture-Aware Synthesis on GPUs

    Aug 5, 2026Shiyang Li, Guangyan Sun, Jinwei Tang +3Graphics Processing Unit KernelsSparsity

  31. LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation

    Aug 4, 2026Fan Yang, Yuting Su, Xiaobo Wang +7Latent World Action ModelsAction-Sensitive World Models

  32. Accelerating Dynamic Graph Clustering on GPU Architectures with cuGraph

    Aug 4, 2026Nelson Aloysio Reis de Almeida Passos, Emanuele Carlini, Salvatore TraniTemporal Graph Neural NetworksClustering

  33. Don't Regenerate, Debug: A Domain-Specific Agent for Repairing Near-Miss Hardware Operators

    Aug 3, 2026Yansong Sun, Shenxiu Wu, Siyuan Chen +6Precise DebuggingGraphics Processing Unit Kernels

  34. LEAP: Lean Environment-Feedback via Adaptive Pruning for Code RL in GPU Kernel Generation

    Aug 3, 2026Tankun Li, Zhi Chen, Yaohua TangGraphics Processing Unit KernelsAI Code Generation

  35. Bole: Efficient Tree Speculation for Hybrid-Attention Language Models

    Aug 3, 2026Li Wang, Yi Su, Xiabao Wu +9Speculative DecodingLLM Inference Efficiency

  36. Meganeura: Portable GPU Training and Inference through Vulkan and Metal

    Aug 3, 2026Dzmitry MalyshauGraphics Processing Unit GenerationsPytorch

  37. HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference

    Aug 1, 2026Xin Yuan, Ning Li, Wenchao Xu +2Mixture-Of-Expert InferenceEdge Computing

  38. TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

    Jul 29, 2026Hengyi Xie, Chenfei Yao, Xianjin Wu +7Diffusion-Based Vision-Language-ActionsRobot Actions

  39. Device-First Feedback: Toward Mobile-Native LLM-Driven Neural Architecture Search

    Jul 29, 2026Saif U Din, Muhammad Ahsan Hussain, Radu Timofte +1Large Language Model Fine-TuningNeural Architecture Search

  40. X-Stage: Modeling Post-Issue Backpressure in GPU Communication--Computation Fusion

    Jul 25, 2026Jianwen Xian, Zhiyuan Xu, Yuchen Li +9Tensor ProgramsGraphics Processing Unit Kernels

  41. Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

    Jul 25, 2026Zhihao Xu, Hao Zhong, Zeting Zhou +9Graphics Processing Unit UtilizationOffloading

  42. Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

    Jul 25, 2026Dongjie Chen, Ping Zhao, Bohua Zhan +11Graphics Processing Unit KernelsCode Optimization

  43. Real2Sim2Real for Vision-Language-Action Manipulation: An AMD ROCm-Based Pipeline

    Jul 25, 2026Qing Yang, Xun Wang, Ziguan Wang +3Vision-Language-ActionSim-To-Real Gap

  44. Singular value soft-thresholding via the polar decomposition

    Jul 24, 2026Stephen BeckerSingular Value DecompositionMulti-Gpu Systems

  45. FusionML: Prefill, Not Decode - Mechanism and Boundaries of CPU+GPU Co-Execution on Unified-Memory Apple Silicon

    Jul 24, 2026Om MohiteMulti-Gpu SystemsPrefill

  46. Multi-turn RL with Structural and Performance Aware Rewards for CUDA Kernel Generation

    Jul 23, 2026Quazi Ishtiaque Mahmud, Nesreen K. Ahmed, Ali JannesariCudaCode Optimization

  47. KernelGenBench: Can LLMs and Agents Write Efficient Kernels Across Operator Sources and Hardware Platforms?

    Jul 22, 2026Peiyu Zang, Jian Tao, Jialing Zhang +4Graphics Processing Unit KernelsLarge Language Model Benchmarks

  48. Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts

    Jul 21, 2026Minyu Cui, Anna Wingkvist, Morgan EricssonMixture-Of-Expert InferenceModern Mixture-Of-Experts

  49. MoA-Structured Decode Attention DNF Derivation, KV-Cache Accumulation, GQA/MQA, and OpenACC Kernel

    Jul 21, 2026Lenore Mulin, Gaetan HainsTransformer AttentionKey-Value Cache Quantization

  50. ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

    Jul 21, 2026Fan Jiang, Zhaoxu Sun, Mengchao Wang +38World Models and DynamicsAgentic Control

  51. FlashRT: Agent Harness for Guiding Agents to Deploy Real-Time Multimodal Applications

    Jul 20, 2026Krish Agarwal, Zhuoming Chen, Yanyuan Qin +3FlashMulti-Gpu Systems

  52. Harness Engineering for LLM-Driven GPU Kernel Generation

    Jul 20, 2026Yue Shui, Chenyu Ma, Hangfei Xu +2Graphics Processing Unit KernelsCode Optimization

  53. A Hardware-oriented Approach for Efficient Bayesian Inference Computation and Deployment

    Jul 20, 2026Nikola Pižurica, Matteo Risso, Nikola Milović +4Bayesian Inference ApproachesVariational Inference

  54. Lossless but Not Free: An Empirical Anatomy of Speculative Decoding on Consumer Hardware

    Jul 19, 2026Param ChordiyaSpeculative DecodingAutoregressive Decoding

  55. QUADS: Stabilizing NVFP4 Reinforcement Learning for MoE via QUantization-error Alignment across Dual Sides

    Jul 17, 2026Zhengyang Zhuge, Hao Yu, Xin Wang +4Fp8Reinforcement Learning Rollouts

  56. AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker

    Jul 16, 2026Zixin Jiang, Bing He, Chaoran Xiong +3Unmanned Aerial Vehicle TrackingUnmanned Aerial Vehicles

  57. A Modern Multimodal Assistant on a 6 GB 2011 GPU: Stage-Validated, All-GPU CUDA Inference for Fermi

    Jul 16, 2026A. C. Opus, J. Q. LuRtxCuda

  58. Are LLM-Generated GPU Kernels Production-Ready? A Trace-Driven Benchmark and Optimization Agent

    Jul 16, 2026Lingyun Yang, Yuxiao Wang, Shenghao Liang +8Graphics Processing Unit KernelsLLM Inference Efficiency

  59. Compression of 3D Gaussian Splatting Data Using GPU-friendly Graphics Texture Coding

    Jul 16, 2026Amir Said, Randall Rauwendaal3D Gaussian SplattingMulti-Gpu Systems

  60. Cost-Optimal Foundation Model Deployment Portfolio for Transportation Management

    Jul 14, 2026Xi Cheng, Ke Liu, Siyuan Feng +2Wireless Foundation ModelsFoundation Model