GPU Acceleration

GPU: Graphics Processing Unit

Overview

GPU acceleration studies how to map computation onto many parallel cores to speed workloads such as language-model inference, rendering, robotics, and scientific simulation. Common approaches include hand-tuned CUDA and Triton kernels, tiling and operator fusion, lower-precision arithmetic, and algorithm reformulations that expose more parallel work. Compilers and coding agents increasingly help generate and tune kernels, while multi-GPU systems focus on scheduling, memory use, and communication. A central challenge is that speedups depend on the workload and hardware: specialized kernels can be fast but difficult to port, and gains in isolated operations may disappear once memory movement, dispatch, or numerical accuracy is considered.

Latest papers

CardsList

200 papers24 papers in the last four weeks, up 26% on the four weeks before. 0.2% of all new papers.

  1. FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling

    Mar 5, 2026Ted Zadouri, Markus Hoehnerbach, Jay Shah +3Efficient AttentionGPU Kernel Optimization

  2. cuNRTO: GPU-Accelerated Nonlinear Robust Trajectory Optimization

    Mar 3, 2026Jiawei Wang, Arshiya Taj Abdul, Evangelos A. TheodorouSecond-Order Cone ProgrammingTrajectory Optimization

  3. RoboGPU: Accelerating GPU Collision Detection for Robotics

    Mar 2, 2026Lufei Liu, Liwei Xue, Yuan Hsi Chou +4GPU AccelerationRobotics

  4. pathsig: A GPU-Accelerated Library for Truncated and Projected Path Signatures

    Feb 27, 2026Tobias NygaardPath SignaturesGPU Acceleration

  5. A GPU-Accelerated Hybrid Method for a Class of Multi-Depot Vehicle Routing Problems

    Feb 24, 2026Zhenyu Lei, Jin-Kao HaoVehicle RoutingMetaheuristic Optimization

  6. SoftDTW-CUDA-Torch: Memory-Efficient GPU-Accelerated Soft Dynamic Time Warping for PyTorch

    Feb 19, 2026Ron Shapira Weber, Oren FreifeldDynamic Time WarpingGPU Acceleration

  7. DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers

    Feb 2, 2026Ionut-Vlad Modoranu, Philip Zmushko, Erik Schultheis +2Deep Learning OptimizationGPU Acceleration

  8. KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta

    Dec 29, 2025Gang Liao, Hongsen Qin, Ying Wang +36GPU Kernel OptimizationGPU Acceleration

  9. Cerium: A Multi-GPU Framework for Terabyte-Scale Encrypted Inference

    Dec 12, 2025Siddharth Jayashankar, Joshua Kim, Michael B. Sullivan +2Homomorphic EncryptionGPU Kernel Optimization

  10. Block Sparse Flash Attention

    Dec 7, 2025Daniel Ohayon, Itay Lamprecht, Itay Hubara +3GPU AccelerationSelf-Attention

  11. Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

    Nov 19, 2025Kexin Chu, Dawei Xiang, Zixu Shen +3Mixed-Precision QuantizationGPU Acceleration

  12. NOSA: Native and Offloadable Sparse Attention

    Oct 15, 2025Yuxiang Huang, Pengjie Wang, Jicheng Han +9KV-Cache OffloadingGPU Acceleration

  13. FastTrack: GPU-Accelerated Tracking for Visual SLAM

    Sep 13, 2025Kimia Khabiri, Parsa Hosseininejad, Shishir Gopinath +2GPU AccelerationVisual SLAM

  14. FSA: An Alternative Efficient Implementation of Native Sparse Attention Kernel

    Aug 25, 2025Ran Yan, Youhe Jiang, Zhuoming Chen +3GPU Kernel OptimizationGPU Acceleration

  15. Parallel Branch Model Predictive Control on GPUs

    Jun 16, 2025Luyao Zhang, Chenghuai Lin, Sergio GrammaticoModel Predictive ControlOptimal Control

  16. Very fast Bayesian Additive Regression Trees on GPU

    Oct 30, 2024Giacomo PetrilloNonparametric RegressionGPU Acceleration