GPU Kernel Optimization

GPU: Graphics Processing Unit

Ask about this topic

Momentum

14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 126

All topics
CardsList

  1. PageWeaver: KV-Guided Query Unions for Sparse Attention

    Oct 8, 2026Zhiyuan Li, Zihan Li, Zefang Yuan +2Sparse AttentionGPU Kernel Optimization

    SenseTime

  2. QUILT: Rethinking Sparse-Attention Prefill through Shared Query Execution

    Oct 8, 2026Zhenduo Zhao, Qihui Zhou, Mingcong Song +7LLM Inference AccelerationSparse Attention

    Huawei Technologies Co., Ltd. China

  3. FlashCart: Fast Cartesian Tensor Products for Equivariant Interatomic Potentials

    Oct 5, 2026Viktor Zaverkin, Payman Goodarzi, Sergey V. Sukhomlinov +4Machine Learning Interatomic PotentialsGPU Kernel Optimization

    INM – Leibniz Institute for New Materials · Saarland University · German Research Center for Artificial Intelligence (DFKI) +2

  4. TurboPairFormer: Fast and Stable Protein Folding Model Training with an Optimized Triangle Attention Kernel

    Oct 5, 2026Yide Ran, Chelsea Lowman, Jan Domański +6Protein Structure PredictionGPU Kernel Optimization

    Stevens Institute of Technology · Lambda · Open Molecular Software Foundation

  5. MetaKernelBench: Measuring GPU Kernel Knowledge Transfer Beyond Code

    Oct 4, 2026Xueyi Chen, Shiyu Liu, Xin Jin +5GPU Kernel OptimizationAI Agent Benchmarks

    Westlake University · Shanghai Jiao Tong University · Zhejiang University

  6. AI as a Compiler: Compiling Triton kernels without the Triton compiler

    Sep 29, 2026François Costa, Charly Castes, Thomas Bourgeat +1GPU Kernel OptimizationLarge Language Model-Guided Optimization

    Stanford University · EPFL

  7. GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulation

    Sep 28, 2026Yuchen Sun, Jinjin He, Sinan Wang +1GPU Kernel OptimizationBenchmark Design

    Georgia Institute of Technology

  8. Hardware-Aware Features for CUTLASS Kernel Selection

    Sep 28, 2026Shriram Chandran, Dominic Rinderer, Yakup Budanaz +3GPU Kernel OptimizationLearning to Rank

    ETH Zurich Zurich, Switzerland

  9. Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge

    Sep 28, 2026Yitong Li, Jincheng Yu, Junsong Chen +6Video Diffusion ModelsGPU Kernel Optimization

    NVIDIA Research, Efficient AI Team & Singapore Lab.

  10. E3J: An Efficient and Open-Source Backend for Euclidean Equivariant Operations on GPU and TPU

    Sep 28, 2026Olivier Peltre, Armand Picard, Adrien Pichard +6AI Accelerator InferenceGPU Kernel Optimization

    InstaDeep · Prima Mente

  11. Towards Certificate-Driven Software Porting: A Self-Improving Agentic Harness for Scientific Program Optimization

    Sep 28, 2026Piyush Jha, Aishik Ghosh, Vijay GaneshCode TranslationGPU Kernel Optimization

    School of Computer Science, Georgia Institute of Technology, USA · School of Physics, Georgia Institute of Technology, USA · Lawrence Berkeley National Laboratory, USA

  12. Validating Memory-Optimal Transformer Kernels on Real Hardware: From Formal Derivation to Measured Performance Across Two HPC Clusters

    Sep 27, 2026Lenore M. Mullin, Gaetan HainsGPU Kernel OptimizationHigh-Performance Computing

    Professor Emerita, College of Nanotechnology, Science, and Engineering, University at Albany (SUNY), Albany, NY, USA.

  13. KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

    Sep 24, 2026Aheli Poddar, Sanskar Prasad, Arindam Samanta +3GPU Kernel OptimizationAgentic Search

    Red Hat

  14. Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

    Sep 22, 2026Liam Cooper, Shinnung Jeong, Hyeran Jeon +2GPU Kernel OptimizationLLM Inference Acceleration

    Georgia Institute of Technology · University of California, Merced

  15. AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

    Sep 16, 2026Li ChenGPU Kernel OptimizationBenchmark Design

  16. Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation

    Sep 15, 2026Carmelo Scribano, Filippo Muzzini, Nedyalko Prisadnikov +6Efficient InferenceGPU Kernel Optimization

    University of Modena and Reggio Emilia, Italy · INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria

  17. AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization

    Sep 14, 2026Ji Liu, Saptarshi Majumder, Yiqing Huang +14GPU Kernel OptimizationLarge Language Model-Guided Optimization

    Advanced Micro Devices, Inc.

  18. GPU-CFR: 80x Faster Counterfactual Regret Minimization by Compiling the Game to Static Dataflow and CUDA Graph Replay

    Sep 12, 2026Boning Li, Longbo HuangGPU Kernel OptimizationGPU Acceleration

    Institute for Interdisciplinary Information Sciences, Tsinghua University

  19. Hardware-Aware FP4 FlashAttention-4

    Sep 3, 2026Robert HuMixed-Precision QuantizationGPU Kernel Optimization

    GRAPHCORE RESEARCH

  20. Unfolding the Leech Lattice: Fused Multi-Shell Decoding and VRAM Layouts for 2-Bit LLM Weights

    Sep 2, 2026Pier-Jean MalandrinoLLM InferenceVector Quantization

    Scub

  21. PTXBench: Benchmarking and Adapting LLMs for GPU Kernel Optimization with Architecture-specific PTX

    Aug 18, 2026Genghan Zhang, Yixin Dong, Chengze Fan +4LLM EvaluationGPU Kernel Optimization

    Stanford University · Carnegie Mellon University · Independent Researcher +1

  22. CAKE: Compiler-Agent Co-Design for Frontier Kernel Evolution

    Aug 12, 2026Zihao Ye, Yingyi Huang, Hongyi Jin +11GPU Kernel OptimizationGPU Kernel Generation

    1NVIDIA · 2Carnegie Mellon University

  23. Dion3: Full-Stack Orthogonal Updates

    Aug 12, 2026Noah Amsel, Jack Zhang, Kwangjun Ahn +5Newton-Schulz IterationGPU Kernel Optimization

    New York University · Microsoft Research · Princeton University +3

  24. Fast and Memory-Efficient Wavelet Convolutions via I/O-Aware Reformulation

    Aug 11, 2026Amit Aflalo, Shahaf E. Finder, Roy Amoyal +2GPU Kernel OptimizationWavelet Methods

    The Stein Faculty of Computer and Information Science, Ben-Gurion University of the Negev, Israel

  25. Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

    Aug 10, 2026Matt J. Borowski, Blazej OsinskiGPU Kernel Optimization

    Kernel Engineer · Machine Learning Engineer

  26. SwiftQK: Fast and Communication-Efficient Tensor Parallelism for Query-Key Normalization

    Aug 10, 2026Gyudong Kim, Wonjun Han, Young Geun KimGPU Kernel OptimizationTensor Parallelism

    Department of Computer Science and Engineering, Korea University, Seoul 02855, Republic of Korea

  27. What Irregularity Costs: CUDA C++, Rust, and Triton on a Hash-Blocked GPU Workload

    Aug 8, 2026Petr KorolevGPU Kernel Optimization

    Spacial Intelligence Labs

  28. Scalable High-Fidelity Macromolecular Docking for GPU-Accelerated Supercomputers

    Aug 7, 2026Xiangyu Meng, Peng Chen, Mingzhen Li +7GPU Kernel OptimizationGPU Acceleration

    College of Computer Science and Technology, Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software, China University of Petroleum (East China), Qingdao, China · A*STAR Institute of Advanced Intelligence and Computing, Singapore · RIKEN Center for Computational Science, Kobe, Japan +2

  29. SparseDitto: An Agentic Sparse Compilation Framework through Architecture-Aware Synthesis on GPUs

    Aug 5, 2026Shiyang Li, Guangyan Sun, Jinwei Tang +3GPU Kernel OptimizationHigh-Performance Computing

    University of Minnesota Minneapolis, MN, USA · Northeastern University Boston, MA, USA

  30. CUDA MPC: A GPU-Native Solver for Model Predictive Control

    Aug 4, 2026Babak Akbari, Melissa GreeffGPU Kernel OptimizationGPU Acceleration

    Robora Lab, Department of Electrical and Computer Engineering Queen's University, Kingston, ON, Canada