AI Accelerator Inference

Ask about this topic

Momentum

8 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 68

All topics
CardsList

  1. Axon: A Synthesizing Superoptimizer for Tensor Programs

    Jun 24, 2026Akash Kothari, Shaowei Zhu, Daniel Kroening +1AI Accelerator InferenceHigh-Performance Computing

    University of Illinois at Urbana-Champaign, USA · Amazon Web Services, USA

  2. An Empirical Study of OpenPangu Quantization on Ascend NPUs

    Jun 19, 2026Tong Shi, Jiacheng Wang, Hui Xie +4LLM QuantizationAI Accelerator Inference

    State Key Laboratory of Complex & Critical Software Environment, Beihang University · School of Artificial Intelligence, Beihang University · School of Computer Science and Engineering, Beihang University

  3. MIVE: A Minimalist Integer Vector Engine for Softmax LayerNorm and RMSNorm Acceleration

    Jun 16, 2026Kosmas Alexandridis, Giorgos DimitrakopoulosAI Accelerator InferenceInference Acceleration

    Integrated Circuits Lab, Electrical and Computer Engineering, Democritus University of Thrace (DUTH), Greece

  4. AoiZora: Topology-Aware Auto-Parallel Optimization for Inference of Diffusion Transformers

    Jun 16, 2026Kaijian Wang, Yuanyuan Xu, Fanjiang Ye +5AI Accelerator InferenceVideo Diffusion Models

    Rice University · Independent Researcher · Google

  5. Prefill/Decode-Aware Evaluation of LLM Inference on Emerging AI Accelerators

    Jun 14, 2026Shun Usami, Venkatram Vishwanath, E. Wes BethelAI Accelerator InferenceLLM Inference

    Department of Computer Science San Francisco State University San Francisco, CA, 94132 · Argonne National Laboratory Lemont, IL, 60439 · Lawrence Berkeley National Laboratory Berkeley, CA, 94720

  6. A Spatio-Temporal Expert Prefetching Framework for Efficient MoE-based LLM Inference

    Jun 13, 2026Yingnan Zhao, Razvan Bunescu, Ahmed Louri +2AI Accelerator InferenceMixture-of-Experts Inference

    George Washington University Washington, DC, USA · University of North Carolina at Charlotte Charlotte, NC, USA · Ohio University Athens, OH, USA

  7. ANEForge: Python for direct computation on the Apple Neural Engine

    Jun 12, 2026Spencer H. BryngelsonEfficient Neural Network InferenceAI Accelerator Inference

    School of Computational Science & Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA · Daniel Guggenheim School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA · George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA

  8. Efficient On-Device Diffusion LLM Inference with Mobile NPU

    Jun 11, 2026Tuowei Wang, Yanfan Sun, Ju RenAI Accelerator InferenceOn-Device Language Model Inference

    Beihang University China · Tsinghua University China

  9. TileFuse: A Fused Mixed-Precision Kernel Library for Efficient Quantized LLM Inference on AMD NPUs

    Jun 9, 2026Wesley Pang, Gregory Hyegang Jun, Feiyang Liu +1Mixed-Precision QuantizationLLM Quantization

    University of Illinois Urbana-Champaign Department of Electrical and Computer Engineering USA

  10. Energy-Efficient On-Device RAG on a Mobile NPU: System Design and Benchmark on Snapdragon X Elite

    Jun 9, 2026Zhiyuan Cheng, Longying LaiRetrieval-Augmented GenerationAI Accelerator Inference

    School of Engineering Stanford University Stanford, CA, USA · Simon Business School University of Rochester Rochester, NY, USA

  11. vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models

    Jun 6, 2026Khanh D. Nguyen, Hung T. Ho, Chinh T. Nguyen +5AI Accelerator InferenceEfficient VLM Inference

    VinRobotics, Vietnam · Max Planck Research School for Intelligent Systems, Germany · University of Stuttgart, Germany +3

  12. Terastal: Layer-Variant-based Scheduling for Real-Time Multi-DNN Workloads on Heterogeneous Accelerators

    Jun 5, 2026Sing-Yao Wu, Fengshuo Song, Eli BozorgzadehAI Accelerator InferenceReal-Time Scheduling

    Department of Computer Science, University of California, Irvine, CA, USA

  13. Operator Fusion for LLM Inference on the Tensix Architecture

    Jun 3, 2026Qingbo Wu, Ke Li, Wenzhu Wang +3Efficient Transformer InferenceAI Accelerator Inference

    KylinSoft Co., Ltd, Tianjin, China · openKylin Community, Tianjin, China · College of Computer Science and Technology, National University of Defense Technology, Changsha, China

  14. KForge: LLM-Driven Cross-Platform Kernel Generation for AI Accelerators

    Jun 1, 2026Taras Sereda, Burak Bartan, Ankita Nayak +3AI Accelerator InferenceGPU Kernel Optimization

    Gimlet Labs Inc., San Francisco, California, USA

  15. From Human Guidance to Autonomy: Agent Skill System for End-to-End LLM Deployment on Spatial NPUs

    May 27, 2026Jiajie Li, Erwei Wang, Zhiru Zhang +1AI Accelerator InferenceLLM Agent Orchestration

    Cornell University · AMD

  16. Fine-Tuning and Serving Gemma 4 31B on Google Cloud TPU: A Technical Comparison with GPU Baselines

    May 25, 2026Jatin Kishnani, Mayank Goel, Amit Singh +2AI Accelerator InferenceLLM Serving

  17. MX-SAFE: Versatile Inference- and Training-Proof Microscaling Format with On-the-Fly Exponent and Mantissa Bit Allocation

    May 23, 2026Dahoon Park, Jahyun Koo, Sangwoo Hwang +1Mixed-Precision QuantizationAI Accelerator Inference

    † School of Electrical Engineering, Korea University, South Korea · ‡ Department of Electrical Engineering and Computer Science, DGIST, South Korea

  18. When NPUs Are Not Always Faster: A Stage-Level Analysis of Mobile LLM Inference

    May 22, 2026Pu Li, Jiawen Qi, Qinyu ChenAI Accelerator InferenceOn-Device Language Model Inference

    Leiden Institute of Advanced Computer Science (LIACS), Leiden University, The Netherlands.

  19. Fast and Stable Triangular Inversion for Delta-Rule Linear Transformers

    May 20, 2026Aleksandros Sobczyk, Gioele Gottardo, Christos K. Matzoros +4Efficient Transformer InferenceAI Accelerator Inference

    Computing Systems Lab Huawei Technologies2026 Switzerland

  20. SA-Kura: An Energy-Efficient Systolic Array Accelerator for Locally-Coupled Kuramoto Drift in Diffusion Sampling

    May 20, 2026Jeongmin Jin, Kyeongwon Lee, Mundo Jeong +2AI Accelerator InferenceDiffusion Sampling

    ISLPED '26, Evanston, IL

  21. Quant.npu: Enabling Efficient Mobile NPU Inference for on-device LLMs via Fully Static Quantization

    May 19, 2026Jinghe Zhang, Daliang Xu, Chenghua Wang +5Mixed-Precision QuantizationLLM Quantization

  22. FLARE: One-Shot PE-Level Fault Localization in Systolic Arrays via Algebraic Test Vectors

    May 9, 2026Logashree Venkatasubramanian, Zishen Wan, Viveck CadambeAI Accelerator InferenceFault Localization

    Georgia Institute of Technology · Georgia Institute of Technology School of Electrical and Computer Engineering Atlanta, Georgia, USA

  23. TRAM: Training Approximate Multiplier Structures for Low-Power AI Accelerators

    May 6, 2026Chang Meng, Hanyu Wang, Yuyang Ye +3AI Accelerator InferenceEnergy-Efficient ML

    Eindhoven University of Technology Eindhoven, The Netherlands · University of California, Los Angeles Los Angeles, USA · Chinese University of Hong Kong Hong Kong, China +2

  24. Design Conductor 2.0: An agent builds a TurboQuant inference accelerator in 80 hours

    May 6, 2026The Verkor Team, Ravi Krishna, Suresh Krishna +1AI Accelerator InferenceMulti-Agent LLM Systems

    The Verkor Team

  25. Performance Optimization and Comparative Analysis of Generative AI Models on Advanced Accelerators

    May 5, 2026Amitash Nanda, Javier Hernandez Nicolau, Madhusudan Gujral +3Mixed-Precision QuantizationAI Accelerator Inference

    University of California San Diego, San Diego, CA, USA · San Diego Supercomputer Center, San Diego, CA, USA

  26. DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference

    Apr 30, 2026Ali Emre Oztas, Mahir Demir, James Garside +1AI Accelerator InferenceGPU Acceleration

    The University of Manchester

  27. Physical Foundation Models: Fixed hardware implementations of large-scale neural networks

    Apr 30, 2026Logan G Wright, Tianyu Wang, Tatsuhiro Onodera +1Efficient Neural Network InferenceAI Accelerator Inference

    Department of Applied Physics, Yale University, New Haven, CT 06520, USA · Department of Electrical and Computer Engineering, Boston University, Boston, MA 02215, USA · School of Applied and Engineering Physics, Cornell University, Ithaca, NY 14853, USA +2

  28. Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment

    Apr 27, 2026Kaijun Zhou, Qiwei Chen, Da Peng +3AI Accelerator InferenceEdge Inference

    School of Computer Science, Shanghai Jiao Tong University

  29. Tessera: Secure, Near-Line-Rate Weight Streaming for UMA Edge Accelerators

    Apr 25, 2026Animan NaskarEfficient Neural Network InferenceAI Accelerator Inference

    Indian Institute of Technology (IIT) Ropar

  30. Cloud to Edge: Benchmarking LLM Inference On Hardware-Accelerated Single-Board Computers

    Apr 24, 2026Harri Renney, Fouad Trad, Michael Mattarock +1AI Accelerator InferenceOn-Device Language Model Inference

    Kaze Technologies Kaze Consulting Bath, BA1 2HN, UK · Electrical and Computer Engineering Lebanese American University Byblos, Lebanon · Carnegie Mellon University Pittsburgh Pennsylvania USA +1