AI Accelerator Inference

Ask about this topic

Momentum

8 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 68

All topics
CardsList

  1. LampAttention: Look-Ahead Mixed-Precision FlashAttention for Dedicated Accelerators

    Sep 30, 2026Stanislav Budzinskiy, Marian Gloser, Tolunay Yilmaz +5AI Accelerator InferenceLLM Inference Acceleration

    Faculty of Mathematics University of Vienna, Austria · Huawei Heisenberg Research Center, Munich, Germany · Huawei Technologies Co. Ltd

  2. E3J: An Efficient and Open-Source Backend for Euclidean Equivariant Operations on GPU and TPU

    Sep 28, 2026Olivier Peltre, Armand Picard, Adrien Pichard +6AI Accelerator InferenceGPU Kernel Optimization

    InstaDeep · Prima Mente

  3. Accelerator Choice Is Not Enough: AlphaFold2 Inference on Cloud TPUs

    Sep 28, 2026Lorenzo Pazienza, Ihab El BaniAI Accelerator InferenceEfficient Inference

    LUISS Guido Carli University Rome, Italy · Stanford University · Al Akhawayn University Ifrane, Morocco

  4. Dynamic Flow, Static Graph: KV Cache Reuse for Efficient LLM Serving on Mobile NPUs

    Sep 28, 2026Zhengxiang Huang, Shengheng Chen, Chaoyue Niu +6AI Accelerator InferenceOn-Device Language Model Inference

    Shanghai Jiao Tong University Shanghai, China · Alibaba Group Hangzhou, China · Alibaba Group Hangzhou, Zhejiang, China

  5. MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration

    Sep 17, 2026Yuan Liao, Jae-sun SeoAI Accelerator InferenceVLM Quantization

    Cornell Tech, Cornell University New York, NY, USA

  6. OptiPrime: Optimizing Private Inference through Protocol-Hardware Co-design

    Sep 15, 2026Jiangrui Yu, Ye Yu, Si Chen +5Efficient Neural Network InferenceSecure Multi-Party Computation

    Peking University, Beijing, China · Open Security Research, Shenzhen, China · Tsinghua University, Beijing, China

  7. A 25-μμs/inf Event-driven Graph Neural Network Processor with Spatiotemporal Caching and Spline Convolution for Ultra-low-latency AI at the Edge

    Sep 14, 2026Adrian Kneip, Martin Lefebvre, Daniel Gehrig +4Event-Based VisionAI Accelerator Inference

    Delft University of Technology (TU Delft), 2628 CD Delft, The Netherlands · KU Leuven, 3000 Leuven, Belgium · University of Zürich (UZH), 8050 Zürich, Switzerland +1

  8. NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference

    Sep 12, 2026Varun Manjunath, Pranav Ramesh, Gopalakrishnan SrinivasanEfficient Neural Network InferenceAI Accelerator Inference

    Electrical Engineering Indian Institute of Technology Madras Chennai, India · Computer Science and Engineering Indian Institute of Technology Madras Chennai, India

  9. How Weight Encoding Affects Language Model Placement and Performance on the Apple Neural Engine

    Aug 22, 2026Shahir M ALLM QuantizationAI Accelerator Inference

    Independent researcher

  10. Achieving Near-Zero-Overhead Multi-Model Hierarchical Classification in Real-Time Detection Pipelines

    Aug 12, 2026Vaishnav RajuEfficient Neural Network InferenceAI Accelerator Inference

    Newspace Research and Technologies, Bengaluru, India

  11. EdgeXpert: An Edge Device for Memory-Efficient LLM Inference with Mixture-of-Experts and Speculative Decoding

    Aug 5, 2026Sangwoo Ha, Hyunwoo Seo, Yurim Jo +2AI Accelerator InferenceOn-Device Language Model Inference

    KAIST Daejeon, South Korea

  12. Deltoris: Enabling Real-time VLA Inference in Embodied AI via Bit-level Sparsity and Speculative Inference

    Aug 5, 2026Zheng Liu, Zeyu Guo, Zihan Liu +9AI Accelerator InferenceEfficient VLA Model Inference

    Shanghai Jiao Tong University Shanghai, China · Shanghai Jiao Tong University, Shanghai Qi Zhi Institute Shanghai, China · ICT, Chinese Academy of Sciences Beijing, China

  13. LightRot: A Light-Weighted Rotation Scheme and Architecture for Accurate Low-Bit Large Language Model Inference

    Jul 30, 2026Sangjin Kim, Yuseon Choi, Jungjun Oh +2LLM QuantizationAI Accelerator Inference

    PIM Semiconductor Design Research Center (AI-PIM), Daejeon 34141, South Korea

  14. GyRot: Leveraging Hidden Synergy between Rotation and Fine-grained Group Quantization for Low-bit LLM Inference

    Jul 30, 2026Sangjin Kim, Yuseon Choi, Byeongcheol Kim +2AI Accelerator InferenceRotation-Based Quantization

    School of Electrical Engineering, Korea Advanced Institue of Science and Technology (KAIST)

  15. AgenticCANN: Automated Ascend C Operator Generation via Knowledge-Augmented Agentic Evolution

    Jul 29, 2026Junhao Qiu, Zidong Wang, Yansong Sun +3AI Accelerator InferenceLarge Language Model-Guided Optimization

    Department of Computer Science, City University of Hong Kong · Hong Kong Yuwin Technology Co., Ltd

  16. A Motion-Aware Vector Quantization Framework with Centroid Reuse for Efficient VLA Inference

    Jul 27, 2026Zhuoran Song, Haozhe Jiang, Chunyu Qi +4AI Accelerator InferenceEfficient VLA Model Inference

    School of Computer Science, Shanghai Jiao Tong University, 2 Institute of Automation, Chinese Academy of Sciences China

  17. RED-PIM: Reducing Data Movement for Transformers using Processing-in-Memory

    Jul 23, 2026Zahra Yousefijamarani, Alaa AlameldeenEfficient Transformer InferenceAI Accelerator Inference

    Simon Fraser University

  18. From Bit-Position Sensitivity to Unequal Error Protection for DNN Inference Memory

    Jul 21, 2026Muhammad Husnain Mubarik, Karthik Mohan Kumar, Pedro Antonio Pena +2AI Accelerator Inference

    Advanced Micro Devices, Inc., USA

  19. BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators

    Jul 21, 2026Fabian Waschkowski, Prabod Rathnayaka, Lukas WesemannAI Accelerator InferenceOn-Device Language Model Inference

    Base Compute, Melbourne, Australia

  20. BRIM: Workload-Balanced Dual-Sided Bit-Serial Sparse Inference Accelerator

    Jul 20, 2026Varun Manjunath, Ruokai Yin, Donghyun Lee +2Efficient Neural Network InferenceAI Accelerator Inference

    University of Southern California Los Angeles, USA · Yale University New Haven, USA

  21. ThAME: 3D Memory-Enabled Heterogeneous Accelerator for LLM Mixture of Experts

    Jul 19, 2026Pratyush Dhingra, Pramit Kumar Pal, Janardhan Rao Doppa +1AI Accelerator InferenceMixture-of-Experts Inference

    Department of Electrical Engineering and Computer Science, Washington State University, Pullman, WA 99163 USA

  22. Automatic Model-Hardware Co-Adaptation for Heterogeneous AI Accelerators

    Jul 14, 2026Tian Chen, Mingheng Mi, Pu Wang +2AI Accelerator InferenceLLM Inference

    Pazhou Laboratory (Huangpu) · Unaffiliated

  23. HCRMap: Pressure-Aware Hot-Expert Residency Mapping for 3.5D MoE Chiplet Inference

    Jul 13, 2026Yongqin ZhangAI Accelerator InferenceMixture-of-Experts Inference

    Nanjing Vocational College of Information Technology, 99 Wenlan Road, Xianlin College Community, Nanjing, Jiangsu, 210023, P.R.C.

  24. FastTPS: An Optimized Method for LLM Token Phase for AI accelerators

    Jul 13, 2026Wenzong Yang, Danyang Zhang, Kun Cao +17AI Accelerator InferenceLLM Inference

    Advanced Micro Devices, Inc., Santa Clara, California, USA.

  25. Is Your NPU Ready for LLMs? Dissecting the Hidden Efficiency Bottlenecks in Mobile LLM Inference

    Jul 6, 2026Guanyu Cai, Ruiming Tian, Lang Yang +4LLM Inference EfficiencyAI Accelerator Inference

    Tsinghua University · Beijing Jiaotong University

  26. HiFA4: Training-Free 4-bit FlashAttention on Ascend HIF4 NPUs for LLM Inference

    Jul 5, 2026Hui Dong, Yanzhao Li, Jie Gao +5Softmax AttentionLLM Quantization

    Huawei Technologies

  27. BitFair: A 12nm Bit-Serial CNN Accelerator with Learnable Early Termination and Adaptive Bit Ordering for Ultra-Low-Power XR Vision

    Jul 4, 2026Ang Li, Chang GaoEfficient Neural Network InferenceAI Accelerator Inference

    Department of Microelectronics, Delft University of Technology, Delft, The Netherlands

  28. BaseRT: Best-in-Class LLM Inference on Apple Silicon via Native Metal

    Jul 1, 2026Prabod Rathnayaka, Fabian Waschkowski, Lukas WesemannAI Accelerator InferenceOn-Device Language Model Inference

    Base Compute, Melbourne, Australia

  29. Scaling Up Thermodynamic AI Models

    Jun 30, 2026Andrew G. MooreEfficient Neural Network InferenceAI Accelerator Inference

  30. SEADA: An efficient methodology for optimizing mixed-precision DNNs on multi-precision spatial architectures

    Jun 26, 2026Leandro Fiorin, Marco Ronzani, Cristina SilvanoMixed-Precision QuantizationEfficient Neural Network Inference

    Indipendent Researcher Groningen, The Netherlands · Dipartimento di Elettronica e Informazione, Politecnico di Milano. Milano, Italy