Matrix Multiplication

Ask about this topic

Momentum

16 papers in the last four weeks, against 1 the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 80

All topics
CardsList

  1. Beyond Accuracy: Prefix-Invariant Realizations of Low-Precision Fast Matrix Multiplication

    Sep 30, 2026Shuxiao Xie, Shuyang Xie, Yuan Cao +3Matrix MultiplicationQuantized

  2. Scalable GNN-based Knowledge Graph Representation Learning with Efficient Message Passing

    Sep 28, 2026Huu Tan Mai, Cuong Xuan Chu, Heiko Paulheim +1Graph Neural NetworksKnowledge Graph Embeddings

    Bosch Center for Artificial Intelligence, Robert-Bosch-Campus 1, 71272 Renningen, Germany · University of Mannheim, Schloss, 68131 Mannheim, Germany

  3. Look Before You Select: Rethinking Vocabulary Sparsification in On-Policy Distillation

    Sep 28, 2026Yongliang Miao, Shuang Liu, Yanguang Liu +2Grammatical Error CorrectionMatrix Multiplication

    The Chinese University of Hong Kong, Shenzhen · Carnegie Mellon University · New Jersey Institute of Technology +1

  4. QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models

    Sep 28, 2026Bang Hu, Guowei Zhu, Changze Lv +4Large Language Model QuantizationLLM Inference Optimization

    School of Computer Science, Fudan University, Shanghai, China

  5. Singularities of Non-negative Matrix Factorization and their application to Bayesian inference

    Sep 28, 2026Naoki Hayashi, Yota Maeda, Yasushi EsakiNonnegative Matrix FactorizationSpectral Norm

    Toyota Central R&D Labs., Inc.

  6. Pretraining Transformers with Quantized Softmax in Attention

    Sep 27, 2026Shangzhen Zhu, Muyan Hu, Tomasz KozlowskiTransformer AttentionGumbel-Softmax Relaxation

    University of Illinois Urbana-Champaign

  7. Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

    Sep 22, 2026Liam Cooper, Shinnung Jeong, Hyeran Jeon +2LLM Inference OptimizationFloating-Point

    Georgia Institute of Technology · University of California, Merced

  8. SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models

    Sep 21, 2026Kewei Zhang, Zheng Chen, Haotong Qin +1Matrix MultiplicationAutoregressive Decoding

    Shanghai Jiao Tong University · The Hong Kong Polytechnic University

  9. Silent Failures Beyond the 32-Bit Index Range: A Differential Characterization of Large-Tensor Matrix Multiplication in PyTorch's MPS Backend

    Sep 19, 2026Junichiro NiimiMatrix MultiplicationPytorch

    Meijo University

  10. Accurate Trace Estimation with Fewer Random Bits via Recursive TensorSketch

    Sep 16, 2026Mohammad Azhar Khan, Rameshwar Pratap, Amit SharmaMatrix MultiplicationRandom

    Indian Institute of Technology Hyderabad, Kandi, Sangareddy, 502284, Telangana, India.

  11. Breaking the 1.58-bit Barrier for Ternary LLMs

    Sep 14, 2026Evangelos Georganas, Alexander Heinecke, Pradeep DubeyLarge Language Model QuantizationModel Weights

    Intel Corporation

  12. A Time-Based Readout for Vector-Matrix Multiplication in Fully Analog Memristive SNNs

    Sep 12, 2026Elia Mateu-Barriendos, Álvaro Gómez-Pau, Josep Rius +3Reram CrossbarSpiking Neural Networks

    Universitat Polit`ecnica de Catalunya - BarcelonaTech (UPC)

  13. Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation

    Sep 9, 2026Ben Merbaum, Mohammad Amin Raeisi, Wenhao Wang +3LLM Inference OptimizationMatrix Multiplication

    Yale University, IC3

  14. EFQ-Softmax: Exp-Free Quantization for Softmax

    Sep 9, 2026Haohui Han, Yuming Wan, Hongni Wang +4Gumbel-Softmax RelaxationBlock Sparse Flash Attention

    Xi'an Jiaotong University · Xi’an Jiaotong University · Huawei Technologies Co., Ltd +1

  15. KBBQ: A Predictive Noise Law and the Limits of Spectrum Flattening in FP4 Quantization

    Sep 8, 2026Lexington Whalen, Yuki Ito, Ryo SakamotoQuantizedQuantizer

    1SB Intuitions, Tokyo, Japan.

  16. Dense Structural Compression of Transformers via Gauge-Correct Channel Removal

    Sep 7, 2026Jed A. Duersch, Naïm Es-Sebbani, Nathanaël Haas +1Data Compression MethodsTransformer Architectures

    Université d’Artois, CNRS, CRIL UMR 8188, Lens, France

  17. Reduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference

    Aug 13, 2026Zixuan Lan, Yanhong Li, Jiawei ZhouMatrix MultiplicationLLM Inference Optimization

    University of Chicago · Independent Researcher · Stony Brook University

  18. BaKron: Efficient Quantization with Kronecker-Factored Hessians

    Aug 6, 2026Johann Birnick, Rayan SaabHessianMatrix Multiplication

    Department of Mathematics · University of California San Diego · La Jolla, California, United States +1

  19. RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection

    Aug 5, 2026Zian Wang, Hangchuan Liang, Yuehua Chen +4Rgb-Thermal Object DetectionInfrared

    Jilin University, China · Taiyuan University of Technology, China · Shenzhen University, China

  20. Gram-Space: Structure-Preserving Codebook Compression for Memory-Efficient Neuro-Symbolic AI

    Aug 2, 2026Weilun Wang, Wantong LiNeuro-Symbolic FrameworkCodebooks

    University of California, Riverside

  21. MOSAIC: Masked Outsourcing of Secure AI Computations

    Jul 31, 2026James Hsin-yu Chiang, Sheila Zingg, Kari Kostiainen +1Matrix MultiplicationMosaic

    ETH Zurich Switzerland

  22. It's All Just Vectorization: einx, a Universal Notation for Tensor Operations

    Jul 30, 2026Florian Fervers, Sebastian Bullinger, Christoph Bodensteiner +1VectorizationTensor Networks

    Fraunhofer IOSB

  23. GPTQ-2D: Cubic-Time Two-Sided Adaptive Rounding

    Jul 29, 2026Jiale Chen, Torsten Hoefler, Dan AlistarhMatrix MultiplicationGeometric Metrics

    Institute of Science and Technology Austria (ISTA) · ETH Zürich · Institute of Science and Technology Austria (ISTA) & Red Hat AI +1

  24. The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy

    Jul 29, 2026Zeyu WangSpiking Neural NetworksNeuromorphic Computing

    Georgia Institute of Technology

  25. HiFloat4 Format for End-To-End Reinforcement Learning Post-Training of Large Language Models

    Jul 29, 2026Hei Yi Mak, Shadan Golestan, Hoang Le +10Fp8Full-Precision Performance

    Huawei

  26. MoA-Structured Decode Attention DNF Derivation, KV-Cache Accumulation, GQA/MQA, and OpenACC Kernel

    Jul 21, 2026Lenore Mulin, Gaetan HainsMatrix MultiplicationTransformer Attention

    University at Albany, SUNY · LACL, Universit´e Paris-Est Cr´eteil

  27. Contraction-Gauge Preconditioning for Quantized Matrix Multiplication

    Jul 21, 2026Piyush Sao, Narasinga Miniskar, Pedro Valero-Lara +2Matrix MultiplicationSpectral Preconditioning

    Oak Ridge National Laboratory, Oak Ridge, Tennessee 37831, USA

  28. (MPO)2^2: Multivariate Polynomial Optimization based on Matrix Product Operators

    Jul 17, 2026Niccolò Ciolli, Anders Vestergaard Nørskov, Michael Kastoryano +2Tensor DecompositionMatrix Multiplication

  29. ExaGEMM: Exploration Framework for CPU-Driven ML Inference via Associative In-Register Computing for Low-Bit GEMM

    Jul 16, 2026Hyunwoo Oh, Suyeon Jang, Hanning Chen +3Matrix MultiplicationIn-Memory Computing

    University of California, Irvine

  30. HiFA4: Training-Free 4-bit FlashAttention on Ascend HIF4 NPUs for LLM Inference

    Jul 5, 2026Hui Dong, Yanzhao Li, Jie Gao +5Block Sparse Flash AttentionLLM Inference Optimization

    Huawei Technologies

  31. Fast, Parallel, Query-Efficient Binary Classification

    Jul 5, 2026Ishani Karmarkar, Liam O'Carroll, Aaron SidfordSeparabilityHigh-Dimensional

    Stanford University

  32. WBMM: Windowed Batch Matrix Multiplication for Efficient Large Receptive Field Convolution

    Jul 2, 2026Wan Song, Wei Zhou, Rui Wang +4Matrix MultiplicationImagenet

    Hefei University of Technology, Hefei, China · Lingyang Industrial Internet Co., Ltd., Hefei, China · Kochi University of Technology, Kochi, Japan.

  33. SharQ: Bridging Activation Sparsity and FP4 Quantization for LLM Inference

    Jun 25, 2026Haoqian Meng, Yilun Luo, Yafei Zhao +4Large Language Model QuantizationLarge Language Model Compression

    School of Computer Science and Technology, Tianjin University

  34. MIVE: A Minimalist Integer Vector Engine for Softmax LayerNorm and RMSNorm Acceleration

    Jun 16, 2026Kosmas Alexandridis, Giorgos DimitrakopoulosMatrix MultiplicationBatch Normalization

    Integrated Circuits Lab, Electrical and Computer Engineering, Democritus University of Thrace (DUTH), Greece

  35. The Discrete-Log Clock: How a Transformer Learns Modular Multiplication

    Jun 16, 2026Huu Danh NguyenTransformer ArchitecturesFourier

    Stanford University

  36. CacheMuon: Using Temporal Preconditioning To Approximate Polar Factor

    Jun 15, 2026Bishnu Dev, Sushil Bohara, Martin Takáč +1MuonSpectral Preconditioning

    Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE · Mohamed bin Zayed University of Artificial Intelligence

  37. SMEPilot: Characterizing and Optimizing LLM Inference with Scalable Matrix Extensions

    Jun 15, 2026Feiyang Chen, Haibo ChenLLM Inference OptimizationMatrix Multiplication

    IPADS, Shanghai Jiao Tong University

  38. MosaicQuant: Inlier-Outlier Disaggregation for Unified 4-Bit LLM Quantization

    Jun 14, 2026Yangjia Hu, Haodong Wang, Zicong Hong +8Large Language Model QuantizationMatrix Multiplication

    HKUST · EPFL · MetaX Integrated Circuits Co., Ltd

  39. Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices

    Jun 13, 2026Tao Lu, Haoyu Wang, Zonghui Wang +3LLM Inference OptimizationMatrix Multiplication

    National University of Singapore · Zhejiang University

  40. Realizing Native INT8 Compute for Diffusion Transformers on Consumer GPUs: A Fused INT8 GEMM Kernel for Ideogram 4.0

    Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiDiffusion TransformersMatched Fp16 Intermediate

    Transformer Lab

  41. Muonp^p: Muon with Fractional Spectral Powers

    Jun 11, 2026Yihe Dong, Will SawinMuonSpectral

    Princeton University

  42. Rigel: Reverse-Engineering the Metal 4.1 Tensor Compute Path on the Apple M4 Max GPU

    Jun 11, 2026Ramchand KumaresanMatrix MultiplicationShape-Memory Alloy

    Murai Labs

  43. TileFuse: A Fused Mixed-Precision Kernel Library for Efficient Quantized LLM Inference on AMD NPUs

    Jun 9, 2026Wesley Pang, Gregory Hyegang Jun, Feiyang Liu +1Neural Processing UnitsMatrix Multiplication

    University of Illinois Urbana-Champaign Department of Electrical and Computer Engineering USA

  44. SpenseGPT: Practical One-shot Pruning Enabling Sparse and Dense GEMMs for LLM Inference

    Jun 9, 2026Jaeseong Lee, Seung-won Hwang, Samyam RajbhandariSparsityLarge Language Model Compression

    Snowflake AI Research* · Seoul National University†

  45. Attention at the Theoretical Minimum: A Mathematics of Arrays Framework for Memory-Optimal Transformer Kernels

    Jun 5, 2026Lenore Mullin, Gaetan HainsMatrix MultiplicationTransformer Architectures

    University at Albany, SUNY, Albany, NY, USA · LACL, Université Paris-Est Créteil, Créteil, France

  46. When Good Enough Is Optimal: Multiplication-Only Matrix Inversion Approximation for Quantized Gated DeltaNet

    Jun 4, 2026Luoming Zhang, Yuwei Ren, Kui Zhang +7Matrix MultiplicationKimi Delta Attention

    Qualcomm AI Research, an initiative of Qualcomm Technologies, Inc.

  47. CRAM-ER: Error-Resilient Spintronic Computational Random Access Memory for Scalable In-Memory Computation

    Jun 1, 2026Sohan Salahuddin Mugdho, Md. Shahedul Hasan, Brahmdutta Dixit +3In-Memory ComputingReram Crossbar

    Electrical and Computer Engineering Iowa State University of Science and Technology Ames, IA, USA · Electrical and Computer Engineering University of Minnesota Twin Cities Minneapolis, MN, USA

  48. Riemannian Optimization for Hadamard Products of Low-Rank Matrices

    May 31, 2026Pratik Jawanpuria, Ankish Chandresh, Bamdev MishraRiemannian OptimizationLow-Rank Structure

    Centre for Machine Intelligence and Data Science, Indian Institute of Technology Bombay, India · Microsoft India

  49. MelT: A Portable, Single-GEMM Mel Audio Frontend via Non-Uniform DFT with Measured Latency and Energy Gains on GPUs

    May 31, 2026Augusto Camargo, Marcelo FingerNeural AudioMatrix Multiplication

    Institute of Mathematics and Statistics (IME), University of São Paulo, São Paulo, Brazil

  50. Neuro-symbolic Syntactic Parsing: Shaping a Neural Network with the CYK Algorithm

    May 29, 2026Fabio Massimo Zanzotto, Federico Ranaldi, Giorgio SattaNeuro-Symbolic FrameworkContext-Free Grammars

    Human-centric ART, University of Rome Tor Vergata, Italy · DEI, University of Padua, Italy

  51. Accelerating Birkhoff Projection for Manifold-Constrained Hyper-Connections

    May 26, 2026Chenrui Wang, Yixuan QiuSolver IterationsProjection

    RenminSchoolUniversityof Statisticsof China · School of Statistics and Data Science & Institute of Big Data Research · Shanghai University of Finance and Economics

  52. RT-Lynx: Putting the GEMM Sparsity In a Right Way for Diffusion Models

    May 26, 2026Xing Cong, Hanlin Tang, Kan Liu +3Diffusion TransformersDiffusion Models

    1Alibaba Group · 2Independent Researcher

  53. Verilog-Evolve: Feedback-Driven and Skill-Evolving Verilog Generation

    May 26, 2026Zehua Pei, Hui-Ling Zhen, Yu Zhang +3High-Level SynthesisHierarchical Register Transfer Level Generation

    The Chinese University of Hong Kong · Huawei Technologies Co., Ltd

  54. GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization

    May 25, 2026Maoyang Xiang, Tao Luo, Bo WangMatrix MultiplicationHierarchical Register Transfer Level Generation

    Information Systems Technology and Design Singapore University of Technology and Design Singapore · Institute of High Performance Computing (IHPC) Agency for Science, Technology and Research (A*STAR) Singapore

  55. EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture

    May 22, 2026Bowen Duan, Cong Guo, Chiyue Wei +8Large Language Model DecodingResidual Vector Quantization

    Duke University, USA

  56. Approaching I/O-optimality for Approximate Attention

    May 22, 2026Pál András Papp, Aleksandros Sobczyk, Anastasios ZouziasKimi Delta AttentionMatrix Multiplication

    Computing Systems Lab, Huawei Technologies, Zurich, Switzerland

  57. Signs Beat Floats: Low-Rank Double-Binary Adaptation for On-Device Fine-Tuning

    May 22, 2026Yoshihiko Fujisawa, Yuma Ichikawa, Yudai Fujimoto +2Low-Rank Adaptation AdaptersLarge Language Model Quantization

    Fujitsu Limited · Institute of Science Tokyo · RIKEN Center for AIP +1

  58. Fast and Stable Triangular Inversion for Delta-Rule Linear Transformers

    May 20, 2026Aleksandros Sobczyk, Gioele Gottardo, Christos K. Matzoros +4Kimi Delta AttentionMatrix Multiplication

    Computing Systems Lab Huawei Technologies2026 Switzerland

  59. CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

    May 19, 2026Han Guo, Jack Zhang, Arjun Menon +4Graphics Processing Unit KernelsMatrix Multiplication

    1Massachusetts Institute of Technology · *Part of this work was done at Together AI. · 2Princeton University +2

  60. CAR-SAM: Cross-Attention Reconstruction for Post-Training Quantization of the Segment Anything Model

    May 16, 2026Houji Wen, Jiangyong Yu, Jun Li +1Post-Training QuantizationQuantized

    1Nanjing University of Science and Technology · 2Houmo AI