Fp8

Ask about this topic

Momentum

1 paper in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 21

All topics
CardsList

  1. Concurrent Split Learning Through Stable Client Clustering

    Sep 24, 2026Mohammad Kohankhaki, Valentin Rentschler, Anke SchmeinkClientsFundamental Limits

    Chair of Information Theory and Data Analytics, RWTH Aachen University, Aachen, Germany

  2. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  3. FOCUS: FP4 Optimization via Coupled-Relaxation and Dual-Granularity Scaling

    Aug 3, 2026Xianglong Yan, Hong Liu, Chengzhu Bao +4Large Language Model QuantizationFp8

    Shanghai Jiao Tong University · Tencent

  4. HiFloat4 Format for End-To-End Reinforcement Learning Post-Training of Large Language Models

    Jul 29, 2026Hei Yi Mak, Shadan Golestan, Hoang Le +10Fp8Full-Precision Performance

    Huawei

  5. Stable FP4 Training via Transposition-Invariant Block Quantization

    Jul 27, 2026Mehdi Rahimifar, Amin Darabi, Mehran Taghian Jazi +6Large Language Model QuantizationFp8

  6. QUADS: Stabilizing NVFP4 Reinforcement Learning for MoE via QUantization-error Alignment across Dual Sides

    Jul 17, 2026Zhengyang Zhuge, Hao Yu, Xin Wang +4Fp8Autoregressive Rollout

    Qwen Team, Alibaba Inc.

  7. Full-Stack FP4: Stable LLM Pretraining with Quantized Projections, Optimizers, and Attention

    Jul 5, 2026Siyu Ding, Mingchuan Ma, Jiabo Tong +3Fp8Large Language Model Pretraining

    Institute of Automation, Chinese Academy of Sciences · Sichuan University · Beijing Zhongguancun Academy +3

  8. W4A4 Quantization for Inference on Wan2.2-I2V-A14B

    Jun 28, 2026Yidong Chen, Chengyu Shi, Jiahao LiuLarge Language Model QuantizationFp8

    Tsinghua University

  9. Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe

    Jun 18, 2026Qian Zhao, Kunlong Chen, Changxin Tian +9Fp8Shrink

    Ling Team, Ant Group

  10. ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training

    Jun 14, 2026Janghwan Lee, Sihwa Lee, Jinseok Kim +4Quantization-Aware TrainingFp8

    1Hanyang University, 2Rebellions Inc., Republic of Korea.

  11. ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling

    Jun 11, 2026Sihwa Lee, Janghwan Lee, Donghoon Yoo +4Fp8Autoregressive Decoding

    Hanyang University, Seoul, Republic of Korea · Xenoscube Korean Inc., Seoul, Republic of Korea

  12. Characterizing the Impact of NVFP4 Quantization for Low-Power Edge AI Deployment

    Jun 3, 2026Ovishake Sen, Venkata Nithin Kamineni, Daniel Lobo +3Fp8Neural Network Inference

    Department of Electrical and Computer Engineering, University of Florida, Gainesville, USA

  13. P-Cast Precision in FP8 Attention: Sink-Induced Collapse and the Optimality of S=2^8

    Jun 2, 2026Reed LauFull-Precision PerformanceFp8

    Tencent

  14. ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

    May 30, 2026Li Lin, Xiaojun WanFp8Full-Precision Performance

    Wangxuan Institute of Computer Technology, Peking University

  15. Tail-Aware HiFloat4: W4A4 Post-Training Quantization for Wan2.2

    May 26, 2026Zhanfeng Feng, Shuai Guo, Xin Di +3Post-Training QuantizationFp8

    University of Science and Technology of China Hefei, China

  16. Grid Games: The Power of Multiple Grids for Quantizing Large Language Models

    May 12, 2026Vage Egiazarian, Erik Schultheis, Andrei Panferov +3Large Language Model QuantizationFp8

    ISTA · Aril Computer · ETH Zürich +1

  17. LoKA: Low-precision Kernel Applications for Recommendation Models At Scale

    May 11, 2026Liang Luo, Yinbin Ma, Quanyu Zhu +21Fp8Recommendation

    Meta AI

  18. Pretraining large language models with MXFP4 on Native FP4 Hardware

    May 11, 2026Musa Cim, Poovaiah Palangappa, Miro Hodak +3Large Language Model QuantizationFp8

    1The Pennsylvania State University · 2Advanced Micro Devices, Inc.

  19. Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence

    Apr 27, 2026NVIDIA, :, Amala Sanjay Deshmukh +216Omni-ModalOmni

  20. FP8 is All You Need (Part 1): Debunking Hardware FP64 as the HPC Holy Grail (Sep 3rd version)

    Date pendingSatoshi MatsuokaHigh-Performance ComputingFp8

    Director, RIKEN Center for Computational Science (R-CCS) Kobe, Hyogo, Japan

  21. FP8 is All You Need (Part 2): Full-FP64 3-D FFT on FP8-Generation Tensor CoresThe Integer-Epilogue Wall and the Minimal Hardware That Would Remove It

    Date pendingSatoshi MatsuokaFp8Nvidia

    Director, RIKEN Center for Computational Science (R-CCS), Kobe, Hyogo, Japan