Latest papers

CardsList

23 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

  1. Mixed Precision Scaling Laws for Quantized Pretraining

    Oct 13, 2026Jinuk Kim, Rajarshi Saha, Muhammed Fatih Balin +1Mixed-Precision QuantizationLLM Quantization

  2. Memory-Efficient Integer-Only Training of Deep Neural Networks

    Oct 12, 2026Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel RoveriLow-Precision TrainingNeural Network Quantization

  3. Q-PACE: Dynamic Precision Allocation for Quantization-Aware Training

    Oct 6, 2026Alexandra Volkova, Matin Ansaripour, Erik Schultheis +2LLM QuantizationQuantization-Aware Training

  4. Backward-State Policy Is Part of the Learning Algorithm

    Sep 30, 2026Shuxiao Xie, Shuyang Xie, Dezhi Ran +2Mixed-Precision QuantizationBackpropagation

  5. Delta-Matching: Closing the Final Gap of Native 8-bit Training for LLMs

    Sep 29, 2026Haozhan Tang, Hao Kang, Han Cai +2Low-Precision TrainingLLM Training

  6. Linger and Lose: Knowledge Collapse in Low-Bit Language Models

    Sep 26, 2026Prashanna Mani Paudel, Shivanand Venkanna SheshappanavarLow-Precision TrainingLLM Quantization

  7. Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

    Aug 27, 2026Kairong Luo, Jiarui Cui, Yaorui Yin +8Language Model PretrainingLanguage Model Scaling Laws

  8. One QK Channel, Many Sources: Tracing Low-Precision Attention Collapse

    Aug 3, 2026Shuxiao Xie, Shuyang Xie, Yuan Cao +3Softmax AttentionTransformer Attention

  9. M+Adam: Low-Precision Training via Additive-Multiplicative Optimization

    Jul 12, 2026Xiaoyuan Liang, Sebastian Loeschcke, Mads Toftrup +1Quantization-Aware TrainingLow-Precision Training

  10. The Silent Freeze: Predicting When Low-Precision Training Stops Learning

    Jul 9, 2026Zekai ShangStochastic RoundingLow-Precision Training

  11. ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training

    Jun 14, 2026Janghwan Lee, Sihwa Lee, Jinseok Kim +4Activation QuantizationQuantization-Aware Training

  12. GNMR: Runtime Stability Control for Low-Precision Large Language Model Training

    May 30, 2026Boao Kong, Weichen Jia, Engao Zhang +6LLM TrainingLow-Precision Training

  13. Normalized Architectures are Natively 4-Bit

    May 7, 2026Maxim Fishman, Brian Chmiel, Ron Banner +2LLM QuantizationNeural Representation Geometry

  14. AdaHOP: Fast and Accurate Low-Precision Training via Outlier-Pattern-Aware Rotation

    Apr 2, 2026Seonggon Kim, Alireza Khodamoradi, Pranathi Vasireddy +2Walsh-Hadamard TransformLow-Precision Training

  15. Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs

    Mar 3, 2026Wuyue Zhang, Chongdong Huang, Chunbo You +3Low-Precision TrainingLLM Training

  16. SageBwd: A Trainable Low-bit Attention

    Mar 2, 2026Jintao Zhang, Marco Chen, Haoxu Wang +5Attention QuantizationLow-Precision Training