Batch Normalization

Follow this topic Ask about this topic

Recent momentum

-60%

4 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Batch Normalization.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Batch Normalization.

73 papers

Latest in Batch Normalization

Open your feed →

Published Unlearning Numbers Move Per Checkpoint, and Not Because the Removed Data Survives: An Audit of 263 Released Batch-Normalized Checkpoints
Sep 12, 2026Junlong Shen Xingyu LiModel Checkpoints Unlearning Aims
FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers
Sep 1, 2026Muhammad Rehan, Haider Ali, Muhammad Ali Munir +1Microcontrollers Test-Time Adaptation
Tracing distinguishability through transformer processing with stochastic LayerNorm
Aug 31, 2026Kieran MurphyBatch Normalization Diffusion Transformers
TopGQ: Fast GNN Post-Training Quantization Leveraging Topology Information
Aug 31, 2026Dain Kwon, Kanghyun Choi, Hyeyoon Lee +4Post-Training Quantization Quantization
Rethinking Normalization Placement for LLMs: Post-Norm under Curriculum Depth Growing
Aug 13, 2026Sheng Ren, Yadong Wang, Naiqiang Tan +7Batch Normalization Normalization
Small-Scale Experiments: Are We There Yet?
Aug 12, 2026Nicholas Lourie, Kyunghyun Cho, Karen Ullrich +1Scaling Laws Hyperparameter
Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure
Aug 10, 2026Xingjian Wang, Qingyu Han, Xiaodong Luo +1Batch Normalization Transformer Encoder
One Model to Magnify Them All: Efficient Scale-Invariant Histopathology via Conditional Normalization and Continuous Magnification Training
Aug 10, 2026Agnieszka Florkowska, Henning Müller, Marek WodzinskiDigital Pathology Resnet-18
SwiftQK: Fast and Communication-Efficient Tensor Parallelism for Query-Key Normalization
Aug 10, 2026Gyudong Kim, Wonjun Han, Young Geun KimTensor Programs Batch Normalization
Low-Dimensional High-Leverage Subspace Optimization: Beyond Full-Parameter Coupled Training for Neural Network Quantization
Aug 4, 2026Peng Xia, Junbiao Pang, Zheng HuangPost-Training Quantization Mixed-Precision Quantization
Cross-Layer Interaction under Weight-Space Ablation: A Closed-Form Attention Jacobian Bound and a Test on a Real Pretrained Model
Aug 4, 2026Abdallah KhemaisAblation Cross-Layer Interactions
Geometry-Guided Layerwise FFN Width Allocation in Transformers
Aug 3, 2026Timur Mudarisov, Mikhail Burtsev, Radu StateBatch Normalization Feed-Forward
Scalable Keyword Spotting via Modular Network Expansion
Jul 22, 2026Viktor Khaymonenko, Dzmitry Saladukha, Aliaksei Rak +1Top-K Tuning
Phasor Attention: Mean Root Square Normalization for Phase Manifold Preservation
Jul 20, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungBatch Normalization Residual Connections
In-context learning of closed form solution to simple linear regression task using transformer with linear self-attention
Jul 17, 2026Katsuyuki HagiwaraIn-Context Learning Regression
What Does Goodness Measure? A Likelihood-Ratio Account of Forward-Forward Learning
Jul 14, 2026Paolo GiannitrapaniSingle Forward Pass Batch Normalization
Same Loss, Same Noise, Opposite Schedules: Noise Structure and Optimizer Normalization Jointly Determine Whether Learning-Rate Cooldown Helps
Jul 14, 2026Subham Singh, Ashutosh Mishra, Subha RautLearning Rates Batch Normalization
LayerNorm as Implicit Gain Control in Looped Transformers
Jul 12, 2026Matthias M. M. BuehlmaierBatch Normalization Recurrent Model
AutoNorm: Understanding Adaptive Normalization in Transformers through Differentiable Gating
Jul 12, 2026Piyush Kaushik Bhattacharyya, Divyanshu Rai, Swastik Singh +3Batch Normalization Normalization
Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions
Jul 9, 2026Sarthak Kumar Maharana, Shambhavi Mishra, Yunbei Zhang +6Test-Time Adaptation Cross-Domain Shifts
Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization
Jul 8, 2026Shuo Huai, Di Liu, Hao Kong +4Nvidia Jetson Orin Nano Low-Latency Systems
Group-Equivariant Poincaré Convolutional Networks
Jul 1, 2026Aiden Durrant, Rahul Baburajan, Georgios LeontidisExact Equivariance Reparameterization
Review Residuals: Update-Conditioned Residual Gating for Transformers
Jun 30, 2026Kyle KramerResidual Connections Batch Normalization
Intrinsically Stable Spiking Neural Networks: Overcoming the Performance Barrier in the Absence of Batch Normalization
Jun 30, 2026Ruichen Ma, Xiaoyang Zhang, Jian Bai +5Spiking Neural Networks Neuromorphic Hardware
CascadeFormer: Depth-Tapered Transformers Motivated by Gradient Fan-in Asymmetry
Jun 25, 2026Huzama Ahmad, Cao Viet Hai Nam, Se-Young YunBatch Normalization Mixformer
Algebraic Dead Directions in LayerNorm Transformers: A Forward-Pass-Only Diagnostic at LLM Scale
Jun 17, 2026Tejas Pradeep Shirodkar, P. J. NarayananBatch Normalization Singular Value Decomposition
Smoothness-Based Derandomization of PAC-Bayes Bounds
Jun 17, 2026Alexandre Lemire Paquin, Brahim Chaib-Draa, Philippe GiguèreGeneralization Bounds Loss Function
MIVE: A Minimalist Integer Vector Engine for Softmax LayerNorm and RMSNorm Acceleration
Jun 16, 2026Kosmas Alexandridis, Giorgos DimitrakopoulosAccelerator Batch Normalization
QK-Normed MLA: QK normalization without full key caching
Jun 15, 2026Yizhou Han, Yao Zhao, Jun Zhou +2Multi-Head Attention Key-Value Cache Quantization
Z-Plane Neural Networks: Bounded Geometric Activation Replaces ReLU and LayerNorm
Jun 14, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungActivation Functions Batch Normalization
Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning
Jun 13, 2026Daniel Vila-Cruz, Laura Morán-Fernández, Verónica Bolón-CanedoTransfer Learning Backpropagation
LieBN: Batch Normalization over Lie Groups
Jun 13, 2026Ziheng Chen, Yue Song, Rui Wang +2Batch Normalization Statistical Manifold
Dense Supervision Is Not Enough: The Readout Blind Spot in Looped Language Models
Jun 12, 2026Rituraj Sharma, Tu VuRecurrent Model Batch Normalization
Squeeze-Release: Iterative Pruning with Exact Structural Minimization
Jun 12, 2026Roman Denkin, Ida Akerholm, Prashant Singh +1Batch Normalization Resnet-18
Zeta: Dual Whitening for Matrix Optimization via Coordinate-Adaptive Preconditioning
Jun 12, 2026Kaiwen Chen, Shuhai Zhang, Zimo Liu +7Batch Normalization Model Weights
PostDeg: Placement Beats Parameterization in LayerNorm GNNs
Jun 12, 2026Yash Tomar, Aryav DasBatch Normalization Graph Neural Networks
MechLens: Late Crystallization of Factual Knowledge Explains Intervention Effectiveness in Language Models
Jun 6, 2026Xueping GaoFactual Recall Crystal
SaluNet: Enabling Total Plasticity in Normalization-Free Deep Networks
Jun 1, 2026Mourad ZaiedBatch Normalization Deep Neural Network
Looped Transformers with Layer Normalization Provably Learn the Power Method
May 30, 2026Lyumin Wu, Chenyang Zhang, Yuan CaoBatch Normalization Principal Component Analysis
On Efficient Scaling of GNNs via IO-Aware Layers Implementations
May 29, 2026Daria Fomina, Daniil Krasylnikov, Alexey Boykov +3Graph Neural Networks Graphics Processing Unit Kernels
Can Entry-Wise Clipping Give Spectral Control of Stochastic Gradients?
May 26, 2026Zitao Song, Cedar Site Bai, Zhe Zhang +2Gradient Clipping Batch Normalization
SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training
May 26, 2026Mohammed Adnan, Rohan Jain, Tom Jacobs +4Batch Normalization Sparsity
Negligible in Size, Significant in Effect: On Scale Vectors in Large Language Models
May 26, 2026Mingze Wang, Shuchen Zhu, Yuxin Fang +3Large Language Model Scale Batch Normalization
Llamion Technical Report
May 25, 2026Kisu Yang, Yoonna Jang, Hyeonseok Moon +6Model Weights Heterogeneous Knowledge Distillation
Momentum Streams for Optimizer-Inspired Transformers
May 23, 2026Jingchu Gai, Nai-Chieh Huang, Jiayun WuTransformer Variant Batch Normalization
Batch Normalization Amplifies Memorization and Privacy Risks
May 23, 2026Ngoc Phu Doan, Chongyan Gu, Ihsen AlouaniBatch Normalization Privacy Risks and Protection
Holistic Reliability Propagation: Decoupling Annotation and Prediction for Robust Noisy-Label
May 20, 2026Jingyang Mao, Ningkang Peng, Yanhui GuNoisy Labels Pseudo-Labeling
StableGrad: Backward Scale Control without Batch Normalization
May 19, 2026Jose I. Mestre, Alberto Fernández-Hernández, Cristian Pérez-Corral +2Batch Normalization Neural Network Optimization
A Geometric Analysis of Sign-Magnitude Asymmetry in a ReLU + RMSNorm Block under Ternary Quantization
May 18, 2026Lei DongBatch Normalization Rectified Linear Unit
AdaptiveLoad: Towards Efficient Video Diffusion Transformer Training
May 18, 2026Yucheng Guo, Yongjian Guo, Zhong Guan +6Video Diffusion Models Batch Normalization
Attention Sinks and Outliers in Attention Residuals
May 18, 2026Haozheng Luo, Haoran Dai, Shaoyang Zhang +10Residual Connections Batch Normalization
The Geometry of Projection Heads: Conditioning, Invariance, and Collapse
May 16, 2026Faris ChaudhryMulti-Head Attention Neural Collapse
TAPIOCA: Why Task- Aware Pruning Improves OOD model Capability
May 14, 2026Krish Sharma, Omar Naim, Soumadeep Saha +3Out-Of-Distribution Multi--Task Learning
Enjoy Your Layer Normalization with the Computational Efficiency of RMSNorm
May 14, 2026Yuxin Guo, Yihao Yue, Yunhao Ni +4Batch Normalization Graph Neural Network Inference
Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping
May 11, 2026Haoyuan Sun, Jing Wang, Yuxin Song +9Text-To-Image Models Text-To-Image
When and Why Grouping Attention Heads Accelerates Muon Optimization
May 9, 2026Hongtao Zhang, Wenjie Zhou, Wei Chen +1Multi-Head Attention Muon
QuadNorm: Resolution-Robust Normalization for Neural Operators
May 8, 2026Bum Jun Kim, Makoto Kawano, Yusuke Iwasawa +1Batch Normalization Neural Operators
Training-Time Batch Normalization Reshapes Local Partition Geometry in Piecewise-Affine Networks
May 6, 2026Xuan Qi, Yi Wei, Fanqi Yu +3Batch Normalization Rectified Linear Unit Networks
Demystifying Manifold Constraints in LLM Pre-training
May 6, 2026Kang An, Jiaxiang Li, Donald Goldfarb +1Large Language Model Post-Training Riemannian Optimization
Normalization Equivariance for Arbitrary Backbones, with Application to Image Denoising
May 5, 2026Youssef Saied, François FleuretExact Equivariance Batch Normalization

Sep 12, 2026 · cs.AIJ/K move · Enter open · S save

Published Unlearning Numbers Move Per Checkpoint, and Not Because the Removed Data Survives: An Audit of 263 Released Batch-Normalized Checkpoints

Junlong Shen Xingyu Li

An unlearning audit reads its verdict off numbers that an unlearned model and its retrained reference each publish, and both also ship batch-normalization statistics that no gradient step wrote and no release records. Refitting them on kept data at bit-identical weights moves 47 of 221 released checkpoints past the spread their own release's seeds show, several inside a method whose average does not move: what moves is the checkpoint's property, not its method's. What does the moving is not the removed data surviving in the state: exchanging kept records for removed ones inside a fixed fitting pool moves a published cell by almost nothing, while how far a checkpoint's shipped state has drifted from any refit does track it. The consequence for a published decision is real but narrow: twelve verdicts cross, four clear a measured recalibration budget, two clear it on every replicate, and a population we trained and sited near its own criterion yields none. A release should therefore name the fitting convention beside the number, on the batch-normalized vision models where this channel exists.

Model Checkpoints Unlearning Aims Recalibration Post-Hoc Batch Normalization Algorithm Auditing

Open paper Ask about it PDF