Overview

Entropy regularization adds an entropy-based term or constraint to an objective to control how concentrated or diverse a model’s distributions and representations become. Methods use Shannon, Rényi, or Tsallis entropy in settings such as reinforcement-learning exploration, test-time adaptation, language-model training, latent-variable learning, and entropically regularized optimal transport solved with Sinkhorn methods. Some approaches minimize prediction entropy for confident decisions, while others preserve or increase entropy to encourage exploration, prevent collapse, or maintain diverse outputs; adaptive and class-, token-, or perceptual-level controls aim to apply these effects selectively. The central challenge is balancing useful confidence or sparsity against bias, lost diversity, and unstable optimization, alongside developing guarantees for convergence and statistical performance.

Latest papers

CardsList

36 papers1 paper in the last four weeks, down 75% on the four weeks before. 0.0% of all new papers.

  1. Entropy-Regularized Integrated Gradients for Stable Feature Attribution

    Nov 17, 2026Rukmangadh Sai Myana, Sumit Kumar Jha, Yanzhao WuIntegrated GradientsFeature Attribution Stability

  2. Self-Supervised Collapse Prevention with Score-Based Entropy Maximization

    Nov 8, 2026Adarsh Kappiyath, Silpa Vadakkeeveetil Sreelatha, Xiatian Zhu +3Self-Supervised Visual Representation LearningRepresentation Collapse

  3. Pareto-Optimal Entropy-Regularized Trajectory Optimization

    Oct 6, 2026Dimitrios S. Georgiou, Augustinos D. Saravanos, Evangelos A. TheodorouTrajectory OptimizationTrajectory Generation

  4. The Arbitrary-Placement Problem in Entropy-Minimizing Selection, and a Residual-Entropy Formulation

    Oct 5, 2026Alyssa H. Shin, Claire H. ShinEntropy Regularization

  5. Entropy Regularization: A Free Correction to Cross-Entropy for Verified Demonstrations

    Sep 24, 2026Mihir Dhanakshirur, Adam Ousherovitch, Ambuj TewariEntropy RegularizationLLM Reasoning

  6. SinkSLOT: Sinkhorn via Sparse Lifted Optimal Transport

    Aug 28, 2026Ian Hsieh, Soumya Snigdha Kundu, Tom Vercauteren +1Optimal TransportEntropy Regularization

  7. Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Density

    Aug 17, 2026Keyi Li, Yuval Kluger, Boris LandaOptimal TransportEntropy Regularization

  8. Soft-Constrained Optimization of Latent Space in Variational Autoencoders

    Jul 26, 2026Ye ShiVariational AutoencodersDisentangled Representation Learning

  9. The SIGReg Objective as Variational Free Energy: A Theoretical Active-Inference Account of JEPA World Models

    Jul 15, 2026Fabio Arnez, Alexandra Gomez-VillaWorld Model LearningActive Inference

  10. Entropy-Regularized Probabilistic Gates for Sparse Model Discovery in Scarce-Data Federated Learning

    Jun 30, 2026Krishna Harsha Kovelakuntla Huthasana, Alireza Olama, Andreas LundellSparse RecoveryNon-IID Federated Learning

  11. Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

    Jun 29, 2026Srinivasa Rao P., Vangmayi P ReddyStatistical Physics of LearningNeural Network Generalization

  12. Sample complexity of unbalanced entropic OT

    Jun 23, 2026Francisco Andrade, Gabriel Peyré, Clarice PoonSample ComplexityEntropy Regularization

  13. Entropy Minimization without Model Collapse: Mitigating Prediction Bias in Medical Imaging

    Jun 1, 2026Tim Nielen, Sameer Ambekar, Johannes Kiechle +2Distribution Shift RobustnessTest-Time Adaptation

  14. Human-Centered Learning Mechanics: Observable Entropy Control under Protected-Risk Constraints

    May 21, 2026Kim Phuc TranRepresentation LearningNeural Network Training Dynamics

  15. Behavior-Consistent Deep Reinforcement Learning

    May 20, 2026Marcel Hussing, Liv G. d'Aliberti, Claas Voelcker +2Reinforcement LearningPolicy Optimization

  16. Normative Networks for Source Separation via Local Plasticity and Dendritic Computation

    May 19, 2026Bariscan Bozkurt, Efe Ali Gorguner, Francesco Innocenti +1Local LearningEntropy Regularization

  17. DiPRL: Learning Discrete Programmatic Policies via Architecture Entropy Regularization

    May 18, 2026Chengpeng Hu, Yingqian Zhang, Hendrik BaierReinforcement LearningProgram Synthesis

  18. Graph Transductive Sharpening: Leveraging Unlabeled Predictions in Node Classification

    May 18, 2026Brown Zaz, Mar Gonzàlez I Català, Ferran Hernandez Caralt +2Graph Neural NetworksGraph-Based Semi-Supervised Learning

  19. On Gaussian approximation for entropy-regularized Q-learning with function approximation

    May 17, 2026Artemy Rubtsov, Rahul Singh, Eric Moulines +2Reinforcement LearningStochastic Approximation

  20. Entropic Auto-Encoding via Implicit Free-Energy Minimization

    May 15, 2026Hazhir Aliahmadi, Irina Babayan, Greg van AndersVariational AutoencodersPosterior Collapse

  21. Sharp Spectral Thresholds for Logit Fixed Points

    May 15, 2026Tongxi WangDynamical SystemsLyapunov Stability

  22. When Policy Entropy Constraint Fails: Preserving Diversity in Flow-based RLHF via Perceptual Entropy

    May 12, 2026Xiaofeng Tan, Jun Liu, Bin-Bin Gao +5Flow MatchingGenerative Modeling

  23. Understanding and Preventing Entropy Collapse in RLVR with On-Policy Entropy Flow Optimization

    May 12, 2026Huimin Xu, Shuai Zhao, Xiaobao Wu +1Entropy Collapse in RLReinforcement Learning

  24. Rethinking Entropy Minimization in Test-Time Adaptation for Autoregressive Models

    May 5, 2026Wei-Ping Huang, Chee-En Yu, Guan-Ting Lin +1Test-Time AdaptationEntropy Regularization

  25. MER-DG: Modality-Entropy Regularization for Multimodal Domain Generalization

    May 3, 2026Yavuz Yarici, Ghassan AlRegibMultimodal Domain GeneralizationDomain Generalization

  26. Asymmetric Advantage Modulation Calibrates Entropy Dynamics in RLVR

    Apr 6, 2026Hengrui Gu, Xiaotian Han, Yujing Bian +2RL for Language Model ReasoningReinforcement Learning with Verifiable Rewards