Kullback-Leibler Divergence

Ask about this topic

Momentum

27 papers in the last four weeks, up 238% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 138

All topics
CardsList

  1. Variance Is Not Importance: Structural Analysis of Transformer Compressibility Across Model Scales

    Apr 22, 2026Samuel SalfatiImportanceKullback-Leibler Divergence

    fraQtl AI Research

  2. Properties and limitations of geometric tempering for gradient flow dynamics

    Apr 22, 2026Francesca Romana Crucinio, Sahani PathirajaWasserstein Gradient FlowsConvergence

    ESOMAS, University of Turin, Italy · Collegio Carlo Alberto, Turin, Italy · School of Mathematics & Statistics, UNSW Sydney, Australia

  3. Efficient Search of Implantable Adaptive Cells for Medical Image Segmentation

    Apr 16, 2026Emil Benedykciuk, Marcin Denkowski, Grzegorz M. WójcikSemi-Supervised Medical Image SegmentationU-Net

    Institute of Computer Science and Mathematics, Maria Curie Sklodowska University, Akademicka 9, Lublin, 20-033,, Poland

  4. The Effective Number of Nonzeros: Theory and Regularization for Sparse Recovery

    Mar 14, 2026Haoyu He, Hao Wang, Jiashan Wang +1SparsityRegularization

    School of Information Science and Technology, ShanghaiTech University, Shanghai, China · Department of Mathematics, University of Washington, Seattle, WA, USA · School of Computer Science and Engineering, Sun Yat-sen University

  5. Logit Distance Bounds Representational Similarity

    Feb 17, 2026Beatrix M. G. Nielsen, Emanuele Marconato, Luigi Gresele +2Kullback-Leibler DivergenceLogit Lens

    IT University of Copenhagen, Denmark · University of Trento, Italy · University of Copenhagen, Denmark +2

  6. A Gaussian Perspective for Distributional Discrepancy in Generative Diffusion Models

    Jan 20, 2026Qiang Sun, H. Vincent Poor, Wenyi ZhangDiffusion ModelsKullback-Leibler Divergence

    Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, China · Department of Electrical Engineering, Princeton University, Princeton, NJ, USA

  7. Black-Box Detection of LLM-Generated Text Using Generalized Jensen-Shannon Divergence

    Oct 8, 2025Shuangyi Chen, Ashish KhistiMachine-Generated Text DetectionBlack Box

    Department of Electrical and Computer Engineering, University of Toronto, Toronto, Canada.

  8. Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization

    Sep 3, 2025Wu Lin, Scott C. Lowe, Felix Dangel +3Neural Network OptimizationKullback-Leibler Divergence

    1Vector Institute, Toronto, Canada · University of Cambridge, Cambridge, United Kingdom · 3Microsoft, United States +1

  9. Learning Task Mixtures from Task Affinities: A Probabilistic Graphical Model for Supervised Fine-Tuning

    Jul 16, 2025Prateek Chanda, Saral Sureka, Parth Pratim Chatterjee +3Multi--Task LearningMixtures

    IIT Bombay · IBM Research · Red Hat AI Innovation +1

  10. GeLaCo: An Evolutionary Approach to Layer Compression

    Jul 14, 2025David Ponce, Thierry Etchegoyhen, Javier Del SerLarge Language Model CompressionCompressed Model

    Fundación Vicomtech, Basque Research and Technology Alliance (BRTA) · University of the Basque Country UPV/EHU · TECNALIA. Basque Research and Technology Alliance (BRTA)

  11. Spherical Cauchy Variational Autoencoders: Heavy Angular Tails and Exact KL Evaluation

    Jun 26, 2025Lukas Sablica, Kurt HornikSpherical Latent SpaceConditional Variational Autoencoder

    Institute for Statistics and Mathematics Vienna University of Economics and Business Austria

  12. The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysis

    Jun 13, 2025Bernardo P. Schaeffer, Ricardo M. S. Rosa, Glauco ValleScore-Based Diffusion ModelStochastic Differential Equations

    Instituto de Matem´atica, Universidade Federal do Rio de Janeiro

  13. A Jump-Diffusion Framework for Irregular Time Series Generation

    May 29, 2025O. Pfohl, J. Chemseddine, P. Hagemann +3Time-Series GenerationStochastic Processes

    Department of Mathematics, Humboldt-Universität zu Berlin, 12489, Berlin, Germany · Department of Mathematics, Technische Universität Berlin, 10623, Berlin, Germany · Bundesanstalt für Materialforschung und -prüfung, 12205, Berlin, Germany +1

  14. Inclusive KL Gradient Flows: Otto-Wasserstein, Fisher-Rao-Gaussian, and Local-Estimator Dynamics

    Oct 31, 2024Jia-Jie ZhuWasserstein Gradient FlowsVariational Inference

    Department of Mathematics, KTH Royal Institute of Technology, Lindstedtsvägen 25, 114 28, Stockholm, Sweden

  15. Variance Reduction for Independent Metropolis

    Jun 25, 2024Siran Liu, Petros Dellaportas, Michalis K. TitsiasVariance ReductionVariance

    Department of Statistical Science, University College London, UK. · Department of Statistics, Athens University of Economics and Business, Greece. · Google DeepMind, UK.

  16. Linear and Quadratic Discriminant Analysis: Tutorial

    Jun 1, 2019Benyamin Ghojogh, Mark CrowleyPrincipal Component AnalysisKullback-Leibler Divergence

    Department of Electrical and Computer Engineering, Machine Learning Laboratory, University of Waterloo, Waterloo, ON, Canada

  17. Accuracy is Not Enough: A Divergence-Based Approach to Evaluate Fidelity Loss in Quantized LLMs

    Date pendingShahzeb Qamar, Lorenz Sparrenberg, Christian Bauckhage +5Large Language Model QuantizationKullback-Leibler Divergence

    Fraunhofer IAIS, Germany · PhenoRob Cluster of Excellence, University of Bonn, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence, Germany +4

  18. REAL-Q: E2E LLM Quantization via Dynamic Gradient Descent

    Date pendingQian Zhang, Yaoming Li, Zhewen Tan +9Large Language Model QuantizationPost-Training Quantization

    Peking University · Northeastern University · ZTE Corporation