Kullback-Leibler Divergence

Also known as KL

Latest papers

CardsList

31 papers4 papers in the last four weeks, down 43% on the four weeks before. 0.0% of all new papers.

  1. Lipschitz-Constrained Discriminators in Generative Modeling: Asymptotic Behavior and Support Mismatch

    Nov 13, 2026Eduardo Pinto, Panagiota BirmpaGenerative ModelingKullback-Leibler Divergence

  2. Displacement Moments and Path-Terminal Separation in Brownian Interpolant Sampling

    Oct 27, 2026Zhong HanStochastic InterpolantsStochastic Differential Equations

  3. Information Estimation with Discrete Diffusion

    Oct 16, 2026Alberto Foresti, Giulio Franzese, Pietro MichiardiMutual Information EstimationDiffusion Models

  4. Divergence-Routed On-Policy Distillation for Language Models

    Oct 14, 2026Tiantian Peng, Guannan Lv, Hongyang Li +5On-Policy DistillationKnowledge Distillation

  5. DisCo Algebra: Why Disintegration and Combination Are Not Inverses

    Oct 10, 2026Xuexing LuKullback-Leibler Divergence

  6. Universal Bounds for Self-Normalized Kullback-Leibler Estimation

    Oct 9, 2026Buu Phan, Lester Mackey, David Alvarez-MelisKullback-Leibler DivergenceImportance Sampling

  7. Divergence controls entropy in distillation

    Oct 2, 2026Nicolas Zucchet, Scott W. LindermanKullback-Leibler DivergenceKnowledge Distillation

  8. How Divergence Becomes Decision Flips in Compressed Language Models

    Sep 30, 2026Beatriz Almeida FelicioLLM EvaluationLLM Compression

  9. Understanding Off- vs On-Policy Distillation: A Tale of Distinct Training Objectives

    Sep 29, 2026Qiwei Di, Xuheng Li, Kaixuan Ji +3Multi-Teacher Knowledge DistillationOn-Policy Distillation

  10. Mode Coverage in Normalizing Flow Boltzmann Generators via Log-Ratio Variation

    Sep 8, 2026Qi Feng, Rongjie Lai, Di Qi +1Normalizing FlowsMolecular Generation

  11. A Token-Level Analysis of Sampled-Token Reverse-KL On-Policy Distillation

    Aug 26, 2026Bing Shao, Jiazheng Zhang, Long Ma +13Language Model DistillationOn-Policy Distillation

  12. Tightening the Score Matching Gap for Diffusion Models

    Jul 5, 2026Benjamin Dupuis, Tyler Farghly, Maxime Haddouche +2Score MatchingScore-Based Generative Modeling

  13. Beyond Global Divergences: A Local-Mass Perspective on Bayesian Inference

    Jun 25, 2026Hanli Xu, Fengxiang He, Sarat MokaBayesian InferenceKullback-Leibler Divergence

  14. Displacement Is Not Direction: Evaluating Fidelity Metrics for Quantized LLM Deployment

    Jun 17, 2026Miloš Nikolić, Ali Hadi Zadeh, Enrique Torres Sanchez +1LLM QuantizationLLM Evaluation

  15. Diffusion Flow Matching: Dimension-Improved KL Bounds and Wasserstein Guarantees

    Jun 15, 2026Marta Gentiloni Silveri, Giovanni Conforti, Alain DurmusDiffusion SamplingFlow-Based Generative Modeling

  16. Rethinking the Role of Temperature in Large Language Model Distillation

    May 29, 2026Hoang-Chau Luong, Lingwei ChenLanguage Model DistillationKnowledge Distillation

  17. A Spectral Framework for Closed-Form Relative Density Estimation

    May 11, 2026Francis BachDensity Ratio EstimationSpectral Methods

  18. Worst-Case Optimal ε\sqrtε-Rate Stability of KL Divergence under Perturbations of Gaussian Distributions

    Apr 13, 2026Jialu Pan, Yufeng Zhang, Nan Hu +3Kullback-Leibler DivergenceInformation Geometry

  19. Robust Multi-Agent Target Tracking in Intermittent Communication Environments via Analytical Belief Merging

    Apr 8, 2026Mohamed Abdelnaby, Samuel Honor, Kevin LeahyKullback-Leibler DivergenceMulti-Agent Systems

  20. Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation

    Mar 31, 2026Hoang-Chau Luong, Dat Ba Tran, Lingwei ChenLanguage Model DistillationKnowledge Distillation

  21. Surprisal-Rényi Free Energy

    Mar 3, 2026Shion Matsumoto, Ankur Arjun MaliLarge Deviation PrinciplesKullback-Leibler Divergence

  22. Dimension-Independent Convergence of Underdamped Langevin Monte Carlo in KL Divergence

    Mar 2, 2026Shiyuan Zhang, Qiwei Di, Xuheng Li +1Kullback-Leibler DivergenceMarkov Chain Monte Carlo

  23. A Gaussian Perspective for Distributional Discrepancy in Generative Diffusion Models

    Jan 20, 2026Qiang Sun, H. Vincent Poor, Wenyi ZhangDiffusion SamplingKullback-Leibler Divergence