Information-Theoretic Lower Bounds

Ask about this topic

Momentum

12 papers in the last four weeks, up 140% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 53

All topics
CardsList

  1. Verification with Transfer: Exact Information Frontiers and Their Price in Calls

    Oct 8, 2026Hazar YuekselInformation-Theoretic Lower BoundsQuery Complexity

  2. Recovery Guarantees for Posterior Sampling of One-Bit Compressed Sensing

    Oct 8, 2026Jing Ma, Yujia Wu, Zhaoqiang LiuCompressed SensingSample Complexity

    University of Electronic Science and Technology of China

  3. New Lower Bound and Upper Bounds on the Regret for Online Sparse Linear Regression

    Oct 8, 2026Xiaofeng Cao, Junfan Li, Langzhang Liang +2Linear RegressionMinimax Regret

    School of Computer Science and Technology, Tongji University, Shanghai, China · School of Computing and Artificial Intelligence, Shanghai University of Finance and Economics, Shanghai, China · AI3 Institute, Fudan University and Shanghai Innovation Institute +2

  4. A General Ω~(TγT)\widetildeΩ(\sqrt{T γ_T}) Lower Bound for Kernel Bandits

    Oct 8, 2026Chenkai Ma, Jonathan ScarlettMinimax RegretMulti-Armed Bandits

    National University of Singapore

  5. An Accuracy-Information Tradeoff for Loss-Difference Conditional Mutual Information

    Oct 6, 2026Hazar YuekselStatistical Learning TheoryInformation-Theoretic Generalization Bounds

  6. Structural Limits of the Information-Theoretic Uncertainty Decomposition

    Sep 30, 2026Jakob Lønborg Christensen, Christian F. Baumgartner, Morten Rieger Hannemose +2Aleatoric UncertaintyInformation-Theoretic Lower Bounds

    DTU Compute Technical University of Denmark · Faculty of Health Sciences and Medicine University of Lucerne

  7. Lower Bounds for Linear-Oracle Online Learning

    Sep 29, 2026Mohit SinhaOnline Convex OptimizationInformation-Theoretic Lower Bounds

  8. A Sharp Transition in Data Reconstruction under Differential Privacy

    Sep 29, 2026Max Cairney-Leeming, Simone Bombari, Marco MondelliAdversarial AttacksDifferential Privacy

    Institute of Science and Technology Austria

  9. QAM: Quadratic-Accurate Checkpoint Merging via Sequential Consistency

    Sep 28, 2026Shihao Wang, Rui Kong, Xinran Chen +7Language Model MergingModel Merging

    University of Wisconsin – Madison · Baidu Inc. · University of Arizona +3

  10. When are bosonic Gaussian states classical to learn?

    Sep 22, 2026Senrui Chen, Antonio Anna Mele, Francesco Anna Mele +1Quantum State TomographyStatistical Learning Theory

    Institute for Quantum Information and Matter, Caltech, Pasadena, CA 91125, USA · Dahlem Center for Complex Quantum Systems, Freie Universität Berlin, 14195 Berlin, Germany

  11. On the Information-Theoretic Limits of Latent-Space Watermarking Through Pretrained Generators

    Sep 21, 2026Jinwan Jeon, Minju Lee, Sung Hoon LimRobust WatermarkingInformation-Theoretic Lower Bounds

    Hallym University, CHUNCHEON-SI, GANGWON-DO, South Korea

  12. Learning CNF Formulas from Uniform Random Solutions: Near-Tight Sample Complexity for Valiant's Algorithm

    Sep 14, 2026Weiming Feng, Yixiao Yu, Yiyao ZhangBoolean Function LearningSample Complexity

    School of Computing and Data Science, The University of Hong Kong. · State Key Laboratory for Novel Software Technology, New Cornerstone Science Laboratory, Nanjing University.

  13. A positive resolution of the gap-entropy conjecture

    Sep 9, 2026P. M. Aronow, Nathan Kallus, Patrick LopattoBest-Arm IdentificationInformation-Theoretic Lower Bounds

  14. Optimal Low-Rank Quantum State Tomography with Bounded-Sample Joint Measurements

    Sep 9, 2026Ashwin Nayak, Xingyu ZhouQuantum State TomographyInformation-Theoretic Lower Bounds

    Department of Combinatorics and Optimization, and Institute for Quantum Computing, University of Waterloo. · Department of Computer Science, University of British Columbia.

  15. Oracle Complexity of Stochastic Fixed-Point Equations with Nonexpansive Maps

    Sep 8, 2026Jelena Diakonikolas, Cristóbal Guzmán, David Martínez-RubioOracle ComplexityStochastic Approximation

    Department of Computer Sciences, University of Wisconsin-Madison · Institute for Mathematical and Computational Engineering, Faculty of Mathematics and School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile · IMDEA Software Institute, Madrid, Spain

  16. Speed Limit for Information Acquisition in Stochastic Learning Dynamics

    Sep 8, 2026Shuta Kobayashi, Andreas DechantNeural Network Training DynamicsInformation-Theoretic Lower Bounds

    Department of Physics, Kyoto University, Kyoto 606-8502, Japan

  17. A Fundamental Limit in Decentralized Decision-Making

    Sep 7, 2026Marco Carpentiero, Felice Scala, Vincenzo Matta +1ClassificationDistributed Inference

    Department of Information and Electrical Engineering and Applied Mathematics (DIEM), University of Salerno, I-84084 Fisciano (SA), Italy · Institute of Electrical and Micro Engineering, EPFL, CH-1015 Lausanne, Switzerland

  18. Minimax bounds for watermarked and masked recursive discrete distribution estimation

    Aug 31, 2026Millen Kanabar, Michael GastparDataset WatermarkingMinimax Estimation

    School of Computer and Communication Sciences, EPFL, Switzerland

  19. Strengthening Recursive Constructions for Zero-Error Shannon Capacity

    Aug 31, 2026Ravi TandonCombinatorial OptimizationInformation-Theoretic Lower Bounds

    School of Electrical, Computing and Software Engineering, University of Arizona, Tucson, AZ 85721, USA.

  20. Sharp Minimax Regret for Infinite-Memory Logistic Prediction

    Aug 27, 2026Vaneet AggarwalLogistic RegressionBayesian Mixture Models

    Purdue University

  21. Quantum Multi-Armed Bandits and Linear Bandits: Lower Bounds and Algorithms

    Aug 14, 2026Maoli Liu, Zhuohua Li, John C. S. LuiMulti-Armed BanditsInformation-Theoretic Lower Bounds

    The Chinese University of Hong Kong · Xidian University

  22. On the Structural Limits of Machine Learning Decision Systems: An Information-Theoretic, Interaction-Based, and Stochastic-Dynamical Perspective

    Aug 13, 2026Nestor R. Barraza, Gabriel PenaStochastic Linear Dynamical SystemsStatistical Learning Theory

    Universidad Nacional de Tres de Febrero. Departamento de Ciencia y Tecnología. · Universidad de Buenos Aires. Facultad de Ingeniería.

  23. Why Formal Monitors Fail: Attack Distribution Entropy as a Coverage Bound for LTL-Based LLM Agent Safety

    Aug 2, 2026Ruiyang ZhangFormal VerificationAI Agent Monitoring

    Ryonix Labs Inc. Flock.io

  24. The Price of Hidden Curvature: An Ω~(d5/4T)\widetildeΩ (d^{5/4} \sqrt{T}) Lower Bound for Bandit Convex Optimization

    Jul 21, 2026Nived RajaramanOnline Convex OptimizationMinimax Regret

    Microsoft Research

  25. Rate-Distortion-Perception Theory: Redefining the Fundamental Limits of Information Representation

    Jul 19, 2026Photios A. Stavrou, Giuseppe Serra, Marios KountourisLearned Image CompressionRate-Distortion Theory

  26. Tight Sample Bounds for Renyi and Min-Entropy Estimation

    Jul 18, 2026Arman Adibi, Piotr KrystaSample ComplexityInformation-Theoretic Lower Bounds

    Department of Computer Science

  27. When Can Safe Controllers Adapt? Information before Commitment

    Jul 18, 2026Venkatesh SaligramaRL ExplorationOptimal Control

    Department of Electrical and Computer Engineering, Boston University, MA 02215

  28. Price of Fairness in Bandits: A Tight Minimax Characterization

    Jul 15, 2026Dhruv Sarkar, Soumyadeep Dutta, Sayak Ray ChowdhuryMulti-Armed BanditsMinimax Regret

    1Indian Institute of Technology Kharagpur · 2Mohamed bin Zayed University of Artificial Intelligence · 3Indian Institute of Technology Kanpur

  29. Watermark Forensics for Generative Models: An Information-Theoretic Perspective

    Jul 14, 2026Xiaoyu Li, Zheng Gao, Xiaoyan Feng +3Text WatermarkingLLM Watermarking

    University of New South Wales · 2Griffith University

  30. Fundamental Limitations of Fixed-Budget Best-Arm Identification

    Jul 13, 2026Motti GoldbergerMulti-Armed BanditsBest-Arm Identification

    Yale University