Information-Theoretic Limits

Ask about this topic

Recent momentum

-14%

6 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Information-Theoretic Limits

Neighbouring directions

Mutual InformationInformation Bottleneck

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Information-Theoretic Limits.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Information-Theoretic Limits.

96 papers

Latest in Information-Theoretic Limits

Open your feed →
CardsList

  1. Intelligence Under Time Constraints: Rethinking Test-Time Compute

    Sep 14, 2026Xiaotian ZhangComputational CostInformation-Theoretic Limits

  2. When Does Text Inform? Benchmarking Information-Theoretic Metrics for Multimodal Time-Series Forecasting

    Sep 12, 2026Emma Andrews, Gianmarco MengaldoTime Series ForecastingMultimodal Learning

  3. A Mathematical Theory of Pragmatic Information

    Sep 12, 2026Kai Niu, Ping ZhangInformation-Theoretic LimitsTheoretical Foundations

  4. Speed Limit for Information Acquisition in Stochastic Learning Dynamics

    Sep 8, 2026Shuta Kobayashi, Andreas DechantStochastic Gradient DescentInformation-Theoretic Limits

  5. Microcanonical Hamiltonian Monte Carlo and the Helmholtz Theorem

    Sep 7, 2026Heinrich von Campe, Bjoern Malte SchaeferHamiltonian Monte CarloThermodynamics

  6. Strengthening Recursive Constructions for Zero-Error Shannon Capacity

    Aug 31, 2026Ravi TandonMaximum Independent SetInformation-Theoretic Limits

  7. Converse and Collision-Based Achievability for Node Localization with Hybrid Distance-Spectral Graph Positional Encodings

    Aug 31, 2026Zimo Yan, Yifan Li, Hao Li +4Positional EncodingGraph Laplacians

  8. Drift and Dependence: Layer-wise Information-Theoretic Bounds for Replay-Based Continual Learning

    Aug 12, 2026Tieliang Gong, Zhongbo Zhang, Wen Wen +1Catastrophic ForgettingContinual Learning

  9. ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handover

    Aug 11, 2026Minwoo Kim, Soochang Song, Namyoon Lee +2Key-Value CacheWireless Resource Allocation

  10. Information Routing across Batch Boundaries: Memory--Batch Tradeoffs in Lipschitz Bandits

    Aug 8, 2026Zicheng Lyu, Zengfeng HuangLipschitz ConstantAdaptive Learning

  11. POMDPs for Autonomous Science Exploration

    Aug 4, 2026Daniel Guirguis, Nathan Wallace, Hanna Kurniawati +1Partially Observable Markov Decision ProcessBelief-Space Planning

  12. An Information Theoretic Treatment of Yager's Probability Distribution Negation

    Aug 1, 2026Roberto Bruno, Ugo VaccaroInformation-Theoretic LimitsNegation

  13. Learning to Persuade Privately Informed Receivers

    Jul 30, 2026I. Arda Vurankaya, Ufuk TopcuPersuasionInformation-Theoretic Limits

  14. The Shared Discovery Paradox: How a One-Answer Rule Turns Better Information into Worse Search

    Jul 20, 2026Yohei NakajimaNash EquilibriaConsensus

  15. Rate-Distortion-Perception Theory: Redefining the Fundamental Limits of Information Representation

    Jul 19, 2026Photios A. Stavrou, Giuseppe Serra, Marios KountourisRate-Distortion TheorySource-Channel Coding

  16. CAS I: A Geometric Coding Theorem

    Jul 15, 2026Romie BanerjeeFinite GroupsSymmetry

  17. Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization

    Jul 15, 2026Jiaxuan ChengPlasticitySingular Learning Theory

  18. Watermark Forensics for Generative Models: An Information-Theoretic Perspective

    Jul 14, 2026Xiaoyu Li, Zheng Gao, Xiaoyan Feng +3WatermarksInformation-Theoretic Limits

  19. Conservation Laws for Diffusion Models

    Jul 11, 2026Ziv Aharoni, Henry D. PfisterCross-Entropy LossesDiffusion Models

  20. Lean-QIT: Towards a Formal Infrastructure for Quantum Information Theory

    Jul 10, 2026Chengkai Zhu, Ziao Tang, Guocheng Zhen +6Quantum Error CorrectionInformation-Theoretic Limits

  21. When Routes Run Out: Adversarial Co-Learning and Explainable Robustness in Quantum Repeater Networks

    Jul 10, 2026Brennan Bell, Inti Gabriel Mendoza Estrada, Andreas Trügler +1Quantum LearningEntanglement

  22. An exact information theory of generalization phase transitions in Bayesian diffusion models

    Jul 9, 2026Henry Hunt, Mason Kamb, Surya GanguliDiffusion ModelsGeneralization Bounds

  23. Lean-Quantum: Toward AI-Assisted Formalization of Quantum Information

    Jul 6, 2026Kazumi Kasaura, Kei Tsukamoto, Kento Mori +6Information-Theoretic LimitsFormalization

  24. LBR: Towards Mitigating Length Bias in Large Language Models for Recommendation

    Jul 5, 2026Hongchen Li, Bohao Wang, Jingbang Chen +5RecommendationLarge Language Model Bias

  25. Co-Adaptive Multi-Task LoRA: Transfer-Aware, Label-Free Control of Domain Participation

    Jul 3, 2026Wei Zhang, Lin Tang, Ming Zhao +1Mamba-Modulated Low-Rank AdaptationLow-Rank Adapters

  26. When AI meets quantum information: A comprehensive review

    Jul 1, 2026Min Chen, Yu Gan, Xin Jin +15Quantum ComputingQuantum Annealing

  27. Informational Frustration in Neural Manifolds: Shannon Bottlenecks and the Limits of Learnability

    Jun 29, 2026Srinivasa Rao P., Vangmayi P ReddyOver-Parameterized Neural NetworksInformation-Theoretic Limits

  28. Information Dynamics of Language Communication

    Jun 29, 2026Leonardo S. Goodall, Andrea I. Luppi, Pedro A. M. MedianoInformation-Flow ControlLinguistics

  29. TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

    Jun 25, 2026Tinghao Wang, Yichen Guo, Rui Huang +11Visual Token PruningLarge Multimodal Models

  30. Text Distance from Nested and Hierarchical Repetitions: A Compression-Based Perspective

    Jun 23, 2026Xiaojun Hu, Jing Wang, Jingwen Zhang +5Structure-AwareLadder

  31. What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis

    Jun 18, 2026Xinghao Chen, Chak Tou Leong, Wenjin Guo +3Latent ReasoningChain-Of-Thought

  32. An Information Theoretic Framework for Graph Novelty Generation via Latent Mixture Modeling

    Jun 18, 2026Itsuki Nakagawa, Kenji YamanishiGraph LearningGenerative Models

  33. Pride and Prejudice: Toward an Information-Theoretic Framework for Mutually Communicative Driver Behavior Modeling

    Jun 15, 2026Tingjun Li, Nan Xu, Shuo Feng +3Dead ReckoningAutonomous Driving

  34. Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers

    Jun 15, 2026Sourya Sengupta. Mark A. AnastasioImage ClassificationMedical Imaging

  35. The Information-Theoretic Benefit of Shared Representations under Orthogonality Constraints

    Jun 14, 2026Thomas Dittrich, Oliver Potocki, Philipp GrohsInformation-Theoretic LimitsNeural Architectures

  36. Behavioral Audit of Machine Unlearning Has a Privacy Cost

    Jun 12, 2026Liou Tang, James Joshi, Ashish KunduMachine UnlearningAlgorithm Auditing

  37. Recovery thresholds for hidden weighted sparse graphs

    Jun 12, 2026Zhe Hou, Jingcheng LiuExponential Random Graph ModelsInformation-Theoretic Limits

  38. How Task Structure Limits Multi-Agent Success: An Information-Theoretic Analysis

    Jun 11, 2026Shi Pan, Ming LuoDecentralized Multi-Agent SystemSingle-Agent

  39. Information-Theoretic Decomposition for Multimodal Interaction Learning

    Jun 10, 2026Zequn Yang, Yake Wei, Haotian Ni +2Multimodal LearningInformation-Theoretic Limits

  40. Bellman-sufficient Information Complexity

    Jun 9, 2026Yunbei XuInformation-Theoretic LimitsOptimal Sample Complexity

  41. A Note on the Strategic Confinement Problem

    Jun 7, 2026Christian Schroeder de WittData LeakageInformation-Theoretic Limits

  42. The Bioelectrical Information Theory: Investigating the theoretical compression limit of bioelectrical signals under artificial intelligence

    Jun 7, 2026Jiawen Zou, Bo YanBrain-Computer InterfaceNeural Recordings

  43. An Information-Theoretic Definition for Open-Ended Learning

    Jun 6, 2026Wanqiao Xu, Yifan Zhu, Benjamin Van RoyInformation-Theoretic LimitsOpen-Ended Responses

  44. The Capacity of Information-Theoretic Secure Aggregation in Federated Learning

    Jun 5, 2026Lanxin Yi, Jinbao Zhu, Kai Wan +1Secure AggregationDiffie-Hellman

  45. InfoShield: Privacy-Preserving Speech Representations for Mental Health Screening via Information-Theoretic Optimization

    Jun 4, 2026Xueyang Wu, Siyuan Liu, Kezhuo Yang +1DepressionSensitive Data

  46. Template Collapse and Information-Theoretic Limits in Camera rPPG Pulse Morphology Restoration

    Jun 2, 2026Achraf Ben AhmedRemote PhotoplethysmographyVascular Network

  47. Query-Limited Community Recovery in Stochastic Block Models

    Jun 1, 2026Sabyasachi Basu, Manuj Mukherjee, Lutz Oettershagen +1SubgraphsInformation-Theoretic Limits

  48. Physics-Informed Deep Learning for Entropy Prediction in Heterogeneous Systems: Thermodynamic and Information-Theoretic Case Studies

    May 31, 2026Biswajeet Sahoo, Debadutta PatraConventional Physics-Informed Neural NetworksPhysics-Informed Deep Learning

  49. Information-Theoretic Lower Bounds for Bit-Constrained Stochastic Optimization via a Reduction to Compressed Gaussian Mean Estimation

    May 30, 2026Munsik KimInformation-Theoretic LimitsStochastic Optimization

  50. The Paradox of Outcome Optimization: A Causal Information-Theoretic Bound on Reasoning Shortcuts in LLMs

    May 30, 2026Zihan Chen, Yiming Zhang, Wenxiang Geng +2LLM Reasoning MethodsCausal Structure and Reasoning

  51. Sequential Neural Probabilistic Amplitude Shaping: Learning the Channel's Language

    May 27, 2026Mohammad Taha Askari, Lutz Lampe, Amirhossein GhazisaeidiSource-Channel CodingNeural Codecs

  52. A Methodological Framework for Explicit Control of the Speed-Accuracy Trade-off in Brain-Computer Interfaces

    May 26, 2026Javier Jiménez, Francisco B RodríguezBrain-Computer InterfaceTrade-Off

  53. Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models

    May 25, 2026Jianwei TaiCross-Architecture AlignmentText Encoders

  54. Adversarial Water-Filling: Theory, Algorithms and Foundation Model

    May 24, 2026Xindi Tong, Chee Wei Tan, H. Vincent PoorWireless Resource AllocationOptimal Comparison Allocation

  55. The Deterministic Horizon: Impossibility Results as Design Specifications for Trustworthy AI Systems

    May 21, 2026Dongxin GuoImpossibilityComputable

  56. A Van Trees Lower Bound for Fully Interactive Differentially Private Federated Learning

    May 19, 2026T. Tony Cai, Yicheng LiDifferential PrivacyLower Bounds

  57. Information Processing Capacity of Stationary Physical Systems: Theory, Data-efficient Estimation Methods, and Photonic Demonstration

    May 18, 2026Rahul Uma Ramachandran, Serge MassarPhotonicsInformation-Theoretic Limits

  58. vega-mir: An information-theoretic Python toolkit for symbolic music, with applications to harmonic graphs and rubato spectra

    May 15, 2026Fred Jalbert-DesforgesStylometricSpearman Correlation

  59. A Mutual Information Lower Bound for Multimodal Regression Active Learning

    May 14, 2026Leonardo Ferreira Guilhoto, Akshat Kaushal, Paris PerdikarisActive LearningMultimodal Learning

  60. Interestingness as an Inductive Heuristic for Future Compression Progress

    May 14, 2026Vincent Herrmann, Jürgen SchmidhuberModel and Context CompressionInformation-Theoretic Limits