Information Bottleneck

Also known as IB

Overview

Information Bottleneck methods seek compact representations that preserve information relevant to a task while discarding irrelevant details. Common approaches include variational and conditional bottlenecks, mutual-information or rate-distortion objectives, and contrastive or structured regularizers. They are used in learning robust features, protecting privacy, explaining predictions, and limiting communication or memory in agents and multimodal systems. A central challenge is choosing and optimizing the compression level: too little compression retains nuisance information, while too much removes evidence needed for the task, and the right balance depends on the setting.

Latest papers

CardsList

62 papers7 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. TIB: Sample-wise Tempered Information Bottleneck for Multimodal Attribution beyond Alignment Assumption

    Nov 8, 2026Qiming Huang, Peixi Liu, Jianbo JiaoMultimodal Model InterpretabilityInformation Bottleneck

  2. What Should an Information Bottleneck Encoder Learn? Separating Representation Learning from Rate Control

    Oct 26, 2026Hassan Tavakoli, Bella BoseInformation BottleneckRepresentation Learning

  3. Intrinsic Information Rates of Summaries in Simulation-Based Inference

    Oct 26, 2026Vansh Bansal, Pradip Sharma Poudel, James G. ScottSimulation-Based InferenceInformation Bottleneck

  4. Multi-view Semantic-aware Resource Allocation for Edge AI

    Oct 25, 2026Jiawei Luo, Hussein Saleh, Mohamad AssaadWireless Resource AllocationSemantic Communication

  5. SICAF: Time-Varying Focus Bottleneck for Self-Supervised Event-Based Optical Flow with Spiking Neural Network

    Oct 21, 2026Shuangming Yang, Qing He, Shangqi Guo +1Event-Based Optical FlowSpiking Neural Networks

  6. Robust Representation Learning for Spiking Neural Networks based on Conditional Information Bottleneck

    Oct 20, 2026Yuli Zha, Wang Fan, Yixiao Dai +5Spiking Neural NetworksNeural Network Robustness

  7. Quasi-Binarized Autoencoders: An Architecture-Independent Information Bottleneck for Medical Image Anomaly Detection

    Oct 7, 2026Shouhei Hanaoka, Takahiro Nakao, Atsushi Takamatsu +2Medical Image Anomaly DetectionUnsupervised Anomaly Detection

  8. IronMan: Information-Constrained Video-Action Learning for Robot Manipulation

    Oct 6, 2026Yuanshuo Zhang, Wenzhe Zhao, Zixing Lei +2Information BottleneckGeneralization in Robotic Manipulation

  9. On the Cardinality of Optimal Representations in the Binary-Source Information Bottleneck

    Oct 5, 2026Dier Tang, Jun ChenInformation BottleneckMutual Information

  10. Rethinking the Information Bottleneck: Structured Decomposition under Label-Induced Partitions

    Oct 1, 2026Jingyao Zhang, Yuxuan Li, Lu Han +2Information BottleneckInvariant Representation Learning

  11. Mutual Information Constrained Chernoff Bottleneck

    Sep 29, 2026Dier Tang, Guangyue HanInformation Bottleneck

  12. Attention-based Hierarchical Variational Information Bottleneck for Robust Multi-Agent Communication under Variable Bandwidth

    Sep 28, 2026Lukas Koch Vindbjerg, Qi Zhang, Yury Brodskiy +1Information BottleneckMulti-Agent Communication

  13. SGWIB:Sliced Gromov-Wasserstein Information Bottleneck for Video Highlight Detection

    Sep 12, 2026Hanjuan Huang, Yung-Chieh Yeh, Hsing-Kuo PaoTemporal Video UnderstandingInformation Bottleneck

  14. Pose accuracy is not grasp reliability: residual pose posteriors improve simulated robotic grasp planning

    Sep 2, 2026Md Selim Sarowar, Sungho KimRepresentation LearningRobotics

  15. Synergistic Information Disentanglement for Omni-modal Slide Representation Learning in Computational Pathology

    Sep 2, 2026Mingxin Liu, Chengfei Cai, Anwen Lu +5Multimodal SSLMedical Image Representation Learning

  16. Towards A Unified Information Bottleneck Framework for Time Series Explanations

    Aug 26, 2026Xu Zheng, Zichuan Liu, Zhuomin Chen +7Explainable Time Series ForecastingExplainable Artificial Intelligence

  17. Information Bottleneck under Perfect Privacy

    Aug 11, 2026Junle Zhong, Mohamad Assaad, Sreejith SreekumarInformation BottleneckPrivacy-Preserving ML

  18. Information Bottleneck Learning for Faithful Time Series Forecasting Explanations

    Jul 30, 2026Xu Zheng, Wei Cheng, Zhuomin Chen +3Multivariate Time Series ForecastingExplainable Time Series Forecasting

  19. Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation

    Jul 25, 2026Yihao Wu, Chenyi Xu, Liqi Yan +6Representation LearningInformation Bottleneck

  20. Indexing: the Beginning and the End

    Jul 24, 2026Alexander Kozachinskiy, Vicente Opazo, Felipe UrrutiaInformation BottleneckLinear Attention

  21. Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation

    Jul 24, 2026Yuqi Li, Xi Xiao, Yunbei Zhang +6Information BottleneckVision Foundation Model Adaptation

  22. External Clustering Validation by the Homogeneity-Parsimony Trade-off

    Jul 22, 2026Andreas Tiffeau-MayerClusteringInformation Bottleneck

  23. When Do Multi-Agent Systems Help? An Information Bottleneck Perspective

    Jul 17, 2026Wendi Yu, Lianhao Zhou, Xiangjue Dong +6Multi-Agent LLM SystemsInformation Bottleneck

  24. The SIGReg Objective as Variational Free Energy: A Theoretical Active-Inference Account of JEPA World Models

    Jul 15, 2026Fabio Arnez, Alexandra Gomez-VillaWorld Model LearningActive Inference