An Information Bottleneck for Post-hoc Memorization Mitigation in LLMs
Organizations: Idiap Research Institute, Switzerland · EPFL, Switzerland
Abstract
Recent studies have shown that large language models (LLMs) can memorize and reproduce copyrighted training data, raising serious privacy and intellectual property concerns. In this work, we investigate whether memorization can be mitigated without modifying or retraining the underlying model through an information bottleneck. We propose a modular plug-and-play framework that inserts a nonparametric variational information bottleneck (NVIB) between a frozen LLM backbone and its language modeling head. By compressing the final hidden representations before token prediction, the proposed bottleneck aims to preserve general linguistic knowledge while filtering out highly specific memorized sequences. We evaluate our approach on memorization extraction tasks involving book passages and on standard language modeling benchmarks to measure the trade-off between memorization reduction and downstream utility. Our experiments show that the NVIB layer substantially reduces extractability while maintaining competitive performance on benchmark tasks. These results suggest that adding an information bottleneck offers a practical and architecture agnostic direction for post-hoc memorization mitigation in pretrained LLMs.
Figures & tables
| Qwen3-8B | Llama-3.1-8B | |||||
|---|---|---|---|---|---|---|
| Book | Base | + Transformer | + NVIB | Base | + Transformer | + NVIB |
| Animal Farm | ||||||
| Down and Out in the Magic Kingdom | ||||||
| Crime and Punishment | ||||||
| The Lord of the Rings: The Two Towers | ||||||
| Qwen3-8B | Llama-3.1-8B | |||||
| Benchmark | Base | + Transformer layer | + NVIB | Base | + Transformer layer | + NVIB |
| Knowledge & Understanding | ||||||
| MMLU | 49.7 | 48.2 | 49.5 | 64.0 | 60.0 | 59.8 |
| MMLU-Redux | 75.9 | 76.3 | 76.1 | 25.8 | 36.7 | 28.2 |
| Complex Reasoning | ||||||
| MMLU-Pro | 63.6 | 62.2 | 62.4 | 36.2 | 32.3 | 32.3 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Book | Base | + Transformer | + NVIB |
|---|---|---|---|
| Harry Potter and the Sorcerer’s Stone | |||
| Harry Potter and the Chamber of Secrets | |||
| Harry Potter and the Prisoner of Azkaban | |||
| Harry Potter and the Order of the Phoenix | |||
| Harry Potter and the Deathly Hallows | |||
| The Lord of the Rings: The Fellowship of the Ring |
| Book | Base | + Transformer | + NVIB |
|---|---|---|---|
| The Lord of the Rings: The Fellowship of the Ring | |||
| The Lord of the Rings: The Return of the King | |||
| The Hitchhiker’s Guide to the Galaxy |
Memorization in Language Models
Memorization in language models studies how training examples and facts are stored, recalled, generalized, and exposed by model parameters.
See all 126 papers