Privacy-Preserving Language Models

Overview

This field studies how to use and adapt language models without exposing private training data, user prompts, or personal context. Approaches include differential privacy for fine-tuning and preference alignment, federated and split learning, cryptographic inference, and practical safeguards such as on-device processing, prompt sanitization, and selective unlearning. Researchers evaluate both formal guarantees and empirical attacks, including membership inference, data extraction, and reconstruction from intermediate activations, across language tasks and clinical or conversational settings. The central tension is preserving privacy without sacrificing model quality, cost, or speed, while ensuring evaluations reflect realistic, multi-turn use and adaptive attackers.

Latest papers

CardsList

191 papers16 papers in the last four weeks, down 41% on the four weeks before. 0.1% of all new papers.

  1. MOAI: Module-Optimizing Architecture for non-interactive secure transformer Inference

    Nov 10, 2026Linru Zhang, Xiangning Wang, Jun Jie Sim +5Privacy-Preserving Language ModelsPrivacy-Preserving ML

  2. VeilTune: Secure Fine-Tuning of Private LoRA Adapters on Public Pretrained Language Models

    Nov 9, 2026Huiyu Xie, Tanping Zhou, Tao Hu +2Fine-Tuning Language ModelsPrivacy-Preserving Language Models

  3. Enabling Privacy-Preserving Natural Language Access to Industrial Smart Meter Data

    Nov 6, 2026Carlos Martín-Abellán, Mark KröllData Analysis AgentsText-to-SQL

  4. An Information Bottleneck for Post-hoc Memorization Mitigation in LLMs

    Nov 5, 2026Dina EL Zein, Shashi Kumar, James HendersonMemorization in Language ModelsPrivacy-Preserving Language Models

  5. Redacting Personal Data: A Speed and Accuracy Comparison of Regex, Presidio and Hybrid Designs

    Nov 5, 2026Sai Yashwant, Manoj Kumar Gondimalla, Arjun Sharma +1PII DetectionPrivacy-Preserving Language Models

  6. Reconciling Privacy with Provenance for Language Model Watermarks

    Nov 4, 2026Elise L. Han, Tatsunori HashimotoLLM WatermarkingData Provenance in Language Models

  7. Perseus: A Full-Stack System for Homomorphic Model Inference

    Nov 3, 2026Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos +2Privacy-Preserving Language ModelsHomomorphic Encryption

  8. Answer-Only Disclosure: Private-Context LLM Assistance over Web APIs with a Leakage Ledger

    Oct 28, 2026Liang Yuan, Xiaohu Du, Ruikun Luo +6Privacy Leakage in Language ModelsPrivacy-Preserving Language Models

  9. EdgeDeID: A 0.6B Clinical De-identifier Trained Without Real Patient Data

    Oct 24, 2026Sina Daneshgar, Raya Namazi, Amirali Khosravi +2Privacy-Preserving Language Models

  10. Privacy in Context Is Being Overlooked in the Age of General-Purpose LLMs

    Oct 21, 2026Prakhar Ganesh, Yash More, Marco Romanelli +2Privacy-Preserving Language Models

  11. Contextual Candour: Role-Aware Graduated Disclosure for LLMs over Mixed-Sensitivity Contexts

    Oct 20, 2026Devansh Srivastav, David Pape, Samira Abedini +1LLM SecurityPrivacy Leakage in Language Models

  12. Profile-DP: Differential Privacy for User-Controlled Profile Release in Personalized LLM Inference

    Oct 19, 2026Mingchen Li, Zifan Peng, Kewei Sha +5Privacy-Preserving Language ModelsDifferential Privacy

  13. Veil-Then-Reveal: Protecting PII Privacy via Reversible Pseudo-Anonymization in Zero-Trust User--LLM Interaction

    Oct 16, 2026Mohamed Elmahallawy, Mohamed Shaaban, Thomas E. CarrollPrivacy-Preserving Language Models

  14. Prune the Leaky Neurons: Mitigating Private Data Leakage in Fine-Tuned LLMs via Joint-Embedding-Guided Pruning

    Oct 16, 2026Mohamed Shaaban, Mohamed ElmahallawyPrivacy Leakage in Language ModelsPrivacy-Preserving Language Models

  15. Exploring The Empirical Privacy Landscape of Synthetic Data

    Oct 15, 2026Zihao Zhao, Avi Schwarzschild, Casey Meehan +3Privacy Leakage in Language ModelsPrivacy-Preserving Language Models

  16. FedSkillGit: Federated Skill Evolution via Version Control

    Oct 15, 2026Boxun Lan, Jiamei Li, Weijian Li +5LLM Agent Skill LearningFederated Learning

  17. PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning

    Oct 15, 2026Max Rosenblattl, Nikhil Krishnaswamy, Leon Nissen +9Time Series Language ModelingOn-Device Language Model Inference

  18. Rank-Aware Differentially Private Release of Listwise Preferences for LLM Alignment

    Oct 13, 2026Junwei Chen, Manjiang Yu, Pengpeng Qiao +1Privacy-Preserving Language ModelsDifferential Privacy

  19. DP-MIND: Differentially private memory-guided Long context Inference

    Oct 9, 2026Zhihao Liu, Yitian Cheng, Shuang Liu +3Privacy-Preserving Language ModelsLong-Context Language Model Inference

  20. zkLLMPoT: Efficient Zero Knowledge Proof of Training for Large Language Models

    Oct 6, 2026Junkai Liang, Zhanpeng Guo, Pengfei Wu +5Zero-Knowledge MLLLM Auditing

  21. Static Bootstrap Placement for Encrypted Language Model Decoding

    Oct 4, 2026Halil Ibrahim Kanpak, Didem UnatPrivacy-Preserving Language ModelsLLM Inference