Differential Privacy
Differential privacy (DP) is a rigorous framework for ensuring data privacy in machine learning by adding carefully calibrated noise to model training processes. Current research focuses on improving the accuracy of DP models, particularly for large-scale training, through techniques like adaptive noise allocation, Kalman filtering for noise reduction, and novel gradient processing methods. This active area of research is crucial for enabling the responsible use of sensitive data in various applications, ranging from healthcare and finance to natural language processing and smart grids, while maintaining strong privacy guarantees.
Papers
Private Synthetic Text Generation with Diffusion Models
Sebastian Ochs, Ivan Habernal
Calibrating Practical Privacy Risks for Differentially Private Machine Learning
Yuechun Gu, Keke Chen
FT-PrivacyScore: Personalized Privacy Scoring Service for Machine Learning Participation
Yuechun Gu, Jiajie He, Keke Chen
Does Differential Privacy Impact Bias in Pretrained NLP Models?
Md. Khairul Islam, Andrew Wang, Tianhao Wang, Yangfeng Ji, Judy Fox, Jieyu Zhao
Enhancing Feature-Specific Data Protection via Bayesian Coordinate Differential Privacy
Maryam Aliakbarpour, Syomantak Chaudhuri, Thomas A. Courtade, Alireza Fallah, Michael I. Jordan
Faster Algorithms for User-Level Private Stochastic Convex Optimization
Andrew Lowy, Daogao Liu, Hilal Asi
Position: Challenges and Opportunities for Differential Privacy in the U.S. Federal Government
Amol Khanna, Adam McCormick, Andre Nguyen, Chris Aguirre, Edward Raff
DMM: Distributed Matrix Mechanism for Differentially-Private Federated Learning using Packed Secret Sharing
Alexander Bienstock, Ujjwal Kumar, Antigoni Polychroniadou
DEeR: Deviation Eliminating and Noise Regulating for Privacy-preserving Federated Low-rank Adaptation
Meilu Zhu, Axiu Mao, Jun Liu, Yixuan Yuan
Reconstruction of Differentially Private Text Sanitization via Large Language Models
Shuchao Pang, Zhigang Lu, Haichen Wang, Peng Fu, Yongbin Zhou, Minhui Xue, Bo Li
Federated Learning in Practice: Reflections and Projections
Katharine Daly, Hubert Eichner, Peter Kairouz, H. Brendan McMahan, Daniel Ramage, Zheng Xu
Balancing Innovation and Privacy: Data Security Strategies in Natural Language Processing Applications
Shaobo Liu, Guiran Liu, Binrong Zhu, Yuanshuai Luo, Linxiao Wu, Rui Wang