Differential Privacy

Differential privacy (DP) is a rigorous framework for ensuring data privacy in machine learning by adding carefully calibrated noise to model training processes. Current research focuses on improving the accuracy of DP models, particularly for large-scale training, through techniques like adaptive noise allocation, Kalman filtering for noise reduction, and novel gradient processing methods. This active area of research is crucial for enabling the responsible use of sensitive data in various applications, ranging from healthcare and finance to natural language processing and smart grids, while maintaining strong privacy guarantees.

Papers

November 6, 2023

DP-DCAN: Differentially Private Deep Contrastive Autoencoder Network for Single-cell Clustering
Huifa Li, Jie Fu, Zhili Chen, Xiaomin Yang, Haitao Liu, Xinpeng Ling
Differential Privacy Single Cell RNA Cell Clustering High Dimensional Single Cell Private Variational

November 2, 2023

Instance-Specific Asymmetric Sensitivity in Differential Privacy
David Durfee
Differential Privacy Private Estimation Bias Variance Sensitivity Aware Unbiased SGG

November 1, 2023

Adversarially Robust Distributed Count Tracking via Partial Differential Privacy
Zhongzheng Xiong, Xiaoyi Zhu, Zengfeng Huang
Differential Privacy Robust Version Object Counting Robust Algorithm Oblivious Adversary

October 31, 2023

October 30, 2023

October 29, 2023

Differentially Private Permutation Tests: Applications to Kernel Methods
Ilmun Kim, Antonin Schrab
Financial Application Differential Privacy Kernel Method Private Data Analysis Kernel Test Private Hypothesis

October 25, 2023

Privately Aligning Language Models with Reinforcement Learning
Fan Wu, Huseyin A. Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan Kulkarni, Robert Sim
Large Language Model Language Model Reinforcement Learning Differential Privacy Model Matching

October 24, 2023

October 23, 2023

Tractable MCMC for Private Learning with Pure and Gaussian Differential Privacy
Yingyu Lin, Yi-An Ma, Yu-Xiang Wang, Rachel Redberg, Zhiqi Bu
Differential Privacy Posterior Sampling Private Learning Tractable Probabilistic Model Approximate Differential Privacy Approximate Sampling

October 18, 2023

Federated Heterogeneous Graph Neural Network for Privacy-preserving Recommendation
Bo Yan, Yang Cao, Haoyu Wang, Wenchuan Yang, Junping Du, Chuan Shi
Differential Privacy Recommender System Effective Recommendation Recommendation Model Heterogeneous Graph Neural Network Heterogeneous Information Network Heterogeneous Recommendation

October 17, 2023

Disentangling the Linguistic Competence of Privacy-Preserving BERT
Stefan Arnold, Nils Kemmerzell, Annika Schreiner
Language Model Differential Privacy Internal Representation Representational Similarity Text Privatization Linguistic Competence

October 15, 2023

Private Synthetic Data Meets Ensemble Learning
Haoyuan Sun, Navid Azizan, Akash Srivastava, Hao Wang
Synthetic Data Differential Privacy Ensemble Learning Synthetic Dataset Private Generative Adversarial Network

October 13, 2023

User Inference Attacks on Large Language Models
Nikhil Kandpal, Krishna Pillutla, Alina Oprea, Peter Kairouz, Christopher A. Choquette-Choo, Zheng Xu
Large Language Model Differential Privacy Fine Tuned Large Language Model Inference Attack User Representation

Differential Privacy

Papers

DP-DCAN: Differentially Private Deep Contrastive Autoencoder Network for Single-cell Clustering

Instance-Specific Asymmetric Sensitivity in Differential Privacy

Adversarially Robust Distributed Count Tracking via Partial Differential Privacy

Compression with Exact Error Distribution for Federated Learning

Verification of Neural Networks Local Differential Classification Privacy

Unified Enhancement of Privacy Bounds for Mixture Mechanisms via $f$-Differential Privacy

Privacy-preserving Federated Primal-dual Learning for Non-convex and Non-smooth Problems with Model Sparsification

Privacy-Preserving Federated Learning over Vertically and Horizontally Partitioned Data for Financial Anomaly Detection

Differentially Private Permutation Tests: Applications to Kernel Methods

Privately Aligning Language Models with Reinforcement Learning

Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphs

On the Inherent Privacy Properties of Discrete Denoising Diffusion Models

Tractable MCMC for Private Learning with Pure and Gaussian Differential Privacy

Mean Estimation Under Heterogeneous Privacy Demands

Conditional Density Estimations from Privacy-Protected Data

PrivImage: Differentially Private Synthetic Image Generation using Diffusion Models with Semantic-Aware Pretraining

Federated Heterogeneous Graph Neural Network for Privacy-preserving Recommendation

Disentangling the Linguistic Competence of Privacy-Preserving BERT

Private Synthetic Data Meets Ensemble Learning

User Inference Attacks on Large Language Models