Who's Asking? Audience-Conditioned Privatization
Organizations: University of Washington Tacoma · Zillow
Abstract
The abundance of user-generated conversational data makes the question of how to responsibly derive insights from confidential data without putting the individuals in it at risk ever more important. However, the majority of existing differentially private (DP) synthetic text generation (SDG) and anonymization approaches ignore the context of the data's downstream usage, which results in loss of important information. DP-SDG provides the same guarantee regardless of the recipient, and anonymization relies on predefined attribute categories. They both ignore the observation that an attribute that is harmless to one audience can be sensitive to another, and each audience typically needs only some attributes preserved. We propose Ext-Classify-Priv, a framework that (1) extracts the information types present in a corpus, (2) classifies which of them are private for a given audience following contextual integrity, and (3) protects only those attributes, using either anonymization or SDG with Feature-DP approaches. On Reddit data with 3 audiences, our audience-specific releases are more faithful than a single audience-agnostic release for every audience. On bioRxiv data, our SDG method improves MAUVE from 0.097 to 0.420 at epsilon=1 and on the proprietary real estate data, our anonymization method improves MAUVE from 0.698 to 0.959 over the best baselines.
Figures & tables
| Approach | Aud. | Unit | Guarantee |
|---|---|---|---|
| Synthetic data generation | |||
| DP fine-tuning Yu et al. (2024) ; Hu et al. (2025) | ✗ | Record | DP |
| Inference DP Xie et al. (2024) ; Chien et al. (2026) | ✗ | Record | DP |
| Secret-aware DP Wang et al. (2026) | ✗ | Secret | DP |
| SDG-CI (ours) | ✓ | Attr. | Feat.-DP |
| Anonymization | |||
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Fields | Signal | Balanced Entropy | Dominance | Coverage | |
|---|---|---|---|---|---|---|
| Hand-written | n/a | 47 | 0.144 | 0.33 | 0.72 | 2.19 |
| LLM | n/a | 20 | 0.440 | 0.96 | 0.58 | 3.14 |
| MAPLE | n/a | 8 | 0.718 | 0.65 | 0.59 | 2.84 |
| DP | 20 | 0.278 | 0.69 | 0.57 | 3.24 | |
| DP | 100 | 19 | 0.243 | 0.75 | 0.56 | 3.00 |
| DP | 10 | 15 | 0.236 | 0.63 | 0.65 | 2.65 |
| Parameter | Value |
|---|---|
| Budget | |
| ( = number of private training records) | |
| split | , |
| Conditional AIM | |
| workload | all cliques with attributes and private attribute |
| max model size | 80 MB (AIM default) |
| Dataset | Attributes |
|---|---|
| age, city_country, birth_city_country, income, relationship_status, sex, education, occupation, income_level, topic, word_count. | |
| bioRxiv | model_organism, disease_mention, sample_size, category, primary_research_area, experimental_approach, dominant_data_type, research_focus_scale, research_goal, word_count. |
| RealEstate (SDG) | location, home_size, price_home, preapproval_status, conversation_outcome, stage_suggested, word_count. |
| RealEstate (Anon.) | location, desired_location, household, third_parties_mentioned, transaction_stage, call_purpose, buying_amount, journey_stage, next_step. |
| Dataset | Information flow | Private (protected) | Public (released as is) | Utility label |
|---|---|---|---|---|
| Sender: Reddit users commenting on public forums Recipient: an external ML vendor Purpose: developing a content recommendation system on users’ writing patterns | age, city_country, birth_city_country, income, relationship_status | sex, education, occupation, income_level, topic, word_count | topic | |
| bioRxiv | Sender: the research lab that conducted the experiments Recipient: the general public (open release) Purpose: disseminating experimental records so the findings can be read, reused and built upon | model_organism, disease_mention, sample_size | category, primary_research_area, experimental_approach, dominant_data_type, research_focus_scale, research_goal, word_count | category |
| RealEstate | Sender: homebuyers and real estate agents Recipient: Internal Audit Team Purpose: assessing the fairness and compliance of the recorded conversations | SDG: location, home_size Anon.: location, desired_location, household, third_parties_mentioned, transaction_stage | SDG: price_home, preapproval_status, conversation_outcome, stage_suggested, word_count Anon.: call_purpose, buying_amount, journey_stage, next_step | stage_suggested |
| Split (priv/pub) | Downstream audience | Private (protected) | Public (released as is) |
|---|---|---|---|
| 5 / 6 | Recipient: an ML vendor training a recommender model on the comments Purpose: training a content recommendation system on users’ writing patterns | age, city_country, birth_city_country, income, relationship_status | sex, education, occupation, income_level, topic, word_count |
| 3 / 8 | Recipient: third parties re-sharing the comments Purpose: releasing the attributes users routinely self-disclose in public posts, withholding only demographic identifiers | sex, age, birth_city_country | city_country, relationship_status, income_level, topic, education, occupation, income, word_count |
| 9 / 2 | Recipient: an external advertising company building ad campaigns and user profiles Purpose: targeted advertising models | age, sex, city_country, birth_city_country, education, occupation, income, income_level, relationship_status | topic, word_count |
| Method | MAUVE | KL | TV | JSD | Acc | Demographic Gap | Leak | |
|---|---|---|---|---|---|---|---|---|
| ML Vendor | ||||||||
| SDG | SDG-CI | 0.479 | 0.791 | 0.422 | 0.099 | 0.546 | 0.038 | 0.004 |
| MAPLE | 0.350 | 1.178 | 0.535 | 0.257 | 0.527 | 0.003 | 0.000 | |
| Aug-PE | 0.027 | 10.557 | 0.814 | 0.188 | 0.522 | 0.084 | 0.001 | |
| Anon. | ANON-CI | 1.000 | 0.002 | 0.019 | 0.011 | 0.734 | 0.013 | 0.111 |
| RUPTA | 1.000 | 0.002 | 0.013 | 0.016 | 0.725 | 0.053 | 0.114 | |
| Method | MAUVE | KL | TV | JSD | Acc | Demographic Gap | Leak | |
|---|---|---|---|---|---|---|---|---|
| SDG | SDG-CI | 0.479 | 0.791 | 0.422 | 0.099 | 0.546 | 0.038 | 0.004 |
| MAPLE | 0.350 | 1.178 | 0.535 | 0.257 | 0.527 | 0.003 | 0.000 | |
| Aug-PE | 0.027 | 10.557 | 0.814 | 0.188 | 0.522 | 0.084 | 0.001 | |
| Anon. | ANON-CI | 1.000 | 0.002 | 0.019 | 0.011 | 0.734 | 0.013 | 0.111 |
| RUPTA | 1.000 | 0.002 | 0.013 | 0.016 | 0.725 | 0.053 | 0.114 | |
| Method | MAUVE | KL | TV | JSD | Acc | Leak | |
|---|---|---|---|---|---|---|---|
| RealEstate | |||||||
| SDG | SDG-CI | 0.225 | 2.570 | 0.583 | 0.163 | 0.327 | 0.074 |
| MAPLE | 0.128 | 3.608 | 0.608 | 0.126 | 0.260 | 0.000 | |
| Aug-PE | 0.010 | 10.928 | 0.926 | 0.391 | 0.313 | 0.007 | |
| Anon. | ANON-CI | 0.959 | 0.115 | 0.160 | – | – | 0.400 |
| RUPTA | 0.698 | 0.668 | 0.269 | – | – | 0.395 | |
| MAUVE | Acc | Demographic Gap | Leak | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | 0.5 | 1 | 10 | 0.5 | 1 | 10 | 0.5 | 1 | 10 | 0.5 | 1 | 10 |
| SDG-CI | 0.520 | 0.479 | 0.464 | 0.502 | 0.546 | 0.638 | 0.014 | 0.038 | 0.022 | 0.004 | 0.004 | 0.000 | |
| MAPLE | 0.302 | 0.350 | 0.711 | 0.478 | 0.527 | 0.551 | 0.051 | 0.003 | 0.048 | 0.000 | 0.000 | 0.000 | |
| Aug-PE | 0.016 | 0.027 | 0.027 | 0.536 | 0.522 | 0.551 | 0.114 | 0.084 | 0.087 | 0.000 | 0.001 | 0.020 | |
| bioRxiv | SDG-CI | 0.194 | 0.420 | 0.668 | 0.662 | 0.746 | 0.796 | – | – | – | 0.000 | 0.000 | 0.031 |
| MAPLE | 0.090 | 0.097 | 0.517 | 0.514 | 0.556 | 0.577 | – | – | – | 0.000 | 0.000 | 0.000 | |