cs.CLNov 3, 2026

Residual Attribute Leakage Is an Interface: Auditing Privacy Evaluation After Text De-identification

Authors: Tuan Thanh Duong, Joongmin Shin, Jeongho Yoon, Junyoung Son, Heuiseok Lim

Organizations: Department of Computer Science and Engineering, Korea University · Human-inspired AI Research, Korea University

Abstract

A privacy evaluation of de-identified text asks a language model (the adversary) to guess a person's protected attribute. We introduce a prior-normalised clipped leakage score of its confidence gain on the true value and audit the conclusions drawn from it. Each verdict depends on an evaluation interface (the queried person, answer options, prior, adversary model and scoring rule), which we vary on fixed releases of three corpora. In a stress test, an editor that writes the opposite-sex form at the same spans a redaction editor would redact misleads the adversary about most people, yet ranks first among editors scored on the same MedQA entries under this score, as under attack accuracy and proper scoring rules read as privacy. A relabelling-invariant reading of AUC ranks that editor sixth of eight, and a rule-aware adversary recovers the attribute from the same text. On ordinary releases most verdict changes are gains or losses of separability; of six choices varied over all pairs, only the adversary reverses comparisons (5 of its 124 changes), and the query can target the wrong person. SACC, a traceable editor we build as the instrument, lets us ablate two editing principles and show where its advantage does not hold.

Figures & tables

Appendix figures & tables11 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RedactionBench

    Jun 17, 2026Sean Brynjólfsson, Shashvat Jayakrishnan, Esha Sali +2LLM EvaluationContextual Integrity

  2. I Am No One: Style-Aware Paraphrasing for Text Anonymization

    Sep 11, 2026Ahmed Sohair Khan, Estrid He, Monica Wachowicz +1Authorship AttributionText Generation

  3. Subject-level Inference for Realistic Text Anonymization Evaluation

    Apr 23, 2026Myeong Seok Oh, Dong-Yun Kim, Hanseok Oh +6Privacy Auditing