Overview

Training data attribution studies how particular examples or datasets affect a model’s behavior, helping researchers debug errors, audit provenance, select useful data, and assess safety. Common approaches include influence functions and gradient similarity, Shapley-style valuation, counterfactual retraining, and membership or provenance tests; newer methods use activations, training trajectories, and compressed gradient representations to scale attribution to large models. Evaluations span language-model knowledge and alignment, image and music generation, classification, and data selection, often comparing scores with retraining or known-inclusion benchmarks. A central challenge is that attribution depends on the counterfactual being asked about, while estimates can be costly, sensitive to interactions and evaluation choices, or confounded by similarity that does not establish causal influence.

Latest papers

CardsList

92 papers10 papers in the last four weeks, down 52% on the four weeks before. 0.1% of all new papers.

  1. quanda: An Interpretability Toolkit for Training Data Attribution Evaluation

    Oct 9, 2024Dilyara Bareeva, Galip Ümit Yolcu, Anna Hedström +4Training Data AttributionExplainability Evaluation

  2. Neural Dynamic Data Valuation via Stochastic State-Adjoint Trajectories

    Apr 30, 2024Zhangyong Liang, Ji Zhang, Huanhuan GaoCooperative Game TheoryGame Theory