Overview

Training data attribution studies how particular examples or datasets affect a model’s behavior, helping researchers debug errors, audit provenance, select useful data, and assess safety. Common approaches include influence functions and gradient similarity, Shapley-style valuation, counterfactual retraining, and membership or provenance tests; newer methods use activations, training trajectories, and compressed gradient representations to scale attribution to large models. Evaluations span language-model knowledge and alignment, image and music generation, classification, and data selection, often comparing scores with retraining or known-inclusion benchmarks. A central challenge is that attribution depends on the counterfactual being asked about, while estimates can be costly, sensitive to interactions and evaluation choices, or confounded by similarity that does not establish causal influence.

Latest papers

CardsList

92 papers10 papers in the last four weeks, down 52% on the four weeks before. 0.1% of all new papers.

  1. Paying Creators for Training Data Can Increase AI Displacement

    Nov 15, 2026Lijuan Luo, Emaad Manzoor, Nathan Yang +1AI and LaborGenerative AI Adoption

  2. Data Attribution Should Steer Pretraining

    Nov 15, 2026Glenn Matlin, Chandreyi Chakraborty, Mohammed Rehan Parwani +8Training Data SelectionTraining Data Curation

  3. MathaMAGICal: Validating Trajectory Data Attribution During Capability Acquisition

    Nov 15, 2026Jason Lee, Dikshanta Pokhrel, Phonn Nay Khant +6Training Data AttributionInfluence Functions

  4. Efficient and Accurate Causal Validation of Training Data Attribution

    Nov 14, 2026Simon Vary, Alireza Mousavi-Hosseini, Roger GrosseTraining Data Attribution

  5. On Representational and Functional Alignment of Training Data Attribution Methods for Language Models

    Nov 14, 2026Loris Schoenegger, Benjamin RothTraining Data Attribution

  6. Functional Dependency beyond Similarity: Hierarchical Decomposition of Training Data Attribution in Music Generative Models

    Nov 6, 2026Changheon Han, Hugh Xuechen Liu, Ashkan Panahi +1Training Data Attribution

  7. Elucidating the Design Space of LM Data Attribution

    Oct 29, 2026Steven Yu, Sheng-Yu Wang, Kimia Hamidieh +2Training Data AttributionGradient-Based Attribution

  8. Robust LLM Data Selection via Content-Invariant Gradient Attribution

    Oct 27, 2026Jia Gu, Liang Pang, Huawei ShenInstruction-Tuning Data SelectionGradient-Based Attribution

  9. RL-IF: Tracking Non-local Training Data Influence for Online Reinforcement Learning

    Oct 20, 2026Shixuan Liu, Cheng Tang, Yuzheng Hu +3Training Data AttributionInfluence Functions

  10. Influence Is the Target-Response Jacobian Times Residuals

    Oct 20, 2026Paul Geertsema, Simon GeertsemaInfluence FunctionsTraining Data Attribution

  11. Tensor Network Datamodels for Training Data Attribution

    Oct 17, 2026Farzaneh Heidari, Md Rifat Arefin, Louis Jaburi +1Training Data AttributionTensor Networks

  12. Dataset Inference for Data Provenance and Privacy Auditing in Tabular Foundation Models

    Oct 16, 2026Dariush Wahdany, Jesse Cresswell, Naiqing Guan +3Training Data AttributionTabular Foundation Models

  13. Groups Don't Move as One: A Bregman Clustering View of Linearized Group Influence

    Oct 10, 2026Hyunho Choi, Jaeseung Heo, Youngbin Choi +2Influence FunctionsTraining Data Attribution

  14. Cross-Modal Latent Influence: Patch-Level Training Sample Attribution for Vision-Language Models

    Oct 9, 2026Laura Yao, Shixing Yu, Jie Peng +3VLM InterpretabilityTraining Data Attribution

  15. TICDA: Tabular In-Context Data Attribution

    Oct 6, 2026Yacine Benihaddadene, Milan Bhan, Eliot Dugelay +4Tabular Foundation ModelsTabular ICL

  16. LUMOS: Tracing Parametric Knowledge from Training Data to Behavioral Outputs in LLMs

    Oct 2, 2026Seoyeon Ye, Gayoung Kim, Jiyoung Hong +2Factual Knowledge in Language ModelsLLM Evaluation

  17. TrueMuse: A Benchmark for Data Attribution in Text-to-Music Models

    Sep 30, 2026Jiawei Yu, Jian LiuText-to-Music GenerationAudio Diffusion Models

  18. Distilling Diffusion Score Discrepancy for Efficient Training Data Attribution

    Sep 30, 2026Shixuan Liu, Joan Serrà, Kin Wai Cheuk +6Gradient-Based AttributionKronecker-Factored Approximation

  19. dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale

    Sep 30, 2026Shixuan Liu, Tongli Zhou, Junwei Deng +2Gradient-Based AttributionTraining Data Attribution