cs.LGFeb 1, 2026

Understanding What TRAK Gets Right and Wrong: A Theory of Data Attribution

Authors: Han Tong, Haolin Zou, Shubhangi Ghosh, Arian Maleki

Organizations: Department of Statistics, Columbia University, New York, NY, USA.

Abstract

Data attribution, which traces a model's prediction back to specific training data, is an important tool for interpreting sophisticated AI models. The widely used TRAK algorithm addresses this challenge by first approximating the underlying model with a kernel machine and then leveraging techniques developed for approximating the leave-one-out (ALO) risk. Despite its strong empirical performance, the theoretical conditions under which TRAK approximations are accurate, as well as the regimes in which they break down, remain largely unexplored. In this paper, we provide a theoretical analysis of the TRAK algorithm, characterizing its performance and quantifying the errors introduced by the approximations on which the method relies. We show that although the approximations can incur significant errors, TRAK preserves the separation between highly influential and weakly influential data points. We corroborate our theoretical results through extensive simulations and empirical studies.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. How Faithful Is Trajectory-Based Data Attribution? Error Sources, Remedies, and Practical Guidelines

    May 12, 2026Junwei Deng, Pingbang Hu, Suliang Jin +4Gradient-Based AttributionData Selection

  2. Data Attribution via Sketched Metadifferentiation

    Sep 14, 2026Yuxi Chen, Hamza Golubovic, Han Tong +2Influence FunctionsTraining Data Attribution

  3. Concept Influence: Leveraging Interpretability to Improve Performance and Efficiency in Training Data Attribution

    Feb 16, 2026Matthew Kowal, Goncalo Paulo, Louis Jaburi +6Training Data Attribution