Gradient-Based Attribution

Overview

Gradient-based attribution studies how changes to inputs, internal representations, model parameters, or training examples affect a model’s outputs. Common approaches include saliency maps, Integrated Gradients and its path-based variants, class activation maps, and gradient-based influence methods for tracing training data or identifying important parameters. Researchers apply them to images, text, graphs, time series, and large language models, evaluating explanations with localization, deletion, faithfulness, robustness, and known-ground-truth benchmarks. A central tension is that gradients are efficient and broadly applicable, but their results can depend strongly on baselines, architectures, training choices, and evaluation metrics, so predictive accuracy alone does not establish that an attribution is faithful.

Latest papers

CardsList

120 papers12 papers in the last four weeks, down 25% on the four weeks before. 0.1% of all new papers.

  1. Lesion-Aware Explainable AI for Diabetic Retinopathy Grading from Fundus Images

    Nov 14, 2026Truong Thinh Nguyen, Hai Phong Nguyen, Truong Thanh Hung Nguyen +2Explainable Medical Image AnalysisDiabetic Retinopathy Grading

  2. Towards Explainable Sleep Stage Classification using Single-Channel Electroencephalogram

    Nov 13, 2026Gurinder Kaur Sandhu, Jude Koenig, Ankita Shukla +1Sleep Stage ClassificationExplainability Evaluation

  3. How a Model's Architecture and Performance Influences Explainability: A Study of Grad-CAM and CRAFT in CNN-Based Image Classification

    Nov 9, 2026Kilian Göller, Haadia Amjad, Steffen Seitz +2Explainable Image ClassificationExplainability Evaluation

  4. Elucidating the Design Space of LM Data Attribution

    Oct 29, 2026Steven Yu, Sheng-Yu Wang, Kimia Hamidieh +2Training Data AttributionGradient-Based Attribution

  5. Follow the Gradient: Tracing Safety Degradation Back to Training Data

    Oct 27, 2026Saket Reddy, Amro Abbas, Anshuman Suri +3Safety-Preserving Fine-Tuning of Language ModelsGradient-Based Attribution

  6. Robust LLM Data Selection via Content-Invariant Gradient Attribution

    Oct 27, 2026Jia Gu, Liang Pang, Huawei ShenInstruction-Tuning Data SelectionGradient-Based Attribution

  7. Direction-Aware Token Credit Assignment with Reward-Model Gradients

    Oct 23, 2026Yikuan Hu, Jifeng Zhu, Minle Su +6Token-Level Credit AssignmentPolicy Gradient Methods

  8. EigenGradCAM with AugSmooth: Enhancing Explainability and Precision in Multi-Stage Alzheimer's Disease Detection

    Oct 23, 2026Arsham Azam, Sagar Ashraf, Tayyaba Farhat +2Alzheimer's Disease ClassificationExplainable Medical Image Analysis

  9. RL-IF: Tracking Non-local Training Data Influence for Online Reinforcement Learning

    Oct 20, 2026Shixuan Liu, Cheng Tang, Yuzheng Hu +3Training Data AttributionInfluence Functions

  10. Correcting Attribution Patching with a Few Exact Measurements

    Oct 19, 2026Luyang Zhang, Minxing Zheng, Jialu WangLLM InterpretabilityActivation Patching

  11. Unlocking Token Rewards via Training-Free Reward Attribution

    Oct 13, 2026Sitong Wu, Haoru Tan, Bin Xia +6Token-Level Credit AssignmentRL for Language Model Reasoning

  12. What Do Sparse Autoencoder Feature Discovery Scores Identify? From Activations to Interventions

    Oct 11, 2026Yifeng Guo, Yanran Li, Xiang ChenSparse AutoencodersMechanistic Interpretability

  13. Static Gradient Attribution Underperforms a Density-Matched Random Mask on Loss-Based Forgetting Within LoRA B-Matrix

    Oct 8, 2026Yu Sun, Junwei Zhou, Zuodong Xiang +5Storage-Efficient Continual LearningContinual Learning for LLMs

  14. Kernelized Parameter Sensitivity Atlases for Amortized Conditional Interpretability

    Oct 8, 2026Davide Wiest, Ahanaf Hasan Ariq, Abdul Monaf ChowdhuryNeural Network InterpretabilityGradient-Based Attribution

  15. Explaining the Saliency Map Sparsity of Adversarially-Trained Neural Networks

    Oct 7, 2026Yannick Lunk, Atell Yehor Krasnopolsky, Damien Garreau +1Adversarial TrainingGradient-Based Attribution

  16. WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing

    Sep 30, 2026Dominik Matuszek, Bartosz Zieliński, Tomasz Danel +1Gradient-Based AttributionExplainability Evaluation

  17. Distilling Diffusion Score Discrepancy for Efficient Training Data Attribution

    Sep 30, 2026Shixuan Liu, Joan Serrà, Kin Wai Cheuk +6Gradient-Based AttributionKronecker-Factored Approximation

  18. dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale

    Sep 30, 2026Shixuan Liu, Tongli Zhou, Junwei Deng +2Gradient-Based AttributionTraining Data Attribution

  19. Auditing Agent Actions through Query-Conditioned Attribution

    Sep 27, 2026Yifan Liu, Praveen Venkateswaran, Abdulhamid Adebayo +1Gradient-Based AttributionAI Agent Benchmarks

  20. Scaling Attention Head Analysis via Gradient-Based Attribution in Context-Aware Machine Translation

    Sep 23, 2026Paweł Mąka, Yusuf Can Semerci, Jan Scholtes +1Gradient-Based AttributionAttention Head Analysis

  21. A Systematic Benchmark of Explainable Methods for Temporal Attribution in Sequential Recommendation Systems

    Sep 23, 2026Akash Pandey, Kanisha Shah, Addrish Roy +5Gradient-Based AttributionSequential Recommendation

  22. Can Data Attribution Filter Out Subliminal Learning? Not Reliably

    Sep 17, 2026Moritz Weckbecker, Sweta Jena, Jonas Müller +5Gradient-Based AttributionTraining Data Curation