Overview

Explainability evaluation studies whether an explanation reflects a model’s behavior and whether people can use it to understand, verify, or act on a decision. Common approaches measure faithfulness with feature removal, perturbations, counterfactuals, or causal interventions; assess stability across inputs, models, and data shifts; and compare explanations with ground-truth annotations or domain knowledge. Human studies test comprehension, decision performance, trust, and error detection, while benchmarks increasingly combine these outcomes with computational cost and robustness. No single metric works across tasks: scores can depend on architecture and perturbation choices, and mathematical quality or fluent explanations do not reliably predict human understanding or better decisions.

Latest papers

CardsList

350 papers24 papers in the last four weeks, down 8% on the four weeks before. 0.2% of all new papers.

  1. Beyond Reconstruction: A Unified Framework for Trustworthy and Explainable EEG Artifact Removal Evaluation

    Nov 16, 2026Phat Lam, Hung Nguyen, Lam Pham +5EEG Artifact RemovalExplainability Evaluation

  2. Interpreting Random Forests: Comparing Surrogate Models and Rule Extraction Methods

    Nov 14, 2026Lea L. Mairhöfer, Jonathan B. Krause, Björn-Hergen Laabs +1Interpretable MLSurrogate Modeling

  3. Towards Explainable Sleep Stage Classification using Single-Channel Electroencephalogram

    Nov 13, 2026Gurinder Kaur Sandhu, Jude Koenig, Ankita Shukla +1Sleep Stage ClassificationExplainability Evaluation

  4. On the Limits of Sufficient Explanations

    Nov 13, 2026Klaus Weinbauer, Peter F. Stadler, Thomas Gärtner +1Explainability EvaluationExplainable Text Classification

  5. A Reliability Study of Explainable AI for Freight Mode Classification

    Nov 11, 2026Ali Alawi Balfaqih, Mansur M. AriefFeature Attribution StabilityExplainability Evaluation

  6. Causal Concept Explanations for Deep Neural Models

    Nov 10, 2026Josh Rountree, Pulkit Verma, Oswin So +2Concept-Based ExplanationsNeural Network Interpretability

  7. Right for the Wrong Reasons? Evaluating Plausibility and Behavioral Change in Explanation-Guided Learning

    Nov 10, 2026David Dembinsky, Adriano Lucieri, Andreas DengelExplainability EvaluationShortcut Learning

  8. Beyond Proxy Metrics: MLLMs as Human Surrogates for Explainable AI Evaluation

    Nov 10, 2026Eoin M. Kenny, Salim I. Amoukou, Tom BewleyExplainability EvaluationExplainable Artificial Intelligence

  9. Fairness in Explainable AI Narratives: Decomposing Social Disparities in LLM-Generated Explanations

    Nov 9, 2026Wannes Van den Bulck, Sofie Goethals, David MartensSocial Bias in Language ModelsFaithfulness of Language Model Explanations

  10. Code-Grounded Agentic Explanations for Static Analysis Vulnerability Findings

    Nov 9, 2026Oshando Johnson, Ranjith Krishnamurthy, Rohith Kumar Shanmuganathan +2Static Code AnalysisExplainability Evaluation

  11. How a Model's Architecture and Performance Influences Explainability: A Study of Grad-CAM and CRAFT in CNN-Based Image Classification

    Nov 9, 2026Kilian Göller, Haadia Amjad, Steffen Seitz +2Explainable Image ClassificationExplainability Evaluation

  12. MotionBench-XAI: Benchmarking What Shapes Shapley Explanations in Spatiotemporal Machine Learning

    Nov 5, 2026Mathilde Papillon, Louisa Cornelis, Nina MiolaneFeature AttributionShapley Value Attribution

  13. Learning from How Users Interpret: Personalizing Recommendation Explanation Order

    Nov 5, 2026Deo Munduku, Elsa NegreExplainable RecommendationUser Modeling

  14. Navigating Disagreement Among Criteria for Evaluating Explanation Faithfulness

    Nov 4, 2026Grant Shanklin, Jiří Němeček, Asia BiegaExplainability EvaluationAlgorithmic Auditing

  15. A Comparative Study of Importance Attribution to Columns in Deep Learning over Relational Databases

    Nov 4, 2026Hila Levi-Yosefi, Shunit Agmon, Ester Livshits +2Feature AttributionExplainability Evaluation

  16. Whose Effect Is It? How Objectives Inflate Learned Subspace Interventions

    Nov 3, 2026Toygar Tanyel, Serkan AyvazMechanistic InterpretabilityExplainability Evaluation

  17. A Bounded Evaluation Protocol for Representational Systematicity

    Nov 1, 2026Boyu Cao, Wenshuo WangExplainability EvaluationFaithfulness of Language Model Explanations

  18. DocXEval: A Systematic Evaluation of Explainability in Multimodal Document Understanding

    Oct 27, 2026Saifullah Saifullah, David Dembinsky, Stefan Agne +2Multimodal Model InterpretabilityExplainability Evaluation

  19. Counterfactual Profile Perturbations for Recommendation Explanations: A Reproducibility Study

    Oct 26, 2026Meysam Varasteh, Elizabeth McKinnie, Robin BurkeExplainable RecommendationCounterfactual Explanations

  20. XALIGN: A Human-centric Visual Analytics Approach to Understanding AI Explanations

    Oct 22, 2026Bahavathy Kathirgamanathan, Gennady Andrienko, Natalia Andrienko +1Explainable Artificial IntelligenceExplainability Evaluation

  21. Engram Memory Network: Brain-Inspired Prototype Explanations

    Oct 20, 2026Hyunjun Kim, Myoung Hoon HaPrototype-Based ExplanationExplainable Image Classification

  22. AnomalyJev: Towards Evaluating Image Anomaly Explanations via Claim-Level Verification

    Oct 20, 2026Qizhou Wang, Jiawen Zhu, Guansong Pang +1Explainability EvaluationInterpretable Anomaly Detection

  23. FRACTION: Fraud Explanation Generation via Agentic Graph Context Navigation

    Oct 13, 2026Cecelia Soh, Jun Hu, Yuan Li +6Faithfulness of Language Model ExplanationsLLMs for Graph Learning

  24. ChemExplain: A Multimodal Benchmark for Explanatory Chemical Reasoning

    Oct 12, 2026Aotian Chen, Frazier N. Baker, Reza Averly +5Scientific ReasoningExplainability Evaluation