Overview

Explainability evaluation studies whether an explanation reflects a model’s behavior and whether people can use it to understand, verify, or act on a decision. Common approaches measure faithfulness with feature removal, perturbations, counterfactuals, or causal interventions; assess stability across inputs, models, and data shifts; and compare explanations with ground-truth annotations or domain knowledge. Human studies test comprehension, decision performance, trust, and error detection, while benchmarks increasingly combine these outcomes with computational cost and robustness. No single metric works across tasks: scores can depend on architecture and perturbation choices, and mathematical quality or fluent explanations do not reliably predict human understanding or better decisions.

Latest papers

CardsList

350 papers24 papers in the last four weeks, down 8% on the four weeks before. 0.2% of all new papers.

  1. CID: Measuring Feature Importance Through Counterfactual Distributions

    Nov 19, 2025Eddie Conti, Álvaro Parafita, Axel BrandoFeature AttributionExplainability Evaluation

  2. Critical or Compliant? The Double-Edged Sword of Reasoning in Chain-of-Thought Explanations

    Nov 15, 2025Eunkyu Park, Wesley Hanwen Deng, Vasudha Varadarajan +4VLM ReasoningMultimodal CoT Reasoning

  3. Surrogate Modeling and Explainable Artificial Intelligence for Complex Systems: A Workflow for Automated Simulation Exploration

    Oct 19, 2025Paul Saves, Pramudita Satria Palar, Muhammad Daffa Robani +7Surrogate ModelingExplainable Artificial Intelligence

  4. Distinguishing Performance From Competence in Evaluations of Humanlike Abstract Reasoning

    Oct 2, 2025Claas Beger, Ryan Yi, Shuhao Fu +5Language Model Reasoning EvaluationExplainability Evaluation

  5. Activation-Deactivation: A General Framework for Robust Post-hoc Explainable AI

    Oct 1, 2025Akchunya Chanchal, David A. Kelly, Hana ChocklerExplainable Artificial IntelligenceExplanation Stability

  6. Explainable Information Processing in Particle Swarm Optimization through Landscape and Search Behavior Analysis

    Sep 8, 2025Nitin Gupta, Bapi Dutta, Anupam YadavMetaheuristic OptimizationExplainability Evaluation

  7. Ultra Strong Machine Learning: LLM-Generated Explanations Do Not Yet Suffice for Teaching Humans Active Learning Strategy

    Aug 31, 2025Lun Ai, Johannes Langer, Ute Schmid +1Active LearningHuman-in-the-Loop AI

  8. Rule2Text: A Framework for Generating and Evaluating Natural Language Explanations of Knowledge Graph Rules

    Aug 14, 2025Nasim Shirvani-Mahdavi, Chengkai LiLLM EvaluationExplainability Evaluation

  9. B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data

    May 28, 2025Magdalena Proszewska, Tomasz Danel, Antoni Antoszek +1GNN ExplainabilityExplainability Evaluation

  10. SurgXBench: Explainable Vision-Language Model Benchmark for Surgery

    May 16, 2025Jiajun Cheng, Xianwu Zhao, Sainan Liu +5VLM EvaluationSurgical Video Understanding

  11. Are explainable AI (XAI) evaluation strategies aligned? Comparing subjective, objective, and mathematical evaluation measures using saliency maps

    Apr 23, 2025Felix Kares, Timo Speith, Hanwei Zhang +1Saliency Map EvaluationExplainability Evaluation

  12. Less is More: Efficient Black-box Attribution via Minimal Interpretable Subset Selection

    Apr 1, 2025Ruoyu Chen, Siyuan Liang, Jingzhi Li +4Feature AttributionVLM Interpretability

  13. Verbosity Tradeoffs and the Impact of Scale on the Faithfulness of LLM Self-Explanations

    Mar 17, 2025Noah Y. Siegel, Nicolas Heess, Maria Perez-Ortiz +1Faithfulness of Language Model ExplanationsLLM Interpretability

  14. VisionLogic: Discovering and Grounding Decision-Relevant Visual Concepts

    Mar 13, 2025Chuqin Geng, Yuhe Jiang, Li Zhang +5Explainable Artificial IntelligenceConcept-Based Explanations

  15. Causal Explanations for Image Classifiers

    Nov 13, 2024Hana Chockler, David A. Kelly, Daniel Kroening +1Actual CausalityExplainable Image Classification

  16. quanda: An Interpretability Toolkit for Training Data Attribution Evaluation

    Oct 9, 2024Dilyara Bareeva, Galip Ümit Yolcu, Anna Hedström +4Training Data AttributionExplainability Evaluation

  17. CHAOSMINING: Benchmarking Post-Hoc Attribution with Sparse Informative Features in High Dimensions

    Jun 17, 2024Ge Shi, Fangyi Liu, Ziwen Kan +1Gradient-Based AttributionFeature Attribution

  18. Stop Using Plausibility as the Criterion for Explainable AI

    Mar 30, 2023Weina Jin, Xiaoxiao Li, Ghassan HamarnehExplainable Artificial IntelligenceExplainability Evaluation

  19. Impact of Model Interpretability and Outcome Feedback on Trust in AI

    Nov 16, 2021Daehwan Ahn, Abdullah Almaatouq, Monisha Gulabani +1Human-AI InteractionTrust in AI