Fusion-CAM: Integrating Gradient and Region-Based Class Activation Maps for Robust Visual Explanations
Organizations: IRIT, UMR5505 CNRS Universit´e de Toulouse · IRIT, UMR5505 CNRS Universit´e Toulouse Capitole · INRAE, Centre Occitanie-Toulouse Unit´e Exp´erimentale APC
Abstract
Interpreting the decision-making process of deep convolutional neural networks remains a central challenge in achieving trustworthy and transparent artificial intelligence. Explainable AI (XAI) techniques, particularly Class Activation Map (CAM) methods, are widely adopted to visualize the input regions influencing model predictions. Gradient-based approaches (e.g. Grad-CAM) provide highly discriminative, fine-grained details by computing gradients of class activations but often yield noisy and incomplete maps that emphasize only the most salient regions rather than the complete objects. Region-based approaches (e.g. Score-CAM) aggregate information over larger areas, capturing broader object coverage at the cost of over-smoothing and reduced sensitivity to subtle features. We introduce Fusion-CAM, a novel framework that bridges this explanatory gap by unifying both paradigms through a dedicated fusion mechanism to produce robust and highly discriminative visual explanations. Our method first denoises gradient-based maps, yielding cleaner and more focused activations. It then combines the refined gradient map with region-based maps using contribution weights to enhance class coverage. Finally, we propose an adaptive similarity-based pixel-level fusion that evaluates the agreement between both paradigms and dynamically adjusts the fusion strength. This adaptive mechanism reinforces consistent activations while softly blending conflicting regions, resulting in richer, context-aware, and input-adaptive visual explanations. Extensive experiments on standard benchmarks show that Fusion-CAM consistently outperforms existing CAM variants in both qualitative visualization and quantitative evaluation, providing a robust and flexible tool for interpreting deep neural networks.
Figures & tables
| Technique | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | |
| Grad-CAM | 26.32 | 30.15 | 10.97 | 17.05 | 26.42 | 9.30 | 15.70 | 3.20 | 15.74 | 5.50 | 5.41 | 3.40 |
| Grad-CAM++ | 23.60 | 27.25 | 5.72 | 13.75 | 9.17 | 7.20 | 18.63 | 2.20 | 14.95 | 4.30 | 3.25 | 6.50 |
| XGrad-CAM | 22.53 | 29.15 | 4.47 | 20.15 | 9.33 | 8.80 | 17.86 | 2.40 | 16.46 | 5.40 | 5.58 | 5.30 |
| Score-CAM | 20.13 | 32.85 | 2.97 | 25.20 | 7.70 | 10.40 | 16.80 | 2.90 | 12.39 | 5.30 | 2.58 | 4.00 |
| Group-CAM | 19.29 | 32.25 | 3.40 | 20.20 | 10.31 | 9.50 | 15.38 | 2.70 | 9.76 | 5.60 | 3.74 | 4.80 |
| XAI Method | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||||||||
| Ins. | Del. | Sc. | Ins. | Del. | Sc. | Ins. | Del. | Sc. | Ins. | Del. | Sc. | Ins. | Del. | Sc. | Ins. | Del. | Sc. | |
| Grad-CAM | 61.19 | 18.23 | 42.96 | 79.70 | 32.63 | 47.07 | 96.71 | 65.95 | 30.76 | 93.26 | 44.67 | 48.59 | 90.70 | 19.64 | 71.06 | 87.76 | 78.20 | 9.56 |
| Grad-CAM++ | 60.08 | 20.94 | 39.14 | 73.64 | 32.18 | 41.46 | 96.92 | 58.97 | 37.95 | 90.77 | 47.31 | 43.46 | 89.84 | 20.53 | 69.31 | 89.38 | 72.22 | 17.16 |
| XGrad-CAM | 64.48 | 18.30 | 46.18 | 81.97 | 32.08 | 49.89 | 93.25 | 51.76 | 41.49 | 93.35 | 42.81 | 50.54 | 91.98 | 18.86 | 73.12 | 89.24 | 71.53 | 17.71 |
| Score-CAM | 64.90 | 21.13 | 43.77 | 83.77 | 28.06 | 55.71 | 94.44 | 47.17 | 47.27 | 93.79 | 43.55 | 50.24 | 92.59 | 17.68 | 74.91 | 90.97 | 74.88 | 16.09 |
| Group-CAM | 65.48 | 17.86 | 47.62 | 82.49 | 32.13 | 50.36 | 96.85 | 54.51 | 42.34 | 93.46 | 44.44 | 49.02 | 92.71 | 19.59 | 73.12 | 87.86 | 73.17 | 14.69 |
| (%) | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD | AI | AD | AI | AD | AI | AD | AI | AD | AI | AD | AI | |
| 0 | 13.73 | 41.00 | 1.72 | 28.85 | 6.24 | 12.60 | 13.26 | 4.00 | 7.96 | 7.50 | 1.11 | 8.40 |
| 10 | 13.25 | 42.25 | 1.56 | 29.70 | 6.17 | 12.80 | 12.43 | 4.00 | 7.75 | 7.30 | 1.04 | 8.70 |
| 20 | 13.87 | 40.70 | 1.60 | 29.20 | 6.19 | 12.70 | 13.87 | 4.40 | 7.65 | 7.30 | 1.03 | 8.60 |
| 30 | 14.81 | 39.55 | 1.70 | 28.95 | 6.20 | 12.70 | 15.13 | 3.80 | 7.72 | 7.40 | 0.22 | 6.90 |
| 40 | 15.27 | 38.50 | 1.69 | 29.65 | 6.25 | 13.10 | 15.24 | 3.20 | 7.67 | 7.10 | 1.14 | 7.60 |
| XAI method | ILSVRC12 | VOC07 | Plant Village | AVG |
| Grad-CAM | 0.028 | 0.027 | 0.016 | 0.023 |
| Grad-CAM++ | 0.046 | 0.027 | 0.020 | 0.027 |
| XGrad-CAM | 0.027 | 0.015 | 0.015 | 0.018 |
| Score-CAM | 4.036 | 4.085 | 1.936 | 3.378 |
| Group-CAM | 0.498 | 0.554 | 0.368 | 0.479 |
| Union-CAM | 5.848 | 6.140 | 2.091 | 4.562 |
| Setting | Description | Average Drop (%) | Average Increase (%) |
| 1 | Baseline | 17.96 | 36.75 |
| 2 | Baseline + Denoising (10%) | 17.10 | 36.95 |
| 3 | Baseline + Weighted Union | 15.26 | 38.55 |
| 4 | Full pipeline | 13.25 | 42.25 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Images | Description |
| ILSVRC 2012 (Val.) | 2000 | Large-scale benchmark for natural image classification. |
| PASCAL VOC 2007 | Object detection and classification benchmark with multi-object scenes. | |
| PlantVillage | 1000 | Extensive plant leaf dataset (healthy and diseased conditions). |
| Plant Leaves | Leaf images categorized by species and health state. | |
| Apple Leaf Disease | Apple leaf disease dataset: Scab, Black Rot, Cedar Apple Rust, Healthy. | |
| PlantK | High-resolution leaves annotated by species and health status. |
| Technique | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | |
| Grad-CAM | 16.88 | 37.20 | 30.92 | 31.00 | 76.86 | 5.00 | 1.85 | 33.00 | 45.70 | 16.67 | 1.06 | 35.50 |
| Grad-CAM++ | 21.10 | 32.25 | 26.96 | 29.00 | 72.23 | 8.00 | 0.69 | 66.00 | 40.18 | 35.00 | 1.34 | 32.00 |
| XGrad-CAM | 18.15 | 35.00 | 26.96 | 29.00 | 71.50 | 8.00 | 0.73 | 64.00 | 50.80 | 8.67 | 1.09 | 34.50 |
| Score-CAM | 16.00 | 39.85 | 18.93 | 43.00 | 62.62 | 10.00 | 0.60 | 70.00 | 33.58 | 43.00 | 0.90 | 36.00 |
| Group-CAM | 16.23 | 37.70 | 25.99 | 31.00 | 71.97 | 9.00 | 0.66 | 68.00 | 42.09 | 16.33 | 1.11 | 36.00 |
| Technique | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | |
| Grad-CAM | 47.98 | 14.00 | 37.67 | 25.00 | 40.65 | 36.50 | 43.53 | 5.00 | 22.52 | 14.00 | 42.57 | 18.00 |
| Grad-CAM++ | 47.03 | 15.00 | 36.35 | 27.00 | 31.45 | 44.50 | 30.93 | 10.00 | 20.88 | 21.00 | 32.72 | 21.00 |
| XGrad-CAM | 44.51 | 17.00 | 34.79 | 29.00 | 30.36 | 49.00 | 28.80 | 25.00 | 18.56 | 24.00 | 29.56 | 22.00 |
| Score-CAM | 30.95 | 24.00 | 32.72 | 34.00 | 18.41 | 64.00 | 17.12 | 30.00 | 13.57 | 32.00 | 23.21 | 38.00 |
| Group-CAM | 46.02 | 15.00 | 33.05 | 30.00 | 27.69 | 49.50 | 17.46 | 28.00 | 19.10 | 27.00 | 27.63 | 29.00 |
| Fusion-CAM variants | ILSVRC2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | AD (%) | AI (%) | |
| Fusion-CAM (GradCAM, ScoreCAM) | 13.25 | 42.25 | 1.56 | 29.70 | 6.17 | 12.80 | 12.43 | 4.00 | 7.75 | 7.30 | 1.04 | 8.70 |
| Fusion-CAM (GradCAM++, ScoreCAM) | 14.77 | 37.55 | 2.01 | 22.95 | 5.11 | 11.80 | 12.79 | 5.40 | 9.82 | 6.60 | 1.31 | 10.70 |
| Fusion-CAM (XGradCAM, ScoreCAM) | 14.91 | 38.10 | 1.86 | 26.80 | 5.93 | 11.70 | 12.84 | 5.10 | 9.85 | 6.60 | 1.22 | 8.30 |
| (%) | ILSV2012 | VOC2007 | Plant Village | Plant Leaves | Plant K | Apple Disease | ||||||
| AD | AI | AD | AI | AD | AI | AD | AI | AD | AI | AD | AI | |
| 0 | 13.73 | 41.00 | 1.72 | 28.85 | 6.24 | 12.60 | 13.26 | 4.00 | 7.96 | 7.50 | 1.11 | 8.40 |
| 10 | 13.25 | 42.25 | 1.56 | 29.70 | 6.17 | 12.80 | 12.43 | 4.00 | 7.75 | 7.30 | 1.04 | 8.70 |
| 20 | 13.87 | 40.70 | 1.60 | 29.20 | 6.19 | 12.70 | 13.87 | 4.40 | 7.65 | 7.30 | 1.03 | 8.60 |
| 30 | 14.81 | 39.55 | 1.70 | 28.95 | 6.20 | 12.70 | 15.13 | 3.80 | 7.72 | 7.40 | 0.22 | 6.90 |
| 40 | 15.27 | 38.50 | 1.69 | 29.65 | 6.25 | 13.10 | 15.24 | 3.20 | 7.67 | 7.10 | 1.14 | 7.60 |
| XAI Method | ILSVRC2012 | VOC2007 | PlantVillage | Plant Leaves | PlantK | Apple Disease | AVG |
| Grad-CAM | 0.028 | 0.027 | 0.016 | 0.026 | 0.028 | 0.014 | 0.023 |
| Grad-CAM++ | 0.046 | 0.027 | 0.020 | 0.027 | 0.027 | 0.014 | 0.027 |
| XGrad-CAM | 0.027 | 0.015 | 0.015 | 0.024 | 0.013 | 0.014 | 0.018 |
| Score-CAM | 4.036 | 4.085 | 1.936 | 4.022 | 4.114 | 2.077 | 3.378 |
| Group-CAM | 0.498 | 0.554 | 0.368 | 0.610 | 0.551 | 0.293 | 0.479 |
| Union-CAM | 5.848 | 6.140 | 2.091 | 6.435 | 6.517 | 2.339 | 4.562 |