Combi-CAM: A Novel Multi-Layer Approach for Explainable Image Geolocalization
Organizations: CB · Centre Borelli, ENS Paris-Saclay, Université de Paris, CNRS, INSERM, SSA, France · CB, CMLA · Universitat de les Illes Balears, IAC3, Spain
Abstract
Planet-scale photo geolocalization involves the intricate task of estimating the geographic location depicted in an image purely based on its visual features. While deep learning models, particularly convolutional neural networks (CNNs), have significantly advanced this field, understanding the reasoning behind their predictions remains challenging. In this paper, we present Combi-CAM, a novel method that enhances the explainability of CNN-based geolocalization models by combining gradient-weighted class activation maps obtained from several layers of the network architecture, rather than using only information from the deepest layer as is typically done. This approach provides a more detailed understanding of how different image features contribute to the model's decisions, offering deeper insights than the traditional approaches.
Figures & tables
Feature Attribution
Feature attribution estimates which input features or internal components contribute to a model’s predictions.
See all 231 papers