cs.CVNov 4, 2026

CounterFactual Retrieval for Evidence-Aware Individual Animal Identification

Authors: Ankit K. Upadhyay, Aleksandr Algasov, Ekaterina Nepovinnykh, Fedor Zolotarev, Tuomas Eerola, Heikki Kälviäinen, Charles V. Stewart, Lukas Picek

Organizations: Rensselaer Polytechnic Institute · LUT University · Brno University of Technology · University of Helsinki · 

Abstract

Automated identification of individual animals is moving from small curated studies toward shared benchmarks and reusable foundation models. This progress is useful, but current evaluation leaves the evidence behind a match unresolved, i.e., high retrieval accuracy does not show whether a model used animal features or identity-correlated shortcuts. We address this with Counterfactual Foreground Retrieval (CFR), an evidence-aware evaluation protocol. CFR evaluates the same query-gallery task under different views: full image, foreground-only, and shortcut-only. The full-image measures standard retrieval performance; the foreground-only measures foreground-supported retrieval; and shortcut-only view measure how much identity signal is recoverable from background, or silhouette. This turns a retrieval score into an evidence profile: how well the model performs on the original images, how much of that performance remains when only the animal is visible, and how much identity signal remains recoverable when the animal is removed. We release around 0.5M masks for 34 datasets and code for mask generation and CFR evaluation.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Are We Recognizing the Jaguar or Its Background? A Diagnostic Framework for Jaguar Re-Identification

    Apr 6, 2026Antonio Rueda-Toicen, Abigail Allen Martin, Daniil Morozov +5Animal Re-IdentificationShortcut Learning

  2. From Visual to Multimodal: Systematic Ablation of Encoders and Fusion Strategies in Animal Identification

    Feb 28, 2026Vasiliy Kudryavtsev, Kirill Borodin, German Berezin +3Animal Re-IdentificationMultimodal Fusion

  3. Degradation-based augmented training for robust individual animal re-identification

    Mar 4, 2026Thanos Polychronou, Lukáš Adam, Viktor Penchev +1Animal Re-IdentificationImage Corruption Robustness