cs.CVNov 16, 2026

Rethinking Perceptual Similarity for Remote Sensing: Multi-Layer Attention Scoring and Human Preference Benchmarking

Authors: Eli Underwood, Marc Bosch, Neil Joshi, Jeffrey Wen, Myron Brown

Organizations: Johns Hopkins University Applied Physics Laboratory · Duke University

Abstract

Perceptual similarity metrics for natural images transfer poorly to remote sensing (RS), where severe geospatial and semantic failures can remain visually plausible while still being decisively wrong for downstream use. To address this, we develop a novel human-aligned perceptual quality metric for generated RS imagery and evaluate it across several generation tasks. We first conduct a controlled perturbation study where we progressively increase the severity of common synthetic perturbations. Using the layer-wise Aligned Attention Score (AAS) responses in RemoteCLIP, we find that different RS artifacts are best captured at different depths. Based on these findings, we introduce Remote Sensing Perceptual Distance (RSPD), a pairwise metric that averages seven independently calibrated layer distances without tuning on human-preference labels. To evaluate our metric on realistic RS generation tasks, we construct a blind, reference-conditioned two-alternative forced-choice (2AFC) benchmark with five 300-triplet subsets spanning synthetic artifacts, airborne and spaceborne super-resolution, SAR-to-optical translation, and timeseries controls. We also construct a 300-triplet ordered misregistration benchmark with deterministic labels. Using the same RemoteCLIP checkpoint, RSPD substantially outperforms simple cosine distance with the final global embedding and is competitive with the strongest generic baselines across the realistic RS generation tasks.

Figures & tables

Explore similar work

CardsList
  1. SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models

    May 11, 2026Chen Zhong, Xiao An, Jiaxing Sun +3VLM EvaluationRemote Sensing

  2. RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing

    Jul 22, 2026Zihan Qin, Boao Xu, Zhao Dong +4Image Editing EvaluationRemote Sensing Benchmarks

  3. Evaluating Remote Sensing Image Captions Beyond Metric Biases

    Apr 22, 2026Ziyun Chen, Fan Liu, Liang Yao +3VLM EvaluationRemote Sensing Image Understanding