cs.CVAug 25, 2026

Image Difference Quantification Using Autoencoder-Based Latent Representations

Authors: Manish Sharma, Timothy Yim, Clifton Forlines

Organizations: Northeastern University · Northeastern University and the University of Toronto

Abstract

Traditional image similarity metrics such as Mean Squared Error (MSE), Peak Signal-to-Noise Ratio (PSNR), and the Structural Similarity Index Measure (SSIM) rely on pixel-level comparisons and often fail to capture perceptually meaningful differences between images. In contrast, latent representations learned by deep neural networks encode high-level semantic information that is more closely aligned with human visual perception. This paper proposes a convolutional autoencoder-based framework for quantifying image differences using cosine similarity in latent space. The learned compact embeddings enable robust differentiation between visually distinct images under variations in illumination, pose, and background. Extensive evaluation on dog-cat images and additional cross-domain datasets demonstrates clear class-wise clustering and strong inter-class separability in the latent space, with 98.4% of dog-cat image pairs exhibiting similarity scores below 0.5. Further validation using the TID2013 dataset shows that latent-space distance correlates positively with human Mean Opinion Scores (MOS), demonstrating sensitivity to perceptually relevant image distortions. The proposed approach provides a computationally efficient and semantically grounded alternative to conventional pixel-based similarity metrics, with potential applications in content-based retrieval, perceptual quality assessment, and semantic similarity analysis.

Explore similar work

CardsList
  1. LatentDiff: Scaling Semantic Dataset Comparison to Millions of Images

    Apr 28, 2026James Flora, Kowshik Thopalli, Akshay R. Kulkarni +2Distribution ShiftDistribution Shift Detection

  2. ML-CLIPSim: Multi-Layer CLIP Similarity for Machine-Oriented Image Quality

    May 10, 2026Feng Ding, Haisheng Fu, Jie Liang +3Image Quality Assessment

  3. JLD: Perceptual Distance Through A Jacobian Lens

    Oct 5, 2026Shreshth Saini, Balu Adsumilli, Alan C. BovikPerceptual LossImage Quality Assessment