cs.CVSep 28, 2026

ARCH-B: Architectural Representation, Comprehension and Hierarchy Benchmark

Authors: Kieran Sagar Parikh, Jose Luis Garcia del Castillo y Lopez

Organizations: Harvard University · Northeastern University

Abstract

Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a benchmark of 354 four-choice questions across 11 cross-representational archetypes, constructed from a building-linked corpus of 3.9 million architectural images using visually similar distractors, model-guided difficulty screening, and manual validation. We evaluate 25 multimodal models and collect 5,830 responses from non-expert human participants. Model accuracy ranges from 10.45% to 83.90%, compared with a human baseline of 35.35%. Models perform comparatively well on mixed-representation outlier detection and photograph matching, but remain weaker on floorplan-to-photograph correspondence. Human and model difficulty across archetypes is only weakly correlated (Spearman's (ρ=0.33)). Held-out evaluation confirms that the difficulty identified during screening generalizes beyond the curation models. ARCH-B provides a diagnostic evaluation of visual correspondence and representation transfer across architectural media.

Figures & tables

Explore similar work

CardsList
  1. MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence

    Aug 10, 2026Chenxu Du, Kang An, Tengyue Wang +8Multimodal Large Language ModelsMultimodal Reasoning

  2. ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models

    May 20, 2026Qirui Shen, Wenda Wang, Jiachen Lu +5Stable Spatial UnderstandingCognitive Science

  3. ARK: A Dual-Axis Multimodal Retrieval Benchmark along Reasoning and Knowledge

    Feb 10, 2026Yijie Lin, Guofeng Ding, Haochen Zhou +3Multimodal RetrievalMultimodal Reasoning Benchmarks