Morphology-Guided Cross-Task Coupling for Joint Building Height and Footprint Estimation

Monocular building height estimation from optical imagery is important for characterizing urban vertical structure, yet remains challenging due to the heterogeneity of urban building morphology and the indirect relationship between optical image appearance and building height. The recently launched PhiSat-2 satellite provides a promising open-access data source for this task, with 4.75m spatial resolution and seven multispectral bands spanning the visible to near-infrared range. However, its suitability for monocular building height estimation has not been systematically assessed. This study presents an initial open-reference assessment of PhiSat-2 imagery for this task by constructing a PhiSat-2--Height Dataset (PHDataset) and proposing a Two-Stream Ordinal Network (TSONet). PHDataset integrates global PhiSat-2 imagery with open building-height references and contains 9,475 co-registered patch pairs from 26 cities worldwide. TSONet jointly learns dense height estimation and auxiliary footprint prediction, using footprint-aware structural guidance and ordinal height modeling to better exploit PhiSat-2 spatial--spectral information. Specifically, a Cross-Stream Exchange Module (CSEM) enables adaptive interaction between the height and footprint streams, while a Feature-Enhanced Bin Refinement (FEBR) module performs coarse-to-fine ordinal query refinement with multi-level features. Experiments on PHDataset show that TSONet outperforms representative competing methods, reducing MAE and RMSE by over 13.2% and 9.7%, respectively, while improving IoU and F1-score by over 14.0% and 10.1%. Additional analyses further indicate that PhiSat-2 imagery contains useful spatial--spectral cues for monocular building height estimation at an intermediate spatial resolution.

We present a method for jointly predicting instance-level roof segment masks together with three continuous geometric attributes -- building height, roof slope, and roof azimuth -- from a single aerial orthophoto. Our approach extends Mask R-CNN with a dedicated attribute regression branch and introduces two key innovations: a conditional azimuth loss that suppresses supervision for flat roof segments where azimuth labels are inherently noisy, and a log-normalized height representation that addresses the heavily skewed distribution of building heights. We train and evaluate on a large-scale dataset of Dutch aerial images paired with automatically derived ground truth from 3DBAG, a nationwide LiDAR-based 3D building dataset. Using a DINOv3 ConvNeXt-Base backbone, our method achieves a mean absolute error of approximately 4 degrees for roof slope, 7 degrees for azimuth, and 1 meter for building height, with an instance segmentation AP$_{50}$ of 0.566. The predicted per-segment masks and attributes are sufficient to reconstruct simplified 3D building models (LoD2) from a single overhead image, requiring expensive 3D reference data only for training.

Current Large Multimodal Models (LMMs) in Earth observation are predominantly evaluated on planar optical tasks and often neglect the vertical dimension, although vertical geometric structure can be critical in applications such as disaster response and urban-morphology analysis. Progress on height-aware reasoning is also hindered by the absence of systematic evaluation: few benchmarks pair optical imagery with height products across pixel-, object-, and scene-level reasoning. To address this gap, we introduce GeoHeight-Bench, a large-scale benchmark for height-aware remote sensing understanding, together with a more challenging terrain-oriented extension, GeoHeight-Bench+. The benchmark is constructed through a scalable, VLM-driven generation pipeline that combines metadata extraction with prompt engineering, and its quality is assessed through a human-in-the-loop verification protocol. To examine whether height-aware reasoning can be learned from optical imagery, we further provide GeoHeightChat, a height-aware baseline that transfers implicit height-related geometric representations into an optical LMM. Evaluations of a broad range of closed- and open-source LMMs show that current models remain limited in their ability to reason about height information, while aligning implicit height priors improves most height-dependent tasks. However, several tasks, particularly slope reasoning and terrain-based flood-susceptibility mapping, remain largely unsolved, highlighting concrete open problems for height-aware GeoAI. Dataset and Code will be released \href{https://teriri1999.github.io/GeoHeight/}{here}.