cs.CVOct 30, 2026

FlowMoDE: Coarse-to-fine Flow Matching for Detail-aware Sim-to-Real Monocular Depth Estimation

Authors: Liangjing Shao, Wanhao Liu, Jinsong Lin, Zhiwei Fang, Hongliang Ren

Organizations: Department of Electronic Engineering, The Chinese University of Hong Kong. · Shenzhen Loop Area Institute.

Abstract

Monocular depth estimation is a fundamental capability for 3D spatial perception in robotic and intelligent systems. While data-driven discriminative methods have achieved compelling performance for monocular depth estimation, generative approaches can reconstruct fine structural details with stronger generalization. However, most existing generative diffusion models suffer from low inference efficiency caused by multi-step sampling, whereas single-step diffusion models struggle to recover high-fidelity depth maps. To mitigate these drawbacks, this paper presents FlowMoDE, a coarse-to-fine flow-matching-based framework for efficient, structure-aware monocular depth estimation supporting sim-to-real and cross-scene generalization. The core architecture first conducts coarse-level decoding conditioned on diffused features extracted from a pre-trained semantic encoder, and subsequently restores fine-grained structural patterns via expanded decoding layers. Trained exclusively on a single synthetic indoor dataset, our proposed method outperforms prior methods across five real-world indoor and outdoor datasets, yielding an average 14.1% reduction in relative error against state-of-the-art works as well as 9.9% reduction in chamfer distance for point cloud reconstruction. We further validate the generalization capability of FlowMoDE on realistic robotic scenes, with qualitative comparisons against state-of-the-art methods. The project page is https://flowmode-shao.netlify.app/

Figures & tables

Explore similar work

CardsList
  1. Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation

    Mar 17, 2026Xinhao Cai, Gensheng Pei, Zeren Sun +3Monocular Depth EstimationDiffusion Models

  2. Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation

    Sep 8, 2026Igor Pavlovic, Thiemo Wandel, Anton Obukhov +6Diffusion TransformerOOD Generalization

  3. PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation

    Aug 17, 2026Zhiyuan Yuan, Guanying Chen, Lingteng Qiu +3Depth EstimationVision Transformer