What the Averages Hide: Monocular Metric Depth Models Still Fail in Everyday Scenes, Mostly on Scale
Organizations: Antigravity Tech, Insta360 · Nanyang Technological University
Abstract
Zero-shot monocular metric depth models are evaluated by averaging metric and scale-aligned scores across datasets. Averages cannot show how many images still have severely wrong metric depth, whether depth is under- or overestimated, or whether different models fail on the same images. We propose an evaluation built on per-image results: the failure rate (metric < 0.5); scale-aligned metrics for structure, and the bias, dispersion and absolute error of the alignment scale for scale; and a cross-model comparison that separates shared from model-specific failures. We apply it to 11 recent architectures with and without ground-truth intrinsics (18 model evaluations) on the 7 everyday-scene benchmarks (4,406 images) used by MoGe-2. Metric depth estimation is not solved in everyday scenes, and the remaining difficulty is mainly scale: the best of the 18 evaluations still has a failure rate of 7.7% (datasets weighted equally); pooled over all failures, 78.8% have intact structure, and after scale correction 98.3% no longer fail. Images failed by at least 6 architectures make up 7.3% of the data, concentrated on HAMMER and DIODE; even when selected only by architectures of other families, they hold 34% to 40% of the error of the top 6 models, against 14% to 18% for as many random images from the same datasets. Adding objects reduces the scale error of most models; ground-truth intrinsics and, in most families, larger models reduce the failures but do not remove them. We recommend reporting failure rates, structure and scale separately, and results stratified by how many models fail. We will release the code, the per-image results with shared-failure labels, and two diagnostic sets built from TUM RGB-D.
Figures & tables
| Use of intrinsics | Model | Backbone | K | Focal length w/o K |
| Canonical camera space, output conversion | Metric3D-v2 ( Hu et al., 2024 ) | DINOv2 ViT-L | required | none |
| DA3METRIC ( Lin et al., 2026 ) | DINOv2 ViT-L | required | none | |
| Depth Pro ( Bochkovskii et al., 2025 ) | DINOv2 ViT-L/16 (384) | optional | FoV head | |
| MetricAnything-DepthMap ( Yang et al., 2026 ) | DINOv3 ViT-H+/16 | required | none | |
| Canonical camera space, input rescaling | DepthVLM ( Yu et al., 2026 ) | Qwen3-VL (about 4B) | required | none |
| Post-hoc geometric solve | MoGe-2 ( Wang et al., 2025b ) | DINOv2 ViT-L | optional | point-map solve |
| Name | Criterion | Meaning |
| Metric failure | metric 0.5 | under half of the pixels within 1.25 of the truth |
| Pure scale failure | metric failure, scale-aligned 0.9 | structure intact; scale alone fails |
| Flawed structure | scale-aligned 0.9 | many pixels still off by more than 1.25 even after |
| Structure failure | scale-aligned 0.5 | subset of flawed; fails after scale correction |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Fail. | Bias ( ) | Disp. | Abs. err. | ||
| Metric3D-v2 | with K | 0.739 | 0.183 | 23.1% | 0.978 | 0.045 | 0.0% | 0.084 | 0.140 | |
| DA3METRIC | with K | 0.865 | 0.128 | 9.0% | 0.962 | 0.058 | 0.1% | 0.106 | 0.096 | |
| Depth Pro | w/o K | 0.543 | 0.276 | 44.0% | 0.950 | 0.066 | 0.4% | 0.305 | 0.298 | |
| Depth Pro | with K | 0.661 | 0.224 | 31.4% | 0.950 | 0.066 | 0.4% | 0.280 | 0.250 | |
| MA-DepthMap | with K | 0.846 | 0.126 | 10.8% | 0.974 | 0.056 | 0.1% | 0.109 | 0.108 | |
| Dataset | Metric failures | Pure scale ( 0.9) | Flawed structure ( 0.9) | of which structure failure ( 0.5) | Flawed structure with wrong scale |
| NYUv2 | 210 | 88.1% | 11.9% | 0.0% | 100% |
| KITTI | 1,015 | 95.0% | 5.0% | 0.3% | 94% |
| ETH3D | 1,362 | 86.7% | 13.3% | 1.3% | 94% |
| iBims-1 | 113 | 91.2% | 8.8% | 0.9% | 90% |
| DDAD | 2,313 | 51.9% | 48.1% | 1.7% | 92% |
| DIODE | 4,838 | 76.7% | 23.3% | 1.9% | 91% |
| Dataset | Images | Specific (1–2) | Intermediate (3–5) | Shared ( 6) | Shared images | ||
| NYUv2 | 654 | 92.2% | 6.6% | 0.9% | 0.3% | 2 | 0% |
| KITTI | 652 | 92.8% | 7.1% | 0.2% | 0% | 0 | 0% |
| iBims-1 | 100 | 80.0% | 16.0% | 3.0% | 1.0% | 1 | 0% |
| DDAD | 1,000 | 38.0% | 59.8% | 1.9% | 0.3% | 3 | 0% |
| ETH3D | 454 | 16.7% | 67.4% | 14.5% | 1.3% | 6 | 0% |
| DIODE | 771 | 0% | 38.7% | 41.0% | 20.4% | 157 | 0.8% |
| Model | Failures | (specific) | = 3 to 5 | (shared) | Main location of specific failures (share, bias) |
| Metric3D-v2 | 1,220 | 30% | 39% | 31% | DIODE (81%, +0.39); HAMMER (12%, +0.28) |
| DA3METRIC | 454 | 3% | 26% | 71% | — |
| Depth Pro | 1,551 | 59% | 20% | 21% | DDAD (58%, -0.61); ETH3D (25%, -0.81) |
| MA-DepthMap | 506 | 41% | 43% | 16% | HAMMER (52%, -0.27); ETH3D (23%, -0.18) |
| DepthVLM | 1,116 | 32% | 36% | 31% | HAMMER (52%, +0.62); DDAD (36%, -0.24) |
| MoGe-2 | 384 | 3% | 18% | 79% | — |
| Share of error by tier | Metric | Metric Rel | |||||||||||
| Model | Spec. | Interm. | Shared | All | Rank | w/o shared | Rank | All | Rank | On shared | w/o shared | Rank | |
| Metric3D-v2 | 7% | 32% | 35% | 27% | 0.739 | 9 | 0.763 | 9 | 0.183 | 8 | 23% | 0.165 | 9 |
| DA3METRIC | 13% | 20% | 24% | 42% | 0.865 | 5 | 0.914 | 5 | 0.128 | 2 | 27% | 0.103 | 4 |
| Depth Pro | 10% | 53% | 19% | 17% | 0.661 | 11 | 0.700 | 11 | 0.224 | 10 | 19% | 0.193 | 10 |
| MA-DepthMap | 14% | 45% | 29% | 12% | 0.846 | 7 | 0.842 | 8 | 0.126 | 1 | 11% | 0.126 | 7 |
| DepthVLM | 18% | 32% | 27% | 23% | 0.728 | 10 | 0.747 | 10 | 0.295 | 11 | 31% | 0.247 | 11 |
Appendix figures & tables31 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Within 5% | SA failures | Metric pass, SA failure |
| NYUv2 | 97.8% / 95.8% / 99.8% / 99.8% | 0 / 2 / 1 / 1 / 1 | 0 / 2 / 1 / 1 / 1 |
| KITTI | 98.4% / 94.6% / 97.3% / 99.6% | 3 / 4 / 3 / 10 / 3 | 0 / 1 / 0 / 7 / 0 |
| ETH3D | 97.6% / 96.2% / 96.2% / 98.9% | 18 / 51 / 37 / 78 / 42 | 0 / 3 / 5 / 19 / 2 |
| iBims-1 | 95.9% / 95.3% / 98.7% / 98.7% | 1 / 1 / 1 / 2 / 2 | 0 / 0 / 0 / 1 / 1 |
| DDAD | 89.6% / 82.1% / 88.9% / 95.9% | 43 / 165 / 194 / 175 / 98 | 3 / 53 / 127 / 92 / 43 |
| DIODE | 86.3% / 92.4% / 92.0% / 96.2% | 104 / 253 / 172 / 470 / 204 | 11 / 68 / 50 / 189 / 61 |
| Model | Intrinsics | Dispersion | Bias | SA failure rate |
| Metric3D-v2 | with K | 0.084/0.085/0.090/0.094/0.094 | 0.0%/0.0%/0.1%/0.0%/0.0% | |
| DA3METRIC | with K | 0.106/0.108/0.114/0.133/0.117 | 0.1%/0.4%/0.5%/0.8%/0.2% | |
| Depth Pro | w/o K | 0.305/0.304/0.307/0.460/0.325 | 0.4%/1.5%/0.9%/1.7%/1.0% | |
| Depth Pro | with K | 0.280/0.280/0.283/0.439/0.300 | 0.4%/1.5%/0.9%/1.6%/1.0% | |
| MA-DepthMap | with K | 0.109/0.108/0.115/0.234/0.119 | 0.1%/0.1%/0.2%/1.1%/0.2% | |
| DepthVLM | with K | 0.149/0.148/0.158/0.158/0.154 | 2.7%/3.7%/4.1%/3.9%/3.5% |
| Model | K | Mean (ours) | Mean (MoGe-2 paper) | Max. difference on one dataset |
| Metric3D-v2 | with K | 0.183 / 0.739 | 0.183 / 0.739 | 0.001 / 0.001 |
| Depth Pro | w/o K | 0.276 / 0.543 | 0.276 / 0.544 | 0.000 / 0.002 |
| MoGe-2 | w/o K | 0.157 / 0.769 | 0.157 / 0.768 | 0.002 / 0.007 |
| MoGe-2 | with K | 0.136 / 0.877 | 0.136 / 0.874 | 0.004 / 0.008 |
| UniDepthV2 | w/o K | 0.213 / 0.753 | 0.213 / 0.753 | 0.001 / 0.001 |
| UniDepthV2 | with K | 0.185 / 0.826 | 0.185 / 0.826 | 0.001 / 0.002 |
| Model | K | Source | Dataset | Rel (paper) | Rel (ours) | (paper) | (ours) |
| DA3METRIC | with K | Depth Anything 3 Table 11 | NYUv2 | 0.070 | 0.071 | 0.963 | 0.970 |
| DA3METRIC | with K | Depth Anything 3 Table 11 | KITTI | 0.086 | 0.073 | 0.953 | 0.960 |
| DA3METRIC | with K | Depth Anything 3 Table 11 | ETH3D | 0.104 | 0.125 | 0.917 | 0.855 |
| DA3METRIC | with K | Depth Anything 3 Table 11 | DIODE | 0.128 | 0.152 | 0.838 | 0.766 |
| DepthVLM | with K | DepthVLM Table 2 | DDAD | — | 0.182 | 0.818 | 0.721 |
| DepthVLM | with K | DepthVLM Table 2 | ETH3D | — | 0.085 | 0.924 | 0.940 |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.965 | 0.071 | 0.5% | 0.974 | 0.047 | 0.063 | 0.047 | 99.5% | |
| DA3METRIC | with K | 0.970 | 0.071 | 0.3% | 0.981 | 0.042 | 0.058 | 0.057 | 99.7% | |
| Depth Pro | w/o K | 0.919 | 0.107 | 3.5% | 0.976 | 0.044 | 0.098 | 0.086 | 96.6% | |
| Depth Pro | with K | 0.935 | 0.093 | 2.6% | 0.976 | 0.044 | 0.098 | 0.074 | 97.4% | |
| MA-DepthMap | with K | 0.969 | 0.078 | 0.6% | 0.985 | 0.037 | 0.071 | 0.068 | 99.4% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.980 | 0.052 | 0.0% | 0.985 | 0.040 | 0.034 | 0.033 | 100.0% | |
| DA3METRIC | with K | 0.960 | 0.073 | 0.0% | 0.969 | 0.056 | 0.041 | 0.045 | 100.0% | |
| Depth Pro | w/o K | 0.383 | 0.235 | 62.1% | 0.964 | 0.055 | 0.154 | 0.268 | 38.0% | |
| Depth Pro | with K | 0.888 | 0.108 | 6.6% | 0.964 | 0.055 | 0.137 | 0.088 | 93.6% | |
| MA-DepthMap | with K | 0.963 | 0.071 | 0.0% | 0.979 | 0.055 | 0.055 | 0.044 | 100.0% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.888 | 0.118 | 7.9% | 0.986 | 0.038 | 0.113 | 0.098 | 92.3% | |
| DA3METRIC | with K | 0.855 | 0.125 | 10.8% | 0.981 | 0.048 | 0.136 | 0.117 | 89.6% | |
| Depth Pro | w/o K | 0.328 | 0.385 | 67.4% | 0.966 | 0.072 | 0.548 | 0.534 | 32.8% | |
| Depth Pro | with K | 0.368 | 0.349 | 63.0% | 0.966 | 0.073 | 0.525 | 0.522 | 37.2% | |
| MA-DepthMap | with K | 0.781 | 0.158 | 16.5% | 0.979 | 0.058 | 0.169 | 0.141 | 83.5% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.941 | 0.100 | 1.0% | 0.976 | 0.043 | 0.086 | 0.078 | 99.0% | |
| DA3METRIC | with K | 0.967 | 0.075 | 0.0% | 0.976 | 0.039 | 0.078 | 0.057 | 100.0% | |
| Depth Pro | w/o K | 0.815 | 0.159 | 14.0% | 0.975 | 0.041 | 0.195 | 0.132 | 86.0% | |
| Depth Pro | with K | 0.878 | 0.116 | 9.0% | 0.975 | 0.041 | 0.124 | 0.102 | 91.0% | |
| MA-DepthMap | with K | 0.928 | 0.088 | 5.0% | 0.987 | 0.037 | 0.099 | 0.080 | 95.0% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.938 | 0.091 | 0.4% | 0.948 | 0.074 | 0.058 | 0.043 | 99.6% | |
| DA3METRIC | with K | 0.875 | 0.123 | 0.1% | 0.880 | 0.116 | 0.039 | 0.035 | 100.0% | |
| Depth Pro | w/o K | 0.351 | 0.334 | 62.5% | 0.846 | 0.139 | 0.360 | 0.400 | 38.6% | |
| Depth Pro | with K | 0.411 | 0.323 | 55.4% | 0.846 | 0.139 | 0.390 | 0.384 | 45.3% | |
| MA-DepthMap | with K | 0.871 | 0.138 | 3.2% | 0.933 | 0.098 | 0.065 | 0.098 | 97.0% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.020 | 0.491 | 99.9% | 0.984 | 0.032 | 0.061 | 0.400 | 0.3% | |
| DA3METRIC | with K | 0.766 | 0.152 | 20.9% | 0.949 | 0.063 | 0.200 | 0.142 | 79.6% | |
| Depth Pro | w/o K | 0.377 | 0.319 | 62.9% | 0.936 | 0.065 | 0.427 | 0.413 | 37.2% | |
| Depth Pro | with K | 0.431 | 0.296 | 57.7% | 0.936 | 0.064 | 0.418 | 0.374 | 42.7% | |
| MA-DepthMap | with K | 0.735 | 0.179 | 23.7% | 0.961 | 0.059 | 0.168 | 0.149 | 76.5% | |
| Metric | Structure | Scale ( ) | ||||||||
| Model | K | Rel | Fail. | Rel | Bias ( ) | Disp. | Abs. err. | |||
| Metric3D-v2 | with K | 0.443 | 0.357 | 52.4% | 0.990 | 0.042 | 0.176 | 0.282 | 47.6% | |
| DA3METRIC | with K | 0.660 | 0.275 | 31.1% | 0.994 | 0.040 | 0.190 | 0.219 | 68.9% | |
| Depth Pro | w/o K | 0.630 | 0.391 | 35.4% | 0.989 | 0.044 | 0.353 | 0.255 | 64.6% | |
| Depth Pro | with K | 0.717 | 0.281 | 25.4% | 0.989 | 0.044 | 0.270 | 0.203 | 74.6% | |
| MA-DepthMap | with K | 0.677 | 0.170 | 26.7% | 0.992 | 0.051 | 0.139 | 0.178 | 73.3% | |
| Failure threshold | Failures | Intact 0.8 | Intact 0.85 | Intact 0.9 | Intact 0.95 | Slightly flawed | Also struct. failure |
| 0.3 | 12,767 | 89.4% | 86.0% | 80.8% | 71.4% | 19.0% | 0.1% |
| 0.4 | 13,871 | 88.6% | 85.0% | 79.7% | 70.1% | 19.5% | 0.8% |
| 0.5 | 15,085 | 87.9% | 84.2% | 78.8% | 69.1% | 19.5% | 1.7% |
| 0.6 | 16,675 | 87.0% | 83.0% | 77.3% | 67.5% | 18.5% | 4.2% |
| 0.7 | 18,805 | 85.2% | 80.8% | 74.8% | 64.7% | 16.4% | 8.8% |
| Failure threshold | NYUv2 | KITTI | ETH3D | iBims-1 | DDAD | DIODE | HAMMER |
| 0.3 | 91% | 95% | 88% | 92% | 55% | 81% | 86% |
| 0.4 | 87% | 95% | 87% | 91% | 54% | 78% | 86% |
| 0.5 | 88% | 95% | 87% | 91% | 52% | 77% | 87% |
| 0.6 | 87% | 93% | 87% | 91% | 48% | 75% | 87% |
| 0.7 | 84% | 90% | 87% | 79% | 44% | 74% | 87% |
| Failure threshold | Failures | Share shared | Share specific | Specific from the 4 models | Scenes with 90% of shared | HAMMER shared overest. | Top-6 error on shared |
| 0.3 | 6,570 | 40% | 29% | 90% | 7 | 100.0% | 32% to 40% |
| 0.4 | 7,082 | 41% | 27% | 90% | 8 | 99.8% | 34% to 43% |
| 0.5 | 7,750 | 42% | 27% | 90% | 9 | 99.5% | 38% to 46% |
| 0.6 | 8,661 | 43% | 26% | 88% | 9 | 98.7% | 41% to 49% |
| 0.7 | 9,961 | 43% | 23% | 85% | 9 | 97.4% | 45% to 52% |
| Model | All | Without | Without | Without |
| Metric3D-v2 | 9 / 8 | 9 / 9 | 9 / 9 | 9 / 9 |
| DA3METRIC | 5 / 2 | 5 / 5 | 5 / 4 | 5 / 4 |
| Depth Pro | 11 / 10 | 11 / 10 | 11 / 10 | 11 / 10 |
| MA-DepthMap | 7 / 1 | 8 / 7 | 8 / 7 | 8 / 7 |
| DepthVLM | 10 / 11 | 10 / 11 | 10 / 11 | 10 / 11 |
| MoGe-2 | 1 / 5 | 1 / 1 | 1 / 1 | 1 / 1 |
| Stratum | Variance of | Failure correlation [95%] | |
| HAMMER, 7 scenes | 218 / 308 | 4.42 / 1.21 | 0.228 / 0.002 [ 0.048, 0.052] |
| HAMMER, scene empty/objects (13 strata) | 218 / 246 | 2.38 / 0.82 | 0.197 / 0.001 [ 0.034, 0.034] |
| DIODE, 6 scenes | 157 / 83 | 5.08 / 1.61 | 0.240 / 0.001 [ 0.011, 0.010] |
| Model (with K) | Full image [95% interval] | Background [95% interval] | Sign-flip p |
| Metric3D-v2 | 0.188 [ 0.242, 0.120] | 0.181 [ 0.237, 0.110] | 0.016 |
| DA3METRIC | 0.125 [ 0.271, 0.026] | 0.127 [ 0.277, 0.027] | 0.016 |
| Depth Pro | 0.186 [ 0.326, 0.051] | 0.190 [ 0.328, 0.058] | 0.047 |
| MA-DepthMap | +0.043 [+0.007, +0.081] | +0.050 [+0.010, +0.087] | 0.953 |
| DepthVLM | 0.146 [ 0.340, 0.007] | 0.139 [ 0.328, 0.010] | 0.109 |
| MoGe-2 | 0.209 [ 0.494, 0.021] | 0.210 [ 0.491, 0.027] | 0.094 |
| Model | Size | HAMMER, w/o K | DIODE, w/o K | HAMMER, w/ K | DIODE, w/ K |
| Metric3D-v2 | ViT-S | — | — | 93% / 77% | 94% / 92% |
| Metric3D-v2 | ViT-L | — | — | 95% / 36% † | 100% / 100% † |
| Metric3D-v2 | ViT-g | — | — | 94% / 39% | 98% / 99% |
| DA3METRIC | ViT-L | — | — | 96% / 6% † | 68% / 9% † |
| Depth Pro | ViT-L | 84% / 16% | 80% / 58% | 78% / 5% † | 87% / 50% † |
| MA-DepthMap | ViT-H+ | — | — | 6% / 35% † | 40% / 20% † |
| Model | Size | 7 benchmarks | DIODE | HAMMER |
| Metric3D-v2 | ViT-g | 24.5% | 98.6% | 54.7% |
| DA3METRIC | ViT-L | 9.0% | 20.9% | 31.1% |
| Depth Pro | ViT-L | 31.4% | 57.7% | 25.4% |
| MA-DepthMap | ViT-H+ | 10.8% | 23.7% | 26.7% |
| DepthVLM | Qwen3-VL | 20.4% | 44.0% | 81.5% |
| MoGe-2 | ViT-L | 8.1% | 19.1% | 23.9% |
| Family | K | Size | HAMMER | DIODE |
| Metric3D-v2 | K | ViT-S | 92% / 78% | 95% / 92% |
| Metric3D-v2 | K | ViT-L | 95% / 39% | 100% / 100% |
| Metric3D-v2 | K | ViT-g | 94% / 42% | 98% / 99% |
| MoGe-2 | w/o K | ViT-S | 58% / 13% | 55% / 44% |
| MoGe-2 | w/o K | ViT-B | 43% / 42% | 43% / 28% |
| MoGe-2 | w/o K | ViT-L | 43% / 25% | 38% / 29% |
| Family and condition | Structure: SA Rel | Scale: |
| MoGe-2 w/o K (S L) | 0.064 0.046 ( 29%) | 0.183 0.143 ( 22%) |
| MoGe-2 with K (S L) | 0.078 0.056 ( 28%) | 0.137 0.090 ( 35%) |
| MoGe-3 w/o K (L G) | 0.046 0.041 ( 11%) | 0.150 0.147 ( 2%) |
| MoGe-3 with K (L G) | 0.059 0.052 ( 11%) | 0.090 0.103 (+14%) |
| UniDepthV2 w/o K (S L) | 0.066 0.049 ( 26%) | 0.252 0.163 ( 35%) |
| UniDepthV2 with K (S L) | 0.065 0.048 ( 26%) | 0.216 0.131 ( 39%) |
Monocular Depth Estimation
Monocular depth estimation infers scene geometry and distance from a single camera image, enabling 3D perception without stereo or depth sensors.
See all 146 papers