MarsFM: Shading-Regularized Flow Matching for Martian Relief Estimation
Organizations: Department of Industrial and Enterprise Systems Engineering The Grainger College of Engineering University of Illinois Urbana-Champaign, Urbana IL 61801-3080, USA
Abstract
We present MarsFM, an image-conditioned latent flow-matching model for local Martian relief estimation from single-band HiRISE RED orthoimagery. The method combines a pretrained generative prior with stereo-derived geometric supervision and a differentiable Lunar--Lambert shading objective. Relief, normal, gradient, curvature, and ordinal terms constrain complementary aspects of terrain structure, while a positive-affine-invariant image comparison constrains rendered appearance. An evaluation comprising 2024 gathered patch records per integration-step count yields mean affine-aligned RMSE between 0.0935 and 0.0957 in normalized signed-log relief space for one to twenty Euler steps. These scores measure agreement with VAE-reconstructed references on positive-reference support. Their narrow range supports low-step inference under this protocol. Spatial, differential, and spectral diagnostics show broad terrain correspondence alongside smoothing, amplitude compression, and boundary mismatch. MarsFM provides a framework for combining learned terrain priors with image-based constraints; establishing improved physical terrain resolution requires matched baselines and independent high-resolution reference data. Data: https://huggingface.co/datasets/SuperComputer/mars_hirise_dtm_processed-6aa9b66ba461e07f; code: https://github.com/Marius-Juston/MarsRecon.
Figures & tables
| Euler steps | 1 | 2 | 4 | 8 | 10 | 20 |
| RMSE | ||||||
| Normal error ( ∘ ) | ||||||
| Slope RMSE ( ∘ ) | ||||||
| Curvature RMSE ( ) | ||||||
| Boundary F-score | ||||||
| Topographic MS-SSIM |
| Steps | 1 | 2 | 4 | 8 | 10 | 20 |
| RMSE | 0.0935 | 0.0944 | 0.0938 | 0.0948 | 0.0957 | 0.0951 |
| (%) | 23.56 | 23.18 | 23.39 | 23.12 | 22.92 | 22.90 |
Appendix figures & tables68 assets
Supplementary material from the paper’s appendix.
Appendix
| Spectral Band | Wavelength Range (nm) | Primary Geological Applications |
| Blue–Green (BG) | 400–600 | Detection of frost, ice, and atmospheric scattering phenomena |
| Panchromatic (RED) | 550–850 | High-resolution topographic mapping, structural geomorphology analysis, and digital elevation model (DEM) extraction |
| Near-Infrared (IR) | 800–1000 | Mineralogical differentiation and sub-pixel spectral unmixing (e.g., integration with CRISM datasets) |
| Channel | Mean | Std | |
| Near-infrared | |||
| Red | |||
| Blue-green |
| Parameter | Example Value | Scientific Representation / Description |
| OBSERVATION_ID | TRA_000873_2015 | Unique identifier for this orbital capture sequence, documenting a transition-phase observation of Becquerel Crater stratigraphy. |
| PRODUCT_ID | TRA_000873_2015_COLOR | Specific identifier for this data product, indicating it is the synthesized color composite image. |
| OBSERVATION_START_TIME | 2006-10-03T12:51:33.015 | Precise Universal Time Coordinated (UTC) timestamp when the instrument began recording the observation. |
| MAP_PROJECTION_TYPE | EQUIRECTANGULAR | Cartographic mapping method applied. Utilizes a spherical approximation (local radius km) where latitude and longitude grid lines intersect at right angles. |
| MAP_SCALE | 0.25 meters/pixel | Spatial resolution of the projected map. Each pixel represents a 0.25 m 0.25 m area on the Martian surface at the center latitude. |
| CENTER_LATITUDE / LONGITUDE | 20.000 ∘ , 180.000 ∘ | Planetocentric coordinates defining the center of the map projection. |
| Attribute | Standard RDR | DTM Ortho |
| Sample Bits | 16 | 8 |
| Effective Max DN | 1023 (10-bit) | 255 (8-bit) |
| Typical Scaling Factor | ||
| Typical Offset |
| Channel | Mean | Std | |
| Elevation | |||
| Left red | |||
| Right red |
| Channel | Mean | Std | |
| Elevation |
| Saturation Rate (Data lost to tails) (%) | Irreducible Clipping Error (MACE) (m) | Base Expansion Factor | |
| 98% (45.9) | 1.9871% | 0.39506 | 22.92 |
| Optimal (76.4m) | 0.3986% | 0.0987 | 13.69 |
| Loss | Supervises | Scale | Noise-robust? | Section |
| latent velocity | all latent | partial | D-B | |
| absolute depth | values | reduced tail influence | D-C | |
| local slope | mid–high | partial | D-D | |
| slope multi-scale | low–high | offset-invariant | D-E | |
| curvature | high | partial | D-F | |
| frequency bands | adaptive bands | no | D-G |
| Metric | Direction | Value |
| Differential geometry diagnostics | ||
| Normal angular error ( ) | ||
| Slope RMSE ( ) | ||
| Curvature RMSE ( ) | ||
| Depth-Boundary F-score | ||
| Structural, image, and spectral diagnostics | ||
Remote Sensing Image Understanding
Remote sensing image understanding uses AI to interpret satellite and aerial imagery for objects, land cover, change, hazards, and spatial relationships.
See all 208 papers