cs.CVMar 7, 2026

Physics-Guided VLM Priors for All-Cloud Removal

Authors: Liying Xu, Huifang Li, Huanfeng Shen

Organizations: School of Resource and Environmental Sciences, Wuhan University, Wuhan 430079, China · School of Resource and Environmental Sciences and the Collaborative Innovation Center for Geospatial Technology, Wuhan University, Wuhan 430079, China

Abstract

Cloud removal is a fundamental challenge in optical remote sensing due to the heterogeneous degradation. Thin clouds distort radiometry via partial transmission, while thick clouds occlude the surface. Existing pipelines separate thin-cloud correction from thick-cloud reconstruction, requiring explicit cloud-type decisions and often leading to error accumulation and discontinuities in mixed-cloud scenes. Therefore, a novel approach named Physical-VLM All-Cloud Removal (PhyVLM-CR) that integrates the semantic capability of Vision-Language Model (VLM) into a physical restoration model, achieving high-fidelity unified cloud removal. Specifically, the cognitive prior from a VLM (e.g., Qwen) is transformed into physical scattering parameters and a hallucination confidence map. Leveraging this confidence map as a continuous soft gate, our method achieves a unified restoration via adaptive weighting: it prioritizes physical inversion in high-transmission regions to preserve radiometric fidelity, while seamlessly transitioning to temporal reference reconstruction in low-confidence occluded areas. This mechanism eliminates the need for explicit boundary delineation, ensuring a coherent removal across heterogeneous cloud covers. Experiments on real-world Sentinel-2 surface reflectance imagery confirm that our approach achieves a remarkable balance between cloud removal and content preservation, delivering hallucination-free results with substantially improved quantitative accuracy compared to existing methods.

Explore similar work

CardsList
  1. Interpretation-Oriented Cloud Removal via Observation-Anchored Residual Flow with Geo-Contextual Alignment

    Jul 2, 2026Ziyao Wang, Maonan Wang, Yucheng He +5Residual LearningImage Restoration

  2. ATT-CR: Adaptive Triangular Transformer for Cloud Removal

    Jun 4, 2026Yang Wu, Ye Deng, Pengna Li +4Remote SensingTransformer Attention

  3. GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations

    Sep 26, 2026Jeonghyeok Do, Munchurl KimCloud RemovalRemote Sensing