RSEdit: Text-Guided Image Editing for Remote Sensing
Organizations: School of Earth Sciences, Zhejiang University, Hangzhou, 310058 China, and Zhejiang Provincial Key Laboratory of Geographic Information Science. · ReLER, CCAI, Zhejiang University, Hangzhou, China. · Key Laboratory of Spatio-temporal Information and Intelligent Services (LSIIS), Ministry of Natural Resources of the People’s Republic of China.
Abstract
In this paper, we explore text-guided image editing in the remote sensing domain using generative modeling. We propose \rsedit, a collection of models from U-Net to DiT with various configurations. Specifically, we present the first comprehensive study of conditioning strategies for building image editing models from off-the-shelf text-to-image ones. Our experiments show that \rsedit achieves the best instruction-faithful edits while preserving geospatial structure. We release the code at https://github.com/Bili-Sakura/RSEdit-Preview and checkpoints at https://huggingface.co/collections/BiliSakura/rsedit.
Figures & tables
| Method | F1 dam | VIE Scores | ||
|---|---|---|---|---|
| SC | PQ | VIE | ||
| SD 1.5 † | ||||
| SD 2.1 † | ||||
| Text2Earth † | ||||
| InstructPix2Pix | ||||
| MagicBrush | ||||
| U-Net | DiT | DiT+ | |||
|---|---|---|---|---|---|
| Metric | ch. | tk. | tk. | ch. | tk. |
| #Param | 860M | 860M | 610M | 610M | 610M |
| GFLOPs | 1 | 2 | 3 | 1.5 | 2.5 |
| F1 dam | 49.74 | 38.29 | 30.28 | 41.37 | 45.35 |
| SC | 4.050 | 4.024 | 4.509 | 4.337 | 3.604 |
| PQ | 5.358 | 5.257 | 5.219 | 5.429 | 5.160 |
Text-Guided Image Editing
Text-guided image editing changes selected image content from natural-language instructions while aiming to preserve everything else.
See all 165 papers