TOP: Transmission-Oriented Remote Sensing Pansharpening
Organizations: University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China · Multi-Hazard Early Warning Key Laboratory of Sichuan Province, Chengdu, Sichuan 611731, China · National Research Council of Italy, Institute of Integrated Methodologies for Earth Observation (CNR-IMIOT), 85050 Tito, Italy
Abstract
Pansharpening has been extensively studied as a fundamental image fusion task in remote sensing. However, most existing methods focus on improving fusion quality under the implicit assumption that high-resolution observations have already been fully downlinked to the ground. As a result, existing models are highly vulnerable to perturbations introduced by lossy compression used for downlink transmission. To address this limitation, we present, to the best of our knowledge, the first transmission oriented pansharpening (TOP) framework, which unifies compact latent coding, onboard pansharpening, and efficient downlink transmission within a single satellite-toground pipeline. TOP encodes remote-sensing observations into a compact binary latent space, where a lightweight onboard fusion module can efficiently predict the fused binary latent code. Since only the compact fused code is downlinked, the transmission payload is substantially reduced. Overall, TOP enables low-payload downlink and lightweight onboard processing while maintaining high fusion quality under severe bandwidth constraints. Experiments across multispectral and hyperspectral settings show that TOP consistently achieves superior fusion quality at higher compression ratios than representative pansharpening methods paired with standard lossy codecs. For example, on GaoFen-2, TOP attains a fusion PSNR of 31.4 dB at a downlink compression ratio of 50x. This design also points toward transmissionoriented processing for other remote-sensing tasks. The code will be made available at https://github.com/JingZe-Liang/TOP.git.
Figures & tables
| Block | Modeling behavior | Main complexity |
| CNN | Fixed, local | |
| Global attention | Adaptive, all tokens | |
| Swin | Adaptive, windowed |
| Method | Ratio | PSNR Std. | SSIM Std. | ERGAS Std. | HQNR Std. | Std. | Std. | SAM (deg) Std. |
| BDSD+JPEG2000 [ 4 ] | 21.26 | |||||||
| FusionNet+JPEG2000 [ 6 ] | ||||||||
| GLP+JPEG2000 [ 5 ] | ||||||||
| GS+JPEG2000 [ 3 ] | ||||||||
| MF+JPEG2000 [ 23 ] | ||||||||
| U2Net+JPEG2000 [ 7 ] |
| Dataset | Modality | bppb | PSNR Std. | SSIM Std. |
| WV3 (33 ) | HR-MSI | 0.063 | ||
| LR-MSI | 0.063 | |||
| PAN | 0.500 | |||
| WV3 (66 ) | HR-MSI | 0.031 | ||
| LR-MSI | 0.031 | |||
| PAN | 0.250 |
| Method | Ratio | PSNR Std. | SSIM Std. | ERGAS Std. | HQNR Std. | Std. | Std. | SAM (deg) Std. |
| BDSD+JPEG2000 [ 4 ] | 20.33 | |||||||
| FusionNet+JPEG2000 [ 6 ] | ||||||||
| GLP+JPEG2000 [ 5 ] | ||||||||
| GS+JPEG2000 [ 3 ] | ||||||||
| MF+JPEG2000 [ 23 ] | ||||||||
| U2Net+JPEG2000 [ 7 ] |
| Method | Ratio | PSNR Std. | SSIM Std. | ERGAS Std. | HQNR Std. | Std. | Std. | SAM (deg) Std. |
| BDSD+HEVC | 6.69 | |||||||
| FusionNet+HEVC | ||||||||
| GLP+HEVC | ||||||||
| GS+HEVC | ||||||||
| MF+HEVC | ||||||||
| U2Net+HEVC |
| Method | Ratio | PSNR Std. | SSIM Std. | ERGAS Std. | HQNR Std. | Std. | Std. | SAM (deg) Std. |
| BDSD+HEVC | 8.94 | |||||||
| FusionNet+HEVC | ||||||||
| GLP+HEVC | ||||||||
| GS+HEVC | ||||||||
| MF+HEVC | ||||||||
| U2Net+HEVC |
| Method | Ratio | PSNR | SSIM | ERGAS | HQNR | SAM (deg) | ||
| AWLP+JPEG2000 [ 22 ] | 19.62 | |||||||
| BDSD-PC+JPEG2000 [ 46 ] | ||||||||
| BT-H+JPEG2000 [ 47 ] | ||||||||
| GSA+JPEG2000 [ 20 ] | ||||||||
| MF+JPEG2000 [ 23 ] | ||||||||
| PRACS+JPEG2000 [ 21 ] |
| Dataset | Method | Ratio | PSNR | SAM (deg) | HQNR |
| GF2 | FusionNet [ 6 ] | 25.0 | |||
| WFANet [ 8 ] | 25.0 | ||||
| TOP (ours) | 50 | ||||
| WV3 | FusionNet [ 6 ] | 16.5 | |||
| WFANet [ 8 ] | 16.5 | ||||
| TOP (ours) | 33 |
| Coefficient | WV3 | WV3 | GF2 | Pavia |
| 0.1 | 0.1 | 1 | 1 | |
| 1 | 1 | 1 | 1 | |
| 0.05 | 0.1 | 0.1 | 0.1 |
| Configuration | WV3 | WV3 | GF2 | Pavia |
| Bands/ / | 8/8/4 | 8/16/8 | 4/16/8 | 102/64/4 |
| Stages/ | 4/64 | 3/128 | 3/128 | 4/64 |
| Width multipliers | ||||
| Encoder/decoder blocks | / | / | / | / |
| Embedding kernel | ||||
| BSQ groups | 1 | 2 | 2 | 8 |
| Dataset | Split | HR | LR | GT | ||
| WV3 | Train | 9714 | 8 | 64 | 16 | Yes |
| Val. | 1080 | 8 | 64 | 16 | Yes | |
| Reduced | 20 | 8 | 256 | 64 | Yes | |
| Full | 20 | 8 | 512 | 128 | No | |
| GF2 | Train | 19809 | 4 | 64 | 16 | Yes |
| Val. | 2201 | 4 | 64 | 16 | Yes |
| Method | Ratio | PSNR | SSIM | ERGAS | HQNR | SAM (deg) | ||
| AWLP+HEVC | 7.79 | |||||||
| BDSD-PC+HEVC | ||||||||
| BT-H+HEVC | ||||||||
| GSA+HEVC | ||||||||
| MF+HEVC | ||||||||
| PRACS+HEVC |
| Method | Ratio | HQNR | ||
| JPEG2000 | ||||
| BDSD+JPEG2000 | 28.43 | |||
| FusionNet+JPEG2000 | ||||
| GLP+JPEG2000 | ||||
| GS+JPEG2000 | ||||
| MF+JPEG2000 | ||||
| Method | Ratio | HQNR | ||
| JPEG2000 | ||||
| BDSD+JPEG2000 | 27.46 | |||
| FusionNet+JPEG2000 | ||||
| GLP+JPEG2000 | ||||
| GS+JPEG2000 | ||||
| MF+JPEG2000 | ||||
| Method | Ratio | Fusion time (ms/img) | HQNR | PSNR | SSIM | ERGAS | SAM (deg) | ||
| JPEG2000 Codec | |||||||||
| WFANet | 20.00 | 185.624 | |||||||
| U2Net | 20.03 | 114.427 | |||||||
| FusionNet | 19.99 | 1.444 | |||||||
| ADWM | 19.97 | 47.665 | |||||||
| ARConv | 20.01 | 80.710 | |||||||
| (a) Architecture reconstruction | ||||
| Architecture | Params (M) | GFLOPs | PSNR Std. | SSIM Std. |
| CNN | 66.721 | 169.96 | ||
| ViT | 62.709 | 219.46 | ||
| Swin | 65.609 | 171.72 | ||
| (b) BSQ payload | ||||
| Method | bppb | Payload/latent entry | ||