To reduce deployment cost and retraining overhead, adapting pretrained learned image compression (LIC) models to downstream machine vision tasks has attracted growing attention. However, existing methods typically insert fine-tuning modules independently into frozen backbones, lacking explicit mechanisms for cross-layer coordination. To address this limitation, we propose a novel framework named CrossMambaTuning, which integrates State Space Models with cross-layer interaction mechanisms for parameter-efficient fine-tuning. Specifically, we design an efficient Mamba adapter equipped with task-specific prompts and multi-scale branching to precisely capture both local features and global dependencies. Furthermore, we introduce a Scale-Invariant Cross-Layer Adapter (SICA) utilizing a parameter-sharing strategy to fuse task information across different scales and reduce redundancy. Extensive experiments demonstrate that CrossMambaTuning achieves state-of-the-art (SOTA) performance on multiple machine vision tasks, reducing parameter overhead by 72% compared to SOTA methods. Code is available at https://github.com/rsr1123/CrossMambaTuning.
Figures & tables
Figure 1. Performance comparison on COCO2017-val ( Lin et al., 2014 ) . The different variants of the proposed method, full fine-tuning, TransTIC ( Chen et al., 2023 ) , ICMH-Net ( Liu et al., 2023a ) ,Adapt-ICMH ( Li et al., 2024 ) , and SVD-LoRA ( Park et al., 2025 ) , are compared. BD-mAP is computed using the base codec of TIC ( Lu et al., 2022 ) as the anchor. The size of the circles represents Gflops for encoding.
Figure 2. The APC modifies the input x before the adapter.
Figure 3. Overview of the proposed CrossMambaTuning.The snowflake symbol represents frozen layers, while the flame symbol represents trainable layers. Since the decoding stage is the inverse process of the encoding stage, only the specific fine-tuning modules within the encoder are shown. More details can be found in Appendix H.
Method
Wasserstein ↓
KL Divergence ↓
Stages
y
Stages
y
w/o APC
0.0308
0.0388
0.0396
0.0163
w/ APC
0.0277
0.0318
0.0318
0.0077
Table 1. We measure the distribution distance relative to the full fine tuning (lower is better). The metrics are reported for the average of intermediate stages (Stages) and the latent ( y ).
Figure 4. Rate-Accuracy performance comparison for different machine vision tasks using the Lu2022-TIC base codec.
Method
Venue
Image Classification
Object Detection
Instance Segmentation
Trainable Params ↓ (M)
BD-rate ↓
BD-acc ↑
BD-rate ↓
BD-mAP ↑
BD-rate ↓
BD-mAP ↑
full fine-tuning
–
/
17.688
-73.943%
4.511
-67.977%
3.755
7.51(100.00%)
channel selection ( Liu et al., 2022 )
ICPR’22
-37.178%
- 6.278
— 6.849%
-0.550
- 16.511%
-0.949
0.92(12.25%)
ICMH-Net ( Liu et al., 2023a )
ACM MM’23
-18.759%
- 3.360
- -9.080%
0.625
-10.772%
0.654
3.98(53.00%)
TransTIC ( Chen et al., 2023 )
ICCV’23
-58.529%
- 9.956
-46.301%
2.768
-46.521%
2.690
1.62(21.57%)
Adapt-ICMH ( Li et al., 2024 )
ECCV’24
-88.573%
16.901
-55.150%
3.547
-52.407%
3.208
0.29(3.86%)
Table 2. Performance comparison of different methods on three machine tasks, using TIC as the base codec. We report the number of trainable parameters and two BD metrics ( Bjontegaard, 2001 ) : BD-rate and BD-acc/mAP. The best and second-best results are highlighted in bold and underline, respectively.
Method
Components
Object Detection
Instance Segmentation
Trainable Params ↓ (M)
APC
LIE
SICA
TSPG
BD-Rate ↓
BD-mAP ↑
BD-Rate ↓
BD-mAP ↑
(a)
-60.162%
3.948
-59.676%
3.405
0.26 (3.46%)
(b)
✓
-61.303%
4.021
-60.885%
3.479
0.26 (3.46%)
(c)
✓
✓
-61.977%
4.062
-61.789%
3.493
0.27 (3.60%)
(d)
✓
✓
✓
-64.931%
4.195
-62.164%
3.575
0.30 (3.99%)
(e)
✓
✓
✓
✓
-65.607%
4.249
-62.589%
3.624
0.32 (4.26%)
Table 3. Ablation study of core components.
Method
Object Detection BD-rate ↓ BD-mAP ↑
Trainable Params ↓ (M)
full fine-tuning
-70.409%
5.745
33.79(100.00%)
channel selection ( Liu et al., 2022 )
-23.235%
1.518
2.68(7.93%)
SVD-LoRA ( Park et al., 2025 )
-41.190%
2.149
0.41(1.21%)
Adapt-ICMH ( Li et al., 2024 )
-54.844%
3.379
0.41(1.21%)
Ours-Tiny
-57.495%
3.863
0.11(0.33%)
Ours-Small
-60.016%
4.137
0.21(0.62%)
Table 4. Performance comparison of different methods on object detection, using ELIC ( He et al., 2022 ) as the base codec.
Figure 5. Visualization of spatial correlation for normalized latent representations (y−μ)/σ . SFMA (right) exhibits significant spatial correlation. In contrast, our method (second from left) effectively suppresses correlations, approaching the decorrelation efficiency of Full Fine-tuning (left). More details are provided in Appendix E.
Strategy
Object Detection
Trainable Params ↓ (M)
BD-Rate ↓
BD-mAP ↑
Independent
-63.224%
4.106
0.36
Shared (Ours)
-65.607 %
4.249
0.32
Table 5. Ablation study on the parameter sharing strategy.
Kernel Configurations
Object Detection
Trainable Params ↓ (M)
BD-Rate ↓
BD-mAP ↑
Baseline ( DW3 )
-61.302%
4.021
0.26
Larger Kernel ( DW5 )
-61.268%
4.032
0.26
Dual Scale ( DW1,3 )
-61.678%
4.045
0.26
Ours ( DW1,3,5 )
-61.977 %
4.062
0.27
Table 6. Ablation study on the Local Perception Mechanism.
Module
Object Detection
Trainable Params ↓ (M)
BD-Rate ↓
BD-mAP ↑
w/ window attention
-62.020%
4.084
0.31
Ours (Mamba-based)
-64.931 %
4.195
0.30
Table 7. Ablation study on the spatial modeling module.
Method
bpp
PSNR(dB)
MS-SSIM
Base codec
0.477
32.04
0.981
Ours w/o adapters
0.477
32.04
0.981
Table 8. Reconstruction quality on Imagenet-val. We report bitrate and reconstruction quality for different settings.
Method
KMACs/pixel
Latency(ms)
Params ↓ (M)
BD - Acc ↑
Enc
Dec
Enc
Dec
full ft
130.5
177.0
29.7
26.8
7.51
17.7
Ours-T
137.9
185.9
32.2
29.1
0.08
16.1
Ours-S
144.5
193.4
32.3
29.7
0.15
16.9
Ours-B
157.8
208.6
33.3
30.5
0.32
17.6
Table 9. We compare the complexity and performance of our method against the full fine-tuning baseline. The average encoding and decoding latencies are evaluated on an INTEL® XEON® SILVER 4310 CPU and an NVIDIA 4090 GPU.
Figure 6. Qualitative comparison of different methods for detection and segmentation. The figure displays (from top to bottom): the original and decoded images, their corresponding results.
Method
bpp
PSNR(dB)
MS-SSIM
Base codec
0.227
28.92
0.971
Ours w/o adapters
0.227
28.92
0.971
full ft
0.239
22.66
0.903
Ours w/ adapters
0.206
23.90
0.923
Adapt-ICMH ( Li et al., 2024 )
0.216
24.23
0.919
TransTIC ( Chen et al., 2023 )
0.176
26.64
0.948
Table 10. Reconstruction reference for the ImageNet-val dataset. We report bitrate and reconstruction quality for the base codec, the adapter-removed setting, and several machine-vision compression methods. Since these methods are optimized using task-oriented feature loss rather than MSE loss, the reported PSNR and MS-SSIM values are included only as reconstruction references, not for a full rate-distortion comparison.
Method
KMACs/pixel
Latency(ms)
Params ↓ (M)
BD - Acc ↑
Enc
Dec
Enc
Dec
full ft
130.5
177.0
29.7
26.8
7.51
17.7
Adapt-ICMH ( Li et al., 2024 )
145.2
191.7
31.4
28.5
0.29
16.9
TransTIC ( Chen et al., 2023 )
328.3
177.0
46.9
27.2
0.29
10.0
SVD-LoRA ( Park et al., 2025 )
130.5
177.0
30.0
26.9
0.09
7.9
Ours-T
137.9
185.9
32.2
29.1
0.08
16.1
Table 11. Complexity and performance comparison with full fine-tuning and representative PEFT baselines. Average encoding and decoding latencies are measured on an INTEL® XEON® SILVER 4310 CPU and an NVIDIA 4090 GPU.
Figure 7. Network architecture of ResNet50-FPN.
Figure 8. Overview of the proposed CrossMambaTuning (decoder stage). Efficient transfer is achieved by incorporating the proposed adapters into various pre-trained codecs. The snowflake symbol represents frozen layers, while the flame symbol represents trainable layers.
Strategy
Object Detection
Trainable Params ↓ (M)
BD-Rate ↓
BD-mAP ↑
Ours-T
-58.236%
3.742
0.08
Ours-T w/ TSPG
-58.453 %
3.749
0.09
Table 12. Ablation study on the TSPG in Tiny variant.
Classification
Detection
Segmentation
Optimizer
Adam
Adam
Adam
Batch size
16
8
8
Trade-off term λ
[2.5, 3.5, 5, 6.7, 13]
[0.5, 0.875, 1.75, 3]
[0.35, 0.5, 0.875, 1.75, 3]
Epochs
8
40
40
Learning rate schedule
-
-
-
Milestones
-
-
-
Table 13. Training hyperparamters for experiments.
Parameter-efficient fine-tuning of pre-trained codecs is a promising direction in image compression for human and machine vision. While most existing works have primarily focused on tuning the feature structure within the encoder-decoder backbones, the adaptation of the statistical semantics within the entropy model has received limited attention despite its function of predicting the probability distribution of latent features. Our analysis reveals that naive adapter insertion into the entropy model can lead to suboptimal outcomes, underscoring that the effectiveness of adapter-based tuning depends critically on the coordination between adapter type and placement across the compression pipeline. Therefore, we introduce Structure-Semantics Co-Tuning (S2-CoT), a novel framework that achieves this coordination via two specialized, synergistic adapters: the Structural Fidelity Adapter (SFA) and the Semantic Context Adapter (SCA). SFA is integrated into the encoder-decoder to preserve high-fidelity representations by dynamically fusing spatial and frequency information; meanwhile, the SCA adapts the entropy model to align with SFA-tuned features by refining the channel context for more efficient statistical coding. Through joint optimization, S2-CoT turns potential performance degradation into synergistic gains, achieving state-of-the-art results across four diverse base codecs with only a small fraction of trainable parameters, closely matching full fine-tuning performance. Code is available at https://github.com/Brock-bit4/S2-CoT.
While Mamba-based models have shown strong potential for long sequence modeling, adapting them to vision is challenging due to the requirement of local neighborhood correlations and multi-directional spatial contexts for visual understanding. In this paper, we present LiAuto-MindViT, a novel hybrid vision backbone that synergizes the strengths of CNNs, Mamba, and Transformers. The core of our design is the Adaptive Bidirectional Mamba (ABM), which eliminates the directional bias of unidirectional SSMs through bidirectional selective scanning with learnable alpha blending, enabling content-adaptive directional fusion without the overhead of exhaustive multi-path routing. To further accelerate inference, we propose a deployment-friendly Reparameterized ConvSE (RepConvSE) module that leverages structural reparameterization to reduce latency and memory access overhead. Extensive experiments demonstrate that LiAuto-MindViT achieves state-of-the-art performance on image classification, object detection, and semantic segmentation while enabling efficient inference through reparameterization.
Lifu Mu, Shuai Chen, Wen Zheng +7
Li Auto Inc. · University of Science and Technology of China
Traditional human vision-centric image compression methods are suboptimal for machine vision centric compression due to different visual properties and feature characteristics. To address this problem, we propose a Channel Importance-driven learned Image Coding for Machines (CI-ICM), aiming to maximize the performance of machine vision tasks at a given bitrate constraint. First, we propose a Channel Importance Generation (CIG) module to quantify channel importance in machine vision and develop a channel order loss to rank channels in descending order. Second, to properly allocate bitrate among feature channels, we propose a Feature Channel Grouping and Scaling (FCGS) module that non-uniformly groups the feature channels based on their importance and adjusts the dynamic range of each group. Based on FCGS, we further propose a Channel Importance-based Context (CI-CTX) module to allocate bits among feature groups and to preserve higher fidelity in critical channels. Third, to adapt to multiple machine tasks, we propose a Task-Specific Channel Adaptation (TSCA) module to adaptively enhance features for multiple downstream machine tasks. Experimental results on the COCO2017 dataset show that the proposed CI-ICM achieves BD-mAP@50:95 gains of 16.25% in object detection and 13.72% in instance segmentation over the established baseline codec. Ablation studies validate the effectiveness of each contribution, and computation complexity analysis reveals the practicability of the CI-ICM. This work establishes feature channel optimization for machine vision-centric compression, bridging the gap between image coding and machine perception.
Yun Zhang, Junle Liu, Huan Zhang +3
School of Electronics and Communication Engineering, Shenzhen Campus, Sun Yat-Sen University, Shenzhen 518107, China. · School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China. · School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China. +2