MedQ-UNI: Toward Unified Medical Image Quality Assessment and Restoration via Vision-Language Modeling
Organizations: Fudan University, Shanghai, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China
Abstract
Existing medical image restoration (Med-IR) methods are typically modality-specific or degradation-specific, failing to generalize across the heterogeneous degradations encountered in clinical practice. We argue this limitation stems from the isolation of Med-IR from medical image quality assessment (Med-IQA), as restoration models without explicit quality understanding struggle to adapt to diverse degradation types across modalities. To address these challenges, we propose MedQ-UNI, a unified vision-language model that follows an assess-then-restore paradigm, explicitly leveraging Med-IQA to guide Med-IR across arbitrary modalities and degradation types. MedQ-UNI adopts a multimodal autoregressive dual-expert architecture with shared attention: a quality assessment expert first identifies degradation issues through structured natural language descriptions, and a restoration expert then conditions on these descriptions to perform targeted image restoration. To support this paradigm, we construct a large-scale dataset of approximately 50K paired samples spanning three imaging modalities and five restoration tasks, each annotated with structured quality descriptions for joint Med-IQA and Med-IR training, along with a 2K-sample benchmark for evaluation. Extensive experiments demonstrate that a single MedQ-UNI model, without any task-specific adaptation, achieves state-of-the-art restoration performance across all tasks while generating superior descriptions, confirming that explicit quality understanding meaningfully improves restoration fidelity and interpretability.
Figures & tables
| CT Denoising | MRI Restoration | PET Denoising | ||||
|---|---|---|---|---|---|---|
| Method | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM |
| UniMedVL [ 23 ] | 29.82 5.12 | 0.861 0.074 | 25.93 3.10 | 0.831 0.058 | 31.65 7.05 | 0.932 0.039 |
| Pix2Pix [ 14 ] | 32.23 4.52 | 0.896 0.061 | 27.85 2.83 | 0.863 0.050 | 34.02 6.57 | 0.953 0.032 |
| Restore-RWKV [ 30 ] | 33.61 4.20 | 0.918 0.055 | 28.96 2.68 | 0.884 0.046 | 34.73 6.31 | 0.959 0.030 |
| AMIR [ 9 ] | 33.70 3.76 | 0.921 0.063 | 28.62 2.71 | 0.878 0.044 | 35.08 6.24 | 0.963 0.029 |
| MPerceiver [ 3 ] | 33.85 4.03 | 0.916 0.058 | 28.47 2.75 | 0.881 0.045 | 35.21 6.18 | 0.960 0.031 |
| Method | Comp. | Prec. | Cons. | Qual. | Overall | Method | Comp. | Prec. | Cons. | Qual. | Overall |
|---|---|---|---|---|---|---|---|---|---|---|---|
| BiMediX2-8B [ 21 ] | 0.458 | 0.434 | 0.229 | 0.740 | 1.861 | InternVL3-38B [ 7 ] | 1.174 | 0.909 | 1.489 | 1.456 | 5.028 |
| MedGemma-27B [ 24 ] | 0.904 | 0.519 | 1.289 | 1.395 | 4.107 | InternVL3-8B [ 7 ] | 1.130 | 0.968 | 1.487 | 1.456 | 5.041 |
| Lingshu-32B [ 28 ] | 0.760 | 0.769 | 1.497 | 1.170 | 4.196 | Grok-4 [ 27 ] | 1.196 | 0.933 | 1.470 | 1.535 | 5.134 |
| Qwen2.5-VL-7B [ 25 ] | 0.871 | 0.739 | 1.485 | 1.246 | 4.341 | Gemini-2.5-Pro [ 11 ] | 1.069 | 0.982 | 1.378 | 1.725 | 5.154 |
| Claude-4-Sonnet [ 4 ] | 0.904 | 0.698 | 1.451 | 1.521 | 4.574 | Qwen2.5-VL-32B [ 25 ] | 1.276 | 1.023 | 1.500 | 1.426 | 5.225 |
| Mistral-Medium-3 [ 15 ] | 1.124 | 0.804 | 1.278 | 1.480 | 4.686 | GPT-4o [ 1 ] | 1.229 | 1.132 | 1.492 | 1.555 | 5.408 |
| CT Denoising | MRI Restoration | PET Denoising | ||||
| Variant | PSNR | SSIM | PSNR | SSIM | PSNR | SSIM |
| Loss design | ||||||
| w/o pixel + SSIM loss | 36.04 4.18 | 0.919 0.055 | 29.67 2.63 | 0.889 0.046 | 36.12 6.44 | 0.964 0.031 |
| IQA conditioning | ||||||
| w/o IQA description | 35.47 4.22 | 0.921 0.054 | 29.18 2.66 | 0.890 0.045 | 35.62 6.50 | 0.963 0.030 |
| Quality description quality | ||||||