RBA: A Read-out Basis Adapter for Parameter-Efficient Interactive OCTA Vessel Segmentation with SEEM
Organizations: School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran
Abstract
Retinal disease monitoring with optical coherence tomography angiography (OCTA) relies on segmentation of vessels and the foveal avascular zone (FAZ). Promptable models such as SEEM (Segment Everything Everywhere All at Once) allow click-based refinement, but without adaptation SEEM segments thin vessels poorly and needs many clicks. Fully fine-tuning its 342 million parameters on a few hundred images is costly and risks overfitting, and parameter-efficient methods such as low-rank adaptation (LoRA) usually adapt only the encoder. Yet SEEM reads every candidate mask from one feature map at quarter resolution, too coarse for vessels one to three pixels wide. This study introduces the Read-out Basis Adapter (RBA), whose read-out branch generates 32 image-specific basis maps at half resolution. Each candidate accesses them through its own vector and a zero-initialised projection, so the model starts exactly as SEEM. The encoder branch, a standard rank-1 LoRA, supplies the information needed to tell arteries from veins. RBA adds 0.47 million trainable parameters. Under simulated error-driven clicks, with the ground truth used only to place them, RBA outperforms LoRA, Conv-LoRA andAdaptFormer on OCTA-500 3mmlarge vessels. Averaged over three seeds, it reaches an intersection over union (IoU) of 85.16% and a Dice score of 91.93%, 2.90 and 1.72 percentage points above Conv-LoRA. On the 6 mm subset, one run gives margins of 4.35 and 2.76 points. The gain extends to arteries, veins and ROSE-O but not to the FAZ. In SEEM, adaptation capacity pays more at the mask read-out than in the encoder.
Figures & tables
| Method | Enc. | Read-out | Params | Dice@4 | clDice | SE | SP | NoC@90 | RBA row [95% CI] | RBA better |
| No adapter | – | – | 0 | 75.83 | 80.44 | 80.05 | 97.79 | 20.00 | – | – |
| LoRA | ✓ | – | 0.27 M | 89.47 | 92.34 | 90.27 | 99.18 | 11.80 | [ , ] | 50/50 |
| LoRA | ✓ | – | 4.33 M | 90.13 0.04 | 92.80 0.02 | 90.79 0.14 | 99.24 0.02 | 7.37 0.53 | [ , ] | 50/50 |
| Conv-LoRA | ✓ | – | 4.35 M | 90.22 0.02 | 92.90 0.02 | 90.96 0.12 | 99.24 0.01 | 6.68 0.38 | [ , ] | 50/50 |
| AdaptFormer | ✓ | – | 0.45 M | 89.52 | 92.53 | 90.68 | 99.15 | 11.18 | [ , ] | 50/50 |
| Read-out only (ours) | – | ✓ | 0.20 M | 90.56 | 92.15 | 93.27 | 99.10 | 5.64 | [ , ] | 50/50 |
| Decoder trained | SEEM frozen | ||||
| Adapter | Trained | Dice@4 | Trained | Dice@4 | Change |
| LoRA | 40.65 | 89.47 | 0.84 | 89.44 | |
| Conv-LoRA | 44.73 | 90.23 | 4.91 | 90.26 | |
| RBA | 40.85 | 91.95 | 1.04 | 91.94 | |
| RBA, click prompt off | – | – | 0.47 | 91.75 | – |
| Dice@4 | ||||||||
| Dataset | Target | RBA | Conv-LoRA | [95% CI] | Better | clDice R / C | NoC@90 R / C | |
| OCTA-500 3 mm | Large vessels ‡ | 91.93 | 90.22 | [ , ] | 50/50 | 93.88 / 92.90 | 3.03 / 6.68 | |
| Veins | 90.49 | 88.87 | [ , ] | 45/50 | 92.78 / 92.28 | 6.72 / 13.54 | ||
| Arteries | 91.26 | 89.69 | [ , ] | 48/50 | 93.17 / 92.39 | 4.48 / 10.48 | ||
| FAZ | 97.52 | 97.86 | [ , ] | 25/50 | 0.59 | – | 1.00 / 1.00 | |
| OCTA-500 6 mm | Large vessels | 88.67 | 85.91 | [ , ] | 50/50 | 91.08 / 89.44 | 13.40 / 20.00 | |
| Dice | IoU | ACC | SE | SP | |||||||
| Dataset | Target | C | R | C | R | C | R | C | R | C | R |
| OCTA-500 3 mm | Large vessels ‡ | 90.22 | 91.93 | 82.26 | 85.16 | 98.69 | 98.92 | 90.96 | 92.52 | 99.24 | 99.38 |
| Veins | 88.87 | 90.49 | 80.03 | 82.69 | 99.35 | 99.44 | 90.36 | 91.24 | 99.62 | 99.69 | |
| Arteries | 89.69 | 91.26 | 81.39 | 84.00 | 99.23 | 99.35 | 90.52 | 92.02 | 99.57 | 99.63 | |
| FAZ | 97.86 | 97.52 | 95.88 | 95.32 | 99.84 | 99.80 | 98.58 | 98.89 | 99.89 | 99.83 | |
| OCTA-500 6 mm | Large vessels | 85.91 | 88.67 | 75.39 | 79.74 | 97.25 | 97.82 | 88.45 | 89.70 | 98.18 | 98.68 |
| Large vessels | Arteries | Veins | FAZ | ||||||
| Method | Setting | 3 mm | 6 mm | 3 mm | 6 mm | 3 mm | 6 mm | 3 mm | 6 mm |
| U-Net [ 37 ] | Automatic, six projections | 92.04 | 89.11 | 89.58 | 87.27 | 87.99 | 86.90 | 96.48 | 87.55 |
| Attention U-Net [ 35 ] | Automatic, six projections | 91.91 | 89.26 | 90.14 | 87.35 | 88.07 | 87.03 | 97.76 | 86.73 |
| IPN-V2 [ 26 ] | Automatic, OCTA volume | 92.32 | 89.17 | 90.78 | 87.27 | 89.71 | 87.30 | 97.68 | 90.12 |
| IPN V2+ [ 27 ] | Automatic | 92.74 | 89.41 | – | – | – | – | 97.55 | 90.84 |
| FARGO [ 36 ] | Automatic | 91.68 | 89.15 | – | – | – | – | 98.39 | 92.72 |
| Method | Type | Vessels | FAZ |
| U-Net [ 37 ] | Single-task | 70.32 | 93.82 |
| OCTA-Net [ 32 ] | Single-task | 75.83 | 94.64 |
| UTNet [ 13 ] | Single-task | 75.08 | 94.47 |
| FARGO [ 36 ] | Multi-task | 74.59 | 94.42 |
| MTI-Net [ 43 ] | Multi-task | 75.34 | 94.77 |
| VAFF-Net [ 14 ] | Multi-task | 76.58 | 95.19 |
| Encoder branch | Read-out branch | Params (M) | Large vessels | Veins |
| – | – | 0 | 75.83 | 50.98 |
| ✓ | – | 0.27 | 89.47 | 87.98 |
| – | ✓ | 0.20 | 90.56 | 71.32 |
| ✓ | ✓ | 0.47 | 91.95 | 90.49 |
| Read-out added to encoder | ||||
| Encoder added to read-out | ||||
| Row | Dice@4 | Found | Art. as vein | FP on art. |
| No adapter | 50.98 | 64.5 | 41.3 | 59.8 |
| Read-out only | 71.32 | 85.7 | 30.4 | 69.5 |
| LoRA | 87.98 | 89.6 | 2.1 | 9.4 |
| Conv-LoRA | 88.87 | 90.3 | 1.8 | 7.4 |
| Conv-LoRA + read-out | 89.68 | 93.0 | 2.4 | 12.1 |
| RBA (ours) | 90.49 | 91.2 | 2.3 | 15.1 |
| Row | Dice@4 | Recall, thin | Recall, mid | Recall, thick | Edge error | Centre-line recall | Distant FP |
| No adapter | 75.83 | 52.5 | 88.7 | 94.9 | 24.8 | 76.8 | 18.5 |
| LoRA | 89.47 | 77.6 | 94.3 | 97.2 | 11.7 | 90.3 | 9.4 |
| Conv-LoRA | 90.23 | 79.5 | 94.5 | 97.4 | 10.8 | 91.2 | 11.0 |
| Read-out only | 90.56 | 85.8 | 95.6 | 97.5 | 9.0 | 94.1 | 29.3 |
| Conv-LoRA + read-out | 91.82 | 84.2 | 95.1 | 97.7 | 8.6 | 93.5 | 17.8 |
| RBA (ours) | 91.95 | 84.0 | 94.9 | 97.4 | 8.4 | 93.5 | 19.2 |
| Method | Trained (M) | Memory (GB) | Encoder (ms) | Click (ms) | Image (ms) |
| No adapter | 40.38 | 1.70 | 92 | 74.6 | 390 |
| LoRA | 40.65 | 1.70 | 103 | 72.3 | 393 |
| LoRA | 44.71 | 1.71 | 105 | 72.3 | 394 |
| Conv-LoRA | 44.73 | 1.71 | 111 | 72.2 | 400 |
| AdaptFormer | 40.83 | 1.70 | 94 | 71.6 | 381 |
| Read-out only | 40.58 | 1.78 | 99 | 72.3 | 389 |
Interactive Medical Image Segmentation
Interactive medical image segmentation uses clinician prompts and iterative model feedback to refine anatomical masks and reduce manual annotation effort.
See all 52 papers