RePL: Pseudo-label Refinement for Semi-supervised LiDAR Semantic Segmentation
Organizations: GENGENAI, Republic of Korea · Dept. of CSE, POSTECH, Republic of Korea · Graduate School of AI, POSTECH, Republic of Korea
Abstract
Semi-supervised learning for LiDAR semantic segmentation often suffers from error propagation and confirmation bias caused by noisy pseudo-labels. To tackle this chronic issue, we introduce RePL, a novel framework that enhances pseudo-label quality by identifying and correcting potential errors in pseudo-labels through masked reconstruction, along with a dedicated training strategy. We also provide a theoretical analysis demonstrating the condition under which the pseudo-label refinement is beneficial, and empirically confirm that the condition is mild and clearly met by RePL. Extensive evaluations on the nuScenes-lidarseg and SemanticKITTI datasets show that RePL improves pseudo-label quality substantially, and in consequence, achieves the state of the art in semi-supervised LiDAR semantic segmentation.
Figures & tables
| Method | Backbone | nuScenes-lidarseg [ 6 ] | SemanticKITTI [ 1 ] | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1% | 10% | 20% | 50% | Avg. | 1% | 10% | 20% | 50% | Avg. | ||
| Sup-only | Cylinder3D | 50.9 | 65.9 | 66.6 | 71.2 | 63.7 | 45.4 | 56.1 | 57.8 | 58.7 | 54.5 |
| Seal [ 23 ] | MinkUNet | 45.8 | 63.0 | - | - | - | 46.6 | - | - | - | - |
| SuperFlow [ 40 ] | MinkUNet | 48.1 | 64.5 | - | - | - | 48.4 | - | - | - | - |
| SLidR [ 32 ] | Cylinder3D | 39.0 | 58.8 | - | - | - | 44.6 | - | - | - | - |
| Lim3D [ 20 ] | LiM3D | - | - | - | - | - | 58.4 | 59.5 | 63.1 | 63.6 | 61.2 |
| Class | % | IoU | Class | % | IoU | Class | % | IoU | Class | % | IoU |
|---|---|---|---|---|---|---|---|---|---|---|---|
| barrier | 1.10 | +3.45 | bus | 0.55 | +1.04 | const. veh. | 0.18 | +2.54 | motorcycle | 0.05 | +2.55 |
| bicycle | 0.02 | +2.68 | car | 4.42 | +1.60 | pedestrian | 0.27 | +6.47 | traffic cone | 0.09 | +7.86 |
| trailer | 0.58 | +0.60 | truck | 1.83 | +1.02 | driv. surf. | 37.6 | 1.47 | flat other | 1.02 | +2.60 |
| sidewalk | 8.31 | 2.40 | terrain | 8.34 | +4.14 | manmade | 21.1 | +4.41 | vegetation | 14.5 | +5.35 |
Semantic Segmentation
Semantic segmentation assigns a class label to every image pixel, enabling detailed scene understanding across domains and sensors.
See all 414 papers