AT3D-AD: Anomaly Type-Aware 3D Anomaly Detection via Hierarchical Point-Language Alignment
Organizations: College of Computer Science and Software Engineering and the Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen 518060, China
Abstract
Detecting and localizing 3D point-cloud defects is essential for industrial inspection. However, existing methods often suffer from imprecise localization due to the lack of anomaly supervision and reliance on single-granularity representations. To address these limitations, we propose Anomaly Type-Aware 3D Anomaly Detection (AT3D-AD), a unified framework for joint detection, localization, and classification. Specifically, we first design the Physics-Driven Parametric Anomaly Synthesis (PDPAS) module employing multiple parametric functions to generate synthetic anomalies, providing explicit anomaly supervision. Then, we propose the Hierarchical Global-Local Anomaly Alignment (HiGLA) module to align global and local representations within the normal and anomalous groups. Finally, we propose the Semantic-Geometric Anomaly Classification (SGAC) module to jointly learn localization and classification, yielding spatially precise and type-discriminative anomaly representations. Extensive experiments establish new state-of-the-art performance on all four benchmarks. AT3D-AD achieves Object/Point AUROC scores of 98.1%/98.9% on Anomaly-ShapeNet and 95.0%/95.2% on Real3D-AD, while reaching 74.2% Macro-F1 for anomaly-type recognition on Real3D-AD.
Figures & tables
| Method | Venue | ashtray0 | bag0 | bottle0 | bottle1 | bottle3 | bowl0 | bowl1 | bowl2 | bowl3 | bowl4 | bowl5 | bucket0 | bucket1 | cap0 | cap3 | cap4 | cap5 | cup0 | cup1 | eraser0 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IMRNet | CVPR24 | 67.1 | 66.0 | 55.2 | 70.0 | 64.0 | 68.1 | 70.2 | 68.5 | 59.9 | 67.6 | 71.0 | 58.0 | 77.1 | 73.7 | 77.5 | 65.2 | 65.2 | 64.3 | 75.7 | 54.8 |
| GLFM | IEEE TASE25 | 52.8 | 53.7 | 49.5 | 69.9 | 74.5 | 53.1 | 54.3 | 61.0 | 79.4 | 75.1 | 72.0 | 51.2 | 66.2 | 62.1 | 56.4 | 81.2 | 64.2 | 56.4 | 63.4 | 55.7 |
| PLANE | ESWA25 | 90.5 | 91.4 | 84.3 | 81.4 | 99.4 | 96.3 | 90.7 | 95.6 | 70.6 | 89.3 | 80.0 | 98.1 | 96.8 | 94.4 | 95.4 | 73.0 | 87.0 | 80.5 | 70.5 | 100.0 |
| PO3AD | CVPR25 | 100.0 | 83.3 | 90.0 | 93.3 | 92.6 | 92.2 | 82.9 | 83.3 | 88.1 | 98.1 | 84.9 | 85.3 | 78.8 | 87.7 | 85.9 | 79.2 | 67.0 | 87.1 | 83.3 | 99.5 |
| MC3D-AD | IJCAI25 | 96.2 | 80.5 | 79.5 | 70.9 | 75.6 | 93.0 | 97.8 | 71.9 | 88.5 | 91.1 | 75.4 | 89.8 | 78.4 | 79.3 | 70.1 | 83.5 | 76.1 | 74.3 | 95.2 | 77.6 |
| Simple3D | AAAI26 | 99.5 | 88.1 | 97.6 | 95.1 | 100.0 | 100.0 | 83.0 | 71.1 | 91.1 | 73.0 | 86.3 | 95.9 | 79.0 | 85.2 | 86.7 | 91.2 | 80.4 | 100.0 | 82.4 | 100.0 |
| Method | Venue | airplane | candybar | car | chicken | diamond | duck | fish | gemstone | seahorse | shell | starfish | toffees | Mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GLFM | IEEE TASE25 | 54.6 | 71.5 | 84.2 | 68.8 | 71.2 | 94.5 | 69.5 | 68.8 | 92.4 | 73.3 | 74.8 | 76.3 | 75.0 |
| PLANE | ESWA25 | 63.0 | 77.4 | 83.3 | 69.3 | 99.8 | 83.9 | 93.9 | 89.1 | 54.0 | 86.6 | 60.1 | 71.6 | 77.7 |
| PO3AD | CVPR25 | 80.4 | 78.5 | 65.4 | 68.6 | 80.1 | 82.0 | 85.9 | 69.3 | 75.6 | 80.0 | 75.8 | 77.1 | 76.5 |
| MC3D-AD | IJCAI25 | 85.0 | 83.0 | 74.9 | 71.5 | 95.5 | 83.1 | 86.5 | 56.0 | 71.6 | 80.3 | 76.6 | 73.8 | 78.2 |
| Simple3D | AAAI26 | 76.5 | 65.1 | 98.1 | 82.6 | 100.0 | 77.8 | 91.2 | 70.4 | 93.0 | 51.4 | 69.6 | 88.8 | 80.4 |
| CASL | AAAI26 | 80.8 | 84.8 | 79.9 | 65.7 | 97.6 | 83.6 | 93.5 | 76.9 | 64.3 | 79.1 | 89.3 | 92.4 | 82.3 |
| Method | Venue | ashtray0 | bag0 | bottle0 | bottle1 | bottle3 | bowl0 | bowl1 | bowl2 | bowl3 | bowl4 | bowl5 | bucket0 | bucket1 | cap0 | cap3 | cap4 | cap5 | cup0 | cup1 | eraser0 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IMRNet | CVPR24 | 67.1 | 66.8 | 55.6 | 70.2 | 64.1 | 78.1 | 70.5 | 68.4 | 59.9 | 57.6 | 71.5 | 58.5 | 77.4 | 71.5 | 70.6 | 75.3 | 74.2 | 64.3 | 68.8 | 54.8 |
| GLFM | IEEE TASE25 | 74.1 | 75.4 | 80.9 | 70.7 | 83.3 | 83.0 | 62.0 | 73.8 | 87.7 | 59.7 | 58.2 | 60.9 | 69.4 | 97.6 | 89.1 | 92.6 | 87.2 | 73.1 | 55.9 | 60.9 |
| PLANE | ESWA25 | 73.4 | 90.4 | 83.3 | 90.0 | 94.9 | 81.0 | 87.4 | 83.4 | 88.0 | 85.3 | 79.3 | 85.5 | 94.7 | 90.4 | 95.1 | 89.4 | 84.4 | 83.4 | 84.7 | 96.7 |
| PO3AD | CVPR25 | 96.2 | 94.9 | 91.2 | 84.4 | 88.0 | 97.8 | 91.4 | 91.8 | 93.5 | 96.7 | 94.1 | 75.5 | 89.9 | 95.7 | 94.8 | 94.0 | 86.4 | 90.9 | 93.2 | 97.4 |
| MC3D-AD | IJCAI25 | 80.7 | 85.7 | 90.2 | 86.7 | 90.2 | 77.5 | 56.2 | 59.7 | 77.9 | 67.0 | 56.2 | 90.2 | 86.8 | 85.4 | 90.3 | 85.8 | 88.2 | 76.3 | 69.4 | 82.0 |
| Simple3D | AAAI26 | 92.0 | 95.4 | 97.4 | 72.8 | 83.8 | 98.8 | 95.1 | 93.3 | 99.3 | 92.9 | 97.9 | 72.5 | 92.1 | 98.8 | 96.4 | 97.9 | 96.4 | 97.9 | 93.7 | 97.0 |
| MiniShift | MulSen-AD | |||
|---|---|---|---|---|
| Method | Object AUROC | Point AUROC | Object AUROC | Point AUROC |
| R3D-AD | 68.7 | 54.9 | 80.6 | 56.6 |
| Reg3D-AD | 51.6 | 52.0 | 77.0 | 60.3 |
| GLFM | 55.8 | 58.7 | 78.5 | 66.5 |
| MC3D-AD | 60.2 | 65.2 | 77.3 | 74.2 |
| Simple3D | 68.6 | 66.2 | 88.2 | 80.3 |
| Method | Anomaly-ShapeNet | Real3D-AD | ||
|---|---|---|---|---|
| Accuracy | Macro-F1 | Accuracy | Macro-F1 | |
| MLP | 51.3 | 47.3 | 67.5 | 63.3 |
| PointNet | 50.1 | 46.6 | 68.1 | 64.9 |
| PointNet++ | 50.1 | 46.2 | 64.2 | 61.0 |
| DGCNN | 50.6 | 47.6 | 64.9 | 61.7 |
| Semantic-only | 59.7 | 57.3 | 70.8 | 66.6 |
| Synth. | G | L | L2G | SGAC | O-AUROC | P-AUROC | P-AUPRO |
|---|---|---|---|---|---|---|---|
| None | – | – | – | – | 65.96 | 71.11 | 38.75 |
| PO3AD | ✓ | ✓ | ✓ | – | 72.74 | 88.67 | 68.86 |
| PDPAS | ✓ | – | – | – | 87.85 | 85.83 | 66.22 |
| PDPAS | ✓ | ✓ | – | – | 89.77 | 92.84 | 85.74 |
| PDPAS | ✓ | ✓ | ✓ | – | 91.04 | 92.84 | 85.74 |
| PDPAS | ✓ | ✓ | ✓ | ✓ | 91.94 | 94.07 | 87.21 |