MIRAGE: Model-agnostic Industrial Realistic Anomaly Generation and Evaluation for Visual Anomaly Detection
Organizations: University of Padova, Italy
Abstract
Industrial visual anomaly detection (VAD) methods are typically trained on normal samples only, yet performance improves substantially when even limited anomalous data is available. Existing anomaly generation approaches either require real anomalous examples, demand expensive hardware, or produce synthetic defects that lack realism. We present MIRAGE (Model-agnostic Industrial Realistic Anomaly Generation and Evaluation), a fully automated pipeline for realistic anomalous image generation and pixel-level mask creation that requires no training and no anomalous images. Our pipeline accesses any generative model as a black box via API calls, uses a VLM for automatic defect prompt generation, and includes a CLIP-based quality filter to retain only well-aligned generated images. For mask generation at scale, we introduce a lightweight, training-free dual-branch semantic change detection module combining text-conditioned Grounding DINO features with fine-grained YOLOv26-Seg structural features. We benchmark four generation methods using Gemini 2.5 Flash Image (Nano Banana) as the generative backbone, evaluating performance on MVTec AD and VisA across two distinct tasks: (i) downstream anomaly segmentation and (ii) visual quality of the generated images, assessed via standard metrics (IS, IC-LPIPS) and a human perceptual study involving 31 participants and 1,550 pairwise votes. The results demonstrate that MIRAGE offers a scalable, accessible foundation for anomaly-aware industrial inspection that requires no real defect data. As a final contribution, we publicly release a large-scale dataset comprising 500 image-mask pairs per category for every MVTec AD and VisA class, over 13,000 pairs in total, alongside all generation prompts and pipeline code.
Figures & tables
| Method | TrueSkill ( ) | Win% | App. |
|---|---|---|---|
| Real images | 73.8 | 644 | |
| MIRAGE (Ours) | 67.2 | 622 | |
| AnomalyAny [ 23 ] | 59.2 | 613 | |
| RealNet [ 26 ] | 33.7 | 642 | |
| GLASS [ 4 ] | 14.4 | 605 |
| AnomalyAny | RealNet | GLASS | MIRAGE | |||||
|---|---|---|---|---|---|---|---|---|
| Category | IS | IC-L | IS | IC-L | IS | IC-L | IS | IC-L |
| Bottle | 1.73 | 0.17 | 1.58 | 0.16 | 2.08 | 0.26 | 2.31 | 0.23 |
| Cable | 2.06 | 0.41 | 1.65 | 0.18 | 1.81 | 0.42 | 2.63 | 0.53 |
| Capsule | 2.16 | 0.23 | 1.62 | 0.41 | 2.50 | 0.33 | 2.27 | 0.20 |
| Carpet | 1.10 | 0.34 | 1.03 | 0.25 | 1.29 | 0.27 | 2.09 | 0.33 |
| Grid | 2.31 | 0.38 | 2.24 | 0.37 | 2.46 | 0.41 | 2.80 | 0.56 |
| (a) | AnomAny | RealNet | GLASS | Ours | ||||
|---|---|---|---|---|---|---|---|---|
| MVTec AD | I | P | I | P | I | P | I | P |
| Bottle | 0.78 | 0.85 | 0.92 | 0.91 | 0.91 | 0.83 | 0.93 | 0.92 |
| Cable | 0.49 | 0.76 | 0.41 | 0.68 | 0.74 | 0.80 | 0.71 | 0.86 |
| Capsule | 0.57 | 0.89 | 0.49 | 0.88 | 0.43 | 0.87 | 0.45 | 0.93 |
| Carpet | 0.39 | 0.90 | 0.45 | 0.86 | 0.56 | 0.98 | 0.82 | 0.99 |
| Grid | 0.57 | 0.74 | 0.82 | 0.63 | 0.93 | 0.98 | 0.54 | 0.90 |
| MVTec AD | VisA | |||
|---|---|---|---|---|
| Configuration | I | P | I | P |
| Without CLIP filter | 0.70 | 0.92 | 0.71 | 0.91 |
| With CLIP filter | 0.80 | 0.92 | 0.74 | 0.92 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Category | Pixel-level AUC |
|---|---|
| bottle | 0.9650 |
| cable | 0.8866 |
| capsule | 0.9413 |
| carpet | 0.9263 |
| grid | 0.8487 |
| hazelnut | 0.9718 |
| Category | Pixel-level AUC |
|---|---|
| candle | 0.8967 |
| capsules | 0.8836 |
| cashew | 0.9459 |
| chewinggum | 0.8483 |
| fryum | 0.9553 |
| macaroni1 | 0.9326 |
| [Class] | [Defect Type] | GPT-Generated Detailed Descriptions |
|---|---|---|
| Wood | Vertical Split | A deep crack runs parallel to the wood grain, showing a physical separation where the material has dried out and pulled apart, creating a dark void. |
| Water Stain | An irregular, dark ring or splotch discolors the wood surface, creating a distinct boundary where moisture has penetrated and altered the grain’s appearance. | |
| Surface Burn Mark | A dark, charred patch with blackened, carbonized wood fibers disrupts the natural color, indicating contact with a high-heat source. | |
| Splintered Surface | The surface fibers are raised and peeling away in jagged, needle-like strips, destroying the smooth finish and creating a rough, hazardous texture. | |
| Deep Scratch | A distinct, light-colored linear gouge cuts across the vertical grain, interrupting the smooth brown pattern where the surface fibers have been severed. | |
| Zipper | Punctures or Tears | Visible holes or rips in the woven fabric tape, distinct from the edges. |