DrawScore: Evaluating Generated CAD Models against Engineering Drawings
Organizations: University of Electronic Science and Technology of China · De Artificial Intelligence Technology Co., Ltd · University of Hong Kong
Abstract
Automatic CAD generation is commonly evaluated with volumetric IoU, Chamfer Distance, and surface F-score, which barely penalize local errors that occupy only a small fraction of a part's volume or surface area, such as a misplaced hole or a slot on the wrong face, even though such errors are critical to manufacturing. We formalize these metrics in a unified integral form and show that the weight of a local error decays as the -th power of its size, where is the dimension of the integration domain and is determined by the penalty function. Guided by this analysis, we propose DrawScore, which projects both models into three orthographic views with visible and hidden lines, as in engineering drawings, and applies a saturating penalty along the projected curves, so that the weight of a local error decays only linearly. Controlled experiments confirm the predicted decay orders, and on outputs of existing CAD generation agents, DrawScore exposes errors in outputs that IoU rates as nearly perfect. DrawScore further improves generation as a reinforcement learning reward and, for CAD generation from engineering drawings, serves as a test-time verifier without 3D ground truth or an additional reward model. Our code is available at https://github.com/UESTC-Simon/DrawScore.
Figures & tables
| Metric | Integration domain | Penalty | Score | Decay order | Supports TTS |
|---|---|---|---|---|---|
| Volumetric IoU [ 20 ] | Solid ( ) | 3 | ✗ | ||
| Chamfer Distance [ 20 ] | Surface ( ) | 3 | ✗ | ||
| Surface F-score [ 24 ] | Surface ( ) | 2 | ✗ | ||
| Edge Chamfer Distance [ 4 ] | Model edges ( ) | 2 ∗ | ✗ | ||
| DrawScore (ours) | Projected curves ( ) | 1 | ✓ |
Generative AI Evaluation
Generative AI evaluation measures the quality, reliability, diversity, and real-world usefulness of generated outputs and AI-assisted workflows.
See all 335 papers