cs.CEFeb 20, 2026

Context-Aware Mapping of 2D Drawing Annotations to 3D CAD Features Using LLM-Assisted Reasoning for Manufacturing Automation

Authors: Muhammad Tayyab Khan, Lequn Chen, Wenhe Feng, Seung Ki Moon

Organizations: Singapore Institute of Manufacturing Technology (SIMTech), A*STAR, Singapore 636732, Republic of Singapore · School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798 · Advanced Remanufacturing and Technology Centre (ARTC), A*STAR, Singapore 637143, Republic of Singapore

Abstract

Manufacturing automation in process planning, inspection planning, and digital-thread integration depends on a unified specification that binds the geometric features of a 3D CAD model to the geometric dimensioning and tolerancing (GD&T) callouts, datum definitions, and surface requirements carried by the corresponding 2D engineering drawing. Although Model-Based Definition (MBD) allows such specifications to be embedded directly in 3D models, 2D drawings remain the primary carrier of manufacturing intent in automotive, aerospace, shipbuilding, and heavy-machinery industries. Correctly linking drawing annotations to the corresponding 3D features is difficult because of contextual ambiguity, repeated feature patterns, and the need for transparent and traceable decisions. This paper presents a deterministic-first, context-aware framework that maps 2D drawing entities to 3D CAD features to produce a unified manufacturing specification. Drawing callouts are first semantically enriched and then scored against candidate features using an interpretable metric that combines type compatibility, tolerance-aware dimensional agreement, and conservative context consistency, along with engineering-domain heuristics. When deterministic scoring cannot resolve an ambiguity, the system escalates to multimodal and constrained large-language-model reasoning, followed by a single human-in-the-loop (HITL) review step. Experiments on 20 real CAD-drawing pairs achieve a mean precision of 83.67%, recall of 90.46%, and F1 score of 86.29%. An ablation study shows that each pipeline component contributes to overall accuracy, with the full system outperforming all reduced variants. By prioritizing deterministic rules, clear decision tracking, and retaining unresolved cases for human review, the framework provides a practical foundation for downstream manufacturing automation in real-world industrial environments.

Figures & tables

Explore similar work

CardsList
  1. Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings

    Aug 25, 2026Muhammad Tayyab Khan, Lequn Chen, Wenhe Feng +1ManufacturingMulti-Agent LLMs

  2. Drawing-Recode: Annotation Grounding for Parametric CAD Code Generation from Raster 2D CAD Drawings

    Jul 30, 2026Mingi Kim, Yongjun Kim, Hyungki KimCode GenerationParametric CAD Modeling

  3. Foundation Models for Automatic CAD Generation

    Jul 6, 2026J de Curtò, Victoria Guillén, I. de ZarzàParametric CAD ModelingLarge Vision-Language Models