PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact
Organizations: Department of Computer Science and Engineering, University of Rajshahi, Rajshahi 6205, Bangladesh · University of Aizu, Aizuwakamatsu, Fukushima, Japan
Abstract
Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant evidence is often scattered across separate municipal and regulatory data sources. This paper presents PermitGPT, a unified generative artificial intelligence framework for converting unstructured construction permit descriptions into structured decision-support outputs across three domains: safety hazard identification, permit requirement specification, and community impact assessment. To address data fragmentation, we spatially and temporally align records from the New York City Department of Buildings, Occupational Safety and Health Administration, and NYC 311 service requests, producing 90,000 structured prompt-response pairs derived through rule-based alignment and domain-informed spot checking. We fine-tune three open-weight language models using parameter-efficient adaptation and evaluate them on 2,833 held-out test cases. The results show complementary model behavior: Gemma-3-1B provides the most efficient inference at 3.07 samples per second with low memory usage, Llama-3.2-3B gives the highest lexical overlap for regulatory-style outputs with a BLEU score of 0.0091, and 4-bit Mistral-7B-Instruct-v0.3 achieves the strongest semantic alignment with a BERTScore-F1 of 0.7747. Because the task involves open-ended structured generation, low BLEU values are interpreted alongside semantic metrics and qualitative output structure rather than as standalone indicators of utility. Overall, PermitGPT provides an initial step toward AI-assisted construction governance while identifying directions for stronger task-level evaluation and real-world validation.
Figures & tables
| Model | Split | BLEU | BERTScore | ROUGE-1 | METEOR |
|---|---|---|---|---|---|
| Gemma-3-1B | Train | 0.0025 | 0.7709 | 0.1166 | 0.0206 |
| Valid | 0.0026 | 0.7709 | 0.1164 | 0.0206 | |
| Test | 0.0024 | 0.7703 | 0.1154 | 0.0206 | |
| Llama-3.2-3B | Train | 0.0093 | 0.7747 | 0.1486 | 0.0376 |
| Valid | 0.0095 | 0.7749 | 0.1490 | 0.0378 | |
| Test | 0.0091 | 0.7742 | 0.1470 | 0.0379 |
| Input permit description: Interior renovation involving demolition, electrical rewiring, and temporary sidewalk obstruction. |
|---|
| Generated safety hazards: Possible demolition debris exposure, electrical hazards, trip hazards, and worker/public separation risks. |
| Generated permit requirements: Electrical permit review, demolition safety compliance, sidewalk obstruction approval, and site protection measures. |
| Generated community impact: Temporary pedestrian disruption, noise, dust, and possible access limitations near the worksite. |
| Aspect | Status in This Study |
|---|---|
| Model comparison | Three fine-tuned open-weight models are compared. |
| Zero-shot baseline | Not included in the current version. |
| Task-specific accuracy | Not separately computed for hazard, permit, and community-impact outputs. |
| Ablation study | Not conducted for individual data sources or pipeline components. |
| Qualitative output | A representative structured output example is provided. |
| Human review | Recommended for sensitive permitting and safety decisions. |
AI-Assisted Decision Making
AI-assisted decision making studies how computational systems can inform human choices while accounting for context, uncertainty, and consequences.
See all 139 papers