cs.SEMar 26, 2026

Factors Influencing the Quality of AI-Generated Code: A Synthesis of Empirical Evidence

Authors: Vehid Geruslu, Zulfiyya Aliyeva, Eray Tüzün

Organizations: Queen’s University Belfast, Belfast, United Kingdom · Azerbaijan Technical University, Baku, Azerbaijan · MilliSoft MMC Corporation, Baku, Azerbaijan · Bilkent University, Ankara, Türkiye

Abstract

Context: The rapid adoption of AI-assisted code generation tools, such as large language models (LLMs), is transforming software development practices. While these tools promise significant productivity gains, concerns regarding the quality, reliability, and security of AI-generated code are increasingly reported in both academia and industry. --Objective: This study aims to systematically synthesize existing empirical evidence on the factors influencing the quality of AI-generated source code and to analyze how these factors impact software quality outcomes across different evaluation contexts. --Method: We conducted a systematic literature review (SLR) following established guidelines, supported by an AI-assisted workflow with human oversight. A total of 24 primary studies were selected through a structured search and screening process across major digital libraries. Data were extracted and analyzed using qualitative, pattern-based evidence synthesis. --Results: The findings reveal that code quality in AI-assisted development is influenced by a combination of human factors, AI system characteristics, and human AI interaction dynamics. Key influencing factors include prompt design, task specification, and developer expertise. The results also show variability in quality outcomes such as correctness, security, maintainability, and complexity across studies, with both improvements and risks reported. --Conclusion: AI-assisted code generation represents a socio-technical shift in software engineering, where achieving high-quality outcomes depends on both technological and human factors. While promising, AI-generated code requires careful validation and integration into development workflows.

Explore similar work

CardsList
  1. Characterizing the Quality Profile of AI-Generated C++ in Production

    Aug 6, 2026Michael Tran, Fred Lewis, Kun Yang +5Code GenerationCode Generation Evaluation

  2. Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code

    May 6, 2026Kaifeng He, Xiaojun Zhang, Peiliang Cai +7Training Data CurationCode Generation Evaluation

  3. What is the Difference Between Me and You? Benchmarking the Quality Gap Between Human-Written and AI-Generated Code

    Sep 11, 2026Cristina Improta, Pietro Liguori, Domenico CotroneoLLM SecurityCode Generation Evaluation