Real World Programming

Real-world programming research focuses on bridging the gap between the capabilities of large language models (LLMs) and the complexities of actual software development. Current efforts concentrate on creating more realistic benchmarks that assess LLMs across the entire software development lifecycle, encompassing tasks beyond simple code generation, and employing transformer-based models and ensemble learning techniques to improve accuracy and efficiency in identifying and resolving technical debt. These advancements aim to enhance the reliability and applicability of LLMs in practical coding scenarios, ultimately improving software development processes and reducing costs.

Papers