Developer Task Delegation to LLMs and the Trust Factor: A Mixed Methods Study
Organizations: Faculty of Information Technology, Monash University, Melbourne, Australia. · School of Computing and Information Systems, Singapore Management University, Singapore.
Abstract
With the rise of Large Language Models (LLMs), software developers are presented with a powerful new approach: delegating software development tasks to LLMs. Existing studies have explored task delegation for a subset of tasks and factors. Critically, what tasks developers delegate to LLMs, to what extent, and why they delegate them, is not yet well understood. We explore these questions through 22 interviews and a survey with 160 software practitioners. Developers reported employing four modes of task delegation to LLMs: full delegation, partial delegation, self-delegation, and task avoidance. Drawing on our qualitative findings, we discuss the rationales behind these choices and explore how task difficulty, task risk, developer motivation, and trust appear to be associated with software development task delegation to LLMs. Our statistical analysis reveals that trust is a significant factor associated with task delegation to LLMs. Finally, we share actionable implications for human-AI collaboration in software research, and for software practitioners to make the most of their newly found powers of delegation.
Figures & tables
| Hypothesis | Grounding |
| : Difficulty Delegation Mode | Higher perceived task difficulty decreases delegation to LLMs |
| : Risk Delegation Mode | Higher perceived risk of delegating a task reduces willingness to fully delegate |
| : Motivation Delegation Mode | Higher intrinsic motivation to perform a task oneself reduces delegation |
| : Trust Delegation Mode | Higher trust in LLM capability for a specific task increases willingness to delegate that task |
| Location | # of Participants | Role | # of Participants |
| Australasia | 10 | Software Eng. | 6 |
| North America | 5 | Software Dev. | 5 |
| Latin America | 4 | Data Analyst | 2 |
| Asia | 2 | AI Engineer | 1 |
| Europe | 1 | Others | 8 |
| Domain | # of Participants | Domain | # of Participants |
| Location | # of Participants | Role | # of Participants |
| Europe | 66 | Software Eng. | 49 |
| North America | 35 | Software Dev. | 49 |
| Asia | 23 | Web Dev. | 12 |
| Latin America | 20 | Frontend Dev. | 8 |
| Australasia | 8 | Cloud Eng. | 5 |
| Africa | 8 | Other | 37 |
| Factors | Stage 1 |
| (No Del. vs. Del.) | Stage 2 |
| (Partial vs. Full) | Empirical Finding |
| Difficulty ( ) | |
| Not Supported | |
| Risk ( ) |
AI-Assisted Software Development
AI-assisted software development uses language models and coding agents to help people design, write, test, review, and maintain software.
See all 109 papers