cs.HCMar 15, 2026

To LLM, or Not to LLM: How Designers and Developers Navigate LLMs as Tools or Teammates

Authors: Varad Vishwarupe, Ivan Flechais, Nigel Shadbolt, Marina Jirotka

Organizations: Department of Computer Science, University of Oxford, Oxford, United Kingdom

Abstract

Large language models (LLMs) are increasingly integrated into design and development workflows, yet decisions about their use are rarely binary or purely technical. We report findings from a constructivist grounded theory study based on interviews with 33 designers and developers across three large technology organisations. Rather than evaluating LLMs solely by capability, participants reasoned about the role an LLM could occupy within a workflow and how that role would interact with existing structures of responsibility and organisational accountability. When LLMs were framed as tools under clear human control, their use was typically acceptable and could be integrated within existing governance structures. When framed as teammates with shared or ambiguous agency, practitioners expressed hesitation, particularly when responsibility for outcomes could not be clearly justified. At the same time, participants also described productive teammate configurations in which LLMs supported collaborative reasoning while remaining embedded within explicit oversight structures. We identify tool and teammate framings as recurring ways in which designers and developers position LLMs relative to human work and present an analytic rubric describing how role framing shapes decision authority, accountability ownership, oversight strategies, and organisational acceptability. By foregrounding design-time reasoning, this work reframes To LLM or Not to LLM as a sociotechnical positioning problem that emerges during system design rather than during post-deployment evaluation.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study

    Feb 16, 2026Annalisa Szymanski, Oghenemaro Anuyah, Toby Jia-Jun Li +1LLM EvaluationHuman-in-the-Loop Evaluation

  2. Human and LLM Facilitation in Collaborative Design Meetings: A Computational Behavioral Comparison

    Oct 9, 2026Mohammed Azeez Khan, Aaron Dsouza, Ashutosh Mishra +3Human-AI CollaborationLanguage Model Generation Evaluation

  3. Using LLMs in Software Design: An Empirical Study of GitHub and A Practitioner Survey

    May 2, 2026Yifei Wang, Ruiyin Li, Peng Liang +5Software EngineeringHuman-AI Interaction