Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System
Organizations: University of Applied Sciences Kempten, Germany
Abstract
Large language models (LLMs) are increasingly embedded as components in software systems, marketed under labels such as chatbot, copilot, retrieval-augmented generation, workflow, coding agent and AI agent. Whether these labels denote genuine architectural forms or serve as branding has not been assessed systematically. In the sources surveyed, labels do carry architectural content, most clearly in vendor usage: copilot denotes a router-worker architecture operating a host application under step-by-step user confirmation, while the more recent shift to the label agent coincides with AI-planned multi-step execution of which the user sees only the outcome. The coding agents of four major providers share one architecture, a reason-and-act loop delegating to subagents. This survey describes seven recurring forms---LLM chats, custom agents, retrieval-augmented generation (RAG), AI-enhanced workflows, copilots, coding agents, and, in part, agentic RAG---in a common vocabulary of agents and tools. Each is characterized along four structural dimensions (agentic RAG only partially): the architectural pattern, the control of execution and the point of user intervention, the number of agent calls per task, and tool use. An illustrative corpus of 22 systems from research publications and vendor documentation grounds the descriptions and shows where they reach their limit.
Figures & tables
| System | RW a | Cont b | Host c | Mono d |
| Excel Copilot, Microsoft 365 Copilot [ 46 , 47 ] | ✓ | ✓ | ✓ | |
| Dynamics 365 Copilot [ 48 ] | ? | ? | ✓ | ✓ |
| SAP Joule, procurement [ 49 ] | ✓ | ✓ | ✓ | ✓ |
| Salesforce Einstein Copilot [ 50 ] | ✓ | ? | ✓ | ✓ |
| Siemens Industrial Copilots [ 51 ] | ✓ | ✓ | ✓ | |
| GitHub Copilot [ 52 ] | ✓ | ✓ |
| Form or System | Architecture a | User control | Agent calls per task b | Tool use | Sources |
| LLM chats c | multifunctional single agent | each answer | one | few | [ 19 , 20 ] |
| Custom agents | monofunctional single agent | each answer | one | at most one | [ 21 , 22 , 23 ] |
| Agentic RAG | ? | each answer | ? | retrieval tools | [ 28 , 32 , 29 ] |
| RAG, narrow | monofunctional single agent | each answer | one | none | [ 25 ] |
| AI-enhanced workflows | workflow | optional checkpoints | fixed (process) | fixed (process) | [ 37 , 38 , 39 , 40 , 41 ] |
| Copilots | router-worker | each action result | two | host functions | [ 47 , 48 , 49 , 50 , 51 , 52 ] |
Explore similar work
Characterizing Large Language Model Agentic Workflows: A Study on N8n Ecosystem
Critique of Agent Model
coding agents'', AI co-scientists'', and other agentic" tools that promise to drive up productivity, and at the same time, existential" concerns such as AI escaping human control with destructive power under a speculative machine agency" against humans, it has become essential to clarify where automation ends and agency begins, both for building capable systems and for understanding whether and what to fear. Drawing on Descartes' grounding of agency in independent thought, and on portrayals of autonomous beings in science fiction, we survey the current landscape of AI agents, and analyze agent architectures along five dimensions: goal, identity, decision-making, self-regulation, and learning. Specifically, we argue that genuine agency requires these structures to be \emph{internalized within the system itself} rather than assembled through external scaffolding. This distinction between \emph{agentic} systems, whose competence resides in engineered workflows, and \emph{agentive} systems, whose capabilities (including social interaction) arise endogenously, defines the boundary between systems designed for prescribed tasks, and those capable of operating in the open world with true autonomy. Building on this analysis, we propose the Goal-Identity-Configurator (GIC) architecture for a general-purpose agent model, combining hierarchical goal decomposition, identity evolution, simulative reasoning grounded in a separately trained world model, learned self-regulation, and self-directed learning from both real and simulated experience. Furthermore, we share insight on the auditability, controllability, and safety of agentive systems that possess greater autonomy and agency", but remain under human oversight.