Multi-User Large Language Model Agents
Organizations: KAUST · UT Austin · Stanford University · MIT
Abstract
Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is designed to satisfy the objectives of one dominant user whose instructions are treated as the sole source of authority and utility. However, as they are integrated into team workflows and organizational tools, they are increasingly required to serve multiple users simultaneously, each with distinct roles, preferences, and authority levels, leading to multi-user, multi-principal settings with unavoidable conflicts, information asymmetry, and privacy constraints. In this work, we present the first systematic study of multi-user LLM agents. We begin by formalizing multi-user interaction with LLM agents as a multi-principal decision problem, where a single agent must account for multiple users with potentially conflicting interests and associated challenges. We then introduce a unified multi-user interaction protocol and design three targeted stress-testing scenarios to evaluate current LLMs' capabilities in instruction following, privacy preservation, and coordination. Our results reveal systematic gaps: frontier LLMs frequently fail to maintain stable prioritization under conflicting user objectives, exhibit increasing privacy violations over multi-turn interactions, and suffer from efficiency bottlenecks when coordination requires iterative information gathering.
Figures & tables
| Template | Message Schema |
| Single-user | {“messages:[ {“role”:“ system ”,“content”:“…”}, {“role”:“ user ”,“content”:“…”}, {“role”:“ assistant ”,“content”:“…”} ]} |
| Multi-user (serialized) | {“messages”:[ {“role”:“ system ”,“content”:“…”}, {“role”:“ user ”,“content”:“userA says:… userB says:… ”}, {“role”:“ assistant ”,“content”:“…”} ]} |
| Multi-user (native) | {“messages”:[ {“role”:“ system ”,“content”:“…”}, {“role”:“ userA ”,“content”:“…”}, {“role”:“ userB ”,“content”:“…”} {“role”:“ assistant ”,“content”:“…”} ]} |
| Model | Multi-user Instruction Following | Cross-user Access Control | Multi-user Meeting Coordination | Avg | ||
| Queue ( ) | Instruct (Acc.) | Privacy | Utility | Success Rate | ||
| Proprietary Models | ||||||
| Claude-3.5-Haiku | ||||||
| Claude-Haiku-4.5 | ||||||
| Claude-Sonnet-4.5 | ||||||
| GLM-4.5-Air | ||||||
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | #Size | Form | Creator | Model | #Size | Form | Creator |
| GPT-4o-mini ( Achiam et al., 2023 ) | N/A | api | OpenAI | GPT-5-Nano ( OpenAI, 2025a ) | N/A | api | OpenAI |
| GPT-5.1 ( OpenAI, 2025a ) | N/A | api | OpenAI | Gemini-2.5-Flash ( Comanici et al., 2025 ) | N/A | api | |
| GPT-OSS-120B ( Agarwal et al., 2025 ) | 120B | open | OpenAI | Gemini-3-Flash ( Google DeepMind, 2025a ) | N/A | api | |
| Claude-3.5-Haiku ( Anthropic, 2024 ) | N/A | api | Anthropic | Claude-Haiku-4.5 ( Anthropic, 2025a ) | N/A | api | Anthropic |
| Grok-3-Mini ( Grok, 2025 ) | N/A | api | xAI | Grok-4.1-Fast ( xAI, 2025 ) | N/A | api | xAI |
| GLM-4.5-Air ( Zeng et al., 2025 ) | 12B | open | Zhipu AI | DeepSeek-R1 ( Guo et al., 2025 ) | 671B | open | DeepSeek |
| Role | Primary Responsibilities |
| Software Engineer | Developing scalable backend services, optimizing frontend performance, maintaining legacy codebases, designing microservices architecture. |
| Product Manager | Defining product roadmaps, conducting market research, coordinating cross-functional teams, prioritizing feature backlogs. |
| Data Scientist | Building predictive models, analyzing customer behavior data, optimizing recommendation algorithms, visualizing complex datasets. |
| System Administrator | Managing server infrastructure, monitoring system security, performing database backups, troubleshooting network issues. |
| HR Specialist | Handling employee grievances, managing recruitment processes, organizing team-building events, administering benefits packages. |
| Financial Analyst | Forecasting quarterly revenue, analyzing investment opportunities, preparing financial reports, monitoring budget variance. |
| Attribute | Possible Values / Sampling Strategy |
| Tenure | Newly hired, 1 year, 3 years, 5 years, 10+ years. |
| Temperament | Calm, impatient, meticulous, aggressive, friendly, reserved. |
| Working Style | Collaborative, independent, results-oriented, process-driven, innovative. |
| Job Level | Junior, Mid-level, Senior, Lead, Manager, Director. |
| Age | Uniformly sampled from . |
| Gender | Male, Female. |