Overview

User simulation studies how to represent people’s goals, preferences, knowledge, and behavior in interactions with AI agents, from tutoring and shopping to healthcare and web use. Common approaches include persona prompting, models grounded in real interaction logs, explicit cognitive or behavioral profiles, and learned simulators trained with supervised or reinforcement learning. Researchers evaluate these simulators against human behavior using measures of conversational and decision fidelity, behavioral diversity, long-term trajectories, and effects on agent performance. A central challenge is closing the sim-to-real gap: fluent or population-level outputs can still misrepresent individuals, omit difficult behaviors, or bias evaluations through overly cooperative simulated users.

Latest papers

CardsList

142 papers16 papers in the last four weeks, down 38% on the four weeks before. 0.1% of all new papers.

  1. SimAI: Mechanistic User Simulation through Psychological Network Models

    Nov 16, 2026Cheng Li, Adhyyan Narang, Jiayi Yuan +6User SimulationHuman Behavior Modeling

  2. SWE-WhatIf: Simulating Real Users of Coding Agents from Recorded Session

    Nov 16, 2026Tae Soo Kim, Tongshuang Wu, Juho KimUser SimulationAutomated Agent Evaluation

  3. FPSRG: Heterogeneous User Simulation First-Person Post-Training and Multidimensional Semantic Response Grids

    Nov 12, 2026Ruimin Pei, Haibo Liu, Fang Zhang +1User SimulationLarge Language Model-Based Social Simulation

  4. ShopMind: A Mental World Model for Personalized and Realistic E-commerce User Simulation

    Nov 9, 2026Peixuan Hou, Bin Chen, Li He +3User SimulationHuman Behavior Modeling

  5. State-Aware Virtual Patient Simulation for Training Psychiatrists in Challenging Clinical Scenarios

    Nov 1, 2026Harsh Mohta, C Chandrahas Reddy, Sunhith Reddy Bojja +3User SimulationLarge Language Model-Based Role-Play Simulation

  6. Intent-Preserving Adversarial User Simulation for Multi-Turn Agent Evaluation

    Oct 26, 2026Atri Vivek Sharma, Brian Formento, Alessio LomuscioLLM Agent EvaluationUser Simulation

  7. Towards User Simulators That Stay On Task And Still Sound Natural

    Oct 22, 2026Mustafa Omer Gul, Philippe Laban, Tanya Goyal +1User SimulationHuman Behavior Simulation

  8. SIM-UT: A User Simulation based Evaluation Framework for Medical Triage Chatbots

    Oct 21, 2026Deepali Mittal, Dheeraj Mundhra, Yulia Sidorova +3Clinical Language Model EvaluationUser Simulation

  9. SWE-DIVE: Multi-Turn Coding Agent Evaluation with Dynamic User Simulation

    Oct 21, 2026Lorenz Brehme, Benjamin Steenhoek, Ruth BreuCoding AgentsAI Agent Evaluation

  10. OmniSimulator: Aligning Small Language Models for Authentic Heterogeneous Behavior Modeling

    Oct 21, 2026Jiawei Chen, Ruoxi Xu, Boxi Cao +12User SimulationHuman Behavior Simulation

  11. Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation

    Oct 19, 2026Jiajie He, Yuanhong Jiang, Xintong Chen +2Human Behavior SimulationUser Simulation

  12. Analyzing Repetition and Interference Effects in Memory-Constrained User Simulators

    Oct 16, 2026Cara Su-Yi Leong, Nicholas Tomlin, Tal LinzenUser Simulation

  13. Learning User Representations to Improve Simulation Fidelity

    Oct 15, 2026Shuhaib Mehri, Philippe Laban, Michel Galley +3User SimulationUser Modeling

  14. ARGUS: An Agenda-Driven Framework for Reliable User Simulation

    Oct 15, 2026Hang Zheng, Nan Jiang, Zichen Zhu +6Task-Oriented Dialogue SystemsUser Simulation

  15. HACHIMI-II: From Role-Play to Learner Behavior Modeling for Faithful Student Simulation

    Oct 14, 2026Yilin Jiang, Fei Tan, Xuanyu Yin +2User SimulationAI in Education

  16. SimInter: Evidence-Grounded User Simulation with Interview-Based Profile Enrichment for Conversational Recommender Systems

    Oct 13, 2026Erfan Shahabi, Amirhossein Roshandel, Mohammad Sadegh Sadeghi +1User SimulationRecommender Systems

  17. EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents

    Oct 12, 2026Min Cai, Dan Zhang, Gao Xing +3LLM Agent TrainingRL for LLM Agents

  18. Uncovering Robustness Weaknesses in LLM Agents via Persona Evolution with Task-Integrity Constraints

    Oct 12, 2026Yutao Xie, Jingbo Yang, Guanyu Yao +3LLM Agent EvaluationUser Simulation

  19. Training User Simulators with Latent Intrinsic Feedback

    Oct 9, 2026Tarek Naous, Craig Boutilier, Wei Xu +1User SimulationLarge Language Model-Based Role-Play Simulation

  20. InterviewPlayground: A Validated Simulation Environment for Evaluating AI Interviewers

    Oct 8, 2026Jonathan Ivey, Aimee Liang, Arthur Y. S. Wang +3Conversational AgentsMulti-Turn Dialogue Evaluation