User Simulation

Ask about this topic

Momentum

13 papers in the last four weeks, up 8% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 76

All topics
CardsList

  1. Can AI Agents Simulate A/B Test Outcomes? A Validation Framework for Agentic Experimentation

    Aug 3, 2026Stefan Hut, Lorenzo MasoeroCausal Effect EstimationAI Agent Evaluation

    Amazon

  2. Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation

    Jul 30, 2026Yuhang Zhu, Mingxuan Du, Benfeng Xu +3LLM EvaluationLarge Language Model-Based Role-Play Simulation

    University of Science and Technology of China · MetaStone · MetaStone Technology, Beijing, China

  3. Instruction-Tuned Language Models Cannot Sample from Distributions They Can Describe

    Jul 28, 2026Chaemin Jang, Dongman Lee, Jihee KimLanguage Model DecodingLLM Prompting

    School of Computing, KAIST · School of Business and Technology Management, KAIST

  4. Reason-Mediated Behavioral Models for Auditing LLM Social Simulators

    Jul 27, 2026Atharva Pandey, Gautam JajooLLM AuditingHuman Behavior Simulation

    Kairosity

  5. A Diffusion-Model Subpopulation Digital Twin for Mobile Health Deployment: A Case Study on the HeartSteps Intervention

    Jul 23, 2026Ziping Xu, Yuyi Chang, Chenshun Ni +5Digital TwinsUser Simulation

    † University of North Carolina at Chapel Hill · ‡ The Ohio State University · ⋄ Harvard University +1

  6. SenWorld: A Digital-Twin Simulation for Generating Context-Rich Evaluation Data

    Jul 22, 2026Zenghui Zhou, Xiaoyang Li, Xiaoxuan Qiao +2Synthetic Data GenerationAgent Evaluation

    ByteDance Inc., Beijing, China

  7. Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems

    Jul 5, 2026Xinyu Lin, Yashar Deldjoo, Sunhao Dai +7LLM Agent EvaluationRecommender Systems

    National University of Singapore · Polytechnic University of Bari · Renmin University of China +1

  8. SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions

    Jun 29, 2026Mohit Raghavendra, Anisha Gunjal, Aakash Sabharwal +1Coding AgentsSoftware Engineering Benchmarks

    1Scale AI

  9. SIMAX: A Scalable and Interpretable Framework for Multi-Fidelity and Annotated Clinician-Patient Dialogue Simulation

    Jun 29, 2026Zhuhan Bao, Rui Yang, Bohao Yang +16Human Behavior SimulationControllable Speech Generation

    Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, NC, USA · Duke-NUS AI + Medical Sciences Initiative, Duke-NUS Medical School, Singapore, Singapore · Centre for Biomedical Data Science, Duke-NUS Medical School, Singapore, Singapore +16

  10. Cognitive World Models for Process-Level Social Influence Evaluation

    Jun 28, 2026Minghui Ma, Bin Guo, Han Wang +4LLM EvaluationCognitive Modeling

    Northwestern Polytechnical University, Xi’an, China · Harbin Engineering University, Harbin, China

  11. Learning User Simulators with Turing Rewards

    Jun 17, 2026Yingshan Susan Wang, Cedegao E. Zhang, Linlu Qiu +5Reward ModelingRL for Language Models

    Massachusetts Institute of Technology · Stanford University · MIT-IBM Watson AI Lab

  12. Simulated Customers Never Walk Away: Decision Fidelity of LLM User Simulators Measured Against Real Purchase Outcomes

    Jun 16, 2026Liang ChenHuman Behavior SimulationUser Simulation

  13. Dialogue SWE-Bench: A Benchmark for Dialogue-Driven Coding Agents

    Jun 12, 2026Brendan King, Jeffrey FlaniganCoding AgentsLLM Agent Evaluation

    University of California, Santa Cruz

  14. VISTA: A Versatile Interactive User Simulation Toolkit for Agent Evaluation

    Jun 9, 2026Yunan Lu, Ryan Shea, Yusen Zhang +1Human Behavior SimulationAI Agent Evaluation

    Department of Computer Science, Columbia University, 2Arklex.ai

  15. Does Persona Make LLMs K-pop Fans? A Pilot Study of LLM-Based Online Concert Audience Agents

    Jun 5, 2026Kirak Kim, Hyojin Kim, Yejin Son +2Multi-Agent LLM SystemsLLM Agent Evaluation

    Graduate School of Culture Technology, KAIST, Daejeon, South Korea · Department of Artificial Intelligence, Yonsei University, Seoul, South Korea

  16. PerceptUI: LLM Agents as Human-Aligned Synthetic Users for UI/UX Evaluation

    Jun 4, 2026Nicolas Bougie, Xiaotong Ye, Gian Maria Marconi +1User ModelingUser Simulation

    1Woven by Toyota

  17. When Clients Stop Following: A Cognitive Conceptualization Diagram-driven Framework for Strategic Counseling

    Jun 3, 2026Yihao Qin, Junyi Zhao, Changsheng Ma +4Mental Health CounselingCognitive Modeling

    School of Information Science and Engineering, Lanzhou University

  18. CRAB-Bench: Evaluating LLM Agents under Complex Task Dependencies and Human-aligned User Simulation

    Jun 1, 2026Danqing Wang, Akshay Sivaraman, Lei LiHuman Behavior SimulationLLM Agent Evaluation

    Carnegie Mellon University

  19. Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues

    May 28, 2026Zhangqi Duan, Shuyan Huang, Alexander Scarlatos +3Large Language Model-Based Role-Play SimulationIntelligent Tutoring Systems

    University of Massachusetts Amherst · 2Eedi

  20. When Seekers Are Hard to Help: Evaluating Emotional Support Dialogue Systems in Worst-Case Interactions

    May 27, 2026Jiajie Yang, Yangchun Li, Guanyi Chen +3Emotional Support ConversationUser Simulation

    Hubei Provincial Key Laboratory of Artificial Intelligence and Smart Learning · National Language Resources Monitoring and Research Center for Network Media · School of Computer Science, Central China Normal University +2

  21. Recon: Reconstruction-Guided Reasoning Synthesis for User Modeling

    May 26, 2026Alan Zhu, Mihran Miroyan, Carolyn Wang +4CoT ReasoningUser Modeling

    University of California, Berkeley

  22. From Static Context to Calibrated Interactive RL: Mitigating Distribution Shift in Multi-turn Dialogue with Aligned Simulator

    May 26, 2026Xiaohua Wang, Jiakang Yuan, Zisu Huang +5RL for Language ModelsReinforcement Learning

    Fudan University

  23. Simulating Human Memory with Language Models

    May 25, 2026Qihan Wang, Nicholas Tomlin, Michael Hu +2LLM EvaluationMemory-Augmented Language Models

    NYU · UMass Amherst

  24. Toward a Benchmark for Controllable Simulation of Imperfect Students with Large Language Models

    May 25, 2026Alexander Apartsin, Omri Sason, Yehudit ApersteinLLM EvaluationLanguage Model-Based Control

    Holon Institute of Technology, Holon, Israel. · Afeka Tel Aviv Academic College of Engineering, Tel Aviv, Israel

  25. Unlocking Proactivity in Task-Oriented Dialogue

    May 21, 2026Azure Zhang, Ning Gao, Yuqin Dai +7LLM Post-TrainingConversational Agents

    1Keeta AI, Meituan · 2Independent Researcher · 3CUHK +1

  26. The Illusion of Intervention: Your LLM-Simulated Experiment is an Observational Study

    May 20, 2026Victoria Lin, Taedong Yun, Maja Matarić +3Human Behavior SimulationLarge Language Model-Based Social Simulation

    Google DeepMind · Carnegie Mellon University

  27. SimGym: A Framework for A/B Test Simulation in E-Commerce with Traffic-Grounded VLM Agents

    May 19, 2026Han Li, Vibhor Malik, Zahra Zanjani Foumani +17Tool-Using Vision-Language AgentsA/b Testing

    Shopify, Bellevue, Washington, USA

  28. SimPersona: Learning Discrete Buyer Personas from Raw Clickstreams for Grounded E-Commerce Agents

    May 14, 2026Zahra Zanjani Foumani, Alberto Castelo, Shuang Xie +3LLM PersonalizationVector-Quantized Variational Autoencoder

    Shopify · Bellevue, Washington, USA

  29. Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents

    May 13, 2026Harshita Chopra, Kshitish Ghate, Aylin Caliskan +3Human Behavior SimulationLLM Agent Evaluation

    University of Washington, Seattle, WA · Georgetown University, Washington, DC

  30. PrivacySIM: Evaluating LLM Simulation of User Privacy Behavior

    May 12, 2026James Flemings, Murali AnnavaramLLM EvaluationUser Modeling

    University of Southern California