Role-Playing Agent Evaluation

Latest papers

CardsList

15 papers4 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. PersonaChatBench: Evaluating Chat Assistants with Diverse Simulated Users

    Oct 30, 2026Zheyuan Deng, Taoran Li, Jingwen Zhang +28AI Agent BenchmarksMulti-Turn Dialogue Evaluation

  2. PsyInterviewee: Informational Invariance and Relational Adaptivity in Mental Health Interview Simulation

    Oct 30, 2026Jiawei Zhang, Huachuan Qiu, Ruocheng Guo +1Large Language Model-Based Role-Play SimulationBehavioral Consistency of LLM Agents

  3. AgentMonopoly: Behavioral Patterns and Persona Control in LLM Agents

    Oct 21, 2026Changshun Wu, Mengyu Li, Mathis Marsault +2LLM AgentsLLM Agent Evaluation

  4. Desirability Confirmation: Relational Sycophancy in AI Intimate Roleplay

    Oct 16, 2026Huiqian Lai, Runze DingLLM SycophancyAI Companions

  5. Adversarial Stress Testing of Role-Playing Language Agents using Multi-Agent Evaluation

    Aug 4, 2026Saqib Shouqi, Abdullah Nazly, Januki Wanniarachchi +1Adversarial Attacks on LLMsLLM Agent Evaluation

  6. Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation

    Jul 30, 2026Yuhang Zhu, Mingxuan Du, Benfeng Xu +3LLM EvaluationLarge Language Model-Based Role-Play Simulation

  7. ArcANE: Do Role-Playing Language Agents Stay in Character at the Right Time?

    Jun 4, 2026Woojung Song, Nalim Kim, Sangjun Song +3Large Language Model-Based Role-Play SimulationPersonality Modeling in Language Models

  8. RoleCDE:Benchmarking and Mitigating Role-Alignment Trade-offs in Role-Playing Agents

    Jun 1, 2026Huayi Lai, Shichao Song, Simin Niu +5Moral Reasoning in Language ModelsAI Agent Benchmarks

  9. DynSess: Dynamic Session-Level Evaluation and Optimization Framework for Role-Playing Agents

    May 28, 2026Rongsheng Zhang, Jiji Tang, Junnan Ren +6Large Language Model-Based Role-Play SimulationLong-Horizon Agent Evaluation

  10. RPA-Check: A Multi-Stage Automated Framework for Evaluating Dynamic LLM-based Role-Playing Agents

    Apr 13, 2026Riccardo Rosati, Edoardo Colucci, Massimiliano Bolognini +2Role-Playing Agent EvaluationLLM Agent Evaluation

  11. Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects

    Mar 4, 2026Ji-Lun Peng, Yun-Nung ChenPersonality Modeling in Language ModelsOOD Generalization

  12. MERRY: Semantically Decoupled Evaluation of Multimodal Emotional and Role Consistencies of Role-Playing Agents

    Feb 24, 2026Zhenyu Wang, Xiaofen Xing, Yirong Chen +1Role-Playing Agent EvaluationMultimodal Agent Evaluation

  13. DEBATE: A Large-Scale Benchmark for Evaluating Opinion Dynamics in Role-Playing LLM Agents

    Oct 29, 2025Yun-Shiuan Chuang, Ruixuan Tu, Chengtao Dai +9Opinion DynamicsLarge Language Model-Based Social Simulation