Chatbot Arena

Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 18

All topics
CardsList

  1. ShowTellArena: Evaluating Business Workflow Understanding from Demonstrations

    Sep 21, 2026David Garg, Ritobrata Sarkar, Ehsan Azarnasab +1Agentic Workflow DesignChatbot Arena

    Brackett Labs

  2. XAI-Arena: Can LLMs Assess the Quality of XAI Explanations?

    Sep 10, 2026Yanfei Hu Fleischhauer, Alona Zharova, Nadja Klein +1XaiExplainable Artificial Intelligence

    LMU Munich, Germany · Chair of Information Systems, School of Business and Economics, Humboldt-Universität zu Berlin, Germany · Scientific Computing Center, Karlsruhe Institute of Technology, Germany +1

  3. ACEA: An Adversarial Co-Evolution Arena for Head-to-Head Red-Team and Blue-Team LLM Testing

    Sep 8, 2026Yi Ting Shen, Kentaroh Toyoda, Alex LeungChatbot ArenaLarge Language Model Evaluation

    Vulcan Research, AIFT Singapore

  4. DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generation

    Aug 11, 2026Xiaotong Wang, Dazhen DengChatbot Arena

    State Key Lab of CAD&CG, Zhejiang University, China · School of Software Technology, Zhejiang University, China

  5. CogArena: A Multimethod Evaluation of Cognitive Ability Structure in Large Language Models

    Jul 27, 2026Dengzhe Hou, Lingyu Jiang, Fangzhou Lin +1Cognitive ScienceChatbot Arena

    1Graduate School of Information Sciences, Tohoku University · 2Unprecedented-scale Data Analytics Center, Tohoku University · 3Texas A&M University +1

  6. LLM-SoccerArena: Benchmarking LLMs on Real-World Predictions in Sports

    Jul 27, 2026Jonas Schröder, Jonas Schweisthal, Oliver Müller +2Large Language Model ForecastingChatbot Arena

    MCML & LMU Munich Munich, Germany · Paderborn University Paderborn, Germany · University of Cologne Cologne, Germany

  7. SidConArena: An Environment Evaluating Agents in Open-Ended,Positive-Sum Bargaining Game

    Jun 24, 2026Yeqi Feng, Yuxin Chen, Tianxing HeNegotiationChatbot Arena

    Institute for Interdisciplinary Information Sciences, Tsinghua University

  8. AIPatient Arena: EHR-grounded evaluation of large language models in end-to-end clinical consultation workflows

    Jun 16, 2026Jiahui Niu, Huizi Yu, Wenkong Wang +11Large Language Model EvaluationReal-World Clinical Workflows

    School of Control Science and Engineering, Shandong University, Ji’nan, Shandong, China · Key Laboratory of Machine Intelligence and System Control, Shandong University, Ji’nan, Shandong, China · Department of Medicine and Therapeutics, The Chinese University of Hong Kong, Shatin, Hong Kong SAR, China +5

  9. Bittensor Agent Arenas as a Trajectory Primitive: Distilling a Shopping Agent from ShoppingBench Subnet Traces

    Jun 8, 2026Shardul Bansal, Seth Schilbe, Jarrod BarnesAgentic BenchmarksChatbot Arena

    1ORO AI · 2Dynamical Systems

  10. ADK Arena: Evaluating Agent Development Kits via LLM-as-a-Developer

    Jun 4, 2026Jintao Huang, Xiaomin Li, Gaurav Mittal +1Agentic FrameworkChatbot Arena

    The Ohio State University · Microsoft

  11. For How Long Should We Be Punching? Learning Action Duration in Fighting Games

    May 20, 2026Hoang Hai Nguyen, Kurt Driessens, Dennis J. N. J. SoemersChatbot Arena

    Department of Advanced Computing Sciences, Maastricht University, Maastricht, the Netherlands

  12. AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents

    May 16, 2026Sharareh Younesian, Wenwen Ouyang, Sina Rafati +11Graphics Processing Unit KernelsAgentic Optimization

    AMD

  13. Generalized Priority-Aware Shapley Value

    May 14, 2026Kiljae Lee, Ziqi Liu, Weijing Tang +1Shapley ValuePrioritization

    The Ohio State University · Carnegie Mellon University

  14. Who Defines "Best"? Towards Interactive, User-Defined Evaluation of LLM Leaderboards

    Apr 23, 2026Minji Jung, Minjae Lee, Yejin Kim +2LeaderboardChatbot Arena

    Yonsei University, South Korea

  15. Personalized Benchmarking: Evaluating LLMs by Individual Preferences

    Apr 21, 2026Cristina Garbacea, Heran Wang, Chenhao TanLarge Language Model PersonalizationPreference Alignment Learning

    University of Chicago

  16. LM Fight Arena: Benchmarking Large Multimodal Models via Game Competition

    Oct 10, 2025Yushuo Zheng, Tongrui Ye, Zicheng Zhang +3Chatbot ArenaLarge Multimodal Models

    Shanghai Jiao Tong University, Shanghai, China · Shanghai AI Lab, Shanghai, China · Tongji University, Shanghai, China

  17. When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

    Sep 30, 2025Wenda Xu, Sweta Agrawal, Vilém Zouhar +2Large Language Model BenchmarksChatbot Arena

    Google · ETH Zurich

  18. Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

    Aug 16, 2025Jenny Y. Huang, Yunyi Shen, Dennis Wei +1RankingChatbot Arena

    Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology · MIT-IBM Watson AI Lab · IBM Research