Multi-Turn Benchmark

Ask about this topic

Momentum

2 papers in the last four weeks, down 71% on the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 50

All topics
CardsList

  1. GIFTBench: Diagnosing Generalization in Image Forgery Localization and Informing Model Design

    Oct 1, 2026Baoke Dou, Ziye Wang, Hao Wang +5Face Forgery DetectionMulti-Turn Benchmark

  2. CypherTurn: A Multi-Turn Benchmark for Conversational Text-to-Cypher Evaluation and the Autonomy Divergence

    Sep 29, 2026Yuzhe Zhang, Weijie Zhu, Haolin Yang +5Reasoning GraphsText2Cypher

    Peking University · National Key Lab of Data Space Technology and System · Baidu Inc.

  3. Do Coding Agents Reuse Existing Code or Reinvent the Wheel?

    Sep 28, 2026Dongsheng Ma, Sizhe Wang, Xinyi Huang +5Coding AgentsReuse

    Peking University · Fudan University · Shanghai Jiao Tong University +3

  4. TQTS-Bench: A Multi-Syntax Benchmark for Text-to-Query over Time-Series Databases

    Sep 28, 2026Fei Lyu, Zhiyi Peng, Jiaming Liu +5Text-To-SqlMulti-Turn Benchmark

    College of Computer Science and Electronic Engineering, Hunan University

  5. A primer on evaluation methods for large language models in healthcare

    Sep 13, 2026Suzannah E McKinney, Phuc Vu, Samuel A Justice +7Large Language Model EvaluationHealthcare

    Mass General Brigham AI, Mass General Brigham, Boston, MA, USA · Generative AI Laboratory, School of Informatics, University of Edinburgh, Edinburgh, UK · University of Edinburgh Centre for Cardiovascular Science, Edinburgh, UK +5

  6. KC-Bench: A Dynamic Interactive Benchmark for Evaluating Knowledge Conflicts in LLM Agents

    Sep 3, 2026Yaxing Lyu, Shengjie Zhou, Binbin Toh +2Large Language Model AgentsMulti-Turn Benchmark

    1Shanghai Artificial Intelligence Laboratory · 2The University of Hong Kong · 3Xiamen University Malaysia +1

  7. Benchmark-Based Comparative Assessment of Publicly Benchmarked Indian Foundation Models: A Capability and Evaluation-Maturity Framework

    Aug 12, 2026Avinash Agarwal, Vridhi JainArtificial Intelligence BenchmarksMulti-Turn Benchmark

    Unique Identification Authority of India, New Delhi, India

  8. TangPoetryBench: A Multi-Dimensional Benchmark and Rubric-Conditioned Evaluator for Poetry-to-Image Generation

    Aug 11, 2026Haoqi Hu, Tongji Luo, Li Zhang +1PoetryMulti-Turn Benchmark

    Independent Researcher

  9. ELBench: A Multi-Dimensional Benchmark for Education-Facing Large Language Models

    Aug 10, 2026Yilin Jiang, Xiaorong Zhu, Fei Tan +9Multi-Turn Benchmark

    1East China Normal University · 2The Hong Kong University of Science and Technology (Guangzhou) · 3Shanghai Jiao Tong University +1

  10. TeXFix-Bench: An Empirically Grounded Multi-Format Benchmark for LLM-Based Document Source Repair

    Aug 7, 2026Prajwal S. VenkateshmurthyRepairDocumentation

    Independent Researcher San Jose, CA, USA

  11. TRACE: A Multi-Layer Benchmark for Human AI Controller Coordination Under Drift and Failure

    Aug 7, 2026Joshua Zuniga, Srinivasan Subramanian, Ramya Madhuri Narapureddy +1TracesArtificial Intelligence Control

    College of Computing and Software Engineering Kennesaw State University Marietta, GA, USA

  12. From Financial Sentiment Classification to Return Predictability: A QLoRA Benchmark of Large Language Models

    Aug 4, 2026Fusheng LuoFinancial Sentiment AnalysisLegal Natural Language Processing Benchmarks

    Johns Hopkins University Baltimore, Maryland, USA

  13. MedPRESS: A Multi-turn Benchmark for Patient-Pressure-Induced Medical Sycophancy in LLMs

    Aug 3, 2026Saman Sarker Joy, Niloy FarhanLarge Language Model EvaluationSycophancy

    Universiti Malaya, Malaysia · BRAC University, Bangladesh

  14. Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models

    Aug 2, 2026Fali Wang, Ali Al-Lawati, Iliyas Bektas +5Reasoning BenchmarkMulti-Turn Benchmark

    The Pennsylvania State University, University Park, PA, USA · Rensselaer Polytechnic Institute, Troy, NY, US

  15. Hy-MultiTurn: A Six-Dimensional Benchmark for Deep Multi-Turn Dialogue Understanding

    Jul 31, 2026Eileen Ye, Jiawen Tao, Yaoming Li +7Multi-Turn InteractionsDialogue

    Hunyuan Team, Tencent · Peking University

  16. M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models

    Jul 31, 2026Ryo Fukuda, Atsushi Ando, Hiroki Kanagawa +4Full-Duplex Speech ModelsTurn-Taking

    NTT, Inc., Kyoto, Japan

  17. MMAC: A Massive Multi-dimensional Benchmark for Audio Captioning

    Jul 29, 2026Weijie Wu, Junbo Li, Lin Li +2Large Audio Language ModelsAudio Understanding

    School of Informatics, Xiamen University, China · DiDi Global Inc., Beijing, China · School of Electronic Science and Engineering, Xiamen University, China

  18. StanceFlip: A Comprehensive Multi-Dimensional Benchmark for Multimodal Conversational Stance Flipping Forecasting

    Jul 27, 2026Heyan Chai, Xin Li, Wenjie Wang +5Multimodal Sentiment AnalysisFlips

    College of Computer Science and Software Engineering, Shenzhen University Shenzhen, China · Harbin Institute of Technology Shenzhen, China · Shenzhen University Shenzhen, China +1

  19. TEmBed-T: A Multi-Dimensional Benchmark for Table-Level Embeddings

    Jul 27, 2026Ayeen Poostforoushan, Liane Vogel, Carsten BinnigText EmbeddingsMulti-Turn Benchmark

    Independent Researcher · Technical University of Darmstadt · Technical University of Darmstadt & DFKI & hessian.AI

  20. Remedying Coarsening-Based GNN Training under Heterophily via Adaptive Complementary Enhancement

    Jul 24, 2026Guoming Li, Jian Yang, Xukun Wang +3Graph Neural NetworksHeterogeneity

    Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR, China · School of Information, Renmin University of China, Beijing, China · Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China +2

  21. One More Turn, Less Regret: A Regret-Based Multi-Turn Benchmark for LLMs' Clarification Policies

    Jul 23, 2026Minh Ngoc Ta, My Anh Tran Nguyen, Duong D. Nguyen +2ClarificationQuestion

    MBZUAI · BKAI Research Center, Hanoi University of Science and Technology · INSAIT, Sofia University "St. Kliment Ohridski"

  22. LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes

    Jul 14, 2026Michael Solodko, Steven Gong, Guangwei Yu +3Data LakesMultimodal Query

    University of Waterloo · Layer 6 AI

  23. Domain-Aware Scaling Laws Uncover Data Synergy

    Jul 13, 2026Kimia Hamidieh, Lester Mackey, David Alvarez-MelisSynergyLarge Language Model Pretraining

    MIT CSAIL · Microsoft Research · Harvard University

  24. Understanding Cross-Rig Generalization in Automotive Perception: a Multi-Rig Benchmark and Rig Variation Metrics

    Jun 25, 2026Tim Alexander Bader, Tim Dieter Eberhardt, Maximilian Dillitzer +1Autonomous Driving PerceptionCamera

    Dept. of Highly Automated and Assisted Driving, Dr. Ing. h.c. F. Porsche AG, Porscheplatz 1, Stuttgart, 70435, Baden-Württemberg, Germany · Institute for Information Processing Technologies, Karlsruhe Institute of Technology, Kaiserstraße 12, Karlsruhe, 76131, Baden-Württemberg, Germany · Faculty of Mobility and Technology, Esslingen University of Applied Sciences,Jun Kanalstraße 33, 73728 Esslingen am Neckar Esslingen, Germany

  25. InvestPhilBench: A Multi-Layer Benchmark for Evaluating Large Language Model Procedural Reasoning in Expert Investment Philosophy

    Jun 24, 2026Mingguang Chen, Bo QuFinancial Strategy ResearchFinance Benchmarks

    University of California, Riverside (UCR). · 2Illinois Institute of Technology (IIT).

  26. SciRisk-Bench: A Risk-Dimension-Aware Benchmark for AI4Science Safety

    Jun 17, 2026Linghao Feng, Yinqian Sun, Dongqi Liang +8Large Language Model BenchmarksMulti-Turn Benchmark

    Brain-inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Future Technology, University of Chinese Academy of Sciences, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, China +5

  27. Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks

    Jun 9, 2026Pradnya Halady, Jiale Wei, Zdravko Marinov +2Visual In-Context LearningIn-Context Learning

    Karlsruhe Institute of Technology

  28. Dense Contexts Are Hard Contexts: Lexical Density Limits Effective Context in LLMs

    Jun 4, 2026Giovanni Dettori, Matteo Boffa, Danilo Giordano +2Multi-Turn BenchmarkHard

    Department of Computer Science Politecnico di Torino Torino, IT 10129 · Department of Computer Science University of Turin Torino, IT 10124

  29. TimeSage-MT: A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoning

    May 31, 2026Yaxuan Kong, Qingren Yao, Yuqi Nie +7Agentic BenchmarksAgentic Reasoning

    University of Oxford · VulpiVox Intelligence · Eindhoven University of Technology +3

  30. Gated Graph Attention Networks with Learnable Temperature

    May 28, 2026Zhongtian Ma, Hao Wu, Yexin Zhang +2Interleaved Graph AttentionMulti-Turn Benchmark

    School of Cybersecurity, Northwestern Polytechnical University, Xi’an 710072, China · Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China

  31. PRISM: A Multi-Dimensional Benchmark for Evaluating LLM Peer Reviewers

    May 26, 2026Ngoc Phan Phuoc Loc, Toan Huynh La Viet, Thanh Tran Khanh +8Peer ReviewMulti-Turn Benchmark

    VinUniversity · University of Illinois, Urbana-Champaign · University of Notre Dame +1

  32. WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation

    May 25, 2026Kaining Ying, Hengrui Hu, Siyu Ren +6Video World ModelsMulti-Turn Benchmark

    Fudan University · Meituan Longcat Team

  33. Boiling the Frog: A Multi-Turn Benchmark for Agentic Safety

    May 21, 2026Piercosma Bisconti, Matteo Prandi, Federico Pierucci +11Large Language Model SafetySafety Benchmarks

    Icaro Foundation · Sapienza University of Rome · Sant’Anna School of Advanced Studies +6

  34. Are Agents Ready to Teach? A Multi-Stage Benchmark for Real-World Teaching Workflows

    May 14, 2026Zixin Chen, Peng Liu, Rui Sheng +6TutorsAgentic Benchmarks

    Hong Kong University of Science and Technology · Qwen Team, Alibaba Group · Qwen Team

  35. SleepWalk: A Three-Tier Benchmark for Stress-Testing Instruction-Guided Vision-Language Navigation

    May 11, 2026Niyati Rawal, Sushant Ravva, Shah Alam Abir +5Vision-Language NavigationSpatial Reasoning

    † Indian AI Research Organization (IAIRO), India · ⋆ĸragya Lab, BITS Pilani Goa, India · ¶ University of Dhaka, Bangladesh +3

  36. PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generation

    May 10, 2026Zhen Hang, Yushan Yashengjiang, Junhui Li +21Neural Partial Differential Equation SolversPartial Differential Equations

    University of Science and Technology of China · Beijing University of Posts and Telecommunications · Tencent +10

  37. Have Graph -- Will Lift? The Case for Higher-Order Benchmarks

    May 8, 2026Bastian RieckHigher-Order StructuresMulti-Turn Benchmark

    AIDOS Lab, University of Fribourg, Switzerland · Institute of AI for Health, Helmholtz Munich, Germany

  38. SEQUOR: A Multi-Turn Benchmark for Realistic Constraint Following

    May 7, 2026Beatriz Canaverde, Duarte M. Alves, José Pombal +2InstructionInstruction-Tuned Models

    Instituto de Telecomunicac¸˜oes · Instituto Superior T´ecnico, Universidade de Lisboa · Sword Health +2

  39. Linear Semantic Segmentation for Low-Resource Spoken Dialects

    May 7, 2026Kirill Chirkunov, Younes Samih, Abed Alhakim Freihat +1DialectsArabic

    Mohamed bin Zayed University of Artificial Intelligence · IBM Research AI

  40. WorldJen: An End-to-End Multi-Dimensional Benchmark for Generative Video Models

    May 5, 2026Karthik Inbasekar, Guy Rom, Omer ShlomovitsGenerative Video ModelsMulti-Turn Benchmark

  41. Multimodal LLMs are not all you need for Pediatric Speech Language Pathology

    Apr 29, 2026Darren Fürst, Sebastian Steindl, Ulrich SchäferSpeech Language ModelsDysarthric Speech

    Ostbayerische Technische Hochschule Amberg-Weiden

  42. K-MetBench: A Multi-Dimensional Benchmark for Fine-Grained Evaluation of Expert Reasoning, Locality, and Multimodality in Meteorology

    Apr 27, 2026Soyeon Kim, Cheongwoong Kang, Myeongjin Lee +3Multi-Turn BenchmarkFree-Form Textual Rationales

    KAIST, INEEJI · Seongnam, Korea · KAIST +2

  43. Domain-level metacognitive monitoring in frontier LLMs: A 33-model atlas

    Apr 21, 2026Jon-Paul CacioliMmlu-ProMulti-Turn Benchmark

    Independent Researcher · Melbourne, Australia

  44. Multiplication in Multimodal LLMs: Computation with Text, Image, and Audio Inputs

    Apr 20, 2026Samuel G. Balter, Ethan Jerzak, Connor T. JerzakMultimodal Large Language ModelsModalities

    University of Texas at Austin · National University of Singapore (NUS)

  45. SciImpact: A Multi-Dimensional, Multi-Field Benchmark for Scientific Impact Prediction

    Apr 18, 2026Hangxiao Zhu, Yuyu Zhang, Ping Nie +1Scientific DiscoveryCitations

    Texas A&M University · Verdent AI · University of Waterloo

  46. Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing

    Apr 16, 2026Yixuan Ding, Wei Huang, Ruijie Quan +2Image EditingEdit

    Zhejiang University · The University of Hong Kong

  47. Local Constrained Bayesian Optimization

    Mar 9, 2026Jing Jingzhe, Fan Zheyi, Szu Hui Ng +1Bayesian OptimizationTrust Region

    State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China · School of Mathematical Sciences, University of Chinese Academy of Sciences, Beijing, China · Department of Industrial Systems Engineering & Management, National University of Singapore, Singapore.

  48. Advancing Multimodal Judge Models through a Capability-Oriented Benchmark and MCTS-Driven Data Generation

    Feb 28, 2026Zeyu Chen, Huanjin Yao, Ziwang Zhao +1Large Language Model JudgesLlm-As-A-Judge

  49. Region-Specific Calibration Achieves Excellent Inter-Device Reliability for Smartphone Dermatology: A Multi-Device Benchmark on Korean Facial Skin

    Dec 26, 2025Sungwoo Kang, Jong-Kook KimSmartphone PhotographsDevice

    Department of Electrical and Computer Engineering, Korea University, Seoul, Republic of Korea · School of Electrical Engineering, Korea University, Seoul, Republic of Korea

  50. From Charts to Code: A Hierarchical Benchmark for Multimodal Models

    Oct 20, 2025Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu +8Image-To-Code GenerationChart

    CSU-JPG, Central South University · National University of Singapore · Nanyang Technological University