LLM Evaluation

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

194 papers in the last four weeks, up 87% on the four weeks before. 1.9% of all new papers.

Jul 13Week of Sep 28

Latest papers 1,643

All topics

V4FinBench: Benchmarking Tabular Foundation Models, LLMs, and Standard Methods on Corporate Bankruptcy Prediction
May 11, 2026Marcin Kostrzewa, Sebastian Tomczak, Roman Furman +5Class-Imbalanced Learning Tabular Foundation Models
Department of Artificial Intelligence, Wrocław University of Science and Technology, Poland · Opera, Wrocław, Poland · Tooploox, Wrocław, Poland
AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
May 11, 2026Edward De Brouwer, Carl Edwards, Alexander Wu +9LLM Evaluation AI Agent Benchmarks
Genentech
Generalizing the Turing Test to Interactive Agents
May 11, 2026Daniel Mitropolsky, Riccardo Neumarker, Emanuele Rimoldi +2LLM Evaluation AI Agent Evaluation
MIT · ETH Zurich · EPFL
Likelihood scoring for continuations of mathematical text: a self-supervised benchmark with tests for shortcut vulnerabilities
May 11, 2026Daniel RanardLLM Evaluation Next-Token Prediction
Department of Physics, California Institute of Technology, Pasadena, CA 91125, USA
Measuring Embedding Sensitivity to Authorial Style in French: Comparing Literary Texts with Language Model Rewritings
May 11, 2026Benjamin Icard, Lila Sainero, Alice Breton +2LLM Evaluation Text Embeddings
LIP6, Sorbonne University, CNRS, France · Infopro Digital, France
LLM Jaggedness Unlocks Scientific Creativity
May 11, 2026Shray Mathur, J. Anibal Boscoboinik, Esther H. R. Tsai +1Creativity Assessment LLM Evaluation
Center for Functional Nanomaterials, Brookhaven National Laboratory Upton, NY 11973, USA
Can Language Models Analyze Data? Evaluating Large Language Models for Question Answering over Datasets
May 11, 2026Andreas Xenofontos, Pavlos FafaliosTable QA LLM Evaluation
School of Production Engineering and Management, Technical University of Crete, Greece · Institute of Computer Science, Foundation for Research and Technology - Hellas, Greece.
Equilibrium Residuals Expose Three Regimes of Matrix-Game Strategic Reasoning in Language Models
May 11, 2026Wenhua Nie, Binhan Luo, Zijie Meng +2Nash Equilibrium LLM Evaluation
National Taiwan University
Valid Best-Model Identification for LLM Evaluation via Low-Rank Factorization
May 11, 2026Elad Tolochinsky, Yaniv Tenzer, Yaniv RomanoModel Selection Multi-Armed Bandits
Department of Computer Science, Technion – Israel Institute of Technology · Department of Electrical and Computer Engineering, Technion – Israel Institute of Technology
Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
May 11, 2026Ivo Petrov, Jasper Dekoninck, Dimitar I. Dimitrov +1Mathematical Reasoning Benchmarks LLM Evaluation
1INSAIT, Sofia University "St. Kliment Ohridski" · 2ETH Zurich
LLM-Based Code Documentation Generation and Multi-Judge Evaluation
May 11, 2026Ikbel Ghrab, Mohamed Dhieb, Ismail Khenissi +1LLM Evaluation LLM-as-a-Judge
University of Carthage, Engineering School of Statistics and Information Analysis (ESSAI), Ariana, Tunisia · Easy Transfer, 72 Rue de la Division Leclerc, 91160 Saulx-les-Chartreux, Paris, France · University of Tunis El Manar, Laboratory of Bioinformatics, bioMathematics, and bioStatistics (LR16IPT09), Institut Pasteur de Tunis, 13 Place Pasteur, B.P. 74, Belv´ed`ere, 1002 Tunis, Tunisia
IndustryBench: Probing the Industrial Knowledge Boundaries of LLMs
May 11, 2026Songlin Bai, Xintong Wang, Linlin Yu +12LLM Evaluation Question Answering
Multimodal and Industrial AI Team† Taobao&Tmall, Alibaba Group
LegalCiteBench: Evaluating Citation Reliability in Legal Language Models
May 11, 2026Sijia Chen, Hang Yin, Shunfan ZhouLLM Evaluation Legal IR
Northeastern University · Phala
Active Testing of Large Language Models via Approximate Neyman Allocation
May 11, 2026Zeli Liu, Jiancheng Zhang, Cong Liu +1LLM Evaluation Language Model Generation Evaluation
University of California, Riverside
PlantMarkerBench: A Multi-Species Benchmark for Evidence-Grounded Plant Marker Reasoning
May 11, 2026Sajib Acharjee Dip, Song Li, Liqing ZhangLLM Evaluation Evidence-Grounded Reasoning
Department of Computer Science, Virginia Tech · School of Plant and Environmental Sciences, Virginia Tech · 3Health Sciences, Virginia Tech +2
TeleResilienceBench: Quantifying Resilience for LLM Reasoning in Telecommunications
May 11, 2026Pranshav Gajjar, Emmanuel Ojo, Vijay K ShahLLM Evaluation LLM Reasoning
¹NextG Wireless Lab, North Carolina State University
NaiAD: Initiate Data-Driven Research for LLM Advertising
May 11, 2026Yihang Zhang, Zimeng Huang, Ren Zhai +2LLM Evaluation Online Advertising
Tsinghua University Beijing, China · College of AI Tsinghua University Beijing, China · Department of Literature, Arts and Communication Anhui International Studies University Anhui, China +1
Calibrate, Don't Curate: Label-Efficient Estimation from Noisy LLM Judges
May 10, 2026Yanran LiLLM Evaluation LLM-as-a-Judge
Department of Biostatistics Columbia University
Absurd World: A Simple Yet Powerful Method to Absurdify the Real-world for Probing LLM Reasoning Capabilities
May 10, 2026Ryan Albright, Golam Md Muktadir, Zarif Ikram +3LLM Evaluation Language Model Robustness
The Nueva School, San Mateo, USA · University of Southern California · Notre Dame College, Dhaka, Bangladesh +2
Statistical Scouting Finds Debate-Safe but Not Debate-Useful Cases: A Matched-Ceiling Study of Open-Weight LLM Reasoning Protocols
May 10, 2026Julia Hu, Alfred Shen, Kumar LakshmipathiLLM Evaluation Multi-Agent Debate
Amazon Web Services
TIDE-Bench: Task-Aware and Diagnostic Evaluation of Tool-Integrated Reasoning
May 10, 2026Yize Li, Junzhi Li, Jason Song +3LLM Evaluation Tool-Use Evaluation
University of Chinese Academy of Sciences · Institute of Software, Chinese Academy of Sciences
An Execution-Verified Multi-Language Benchmark for Code Semantic Reasoning
May 10, 2026Yikun Li, Jinfeng Jiang, Ting Zhang +7LLM Evaluation Code Language Models
Singapore Management University · Monash University · Nanjing University of Science and Technology +1
Beyond Accuracy: Evaluating Strategy Diversity in LLM Mathematical Reasoning
May 10, 2026Xia Yang, Xuanyi Zhang, Hao Hu +1Mathematical Reasoning Benchmarks LLM Evaluation
University of Toronto · Upper Canada College · East China Normal University
Beyond Continuity: Challenges of Context Switching in Multi-Turn Dialogue with LLMs
May 10, 2026Aditya Sinha, Harald Steck, Vito Ostuni +1LLM Evaluation Multi-Turn Dialogue Evaluation
Netflix Inc. · Los Gatos, CA, USA
Fin-Bias: Comprehensive Evaluation for LLM Decision-Making under human bias in Finance Domain
May 9, 2026Xiaoyu Hu, Jinman ZhaoLLM Evaluation Social Bias in Language Models
Rutgers University · Department of Computer Science, University of Toronto
Evaluating Pragmatic Reasoning in Large Language Models: Evidence from Scalar Diversity
May 9, 2026Ye-eun ChoLLM Evaluation Pragmatic Reasoning in Language Models
Sungkyunkwan University Seoul, South Korea
Re $^2$ Math: Benchmarking Theorem Retrieval in Research-Level Mathematics
May 9, 2026Zicheng Lyu, Wenjie Yang, Shengzhong Zhang +1Mathematical Reasoning Benchmarks LLM Evaluation
Fudan University Shanghai, China · Nanjing University of Aeronautics and Astronautics Nanjing, Jiangsu, China · Fudan University Shanghai Innovation Institute Shanghai, China
Decomposing and Steering Functional Metacognition in Large Language Models
May 9, 2026Yanshi Li, Xueru Bai, Shuman Liu +2LLM Evaluation LLM Interpretability
Shopee Singapore, Singapore
Narrative Landscape: Mapping Narrative Dispositions Across LLMs
May 9, 2026Donghoon Jung, Jiwoo Choi, Songeun Chae +1LLM Evaluation
School of Digital Humanities and Computational Social Sciences, KAIST, South Korea
PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?
May 9, 2026Jingzhe Xu, Rui Wang, Jiannan Wang +1LLM Evaluation LLM Code Generation
Department of Computer Science and Technology, BNRist, Tsinghua University

May 11, 2026, cs.LGJ/K move · Enter open · S save

V4FinBench: Benchmarking Tabular Foundation Models, LLMs, and Standard Methods on Corporate Bankruptcy Prediction

Marcin Kostrzewa, Sebastian Tomczak, Roman Furman, Anna Poberezhna+4

Department of Artificial Intelligence, Wrocław University of Science and Technology, Poland · Opera, Wrocław, Poland · Tooploox, Wrocław, Poland

Class-Imbalanced Learning Tabular Foundation Models LLM Evaluation Benchmark Design Tabular Prediction Finance

Open paper AskPDF arXiv

Corporate bankruptcy prediction is a high-stakes financial task characterized by severe class imbalance and multi-horizon forecasting demands. Public datasets supporting it remain scarce and small: widely used free benchmarks contain between 6,000 and 80,000 company-year observations, while larger resources are behind subscription paywalls. To address this gap, we introduce V4FinBench, a benchmark of over one million company-year records from the Visegràd Group (V4) economies (2006-2021), with 131 financial and non-financial features, six prediction horizons, and a composite distress criterion jointly capturing solvency, profitability, and liquidity deterioration. V4FinBench is designed to support the evaluation of tabular and foundation-model methods under realistic class imbalance, with positive rates between 0.19% and 0.36%. We provide reference evaluations of standard tabular baselines, finetuned TabPFN, and QLoRA-finetuned Llama-3-8B. With imbalance-aware finetuning, TabPFN matches or exceeds gradient boosting at longer time horizons on both

F_1

-score and ROC-AUC. In contrast, Llama-3-8B trails gradient boosting on ROC-AUC at every horizon and is generally weaker on

F_1

-score, with the gap widening sharply beyond the immediate horizon. In an external evaluation on the American Bankruptcy Dataset, the V4FinBench-finetuned TabPFN checkpoint improves over vanilla TabPFN, suggesting that adaptation captures transferable financial-distress structure rather than only V4-specific patterns. V4FinBench is publicly released to support further evaluation and development of prediction methods on realistic financial data.

Momentum

Related topics

Latest papers 1,643