Benchmark Datasets

Follow this topic Ask about this topic

Recent momentum

-41%

10 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

5 new papers

A weekly snapshot of new work published in Benchmark Datasets.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Benchmark Datasets.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Benchmark Datasets.

150 papers

Latest in Benchmark Datasets

Browse all topics →

LessonBench-V1: A Benchmark Dataset for Evaluating AI Lesson Generation Agents
Jun 12, 2026Ravidu Suien Rammuni Silva, Ahmad Lotfi, Isibor Kennedy Ihianle +2Tutors Human-Annotated Benchmark
HybridCodeAuthorship: A Benchmark Dataset for Line-Level Code Authorship Detection
Jun 10, 2026Luke Patterson, Li Wang, Adam FaulknerCode Quality Authorship
An Electric Potential-Augmented Benchmark Dataset for Physics-Guided Image Reconstruction of Electrical Capacitance Tomography
Jun 10, 2026Xinqi Zhang, Qiming Ma, Lihui PengImage Reconstruction Benchmark Datasets
ClusBench: The Clustering Benchmark Data Resource You've All Been Waiting For (?)
Jun 9, 2026David P. HofmeyrImage Clustering Synthetic Data
Benchmarking and Exploring the Capabilities of LLMs for Attack Investigations
Jun 9, 2026Aniket Anand, Yiwei Hou, Daniel Fields +4Security Analysis Algorithm Auditing
POPSICLE: Benchmark Datasets for Segmentation and Localization in CryoET
Jun 8, 2026Jonathan Schwartz, Utz Heinrich Ermel, C. Braxton Owens +6Cryo-Electron Microscopy Pixel-Level Annotation
DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions
Jun 4, 2026Nathan Bout, Maxime Langevin, Ronan RiochetBenchmark Datasets Real-World Manipulation Tasks
RIDE: An Open Dataset and Benchmark for Train Delay Prediction
Jun 3, 2026Clément Elliker, Mathis Le Bail, Clément Mantoux +2Railway Environments Accurate Traffic Forecasting
New Benchmarking Shows Limited Generalization Power of TCR Antigenic Epitope Prediction Models
Jun 3, 2026Yiming Liao, Yiheng Li, Ning Jiang +2Epitope Prediction Clinical Prediction
AICompanionBench: Benchmarking LLMs-as-Judges for AI Companion Safety
Jun 3, 2026Yanjing Ren, Reza Ebrahimi, TengTeng MaArtificial Intelligence Companions Large Language Model Safety
RelGT-AC: A Relational Graph Transformer for Autocomplete Tasks in Relational Databases
Jun 2, 2026Phillip JiangRelational Deep Learning Heterogeneous Graph Transformers
Benchmark Dataset for Catalysis on 2D MXenes
May 30, 2026Pavlo Melnyk, Anmar Karmush, Mårten Wadenbäck +4Heterogeneous Catalysis First-Principles Calculation
On the Robustness of Multilingual Text Embedding Rankings Across Learning Tasks, Languages, and Benchmark Datasets
May 29, 2026Ana Gjorgjevikj, Barbara Koroušić Seljak, Tome EftimovDomain-Invariant Text Embeddings Multilingual
Optimizing Latent Representations for Robust Building Damage Assessment Onboard Earth Observation Satellites
May 28, 2026Thomas Goudemant, Benjamin FrancesconiPost-Disaster Damage Assessment Satellite
How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions
May 28, 2026Jeff A. Bilmes, Gantavya Bhatt, Arnav M. DasBenchmark Datasets Objective Functions
Federated Learning for Multivariate Time Series Anomaly Detection in Industrial Automation
May 26, 2026Khayyam Nosrati, Martin Uray, Saverio Messineo +2Time-Series Anomaly Detection Federated Learning
Rethinking Weak Supervision in Anomaly Detection: A Comprehensive Benchmark
May 25, 2026Xu Yao, Siyuan Zhou, Zhenbo Wu +6Weak Supervision Anomaly Detection
Building an Adversarial Malware Dataset by Family and Type: Generation, Evasion, and Poisoning Evaluation
May 25, 2026David Košťál, Martin JurečekMalware Detection Evasion
Are We Overconfident in Models and Results for Semi-Supervised 3D Medical Image Segmentation?
May 25, 2026Jun Li, Ziwei QinMedical Image Segmentation Segmentation Model
PDEInvBench: A Comprehensive Dataset and Design Space Exploration of Neural Networks for PDE Inverse Problems
May 25, 2026Divyam Goel, Nithin Chalapathi, Sanjeev Raja +1Neural Partial Differential Equation Solvers Ill-Posed Inverse Problem
LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots
May 23, 2026Daria Grushina, Kseniia Kuvshinova, Alina Kostromina +3Tabular Learning Benchmark Datasets
An Open-Source Training Dataset for Foundation Models for Black-box Optimization
May 22, 2026Aaron Klein, Herilalaina Rakotoarison, Luca Thale-Bombien +1Black-Box Optimization Benchmark Datasets
Stabilising Explainability Fragility in Cybersecurity AI: The Impact and Mitigation of Multicollinearity in Public Benchmark Datasets
May 21, 2026Ioannis J. Vourganas, Anna Lito MichalaExplainability Intrusion Detection
Evaluation of Pipelines for Data Integration into Knowledge Graphs
May 21, 2026Marvin Hofer, Erhard RahmKnowledge Graphs Benchmark Datasets
ShadeBench: A Benchmark Dataset for Building Shade Simulation in Sustainable Society
May 19, 2026Longchao Da, Mithun Shivakoti, Xiangrui Liu +3Urban Environments Scene Bias
Less Data, Faster Training: repeating smaller datasets speeds up learning via sampling biases
May 19, 2026Jingwen Liu, Ezra Edelman, Surbhi Goel +1Unified Inductive Bias Table Reasoning Datasets
LLM Benchmark Datasets Should Be Contamination-Resistant
May 19, 2026Ali Al-Lawati, Jason Lucas, Dongwon Lee +1Contamination-Aware Benchmarking Framework Benchmarking Large Language Models
MSAlign: Aligning Molecule and Mass Spectra Foundation Models for Metabolite Identification
May 19, 2026Paul Krzakala, Gabriel Melo, Camille Lançon +4Tandem Mass Spectra Metabolic
Provable Fairness Repair for Deep Neural Networks
May 19, 2026Jianan Ma, Jingyi Wang, Qi Xuan +1Fairness-Aware Learning Benchmark Datasets
PIPER: Content-Based Table Search via profiling and LLM-Generated Pseudoqueries
May 18, 2026Riccardo Terrenzi, Matteo Falconi, Serkan Ayvaz +1Tabular Data Complex Query Answering
Memisis: Orchestrating and Evaluating Synthetic Data for Tabular Health Datasets
May 18, 2026Nitish Nagesh, Pengbao Zhou, Atchuth Naveen Chilaparasetti +8Synthetic Data Benchmark Datasets
TextClusterLab: An Integrated Framework for Reliable Text Clustering Studies
May 17, 2026Daoming Wan, Yizheng Huang, Jimmy X. HuangTextual Dataset Benchmark Datasets
Federated Learning of Spiking Neural Networks under Heterogeneous Temporal Resolutions
May 14, 2026Sanja Karilanova, Subhrakanti Dey, Ayça ÖzçelikkaleSpiking Neural Networks Heterogeneous Federated Learning
Croissant Baker: Metadata Generation for Discoverable, Governable, and Reusable ML Datasets
May 14, 2026Rafi Al Attrach, Rajna Fani, Sebastian Lobentanzer +17Benchmark Datasets Metadata
TILBench: A Systematic Benchmark for Tabular Imbalanced Learning Across Data Regimes
May 14, 2026Ruizhe Liu, Jiaqi LuoTabular Learning Tabular Data
PiAnnotate: A Web Annotation Tool for Piano Fingering, with a Diagnostic Probe
May 14, 2026Joonhyung Bae, Kirak Kim, Hyeyoon Cho +8Piano Human Annotations
TabPFN-3: Technical Report
May 13, 2026Léo Grinsztajn, Klemens Flöge, Oscar Key +38Tabpfn Benchmark Datasets
Fast and effective algorithms for fair clustering at scale
May 13, 2026Claudio Mantuano, Manuel Kammermann, Philipp BaumannImage Clustering Unsupervised
Fast and Compact Graph Cuts for the Boykov-Kolmogorov Algorithm
May 13, 2026Christian Møller Mikkelstrup, Anders Bjorholm Dahl, Philip Bille +2Maximum Independent Set Computer Vision
GraphIP-Bench: How Hard Is It to Steal a Graph Neural Network, and Can We Stop It?
May 12, 2026Kaixiang Zhao, Bolin Shen, Yuyang Dai +2Graph Neural Networks Graph Representations
CIDR: A Large-Scale Industrial Source Code Dataset for Software Engineering Research
May 12, 2026Vladislav SavenkovRepository Code Quality
FastUMAP: Scalable Dimensionality Reduction via Bipartite Landmark Sampling
May 12, 2026Hongmin LiDimensionality Reduction Statistical Manifold
Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New Insights
May 11, 2026Wenbo Chen, Veena Padmanabhan, Tootiya Giyahchi +2Hallucination Detection Large Language Model Hallucination
V4FinBench: Benchmarking Tabular Foundation Models, LLMs, and Standard Methods on Corporate Bankruptcy Prediction
May 11, 2026Marcin Kostrzewa, Sebastian Tomczak, Roman Furman +5Credit Risk Prediction Tabular Foundation Models
BEACON: A Multimodal Dataset for Learning Behavioral Fingerprints from Gameplay Data
May 11, 2026Ishpuneet Singh, Gursmeep Kaur, Uday Pratap Singh Atwal +3Biometrics Authentication
MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image
May 11, 2026Alan Arazi, Eilam Shapira, Shoham Grunblat +8Tabular Learning Tabular Foundation Models
ThreatCore: A Benchmark for Explicit and Implicit Threat Detection
May 11, 2026Davide Bruni, Carlo Bardazzi, Maurizio TesconiHate Speech Threat Models
Sens-VisualNews: A Benchmark Dataset for Sensational Image Detection
May 11, 2026Andreas Goulas, Damianos Galanopoulos, Evlampios Apostolidis +1Fake News Detection Saliency
Unsupervised Process Reward Models
May 11, 2026Artyom Gadetsky, Maxim Kodryan, Siba Smarak Panigrahi +2Reliable Medical Process-Level Reward Model Evaluation Framework Large Language Model Reasoning
HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities
May 10, 2026Shusaku Egami, Aoi Ohta, Tomoki Tsujimura +5Knowledge Graph Embeddings Knowledge Graphs
TailedTS: Benchmark Dataset for Heavy-Tailed Time Series Prediction and Periodicity Quantification
May 9, 2026Xinyu Chen, HanQin Cai, Lijun Ding +1Long-Tailed Distribution Time Series
CA-SQL: Complexity-Aware Inference Time Reasoning for Text-to-SQL via Exploration and Compute Budget Allocation
May 8, 2026James Petullo, Nianwen XueText-To-Sql Sql
FLAM: Evaluating Model Performance with Aggregatable Measures in Federated Learning
May 8, 2026Fabian Stricker, Jose A. Peregrina, David Bermbach +1Federated Learning Model Evaluation
Have Graph -- Will Lift? The Case for Higher-Order Benchmarks
May 8, 2026Bastian RieckTopological Deep Learning Higher Order
ModelLens: Finding the Best for Your Task from Myriads of Models
May 8, 2026Rui Cai, Weijie Jacky Mo, Xiaofei Wen +5Benchmark Datasets Machine Learning
LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)
May 6, 2026Wei Luo, Yiting Lu, Xin Li +32Large-Scale Video Generation Models Video Quality
Building informative materials datasets beyond targeted objectives
May 6, 2026Rafael Espinosa Castañeda, Ashley Dale, Hongchen Wang +6Data-Driven Materials Discovery Synthetic Dataset
Evaluating Tabular Representation Learning for Network Intrusion Detection
May 4, 2026Muhammad Usman Butt, Andreas Hotho, Daniel SchlörIntrusion Detection Reconstruction-Based Anomaly Detection
Evaluating LLMs on Large-Scale Graph Property Estimation via Random Walks
May 2, 2026Sunil Kumar Maurya, Xin LiuBenchmarking Large Language Models Large Language Model Evaluation
GameScope: A Multi-Attribute, Multi-Codec Benchmark Dataset for Gaming Video Quality Assessment
May 2, 2026Rajesh Sureddi, Shreshth Saini, Avinab Saha +1Video Quality Video Dataset

Jun 12, 2026 · cs.CYJ/K move · Enter open · S save

LessonBench-V1: A Benchmark Dataset for Evaluating AI Lesson Generation Agents

Ravidu Suien Rammuni Silva, Ahmad Lotfi, Isibor Kennedy Ihianle, Golnaz Shahtahmassebi+1

Department of Computer Science, Nottingham Trent University, Nottingham, UK · Department of Physics and Mathematics, Nottingham Trent University, Nottingham, UK

Large Language Model (LLM) based AI educational content generation systems are increasingly being developed, yet no standardised benchmark exists to systematically evaluate them. This study introduces LessonBench-V1, a benchmark dataset comprising 647 human-written lessons paired with LLM-based reverse-engineered lesson plans across 240 STEM topics spanning mathematics, physics, chemistry, and computer science. The lessons are drawn from 97 trusted open sources, including LibreTexts, Brilliant.org and GeeksForGeeks. Each lesson plan is human-reviewed and produced through a pedagogically grounded methodology that synthesises Bloom's Taxonomy, Gagné's Events, Merrill's First Principles, and the 5E Instructional Model. The lesson plans capture 3,620 learning objectives with pedagogical metadata, enabling systematic, reproducible evaluation of lesson-generation AI agents and supporting further research. The study further proposes a three-dimensional evaluation pipeline for use with the dataset.

Tutors Human-Annotated Benchmark Benchmark Datasets

Open paper Ask about it PDF