Reproducibility

Follow this topic Ask about this topic

Recent momentum

-14%

24 papers in the last 28 days · 0.4% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

7 new papers

A weekly snapshot of new work published in Reproducibility.

Period ending 2026-09-14

6 new papers

A weekly snapshot of new work published in Reproducibility.

Period ending 2026-09-07

16 new papers

A weekly snapshot of new work published in Reproducibility.

229 papers

Latest in Reproducibility

Browse all topics →

Traxia: A Framework for Verifiable, Agent-Native Scientific Publishing
Jun 6, 2026Wisdom DogahPeer Review Reproducibility
Illusions of the Gold Standard: A Large-scale Analysis of Human Evaluation Protocols for Long-form Text Generation
Jun 6, 2026Katelyn Xiaoying Mei, Yi-Li Hsu, Minjoon Choi +5Reproducibility Long-Form Generation
Accelerating Reproducible Research in Synthetic EHR Generation
Jun 5, 2026Jalen Jiang, Chufan Gao, Ethan Rasmussen +2Electronic Health Records International Classification Of Disease Codes
Tight list replicability bounds via a novel sphere covering theorem
Jun 4, 2026Ari Blondal, Hamed Hatami, Pooya Hatami +2Repetition Reproducibility
Revisiting Vul-RAG: Reproducibility and Replicability of RAG-based Vulnerability Detection with Open-Weight Models
Jun 3, 2026Sabrina Kaniewski, Fabian Schmidt, Tobias HeerVulnerability Detection & Repair Reproducibility
Failure Modes of Deep Multi-Agent RL in Asynchronous Pricing: Reproducible Triggers, Trace Diagnostics, and a Partial Fix
Jun 3, 2026Shree Murthy, Rohan PandeyMulti-Agent Reinforcement Learning Algorithmic Collusion
Reproducibility is the New Copyleft: Defining AGI-oriented Reproducible Builds
Jun 2, 2026Masayuki HattaArtificial Intelligence Governance Artificial Intelligence Systems
ERICA: Quantifying Replicability of Cluster Analysis
May 29, 2026Siamak K. Sorooshyari, Manuel A. Rivas, Robert TibshiraniImage Clustering Reproducibility
A Unified and Reproducible Experimentation Framework for Speech Understanding
May 29, 2026Jing Peng, Junhao Du, Chenghao Wang +21Speech Large Language Models Reproducibility
EASE Configuration Facilitates A Reproducible Science of LLM Social Simulations
May 28, 2026Sneheel Sarangi, Maximilian Puelma Touzel, Aurélien Bück-Kaeffer +3User Simulation Multi-Agent Simulations
ResearchClawBench: A Benchmark for End-to-End Autonomous Scientific Research
May 28, 2026Wanghan Xu, Shuo Li, Tianlin Ye +48Autoresearch Agentic Benchmarks
Replicable Simulation-Based Robot Validation through Provenance
May 28, 2026Argentina Ortega, Samuel Wiest, Frederik Pasch +1Scalable Robot Data Synthesis Reproducibility
Croissant Tasks: A Metadata Format for Reproducible Machine Learning Evaluations
May 28, 2026Omar Benjelloun, Leonardo Martins Bianco, Isabelle Guyon +8Reproducibility Metadata
From paper to benchmark: agentic, framework-based reproduction of under-specified methods in machine health intelligence
May 27, 2026Raffael Theiler, Ludovico Comito, David Leko +3Reproducibility Mle-Bench Lite
ResearchLoop: An Evidence-Gated Control Plane for AI-Assisted Research
May 27, 2026Yihan Xia, Taotao WangAutoresearch Academic Papers
Persistent AI Agents in Academic Research: A Single-Investigator Implementation Case Study
May 26, 2026Anas H. AlzahraniAgent Memory Artificial Intelligence Agents
ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence
May 25, 2026Rui Meng, Bhavana Dalvi Mishra, Jiefeng Chen +10Autoresearch Scientific Agents
Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning
May 25, 2026Jun-Tao Tang, Yu-Cheng Shi, Zhen-Hao Xie +1Multimodal Instruction Tuning Instruction Tuning
What Gets Cited: Competitive GEO in AI Answer Engines
May 25, 2026Rahul Vishwakarma, Shushant Kumar, Ratnesh JamidarCitations Relevance
ViroBench: Benchmarking Nucleotide Foundation Models on Viral Genomics Tasks
May 25, 2026Dongxin Ye, Fang Hu, Han Hu +6Viral Sharing Reproducibility
InvariantCloud: A Globally Invariant, Uniquely Indexed Point Cloud Framework for Robust 6-DoF Tactile Pose Tracking
May 24, 2026Pengfei Ye, Yuxiang Ma, Yi Zhou +3Category-Level Object Pose Estimation 6-Dof
Soft Pneumatic Actuators for Soft Robotics: A Motion-Based Review of Actuation Mechanisms and Performance Trade-offs
May 24, 2026Mohammed AbboodiSoft Pneumatic Actuators Trade-Off
Auditable Climate Risk Intelligence from Fragmented ESG Data: Deterministic Orchestration and Imbalance-Aware Learning for Scope 1-3 Validation
May 23, 2026Karan Sehgal, Khawar Naveed BhattiContent Provenance Reproducibility
Position: AI for Science Should Treat Measurement-to-Dataset Pipelines as Inference Components
May 23, 2026Ling Zhan, Xiaoyao Yu, Tao JiaScientific Workflows Scientific Discovery
Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks
May 22, 2026Ashok Chandrasekar, Jason KrambergerPer-Token Latency LLM Inference Efficiency
Paraphrase Brittleness in Production Retrieval-Augmented Commercial Recommendation: Reproducibility Below the Rerun-Stability Baseline
May 22, 2026Will Jack, Noah Lehman, Keller Maloney +1Brand Pairs Reproducibility
Sparse In-Network Learning via Shortest-Path Backpropagation and Finite-Rate Gating
May 22, 2026Mohammad Reza Deylam SalehiBackpropagation Regularization Techniques
A Reproducible Universal Dependencies-Style Pipeline for Katharevousa Greek Parliamentary Text
May 21, 2026George Mikros, Fotios FitsilisAncient Greek Parliamentary Discourse
Sibyl-AutoResearch: Autonomous Research Needs Self-Evolving Trial-and-Error Harnesses, Not Paper Generators
May 21, 2026Chengcheng Wang, Qinhua Xie, Wei He +3Autoresearch Scientific Workflows
Comparative Evaluation of Deep Learning Models for Fake Image Detection
May 20, 2026Akhitha Pakala, Mohammed Mahir Rahman, Shahzad Memon +1Explainable Deepfake Detection Digital Forensics
VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
May 20, 2026Alex S. Huang, Jiahui Zhang, Shiqing Tang +1Robotic Datasets Generalizable Robotic Manipulations
Using Aristotle API for AI-Assisted Theorem Proving in Lean 4: A Formalisation Case Study of the Grasshopper Problem
May 19, 2026Gabriel Rongyang LauTheorem Proof
MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility
May 15, 2026Sasi Kiran Gaddipati, Diyana Muhammed, Farhana Keya +2Reproducibility Autoresearch
Marginal Alignment Does Not Guarantee Joint-Distribution Fidelity: An Official-Reference Audit of Nemotron-Personas-Korea with Cross-Locale Replication
May 15, 2026Joonhyung BaeDemographics Persona
paper.json: A Coordination Convention for LLM-Agent-Actionable Papers
May 15, 2026Arquimedes CanedoReproducibility Large Language Model Agents
Saturating Scaling Laws for Equational Discovery: A Phenomenology of Growth Dynamics in Three Toy Substrates with Two Real-World Replications
May 14, 2026Fabio RovaiPower-Law Distribution Scaling Laws
ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents
May 13, 2026Yuxiang Lai, Peng Xia, Haonian Ji +8Agentic Benchmarks Computer-Use Agents
Measuring and Mitigating Toxicity in Large Language Models: A Comprehensive Replication Study
May 13, 2026Mokshit Surana, Archit Rathod, Akshaj SatishkumarLarge Language Model Safety Toxicity
Improving Reproducibility in Evaluation through Multi-Level Annotator Modeling
May 13, 2026Deepak Pandita, Flip Korn, Chris Welty +1Reproducibility Large Language Model Evaluation
It's not the Language Model, it's the Tool: Deterministic Mediation for Scientific Workflows
May 13, 2026Marios Adamidis, Danae Katrisioti, Yannis Tzitzikas +1Reproducibility Scientific Workflows
Neurodata Without Boredom: Benchmarking Agentic AI for Data Reuse
May 12, 2026Ling-Qi Zhang, Kristin BransonArtificial Intelligence Scientists Reproducibility
A Comparative Study of Controlled Text Generation Systems Using Level-Playing-Field Evaluation Principles
May 12, 2026Michela Lorandi, Anya BelzText Generation Reproducibility
Rollout Cards: A Reproducibility Standard for Agent Research
May 12, 2026Charlie Masters, Ziyuan Liu, Stefano V. AlbrechtLong Rollouts Reproducibility
Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing
May 11, 2026Yunze Zhao, Yibo Zhao, Yuchen Zhang +2Vulnerability Detection & Repair Large Language Model Serving
Quantifying the Reconstructability of Astrophysical Methods with Large Language Models and Information Theory: A Case Study in Spectral Reconstruction
May 11, 2026Hsing Wen Lin, Zong-Fu SieReproducibility Spectral Reconstruction
From Accuracy to Auditability: A Survey of Determinism in Financial AI Systems
May 11, 2026Ruizhe Zhou, Xiaoyang Liu, Gaoyuan Du +4Algorithm Auditing Reproducibility
CheckSupport: A Local LLM-Powered Tool for Automated Manuscript Submission Checklist Selection and Completion
May 10, 2026Satvik Tripathi, Don Enwerem, Kevin Song +3Reproducibility Papers
Your Simulation Runs but Solves the Wrong Physics: PDE-Grounded Intent Verification for LLM-Generated Multiphysics Simulation Code
May 10, 2026Zhenghan Song, Yulong Liu, Cheng Wan +4Code Generation Correctness
Data Contamination in Neural Hieroglyphic Translation: A Reproducibility Study
May 8, 2026Ammar Toutou, Abdelrahman Harb, Christine BastaNeural Machine Translation Models Translation Quality
Business Utility of Large Language Models as Exploratory Data Analysis Agents
May 8, 2026Rafał Łabędzki, Patryk Miziuła, Hubert Rutkowski +5Reproducibility Supply Chain Optimization
CellScientist: Dual-Space Hierarchical Orchestration for Closed-Loop Refinement of Virtual Cell Models
May 8, 2026Mengran Li, Bo Li, Jiaying Wang +12Single-Cell Perturbation Prediction Scientific Workflows
A Reproducible Multi-Architecture Baseline for Token-Level Chinese Metaphor Identification under the MIPVU Framework
May 8, 2026Yufeng WuMetaphors Text Corpora
Beyond Reproducibility: Towards Security-Aware Evaluation of Research Artifacts
May 7, 2026Nanda Rani, Christian RossowSecurity Analysis Security
From Agent Loops to Deterministic Graphs: Execution Lineage for Reproducible AI-Native Work
May 7, 2026Josh Rosen, Seth RosenAgent Loop Multi-Agent Large Language Model Systems
BioMedArena: An Open-source Toolkit for Building and Evaluating Biomedical Deep Research Agents
May 7, 2026Jinge Wu, Hongjian Zhou, Mingde Zeng +8Agentic Benchmarks Biomedical Knowledge
NeurIPS Should Require Reproducibility Standards for Frontier AI Safety Claims
May 5, 2026Varad Vishwarupe, Nigel Shadbolt, Marina Jirotka +1Artificial Intelligence Safety Reproducibility
Reservoir property image slices from the Groningen gas field for image translation and segmentation
May 5, 2026Abdulrahman Al-Fakih, Nabil Sariah, Ardiansyah Koeshidayatullah +1Vision Datasets Geological Semantic Understanding
ProtDBench: A Unified Benchmark of Protein Binder Design and Evaluation
May 5, 2026Cong Liu, Milong Ren, Jiaqi Guan +4Protein Design Reproducibility
ARA: Agentic Reproducibility Assessment For Scalable Support Of Scientific Peer-Review
May 4, 2026Kevin Riehl, Andres L. Marin, Nikofors Zacharof +6Reproducibility Peer Review
AutoResearch: An Execution-Grounded Multi-Agent Framework for Reliable Research Workflow Automation
May 4, 2026Rajesh Kumar, Waqar Ali, Junaid Ahmed +2Autoresearch Automated

Jun 6, 2026 · cs.AIJ/K move · Enter open · S save

Traxia: A Framework for Verifiable, Agent-Native Scientific Publishing

Wisdom Dogah

Verifiability, attribution, and reproducibility are foundational requirements of scientific knowledge, yet current publishing infrastructure does not enforce them at scale. We introduce Traxia, an agent-native scientific publishing framework in which AI research agents publish verifiable papers, build reputational identities, peer-review one another, and collaborate with humans in a shared provenance model. Traxia treats agents as first-class epistemic participants: every paper carries a reasoning trace, every claim a confidence interval, every agent a cryptographically signed identity, and every collaboration an immutable contribution log. We formalise five components: Agent Identity and Registry, Verifiable Publishing Layer, four-tier Peer Review Protocol, Reputation and Staking Engine, and a Knowledge Graph with contradiction detection. The framework targets reproducibility failure, provenance opacity, and exclusion of Global South research capacity. This paper presents architectural foundations and formal specifications only; it does not report empirical results. Evaluation and deeper component studies will follow in subsequent papers. A prototype partially implements core formalisms; the full system remains under active development.

Peer Review Reproducibility Content Provenance Verifier Epistemic Actions

Open paper Ask about it PDF