Validation

Ask about this topic

Momentum

39 papers in the last four weeks, up 457% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 191

All topics
CardsList

  1. A rubric landscape for evaluating clinical reasoning in large language models: what exists, what is missing, and what needs to be combined

    Oct 1, 2026Zhangshu Joshua Jiang, Zina Ibrahim, James T. TeoClinical Reasoning TrainingLLM Reasoning Strategies

    DRIVE-Health CDT Department of Biostatistics and Health Informatics Institute of Psychiatry, Psychology and Neuroscience King’s College London London, UK

  2. Scientific Discovery under Validation Congestion via Multi-Fidelity Pairwise Rankings

    Oct 1, 2026Kevin Tirta Wijaya, Alston Lo, Michael Sun +2Drug DiscoveryScientific Discovery

    University of Bonn · Fraunhofer SCAI · Massachusetts Institute of Technology

  3. Model validation in machine learning: A scenario-based guide from hold-out splits to nested group cross-validation in biomedical and applied research

    Oct 1, 2026Mehmet Baygin, Sengul Dogan, Turker TuncerCross ValidationValidation

    Department of Computer Engineering, Faculty of Engineering and Architecture, Erzurum Technical University, Erzurum, Türkiye · Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Türkiye

  4. The Price of Correlated Tests: How Strict Should a Model Release Gate Be?

    Oct 1, 2026Marco PollanenReleaseGating

    Department of Mathematics & Statistics Trent University Peterborough, ON, Canada

  5. Paying for Too Many Tokens? Valid and Cost-Efficient Multimodal LLM Annotation with Simple Heuristics

    Sep 30, 2026Zhixi Zhu, Kristina GligoricLong Visual-Token SequencesLarge Language Model Annotations

    Johns Hopkins University

  6. Reliability-Aware Checkpoint Selection for Domain Generalization

    Sep 30, 2026Jinshi Liu, Jiahao Li, Pan Liu +5Multimodal Domain GeneralizationModel Checkpoints

    Shenzhen University · Xiamen University · The Hong Kong University of Science and Technology (Guangzhou) +3

  7. Hard-Gate Candidacy in a Deployed Validator Suite

    Sep 30, 2026Xin XuGatingValidation

    Carnegie Mellon University

  8. VACE: Validation-Gated Alternating Co-Evolution of Agent Models and Harnesses

    Sep 29, 2026Jiexing Qi, Yu He, Jun Liu +9Language-Model AgentsCo-Evolution

    ICT AI Competence Center, Huawei Technologies Co., Ltd., Shanghai, China · Shanghai Jiao Tong University, Shanghai, China

  9. WitnessGym: Benchmarking Coding Agents on the Construction of Bug Witnesses

    Sep 29, 2026Haomin Qi, Xiangzhe Xu, Yiming Huang +2BugCoding Agents

    University of California, San Diego · Purdue University · National University of Singapore

  10. Design and Validation of an Antagonistic Tendon-Driven Dexterous Robotic Hand with Bidirectional Operation

    Sep 28, 2026Chunghyeon Lee, Hyukjun Kwon, Sungeon Kim +2Robotic HandsBimanual Manipulation

    Department of Mechanical Engineering, Texas A&M University, College Station, TX 77843, USA · Department of Mechanical Engineering, Sogang University, Seoul 04107, South Korea

  11. When Valid Tool Calls Change Meaning: Formation-Consistent Dispatch for LLM Agents

    Sep 28, 2026Geonwoo Kim, Brent ByungHoon KangAgentic DeploymentsCall

    Korea Advanced Institute of Science and Technology

  12. When Is an SAE Feature Interpretable? A Validation Ladder for EEG Foundation Models

    Sep 28, 2026Yucong Cao, Chenqi Li, Tingting ZhuElectroencephalography Foundation ModelsSparse Autoencoder Features

    Department of Engineering Science University of Oxford

  13. Large Language Models for Structured Clinical Data Analysis: Dual-Agent Grounding and Validation

    Sep 28, 2026Erfan D. Dehkalani, Seetha Shankaran, Abbot R. Laptook +3Data Science AgentsValidation

    Fetal-Neonatal Neuroimaging and Developmental Science Center, Boston Children’s Hospital, and Harvard Medical School, Boston, MA, USA · Department of Pediatrics, Wayne State University School of Medicine, Detroit, MI, USA · Department of Pediatrics, Women & Infants Hospital of Rhode Island, and Warren Alpert Medical School of Brown University, Providence, RI, USA +1

  14. Maat: Independent Deterministic Contract-Based Governance for Multi-Agent LLM Workflows

    Sep 27, 2026Uliana ElinaLarge Language Model WorkflowsContracts

    SynWe Group s.r.o.

  15. Artificial Societies Benchmark: A Validation Framework for Synthetic Research

    Sep 24, 2026Edoardo Chidichimo, Min Jun Jung, Felix P. S. Wallis +1SurveyValidation

    Artificial Societies University of Oxford, UK

  16. Human-AI-Powered Hypothesis Testing: Cost-Aware Selective AI Scoring and Sequential Human Escalation

    Sep 24, 2026Dae Woong, Ham, Xuejun Zhao +2Artificial Intelligence EvaluationEscalation

    David · University of Michigan, Ann Arbor, MI 48109, USA · University of North Carolina at Charlotte, Charlotte, NC 28223, USA

  17. Consequential Behaviour and Representational Fairness in the Validation of Synthetic Research

    Sep 23, 2026Florian Kutzner, Celina Kacperski, Laura de Molière +4ValidationSurvey

    decision-context. · Seeburg Castle University, Seekirchen am Wallersee, Austria. · Artificial Societies Ltd., London, United Kingdom. +1

  18. Receptiveness, Not Sycophancy: Distinguishing Engagement from Deference in Language Models

    Sep 22, 2026Calvin Isley, Johann Gaebler, Max Lamparth +2SycophancyConversational Context

    Harvard Kennedy School, Harvard University, Cambridge, MA 02138, USA · Department of Statistics, Harvard University, Cambridge, MA 02138, USA · Computer Science, Stanford University, Stanford, CA 94305, USA

  19. A Practical Guide on Graphical Model Validation

    Sep 22, 2026Mario V. WüthrichActuarial RatemakingProbabilistic Graphical Models

    Department of Mathematics, ETH Zurich

  20. Auditing Proxy-Based Validation Across Text Spans

    Sep 22, 2026Daein Weon, Dong Ho KangValidationScores

    Kookmin University · UStechlab

  21. SSP-Bench: A Hybrid Data Generation Framework for Safety, Security, and Privacy Evaluation

    Sep 21, 2026Fatih Deniz, Yazan Boshmaf, Issa KhalilSecurityValidation

    Qatar Computing Research Institute (QCRI), HBKU, Doha, Qatar

  22. Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation

    Sep 17, 2026Sho Kawano, Zehang Richard Li, Paul A. ParkerArtificial Intelligence EvaluationConfidence Intervals

    Department of Statistics, University of California, Santa Cruz, CA, USA

  23. GraphSkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback

    Sep 17, 2026Ziqiao Shang, Ling-Yue Ge, Lan-Zhe GuoUnsupervised Skill DiscoveryFrozen Language Model

    National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China · School of Intelligence Science and Technology, Nanjing University, Suzhou, China

  24. Perception, Layout, and Validation: Calibrated Confidence for Reliable Straight-Through Processing of Financial Documents

    Sep 17, 2026Yichao Jin, Yushuo Wang, Yuxuan Han +7ValidationLarge Language Model Reliability

    OCBC, Singapore

  25. FCA-Guided Counterfactual Explanations for Multi-Modal Breast Cancer Diagnosis: A Framework Achieving Perfect Validity with Emergent Sparsity

    Sep 17, 2026Abdullahi Isa, Souley Boukari, Muhammad AliyuCancer DetectionCounterfactual Explanation

    Department of Computer Science, Faculty of Computing, Abubakar Tafawa Balewa University, Bauchi, Nigeria.

  26. Reproducibility is not construct validity: LLM measurement of institutionally situated communication

    Sep 17, 2026Veronika Batzdorfer, Carlo Romano Marcello Alessandro SantagiustinaInter-Annotator AgreementLarge Language Model Evaluation

    KIT · Department of Sociology and Computational Sociology, Karlsruhe Institute of Technology (KIT), Douglasstr. 24, 76133 Karlsruhe, Germany · ALMAnaCH, médialab, Sciences Po +2

  27. The segmentation ceiling: why explicit left-ventricular masks do not improve learned ejection-fraction regression

    Sep 17, 2026Farshid Farhadi Khouzani, Paul La Plante, Bryar Mustafa Shareef +1Left-Ventricular Ejection FractionCeiling

    Department of Computer Science, University of Nevada, Las Vegas, Las Vegas, NV, USA

  28. VAST: V2X/Dynamic Map-Aware Autonomous Driving Systems Validation Toolchain

    Sep 17, 2026Shunsuke Ito, Takuya AzumiV2XAutomated Vehicles

    Graduate School of Science and Engineering Saitama University · Academic Association (Graduate School of Science and Engineering) Saitama University

  29. PESTO: Formally Correct Registration of LiDAR Point Clouds with Limited Overlap

    Sep 16, 2026Valen Yamamoto, Matteo Marchi, Paulo TabuadaLight Detection And Ranging Point CloudsPoint Clouds

    Electrical and Computer Engineering Department, University of California at Los Angeles, Los Angeles, CA 90095 USA

  30. Beyond Measurement Metrics: A Human-Centered Framework for Semantic Validation of Network Traffic Classification

    Sep 15, 2026Igor Cherepanov, David Sessler, Alex Ulmer +2ExplainabilityTraffic

    Fraunhofer IGD, Darmstadt, 64283, Germany. · Technische Universität Darmstadt, Darmstadt, 64289, Germany.

  31. Can We Trust the Judges? Validation of Factuality Evaluation Methods via Answer Perturbation

    Sep 14, 2026Sarra Gharsallah, Adele Robaldo, Mariia Tokareva +5JudgesValidation

    Data Science Department, EURECOM, Campus SophiaTech, Biot, France

  32. Turkish MMLU Pro: Traceable Option Augmentation and Its Validity Limits in Turkish Multiple-Choice Evaluation

    Sep 14, 2026M. Ali BayramMultiple-Choice QuestionsMmlu-Pro

    Department of Computer Engineering, Yıldız Technical University İstanbul, Turkey

  33. A Corpus-Aligned Uthmani-to-Standard Quranic Word Mapping and a Deterministic Recitation Validator

    Sep 14, 2026Yahya Mohamed ElnawasanyCharacter Error RateValidation

    Independent Researcher, Egypt

  34. Autonomous Chemical Mechanistic Discovery through Agentic Reasoning and Validation

    Sep 12, 2026Dong Li, Sixuan Mi, Zihao Ye +10ReactionResearch Automation

    Shanghai Artificial Intelligence Laboratory, Shanghai, China. · Institute for Advanced Study in Mathematics, Harbin Institute of Technology, Harbin, China. · School of Chemistry and Molecular Engineering, East China Normal University, Shanghai, China. +4

  35. When Validation Stops Learning: Auditing Update Admission for Continual Embodied Agents

    Sep 12, 2026Qinzhen Ma, Ruihai WuAdmissibilityReplay-Based Continual Learning

    Rice University · University of California, Berkeley

  36. CHOIR: heterogeneity-aware conformal prediction for crash injury severity across driver safety strata

    Sep 10, 2026Amir Rafe, Subasish DasCertificationCrashes

    Civil Engineering, Texas State University, 601 University Drive, San Marcos, 78666 TX, USA

  37. AXON: A ROS 2 RMW with Shared-Memory/QUIC Transport and QKD/ML-KEM Key Establishment

    Sep 9, 2026Sergio Sánchez de la Fuente, Miguel Ángel González-Santamarta, Francisco Javier Rodríguez-Lera +2Robot Operating SystemPost-Quantum Cryptography

    Robotics Group Universidad de León

  38. API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces

    Sep 8, 2026Jennifer Wang, Joachim Baumann, Daniel E. Ho +1Application Programming InterfacesScores

    Stanford University

  39. Validating DBpedia Triple Sets for Natural Language Generation

    Sep 7, 2026Mark Andrade, Simon Mille, Anya Belz +1RdfNatural Language

    ADAPT Centre, Dublin City University, Ireland · University of Bordeaux, CNRS, LaBRI-UMR5800, France

  40. Fresh Memory, Stale Plans: Derivation Currency for Distributed LLM-Agent Memory

    Sep 3, 2026Evan Chen, Shiqiang Wang, Christopher G. BrintonGradient StalenessPeak Memory

    Purdue University · University of Exeter

  41. Design and Validation of a Lightweight, Low-Profile Powered Knee Prosthesis with Quasi-Direct Drive Actuation

    Sep 2, 2026Ross J. Cortino, Ryan Posh, Emily G. Keller +1FeetSoft Pneumatic Actuators

    Robotics Department, University of Michigan, Ann Arbor, MI 48109

  42. Fi-ImageNet-1k: An OOD Benchmark From the Inside of the ImageNet-1k Validation Set

    Sep 1, 2026Ruslan Rozumnyi, Matěj Suchánek, Tomáš Vojíř +2Out-Of-Distribution DetectionImagenet

    Visual Recognition Group · Department of Cybernetics · Faculty of Electrical Engineering +1

  43. Recovering Expert Critic-Sourced Network Adjacency between Musical Artists from Acoustic Distributions: A Construct-Validity Approach

    Aug 27, 2026Elena Badillo-Goicoechea, Fengfeng HeCollaborative FilteringSymbolic Music Generation

    University of Chicago Chicago, Illinois, USA

  44. Spending Scarce Confirmatory PET Measurements: Target-Aligned Validation in A4/LEARN

    Aug 23, 2026Eliuvish Han Cui, Qiang Yang, Meredith Mengmeng ZhangPositron Emission TomographyValidation

    Clinical Functional Service Provider (cFSP) Department, Kuntuo, an IQVIA company · Department of Biostatistics, University of California, Los Angeles · Department of Biometrics, Hengrui Pharmaceuticals

  45. Beyond Local Accuracy: A Protocol-Level Identifiability Audit for Controlled LLM Reasoning Evaluation

    Aug 13, 2026Junhao Luo, Ning Huang, Ziqi Sha +2Evaluation ProtocolsModel Auditing

    School of Statistics and Data Science, Southwestern University of Finance and Economics · School of Statistics and Data Science, Southwestern University of Finance and Economics Chengdu, China

  46. When Do Task Vectors Interfere? Mapping the Validity Boundaries of Weight-Space Composition

    Aug 10, 2026Chencheng Zhu, Xiaoyang Li, Taotao CaiWeight-SpaceTask-Level

    UNSW Sydney · University of Southern Queensland

  47. Reproducing and Stress-Testing Two Approaches to LLM Reasoning Reliability: Test-Time Probability Aggregation and Logic-Representation Editing

    Aug 9, 2026Minhan Cho, Jimin KweonLLM Reasoning StrategiesValidation

    Remember & Company AI Lab · DSAIL, Dept. of Applied AI · Sungkyunkwan University +2

  48. Yesterday's Shield, Today's Spear: A Self-Evolving Safety Guardrail in Production

    Aug 9, 2026Cong Ming, Jingyi Chen, Bin Liu +4GuardrailLarge Language Model Safety

    University of Science and Technology of China · Shenzhen University · Sangfor Technologies

  49. JTA: Joint Testability Architecture for Scenario-Based Validation of Safety-Critical Software

    Aug 6, 2026Wenyao Xue, Jiandi Wang, Yichen WangSafety-Critical ScenariosValidation

    Beihang University, Beijing, China

  50. Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted Scores

    Aug 4, 2026Zeyu Zhang, Bradly C. StadieMemorizationValidation

    Department of Statistics and Data Science Northwestern University

  51. Can AI Agents Simulate A/B Test Outcomes? A Validation Framework for Agentic Experimentation

    Aug 3, 2026Stefan Hut, Lorenzo MasoeroControlled StudyBehavioral Foundation Models

    Amazon

  52. FastGFDs: Efficient Validation of Graph Functional Dependencies with Desbordante

    Aug 3, 2026Anton Chernikov, Yurii Litvinov, Kirill Smirnov +1SubgraphsProfiling

    Saint-Petersburg University · Universe Data · Saint-Petersburg, Russia

  53. UpliftBench: Revealing Outcome-Regime and Objective Mismatch in Uplift Evaluation

    Aug 2, 2026Binshuang LiRiseHeterogeneous Treatment Effects

    Independent Researcher USA

  54. Beyond Component Testing: Validating Agentic AI Systems

    Jul 31, 2026Fabio Orazio Mirto, Luca D'Agati, Giuseppe Tricomi +4Production Agentic SystemsModel-Based Multi-Agent Systems

    Department of Biomedical, Dental, and Morphological and Functional Imaging Sciences, University of Messina, A.O.U. Policlinico “G.Martino” - Via Consolare Valeria, Messina, 98125, Italy. · Department of Engineering, University of Messina, Contrada di Dio, Sant’Agata, Messina, 98158, Italy. · Institute for High Performance Computing and Networking of National Research Council of Italy, ICAR-CNR, Via Pietro Castellino 111, Naples, 80131, Italy. +1

  55. Validation Evidence in LLM Repair Agents: How Much of What Passes Actually Tests the Bug?

    Jul 30, 2026Xiaonan Xu, Wenjing WuAutomated Program RepairBug

    College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA. · Department of Computer Science, University of Colorado Boulder, Boulder, CO, 80309, USA.

  56. Benchmarks Are Not Validation: A System-Level View of Financial LLM Applications

    Jul 30, 2026Burak Payzun, İrem Demirtaş, Simona Scala +2Finance BenchmarksLarge Language Model Evaluation

    Prometeia S.p.A.

  57. Evaluating Agentic Bioinformatics through Function, Evidence, and Validation

    Jul 30, 2026Phuc Pham, Truong-Son HyBioinformaticsAgentic Workflows

    Department of Computer Science, The University of Alabama at Birmingham, USA

  58. Explicit Note-Event Tokenization and Pitch-Validity Constrained Decoding for MIDI-to-Tablature Transcription

    Jul 29, 2026Ting-Kai Hsu, Wei-Chin Wang, Kai-Xi Hong +1Multi-Instrument Music TranscriptionTranscription

    Graduate Institute of Communication Engineering National Taiwan University Taipei, Taiwan · Department of Electrical Engineering National Taiwan University Taipei, Taiwan · Graduate Institute of Networking and Multimedia National Taiwan University Taipei, Taiwan

  59. VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation

    Jul 28, 2026Shutong Qiao, Wei Yuan, Tong Chen +3Sequential RecommendationRecommendation

    University of Queensland Brisbane, Australia · Computer Network Information Center, Chinese Academy of Sciences Beijing, China · Griffith University Gold Coast, Australia

  60. RIDGE: An Autonomous Framework for Validation and Method Discovery in LLM-Generated Option Pricing

    Jul 28, 2026Liexin Cheng, Xue Cheng, Shuaiqiang Liu +1Mathematical FinanceValidation

    Mathematical Institute, Utrecht University · School of Mathematical Sciences, Peking University · Delft Institute of Applied Mathematics, Delft University of Technology