Scoring

Ask about this topic

Momentum

10 papers in the last four weeks, up 25% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 71

All topics
CardsList

  1. Scoring Higher, Answering Worse: Mitigating Reward Hacking in Rubric-Based RL via Protocol-Level Rubrics

    Sep 30, 2026Maoqi Liu, Junwei He, Bowen Zhang +5RubricsScoring

    Beijing University of Posts and Telecommunications · ByteDance

  2. Text2Sim: Agentic Physics-Based Simulation Generation with Distilled Expertise

    Sep 29, 2026Xiaoyu Xiong, Tsun-Hsuan Wang, Yi-Ling Qiao +2Physics SimulationAgentic

    Tsinghua University · Carnegie Mellon University · Genesis AI +1

  3. When the Score Becomes the Target: Rethinking Metric Validity in Autonomous Driving

    Sep 28, 2026Morui Zhu, Deyuan Qu, Qi Chen +2Autonomous DrivingScoring

    University of North Texas · Toyota InfoTech Labs

  4. Scoring Both Directions: LLMs realize the MRS they cannot reliably parse

    Sep 24, 2026Soham DanContext-Free GrammarsScoring

    Scale AI

  5. Can LLMs Catch a Rigged Backtest? A Clean-Control Calibration Benchmark

    Sep 23, 2026Makar Ulesov, Vladislav Smirnov, Omar Ibrahim +1Model AuditingCode Quality

    Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) · School of Computing and Information, University of Pittsburgh

  6. MORSE: Multi-Context Ordering via Reverse Scoring for Evidence-Preserving Compression

    Sep 23, 2026Ke Wan, Yifan Wang, Liheng Lai +1Data Compression MethodsBounded-Memory

    Department of Computer Science University of Virginia Charlottesville, VA, USA · AfterQuery

  7. You Should Be Properly Scoring Your Odometry

    Sep 22, 2026Ola Rønning, Usama Saqib, Andrzej WąsowskiOdometryRobust Lidar-Inertial Odometry

    Software Quality Research Group, IT University of Copenhagen, Denmark

  8. OSCAR: Order-aware Scoring and Calibration for AI Rankings

    Sep 21, 2026You Liu, Yue Liu, Quanchao Lu +1ScoringRanking

  9. How Calibration Content Shapes Attention-Based Reranking

    Sep 15, 2026Petros Karypis, Hossein Rajaby Faghihi, Peter Chen +4Cross-Encoder RerankingRelevance

    UC San Diego · Google · Google DeepMind

  10. The Answer Path and the Grounding Instruction in LLM Question Answering over Knowledge Graphs

    Sep 9, 2026Arquimedes CanedoKnowledge GraphsSparql

    Siemens Digital Industries Software Princeton, NJ, USA

  11. GLASS: Graph-Language Alignment with Spherical Scoring for Transferable Graph-Level Anomaly Detection

    Sep 4, 2026Xudong Wang, Chris Ding, Tongxin Li +1Generalist Graph Anomaly DetectionMotion-Language Alignment

    School of Data Science, The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China

  12. Designing Versatile Samples for Learned Trajectory Scoring

    Sep 1, 2026Yaguang Li, Jiaru Zhang, Chuheng Wei +2Trajectory GenerationClassical Planning

    Purdue University1 · Bosch Artifical Intelligence Center2

  13. A Unified Uncertainty-Aware Back-End for Speaker Verification: Scoring, Normalization, and Calibration

    Sep 1, 2026Junjie Li, Kong Aik LeeAutomatic Speaker VerificationSpeaker

    Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR

  14. Retrieval, Scoring, and Decoding Shape Performance and Stability in LLM-based Conversational Recommendation

    Aug 31, 2026Ante Kapetanovic, Tomislav Duricic, Andro Mercep +1Cross-Encoder RerankingRecommendation

    Infobip · Split, Croatia · Zagreb, Croatia

  15. Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation

    Aug 30, 2026Nishant Balepur, Paiheng Xu, Wei Ai +3Multiple-Choice QuestionsScoring

    University of Maryland · New York University · Nanyang Technological University

  16. When Do Supervised UQ Ensembles Improve LLM Hallucination Detection? A Robustness Study

    Aug 25, 2026Mohit Singh Chauhan, Vipin Gyanchandani, Dylan BouchardLarge Language Model HallucinationHallucination Detection

    CVS Health®, Wellesley, MA, USA

  17. Personalized Scorer Modeling: A Learning-Based Framework for Deriving Robust Sleep Stage Labels from Multiple Experts

    Aug 12, 2026Seyyed Ali Hoseini, Javad Baseri, Hamid Saadatfar +2SleepScoring

    Department of Electrical and Computer Engineering, University of Birjand, Birjand, South Khorasan, Iran

  18. Structure-Enhanced Features and Quality-Aware Dynamic Anchor Scoring for Robust Lane Detection

    Aug 10, 2026Weize Cai, Yongqi Dong, Zhida Shao +2Unsupervised DetectionFeature Extraction

    RWTH Aachen University, Aachen, Germany · Delft University of Technology, Delft, The Netherlands · Chang’an University, Xi’an, China

  19. WorldCup Arena: Prospective, Leakage-Free Evaluation of Frontier LLMs on a Live Tournament

    Aug 4, 2026Zhenran Wang, Zhonghan Bian, Jinsong Li +1Large Language Model ForecastingCompetition

  20. Comparative Validation of GPT-4o-mini and Teacher Mean Scores for Automated Scoring of Music Analysis Responses: Single-Pass Deployment, Repeatability, and Strategy-Specific Bias

    Aug 3, 2026Baicheng Lin, Lingxi Jin, Kyung-Seok MinRubric-Based ScoringScoring

    Department of Education, Sejong University, South Korea · Department of Educational Technology, Ewha Womans University, South Korea

  21. Verification Without Sufficiency: Per-Chunk Filtering Fails on Multi-Hop RAG, and Decomposition Repairs It

    Aug 1, 2026Randhir KumarMulti-Hop ReasoningEntailment

    Independent Researcher

  22. LOCUS-DT: Localization via Observation-Conditioned Uncertainty Scoring with Digital Twins

    Aug 1, 2026Haozhe Lei, Roberto Bomfin, Marwa Chafii +1Indoor LocalizationDigital Twins

    NYU WIRELESS, Tandon School of Engineering, New York University, Brooklyn, NY 11201, USA · Engineering Division, New York University Abu Dhabi, 129188, UAE

  23. CalibratedRubric: Task-Adaptive Rubric Banks for Open-Ended LLM Evaluation

    Jul 31, 2026Mengting Chen, Yanshu Sun, Wanting Liang +5Task-Specific RubricsRubrics

    FinStep · StepFun

  24. ClawTrack: Towards Trace-Level Evaluation and Improvement of Real-World Autonomous Agents

    Jul 30, 2026Xingjian Wu, Xuhang Zhu, Xingchen Liu +6Autonomous AgentsClaw-Like Agent

    Meituan

  25. ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring

    Jul 30, 2026Shengjie Li, Vincent NgAutomated Essay ScoringScoring

    Human Language Technology Research Institute University of Texas at Dallas Richardson, TX 75080-0688

  26. Learning Color Grading, No Photo Sharing: Federated Aesthetic Preference Learning for Personalized Image Enhancement

    Jul 30, 2026Chuanzhi Xu, Ziyuan Tao, Jean Julien KNell +5Image EnhancementFedavg

    The University of Sydney · Macquarie University

  27. PhaseAware: Interpretable Human-in-the-Loop Rehabilitation Scoring with Boundary Monitoring

    Jul 22, 2026Yankai Zheng, Yuhe Liu, Yuxin Ma +8RehabilitationMultimodal Evaluation

    Department of Medical Imaging, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, 710061, China · Faculty of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an, 710049, China · School of Future Technology, Xi'an Jiaotong University, Xi'an, 710049, China +2

  28. Copy-on-Write Scoring: Application-Specific Agent Evaluations

    Jul 15, 2026Joanna Roy, Sven HoelzelAgentic EvaluationsAgentic Workflow Design

    trail-ml, Munich, Germany

  29. Self-supervised Speech Comparison for L2 Phone, Rhythm, and Intonation Scoring

    Jul 15, 2026Stephen McIntosh, Reuben Smit, Daisuke Saito +2Grapheme-To-PhonemeProsody

    The University of Tokyo, Japan · Stellenbosch University, South Africa

  30. CLIP-Guided Label-Free Discriminative Region Scoring for Fine-Grained Classification

    Jul 15, 2026Yujie ZhuHigh Confidence Pseudo-LabelsLabel-Free

    State University of New York at Buffalo

  31. Evaluating Frontier AI Agents as Autonomous Clinical Security Auditors

    Jul 15, 2026Michael O. EnioladeSecurity EvaluationArtificial Intelligence Risk

    University of the Cumberlands

  32. Evaluating Nonuniform Dependability Across Response Conditions: A Conditional Generalizability Framework Illustrated in Automated Essay Scoring

    Jul 13, 2026Yi GuiAutomated Essay ScoringScoring

    Measurement Incorporated

  33. Q-Score: A Quantum-Native Scoring Function for Molecular Docking

    Jul 2, 2026Kangyu Zheng, Yidong Zhou, Ruihao Li +3Quantum ChemistryQuantum Approximate Optimization Algorithm

    Department of Computer Science and Engineering The Chinese University of Hong Kong Shatin, N.T., Hong Kong SAR · Department of Electrical and Computer Engineering Rutgers University Piscataway, NJ · Computational Life Sciences Cleveland Clinic Cleveland, OH +1

  34. Role-Aware Neural Convex Divergence Heads for Asymmetric Representation Learning

    Jul 2, 2026He Huang, Lu Shen, Yunfeng Huang +1DivergenceEntailment

    School of Mathematics and Statistics, Chongqing Technology and Business University, Chongqing, 400067, China · School of Food Science, Chongqing Technology and Business University, Chongqing,2026 400067, China · Faculty of Electrical EngineeringUniversity, andDortmund,InformationGermanyTechnology, TU Dortmund +1

  35. Off the Rails: Hijacking the Scoring Head in Generative End-to-End Driving Planners with Safety-Violating Adversarial Perturbations

    Jun 29, 2026Halima Bouzidi, Mboutidem Ekemini Mkpong, Haoyu Liu +1Causality-Aware End-To-End Autonomous DrivingAutonomous Driving

    University of California, Irvine, CA, USA

  36. AI Trading's Alpha Singularity: Emergent Market Reasoning through Agent-to-Agent Self-Evolution

    Jun 28, 2026Yuqi Li, Siyuan Liu, Bingjun LiuAlgorithmic TradingSelf-Evolving Agents

    Panda AI

  37. Scoring Is Not Enough: Addressing Gaps in Utility-fairness Trade-offs for Ranking

    Jun 24, 2026Shubham Singh, Ian A. Kash, Mesrob I. OhannessianAlgorithmic FairnessScoring

    Department of Computer Science University of Illinois Chicago Chicago, IL 60607 · Department of Electrical and Computer Engineering University of Illinois Chicago Chicago, IL 60607

  38. How Reliable Is Your Jailbreak Judge? Calibration and Adversarial Robustness of Automated ASR Scoring

    Jun 24, 2026Yang GaoLlm-As-A-JudgeLarge Language Model Jailbreaks

    Veyon Solutions

  39. PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback

    Jun 18, 2026Wei Xia, Jin Wu, Haoran Shi +2Automated Essay ScoringScoring

    Department of Educational Psychology, East China Normal University · 2Shanghai Institute of Artificial Intelligence for Education, East China Normal University · School of Computer Science and Technology, East China Normal University

  40. Scoring Backends Matter More Than Pooling: A Systematic Study of Training-Free Anomalous Sound Detection under Domain Shift

    Jun 17, 2026Jingwen Zhou, Mingzhe WangAnomaly ScoreArea Under The Receiver Operating Characteristic Curve

    Xidian University, Xi’an, China

  41. Confusion-Aware Transfer Teacher Curriculum Learning Framework: Disentangling Scoring and Pacing Effects

    Jun 16, 2026Savini Kommalage, Sanka Mohottala, Asiri Gawesha +5Adaptive CurriculumCurriculum

    Faculty of Computing, Sri Lanka Institute of Information Technology, Sri Lanka · Faculty of Engineering, University of Sri Jayewardenepura, Sri Lanka · Faculty of Engineering, Sri Lanka Institute of Information Technology, Sri Lanka +2

  42. TRUST-SCF: Transformer-based Risk Understanding and Scoring for Transactional Supply Chain Finance

    Jun 6, 2026Mohammadamin Davoodabadi, Amirabbas ShakeriCredit Risk PredictionStep-Level Credit

    Department of Growth Barook Co.

  43. Test-Time Trajectory Optimization for Autonomous Driving

    Jun 5, 2026Yihong Xu, Eloi Zablocki, Yuan Yin +4Autonomous DrivingRobust Trajectory

    valeo.ai, Paris, France · Sorbonne Universit´e, CNRS, ISIR, F-75005 Paris, France

  44. Auditing Demonstration Curation Metrics: Action-Only Scorers Fail on the Structural Defects That Degrade Imitation Policies

    Jun 4, 2026Aarav BediBehavior CloningDefect

    University of California, Berkeley · Department of Mechanical Engineering University of California, Berkeley Berkeley, California, USA

  45. AI Rater Discrimination Depends on Scoring Protocol in Complex Clinical Decision-Making

    Jun 2, 2026Sangwon Baek, Kyu Yeon Hur, Kyunga KimRaterArtificial Intelligence Evaluation

    Asclep Korea Inc., Changwon, Republic of Korea · Center for Data Science, New York University, New York, USA · Division of Endocrinology and Metabolism, Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea +1

  46. Off-the-Shelf LLMs as Process Scorers: Training-Free Alternative to PRMs for Mathematical Reasoning

    Jun 1, 2026Atoosa Chegini, Soheil FeiziLLM Reasoning StrategiesMathematical Reasoning

    Department of Computer Science, University of Maryland

  47. What to Test Next: Interpretable Coverage Gap Discovery in Driving VLMs

    Jun 1, 2026Abhishek Aich, Sparsh Garg, Vijay Kumar BG +2Ava-VlmSlices

    NEC Laboratories, America, USA · University of California, San Diego, USA

  48. Beyond Agreement: Scoring Panel-Surfaced Biomedical Entity Candidates for Curator Triage

    May 29, 2026Shuheng Cao, Ruiqi Chen, Renjie Cao +3Medical OntologyNamed-Entity Recognition

    University of California, San Diego · University of Michigan, Ann Arbor · The Hong Kong University of Science and Technology, Guangzhou +2

  49. Prompt-Level Reward Specifications for Open-Ended Post-Training

    May 28, 2026Zijun Weng, Xiaohui Hu, Shuangyong Song +3Post-TrainingOffline Reinforcement Learning

    1Fudan University · 2Xingchen AGI Lab, China Telecom Artificial Intelligence Technology (Beijing) Co., Ltd.

  50. Learnable Assessment Skills for LLM-based Automated Scoring: Rubric Construction via Iterative Optimization

    May 28, 2026Yun Wang, Xin Xia, Xuansheng Wu +2Rubric-Based ScoringTask-Specific Rubrics

    School of Computing, University of Georgia, Athens, GA, USA · AI4STEM Education Center, University of Georgia, Athens, GA, USA · The Hong Kong Polytechnic University, Hong Kong, China

  51. Fine-Tuning Vision-Language Models for Understanding Current Damage and Scoring Priority with Quality Guard Agent

    May 24, 2026Takato YasunoRecent Vision-Language ModelsStructural Damage

  52. Proper Scoring Rules for Agentic Uncertainty Quantification

    May 23, 2026Suresh Raghu, Satwik Pandey, Shashwat PandeyUncertainty ScoreScoring

    Independent Researcher

  53. Ontology-constrained multi-LLM scoring of hypothesis support in the predictive processing literature

    May 23, 2026Hamed Nejat, Alexander Maier, Jesse Spencer-Smith +1Predictive CodingHypothesis

    Department of Psychology and Vanderbilt Brain Institute, Vanderbilt University · Data Science Institute, Vanderbilt University

  54. Trajectory-Based Difficulty Scoring for Reliable Learning on Tabular Data

    May 23, 2026Tomer Lavi, Bracha Shapira, Nadav RappoportTabular DataEnsemble

    Faculty of Computer and Information Science, Ben-Gurion University of the Negev, Israel.

  55. CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning

    May 14, 2026Sining Ang, Yuguang Yang, Canyu Chen +1Autonomous NavigationScoring

    Department of Automation, University of Science and Technology of China · Institute for AI Industry Research, Tsinghua University · School of Electronic Information Engineering, Beihang University +1

  56. Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework

    May 14, 2026Phuc Truong Loc Nguyen, Thanh Hung Do, Truong Thanh Hung Nguyen +1Tabular LearningScoring

    † Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany · ‡ University of New Brunswick, Canada

  57. CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution

    May 13, 2026Tom ZehlePrompt OptimizationScoring

    University of Freiburg · ELLIS Institute Tübingen

  58. Concordia: Self-Improving Synthetic Tables for Federated LLMs

    May 11, 2026Jimin Huang, Duanyu Feng, Nuo Chen +8Federated LearningLarge Language Model Adaptation

    University of Manchester · The Fin AI · National University of Singapore +5

  59. Mental Health AI Safety Claims Must Preserve Temporal Evidence

    May 9, 2026Srimonti Dutta, Ratna KandalaArtificial Intelligence SafetySafety Claims

    WAI USA Research Labs · Texas, USA · University of Kansas +1

  60. Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling

    May 7, 2026Yuan Wang, Ouxiang Li, Yulong Xu +8Generative Video ModelsScoring

    University of Science and Technology of China · Kling Team, Kuaishou Technology · Institute of Software Chinese Academy of Sciences