Language Model Self-Assessment

Ask about this topic

Momentum

9 papers in the last four weeks, up 29% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 56

All topics
CardsList

  1. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches

    Jul 20, 2026Jiacheng Ding, Cong Guo, Jason XuLLM Agent EvaluationForecasting Benchmarks

    University of Memphis Memphis, Tennessee, USA · QuantaInsight Seattle, Washington, USA

  2. Diagnosing Correctness Probes under Self-Judgement Confounding

    Jul 18, 2026Yi-Long LuLLM InterpretabilityLanguage Model Self-Assessment

    Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Wuhan 430079, China · Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China

  3. Metacognition in LLMs: Foundations, Progress, and Opportunities

    Jul 13, 2026Gabrielle Kaili-May Liu, Areeb Gani, Jacqueline Lu +3Language Model Self-AssessmentMetacognition in Language Models

    Yale University · University of California, Irvine

  4. More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judges

    Jul 7, 2026Chenyu ZhouReward HackingRL for Language Models

    School of Engineering, Institute of Science Tokyo

  5. Revealing Hidden Model Behaviors with Task-Specific Self-Reports

    Jul 3, 2026Taras Kutsyk, Bartosz ZielińskiLLM AuditingLanguage Model Introspection

    1Jagiellonian University, Faculty of Mathematics and Computer Science · 2Jagiellonian University, Doctoral School of Exact and Natural Sciences

  6. Testing Frontier Large Language Models' Physics Literacy in Parallel Physical Worlds

    Jun 30, 2026Dong ZhangLLM EvaluationPhysical Reasoning

  7. Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA

    Jun 26, 2026Sambaran BandyopadhyayIn-Context RetrievalLLM Evaluation

    Adobe Research

  8. Latent Confidence Alignment for LLM Self-Assessment

    Jun 20, 2026Ting-Yu Chen, Tingting Yu, Pei-Cing Huang +3LLM EvaluationConfidence Estimation in Language Models

    Department of Information Management National Sun Yat-Sen University Kaohsiung, Taiwan · Kaohsiung Medical University Hospital Kaohsiung Medical University Kaohsiung, Taiwan

  9. Self-CTRL: Self-Consistency Training with Reinforcement Learning

    Jun 16, 2026Itamar Pres, Laura Ruis, Melat Ghebreselassie +2RL for Language ModelsFaithfulness of Language Model Explanations

    MIT CSAIL

  10. Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data

    Jun 3, 2026XiuYu Zhang, Yi Shan, Junfeng Fang +1LLM EvaluationLLM-as-a-Judge

    National University of Singapore · Beijing University of Technology

  11. Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models

    Jun 2, 2026Qi Cao, Takeshi Kojima, Andrew Gambardella +3LLM EvaluationUncertainty Quantification

    The University of Tokyo, Japan

  12. CoEval: Ranking Language Models for Custom Tasks Without Labeled Data or Trustworthy Benchmarks

    Jun 2, 2026Alexander Apartsin, Yehudit ApersteinModel SelectionLLM Evaluation

    Holon Institute of Technology, Israel · Afeka Tel Aviv Academic College of Engineering, Israel

  13. Capability Self-Assessment: Teaching LLMs to Know Their Limits

    May 29, 2026Haoyan Yang, Reza Shirkavand, Yukai Jin +3LLM EvaluationLanguage Model Self-Assessment

    Stony Brook University · University of Maryland · Florida State University

  14. What Am I Missing? Question-Answering as Hidden State Probing

    May 29, 2026Chu Fei Luo, Samuel Dahan, Xiaodan ZhuLLM Self-RefinementLanguage Model Self-Assessment

    Department of Electrical and Computer Engineering & Ingenuity Labs, Queen’s University · Conflict Analytics Lab, Queen’s University · Cornell Law School +1

  15. Self-Verified Distillation: Your Language Model Is Secretly Its Own Synthetic Data Pipeline

    May 20, 2026Tony Lee, Percy LiangSelf-Training for Language ModelsLanguage Model Self-Assessment

    Stanford University

  16. Do as I Say, Not as I Do: Instruction-Induction Conflict in LLMs

    May 19, 2026Carolina Camassa, Derek ShillerLLM EvaluationLanguage Model Self-Assessment

    Future Impact Group · Rethink Priorities

  17. Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs

    May 8, 2026Sree Bhattacharyya, Samarth Khanna, Leona Chen +3LLM EvaluationConfidence Estimation in Language Models

    Department of Informatics and Intelligent Systems, College of Information Sciences, The Pennsylvania State University. · Department of Computer Science and Engineering, College of Engineering, The Pennsylvania State University.

  18. EvoLM: Self-Evolving Language Models through Co-Evolved Discriminative Rubrics

    May 5, 2026Shuyue Stella Li, Rui Xin, Teng Xiao +8RL for Language ModelsLLM Evaluation

    University of Washington · 2Allen Institute for AI · University of Pennsylvania

  19. Zero-Shot Confidence Estimation for Small LLMs: When Supervised Baselines Aren't Worth Training

    May 4, 2026Luong N. NguyenConfidence Estimation in Language ModelsLanguage Model Self-Assessment

  20. An LLM-Native Psychometric Instrument Reveals a Self-Report--Behavior Gap Across 25 Models

    Apr 24, 2026Juan Manuel ContrerasLLM EvaluationLanguage Model Self-Assessment

    Independent Researcher

  21. Beyond "I Don't Know": Evaluating LLM Self-Awareness in Discriminating Data and Model Uncertainty

    Apr 19, 2026Jingyi Ren, Ante Wang, Yunghwei Lai +5LLM EvaluationSelective Prediction

    Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China · Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China

  22. Introspection Adapters: Training LLMs to Report Their Learned Behaviors

    Apr 18, 2026Keshav Shenoy, Li Yang, Abhay Sheshadri +4LLM AuditingLanguage Model Introspection

    Anthropic Fellows · Ashwood Centre on AI Science and Policy, University of Cambridge · Anthropic

  23. Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations

    Jan 30, 2026Dani Roytburg, Matthew Bozoukov, Matthew Nguyen +3LLM-as-a-JudgeLanguage Model Generation Evaluation

    Department of Machine Learning, Carnegie Mellon University, Pittsburgh, PA, USA · Apart Research, San Francisco, California, USA · Department of Computer Science and Engineering, University of California San Diego, La Jolla, CA, USA +2

  24. No Reliable Evidence of Self-Reported Sentience in Small Large Language Models

    Jan 20, 2026Caspar Kaiser, Sean EnderbyLLM EvaluationLanguage Model Self-Assessment

    University of Warwick, Warwick Business School.

  25. Calibration Is Not Enough: Evaluating Confidence Estimation Under Language Variations

    Jan 12, 2026Yuxi Xia, Dennis Ulmer, Terra Blevins +3LLM EvaluationConfidence Estimation in Language Models

    Faculty of Computer Science, UniVie Doctoral School Computer Science · Faculty of Philological and Cultural Studies, University of Vienna, Austria · ILLC, University of Amsterdam, Netherlands +2

  26. When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

    Sep 30, 2025Wenda Xu, Sweta Agrawal, Vilém Zouhar +2LLM EvaluationLanguage Model Generation Evaluation

    Google · ETH Zurich