Language Model Self-Assessment

Ask about this topic

Momentum

9 papers in the last four weeks, up 29% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 56

All topics
CardsList

  1. Identifying Introspection From the Inside

    Oct 5, 2026David I. Atkinson, Dillon Plunkett, David BauLLM InterpretabilityLanguage Model Introspection

    Northeastern University · Eleos AI Research

  2. Anosognosia in LLMs: Probing Self-Awareness of Quantized Computational Substrate

    Oct 5, 2026Yoshihiro Izawa, Gouki Minegishi, Yoko YamakataLanguage Model Self-AssessmentMetacognition in Language Models

    The University of Tokyo

  3. Also Small Models Can Reasonably Self-Evaluate Their Confidence

    Sep 30, 2026Idil Kapikiran, Thomas Decker, Thomas RunklerConfidence Estimation in Language ModelsSmall Language Models

    Technical University of Munich · Siemens AG · LMU Munich +1

  4. On the Limits of Metacognitive Monitoring in LLMs

    Sep 28, 2026Dongqi Han, Yifan Yang, Dongsheng LiLanguage Model Error DetectionConfidence Estimation in Language Models

    Microsoft Research Asia

  5. Nudgeability: Reasoning Models Follow Confidence Signals Without Tracking Their Own Competence

    Sep 28, 2026Rohit Saxena, Utkarsh UpadhyayLanguage Model Self-AssessmentLLM Tool Use

  6. Self-Designed Evaluators and Warm Memory for Long-Horizon Agents

    Sep 27, 2026Saeid Asgari, Emre Kiciman, Leonardo de Oliveira Nunes +1Language Model Generation EvaluationLong-Horizon Agent Evaluation

    Microsoft

  7. Audio LLMs Know When They Can't Hear You

    Sep 24, 2026Amirhosein Javadi, Richa Dixit, Mehrdad Farajtabar +3Audio-Language Model EvaluationLanguage Model Self-Assessment

    Apple · University of California San Diego

  8. Style, Not Self: Surface Cues Explain Zero-Shot Code Attribution by Large Language Models

    Sep 24, 2026Ehsan Barkhordar, Surendrabikram ThapaLLM EvaluationLanguage Model Generation Evaluation

    Koç University · Virginia Tech

  9. An Analysis of Training-Free Self-Reported Confidence in Language Models

    Sep 17, 2026Lukas Meyer, Sofia Rossi, Wei Chen +2Confidence Estimation in Language ModelsLanguage Model Self-Assessment

    DreamAI

  10. When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control

    Sep 15, 2026Ali ŞenolSelective PredictionLLM Prompting

    Department of Computer Engineering, Tarsus University, Tarsus, Türkiye

  11. Strangers to Themselves: What Language Models Say About Themselves Is Generic

    Sep 9, 2026Phil Blandfort, Urja PawarLanguage Model Self-AssessmentMetacognition in Language Models

    Predictably Weird · Independent

  12. Self-Reports Are Not Verification: Environment-Grounded Auditing of LLM Operators in Evolutionary Search

    Sep 1, 2026Enrong Pan, Ryan Zhou, Ting HuLLM AuditingLanguage Model Self-Assessment

    Queen’s University

  13. The Assistant's Ideal Self

    Aug 31, 2026Mert YazanPersonality Modeling in Language ModelsLanguage Model Self-Assessment

    Leiden University · Research conducted at the Digital Minds Research Sprint, August 2026.

  14. S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement?

    Aug 31, 2026Jiajun Shi, Siyuan Tao, Yuhao Wu +18LLM Agent EvaluationLanguage Model Self-Assessment

    ByteDance Seed

  15. Evaluating and Improving LLM Self-Modeling

    Aug 31, 2026Siqi Zeng, Andre N. Assis, Rowan WangLLM EvaluationLanguage Model Introspection

    University of Illinois · Constellation · Anthropic

  16. Sleight of Word Benchmark: Can Language Models Notice If Their Own Output Was Tampered With?

    Aug 30, 2026Alberto CetoliLanguage Model Generation EvaluationLanguage Model Self-Assessment

    Cleo

  17. Explanatory Engagement Under Rare Anomalous Failure: Asymptotic Rarity in Model Behavior (or: The Asymptotic AI)

    Aug 13, 2026Sam MaoLanguage Model Self-AssessmentLLM Reliability

    New York University | Interactive Media Arts

  18. Reinforcing Step-level Reasoning for Effective Self-Correction in LLMs

    Aug 12, 2026Vu Duc Anh, Nhat M. Hoang, Do Xuan Long +3LLM Self-CorrectionDirect Preference Optimization

    Nanyang Technological University, Singapore · National University of Singapore · Institute for Infocomm Research (I2R), A*STAR +1

  19. The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads

    Aug 5, 2026Yushi Sun, Yanjie Zhang, Rui ShengLLM EvaluationLLM Personalization

    LIGHTSPEED, Shenzhen, China · The Hong Kong University of Science and Technology, Hong Kong, China · Tencent LIGHTSPEED

  20. How Much Does a Reasoning Summary Reveal? An Observability Ladder for Large Language Models

    Aug 3, 2026Andres Algaba, Francesca Carlon, Lynn Delcon +3LLM EvaluationLLM Interpretability

    1Data Analytics Lab, Vrije Universiteit Brussel, Pleinlaan 5, 1050 Brussel, Belgium · 2imec-SMIT, Vrije Universiteit Brussel, Pleinlaan 9, 1050 Brussel, Belgium · School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA

  21. Reflection or Re-Generation? Why LLM Revision Fails Where Human Revision Succeeds

    Jul 31, 2026Yefan Tao, Gerald Friedland, Madhusudhanan Chandrasekaran +1LLM Self-CorrectionLLM Self-Refinement

    Amazon

  22. Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B

    Jul 30, 2026Iliya MirzaeiLLM Self-RefinementLanguage Model Generation Evaluation

    Department of Computer Science Stony Brook University

  23. SVR: Self-Verifying Refinement via Joint Verdict-Confidence Reinforcement Learning for Adaptive Test-Time Compute

    Jul 30, 2026Hongyu Chen, Liang Lin, Guangrun WangRL for Language Model ReasoningLanguage Model Self-Assessment

    1Sun Yat-sen University · 2Guangdong Key Laboratory of Big Data Analysis and Processing · 3X-Era AI Lab

  24. One Human, NN Agents: Audit-Budget Allocation for LLM Agent Fleets under Miscalibrated, Correlated Confidence

    Jul 30, 2026Cesare Zavattari, Alessandro Tommasi, Giuseppe PrencipeScalable OversightAI Agent Reliability

    Dipartimento di Informatica, Università di Pisa, Pisa, Italy

  25. Rehearse: Stepping Back from the Confidence Cliff in Self-Improving Autoresearch

    Jul 30, 2026Jiazhen Ji, Shouhong DingLanguage Model Self-AssessmentAutonomous Experimentation

    Tencent

  26. When Do Agent Loops Mistake Stagnation for Progress? Self-Evaluation Bias and Externally Grounded Verification in Long-Running Autonomous LLM Agent Loops

    Jul 27, 2026Hyundoo Park, Byungho ChoiAI Agent ReliabilityLLM Self-Refinement

    AsyncSite

  27. Reality Monitoring in Large Language Models: Self-Knowledge That Transforms with Conversation Memory

    Jul 27, 2026Saurabh Ranjan, Konstantina Sokratous, Brian OdegaardHallucination in Language ModelsLanguage Model Self-Assessment

    Department of Psychology, University of Florida, Gainesville, Florida, USA. · University of Missouri, Missouri, USA.

  28. The Two-Process Theory of Machine Self-Report

    Jul 22, 2026Hubert Plisiecki, Filip Chmielewski, Kacper Dudzic +3Personality Modeling in Language ModelsLanguage Model Self-Assessment

    IDEAS Research Institute · Faculty of Physics and Applied Informatics, University of Lodz

  29. The Knowing-Saying Gap: When Probes See Errors that Confidence Misses

    Jul 21, 2026Jyotin Goel, Ipshita Bandyopadhyay, Justin ShenkLanguage Model Error DetectionConfidence Estimation in Language Models

  30. Operational Proto-Introspection in Looped Language Models: Process-Quality Taps, Executable Branching, and the Readout-Control Boundary

    Jul 20, 2026Jan KirinLanguage Model IntrospectionLanguage Model Self-Assessment

  31. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches

    Jul 20, 2026Jiacheng Ding, Cong Guo, Jason XuLLM Agent EvaluationForecasting Benchmarks

    University of Memphis Memphis, Tennessee, USA · QuantaInsight Seattle, Washington, USA

  32. Diagnosing Correctness Probes under Self-Judgement Confounding

    Jul 18, 2026Yi-Long LuLLM InterpretabilityLanguage Model Self-Assessment

    Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education, Wuhan 430079, China · Key Laboratory of Human Development and Mental Health of Hubei Province, School of Psychology, Central China Normal University, Wuhan 430079, China

  33. Metacognition in LLMs: Foundations, Progress, and Opportunities

    Jul 13, 2026Gabrielle Kaili-May Liu, Areeb Gani, Jacqueline Lu +3Language Model Self-AssessmentMetacognition in Language Models

    Yale University · University of California, Irvine

  34. More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judges

    Jul 7, 2026Chenyu ZhouReward HackingRL for Language Models

    School of Engineering, Institute of Science Tokyo

  35. Revealing Hidden Model Behaviors with Task-Specific Self-Reports

    Jul 3, 2026Taras Kutsyk, Bartosz ZielińskiLLM AuditingLanguage Model Introspection

    1Jagiellonian University, Faculty of Mathematics and Computer Science · 2Jagiellonian University, Doctoral School of Exact and Natural Sciences

  36. Testing Frontier Large Language Models' Physics Literacy in Parallel Physical Worlds

    Jun 30, 2026Dong ZhangLLM EvaluationPhysical Reasoning

  37. Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA

    Jun 26, 2026Sambaran BandyopadhyayIn-Context RetrievalLLM Evaluation

    Adobe Research

  38. Latent Confidence Alignment for LLM Self-Assessment

    Jun 20, 2026Ting-Yu Chen, Tingting Yu, Pei-Cing Huang +3LLM EvaluationConfidence Estimation in Language Models

    Department of Information Management National Sun Yat-Sen University Kaohsiung, Taiwan · Kaohsiung Medical University Hospital Kaohsiung Medical University Kaohsiung, Taiwan

  39. Self-CTRL: Self-Consistency Training with Reinforcement Learning

    Jun 16, 2026Itamar Pres, Laura Ruis, Melat Ghebreselassie +2RL for Language ModelsFaithfulness of Language Model Explanations

    MIT CSAIL

  40. Self-Evaluation Is Already There: Eliciting Latent Judge Calibration in Base LLMs with Minimal Data

    Jun 3, 2026XiuYu Zhang, Yi Shan, Junfeng Fang +1LLM EvaluationLLM-as-a-Judge

    National University of Singapore · Beijing University of Technology

  41. Clustered Self-Assessment: A Simple yet Effective Method for Uncertainty Quantification in Large Language Models

    Jun 2, 2026Qi Cao, Takeshi Kojima, Andrew Gambardella +3LLM EvaluationUncertainty Quantification

    The University of Tokyo, Japan

  42. CoEval: Ranking Language Models for Custom Tasks Without Labeled Data or Trustworthy Benchmarks

    Jun 2, 2026Alexander Apartsin, Yehudit ApersteinModel SelectionLLM Evaluation

    Holon Institute of Technology, Israel · Afeka Tel Aviv Academic College of Engineering, Israel

  43. Capability Self-Assessment: Teaching LLMs to Know Their Limits

    May 29, 2026Haoyan Yang, Reza Shirkavand, Yukai Jin +3LLM EvaluationLanguage Model Self-Assessment

    Stony Brook University · University of Maryland · Florida State University

  44. What Am I Missing? Question-Answering as Hidden State Probing

    May 29, 2026Chu Fei Luo, Samuel Dahan, Xiaodan ZhuLLM Self-RefinementLanguage Model Self-Assessment

    Department of Electrical and Computer Engineering & Ingenuity Labs, Queen’s University · Conflict Analytics Lab, Queen’s University · Cornell Law School +1

  45. Self-Verified Distillation: Your Language Model Is Secretly Its Own Synthetic Data Pipeline

    May 20, 2026Tony Lee, Percy LiangSelf-Training for Language ModelsLanguage Model Self-Assessment

    Stanford University

  46. Do as I Say, Not as I Do: Instruction-Induction Conflict in LLMs

    May 19, 2026Carolina Camassa, Derek ShillerLLM EvaluationLanguage Model Self-Assessment

    Future Impact Group · Rethink Priorities

  47. Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs

    May 8, 2026Sree Bhattacharyya, Samarth Khanna, Leona Chen +3LLM EvaluationConfidence Estimation in Language Models

    Department of Informatics and Intelligent Systems, College of Information Sciences, The Pennsylvania State University. · Department of Computer Science and Engineering, College of Engineering, The Pennsylvania State University.

  48. EvoLM: Self-Evolving Language Models through Co-Evolved Discriminative Rubrics

    May 5, 2026Shuyue Stella Li, Rui Xin, Teng Xiao +8RL for Language ModelsLLM Evaluation

    University of Washington · 2Allen Institute for AI · University of Pennsylvania

  49. Zero-Shot Confidence Estimation for Small LLMs: When Supervised Baselines Aren't Worth Training

    May 4, 2026Luong N. NguyenConfidence Estimation in Language ModelsLanguage Model Self-Assessment

  50. An LLM-Native Psychometric Instrument Reveals a Self-Report--Behavior Gap Across 25 Models

    Apr 24, 2026Juan Manuel ContrerasLLM EvaluationLanguage Model Self-Assessment

    Independent Researcher

  51. Beyond "I Don't Know": Evaluating LLM Self-Awareness in Discriminating Data and Model Uncertainty

    Apr 19, 2026Jingyi Ren, Ante Wang, Yunghwei Lai +5LLM EvaluationSelective Prediction

    Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China · Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China

  52. Introspection Adapters: Training LLMs to Report Their Learned Behaviors

    Apr 18, 2026Keshav Shenoy, Li Yang, Abhay Sheshadri +4LLM AuditingLanguage Model Introspection

    Anthropic Fellows · Ashwood Centre on AI Science and Policy, University of Cambridge · Anthropic

  53. Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations

    Jan 30, 2026Dani Roytburg, Matthew Bozoukov, Matthew Nguyen +3LLM-as-a-JudgeLanguage Model Generation Evaluation

    Department of Machine Learning, Carnegie Mellon University, Pittsburgh, PA, USA · Apart Research, San Francisco, California, USA · Department of Computer Science and Engineering, University of California San Diego, La Jolla, CA, USA +2

  54. No Reliable Evidence of Self-Reported Sentience in Small Large Language Models

    Jan 20, 2026Caspar Kaiser, Sean EnderbyLLM EvaluationLanguage Model Self-Assessment

    University of Warwick, Warwick Business School.

  55. Calibration Is Not Enough: Evaluating Confidence Estimation Under Language Variations

    Jan 12, 2026Yuxi Xia, Dennis Ulmer, Terra Blevins +3LLM EvaluationConfidence Estimation in Language Models

    Faculty of Computer Science, UniVie Doctoral School Computer Science · Faculty of Philological and Cultural Studies, University of Vienna, Austria · ILLC, University of Amsterdam, Netherlands +2

  56. When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

    Sep 30, 2025Wenda Xu, Sweta Agrawal, Vilém Zouhar +2LLM EvaluationLanguage Model Generation Evaluation

    Google · ETH Zurich