Psychometric Validation

Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 48

All topics
CardsList

  1. Measuring Psychological States Through Semantic Projection: A Theory-Driven Approach to Language-Based Assessment

    May 6, 2026Maria Luongo, Davide Marocco, Nicola MilanoPsychometric ValidationClinical NLP

    University of Naples Federico II Department of Humanistic Studies Natural and Artificial Cognition Laboratory “Orazio Miglino” via Porta di Massa 1, Naples, 80125, Italy

  2. Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs

    May 5, 2026Stefano Bannò, Kate Knill, Mark GalesLLM EvaluationAutomated Essay Scoring

    ALTA Institute, Department of Engineering, University of Cambridge (UK)

  3. Verbal Confidence Saturation in 3-9B Open-Weight Instruction-Tuned LLMs: A Pre-Registered Psychometric Validity Screen

    Apr 24, 2026Jon-Paul CacioliLLM EvaluationConfidence Estimation in Language Models

    Independent Researcher, Melbourne, Australia

  4. An LLM-Native Psychometric Instrument Reveals a Self-Report--Behavior Gap Across 25 Models

    Apr 24, 2026Juan Manuel ContrerasLLM EvaluationLanguage Model Self-Assessment

    Independent Researcher

  5. Has Automated Essay Scoring Reached Sufficient Accuracy? Deriving Achievable QWK Ceilings from Classical Test Theory

    Apr 21, 2026Masaki UtoInter-Rater ReliabilityEducational Assessment

    The University of Electro-Communications, Tokyo, Japan

  6. Concurrent Criterion Validation of a Validity Screen for LLM Confidence Signals via Selective Prediction

    Apr 20, 2026Jon-Paul CacioliLLM EvaluationSelective Prediction

    Independent Researcher, Melbourne, Australia

  7. Screen Before You Interpret: A Portable Validity Protocol for Benchmark-Based LLM Confidence Signals

    Apr 20, 2026Jon-Paul CacioliLLM EvaluationPsychometric Validation

    Independent Researcher, Melbourne, Australia

  8. Before You Interpret the Profile: Validity Scaling for LLM Metacognitive Self-Report

    Apr 20, 2026Jon-Paul CacioliPsychometric ValidationLLM Uncertainty Estimation

    Independent Researcher, Melbourne, Australia

  9. The Hitchhikers Guide to Rubric Quality Understanding and Enrichment

    Apr 1, 2026Ankit Aich, Zhengyang Qi, Charles Dickens +7Agent EvaluationPsychometric Validation

    Snorkel AI · University of Wisconsin–Madison

  10. The Ultimate Tutorial for AI-driven Scale Development in Generative Psychometrics: Releasing AIGENIE from its Bottle

    Mar 30, 2026Lara Russell-Lasalandra, Hudson Golino, Luis Eduardo Garrido +1Psychometric Validation

    Department of Psychology, University of Virginia, Charlottesville, VA 22903, USA · Department of Psychology, Pontificia Universidad Madre y Maestra, Dominican Republic · Department of Psychology, Vanderbilt University, USA

  11. Falsifying Discriminant Validity of Predictive Algorithms

    Jan 23, 2026Amanda CostonAlgorithmic AuditingPsychometric Validation

    Statistics Department University of California, Berkeley Berkeley, CA, USA

  12. Psychometric Comparability of LLM-Based Digital Twins

    Dec 22, 2025Yufei Zhang, Zhihao MaLLM EvaluationPersonality Modeling in Language Models

    Computational Communication Collaboratory, School of Journalism and Communication, Nanjing University, Nanjing 210023, China

  13. Adaptive Testing for LLM Evaluation: A Psychometric Alternative to Static Benchmarks

    Oct 26, 2025Peiyu Li, Xiuxiu Tang, Si Chen +4LLM EvaluationPsychometric Validation

    University of Notre Dame, Notre Dame, USA

  14. Human Psychometric Questionnaires Mischaracterize LLM Behavior

    Sep 12, 2025Woojung Song, Dongmin Choi, Yoonah Park +3Personality Modeling in Language ModelsPsychometric Validation

    1Graduate School of Data Science, Seoul National University · Department of Communication, Interdisciplinary Program in Artificial Intelligence, Seoul National University

  15. Automatic Item Generation for Personality Situational Judgment Tests with Large Language Models

    Dec 10, 2024Chang-Jin Li, Jiyuan Zhang, Yun Tang +1Psychometric ValidationAutomated Test Generation

    Faculty of Psychology, Beijing Normal University, Beijing, 100875, China · School of Psychology, Central China Normal University, Wuhan, Hubei, 430079, China · Key Laboratory of Adolescent Cyberpsychology and Behavior, Ministry of Education, Wuhan, Hubei, 430079, China +1

  16. Interpretable factorization of clinical questionnaires to identify latent factors of psychopathology

    Dec 12, 2023Ka Chun Lam, Francisco Pereira, Bridget W Mahony +1Latent Variable ModelsNon-Negative Matrix Factorization

    Machine Learning Core National Institute of Mental Health, National Institutes of Health · Section on Developmental Neurogenomics, Human Genetics Branch National Institute of Mental Health, National Institutes of Health

  17. "Mirror" Large Language Model Evaluations of Depression are Criterion Contaminated

    Date pendingTong Li, Rasiq Hussain, Mehak Gupta +1Depression DetectionMental Health

    Division of Computational & Data Sciences (DCDS), Washington University in St. Louis, St. Louis, MO · Department of Computer Science, SMU · Department of Psychological & Brain Sciences, Washington University in St. Louis

  18. Measurement Without Validity: The Compounding Reliability Problem in Agentic AI Evaluation

    Date pendingWilliam CabanInter-Rater ReliabilityAI Agent Evaluation

    Red Hat, Inc., Raleigh, North Carolina, USA · Alma Mater Europaea University, Vienna, Austria