Psychometric Validation

Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 48

All topics
CardsList

  1. COMPASS 2.0: psychometric representational similarity analysis distinguishes symptom structure from personal signal

    Oct 5, 2026Baihan LinRepresentational Similarity AnalysisPsychometric Validation

    Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY, USA · Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, USA · Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, USA +2

  2. Artificial Societies Benchmark: A Validation Framework for Synthetic Research

    Sep 24, 2026Edoardo Chidichimo, Min Jun Jung, Felix P. S. Wallis +1Benchmark DesignComputational Social Science

    Artificial Societies University of Oxford, UK

  3. Measuring AI Leadership: Development and Validation of a Multidimensional Measure for AI-Native Organizations

    Sep 16, 2026Mustafa Akben, Leslie CoynePsychometric Validation

    Department of Management and Entrepreneurship Love School of Business, Elon University · Signalead LLC

  4. Bridging Network Psychometrics and Artificial Intelligence: An Ising-Potts Model with LLM-Derived Weights

    Sep 8, 2026Matthias von DavierInter-Rater ReliabilityPsychometric Validation

  5. Three Ways Classical Test Theory Can Mislead About LLM Judges

    Aug 31, 2026Louis Yiven ZhuLLM-as-a-JudgePsychometric Validation

    University of Oxford

  6. Automated Generation of Complexity-Validated Decision Scenarios Using Large Language Models

    Aug 9, 2026Abdalla Doleh, Toni Somers, Ratna Babu ChinnamSynthetic Data GenerationPsychometric Validation

    Department of Industrial & Systems Engineering, Wayne State University, Detroit, MI, 48202, USA · Mike Ilitch School of Business, Wayne State University, Detroit, MI, 48202, USA

  7. Natural Language Processing Psychometrics

    Aug 7, 2026Edoardo Sebastiano De Duro, Emma Franchino, Massimo StellaClinical Outcome PredictionPsychometric Validation

    CogNoscoLab, Department of Psychology and Cognitive Science, University of Trento, Italy

  8. Every Wrong Answer Counts: Option-Level Psychometrics for LLM Multiple-Choice Benchmarks

    Aug 3, 2026Xiao Fei, Yang Zhang, Sarah Almeida Carneiro +1LLM EvaluationPsychometric Validation

    École Polytechnique, Institut Polytechnique de Paris, France · Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates

  9. Comparative Validation of GPT-4o-mini and Teacher Mean Scores for Automated Scoring of Music Analysis Responses: Single-Pass Deployment, Repeatability, and Strategy-Specific Bias

    Aug 3, 2026Baicheng Lin, Lingxi Jin, Kyung-Seok MinLLM-as-a-JudgeEducational Technology

    Department of Education, Sejong University, South Korea · Department of Educational Technology, Ewha Womans University, South Korea

  10. Dimensionality and Measurement Precision in HLE's Multiple-Choice Subset

    Jul 29, 2026Mayank Sharma, Savira Nadela, Tyler MattesonLLM EvaluationPsychometric Validation

    Stanford University

  11. Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)

    Jul 24, 2026Tran Gia Bao, Mo El-Haj, Sameha Al-Shakhsi +3Human-AI InteractionPsychometric Validation

    VinUniversity · Lancaster University · Hamad Bin Khalifa University +2

  12. Measuring How Students Rely on Generative AI in Academic Writing: Development and Multi-Source Validation of the Generative AI Reliance Types Scale (GenAI-RTS)

    Jul 15, 2026Shahin Hossain, Tukhbita Afroz NawmiGenerative AI in EducationPsychometric Validation

  13. Bringing Back Rule Induction to Fluid Intelligence Research? An Initial Validation of the ARC-AGI Benchmark in Humans

    Jul 13, 2026Jasmin Thelen, Oliver WilhelmPsychometric Validation

    Institute of Psychology and Education, Ulm University, Germany

  14. Evaluating Nonuniform Dependability Across Response Conditions: A Conditional Generalizability Framework Illustrated in Automated Essay Scoring

    Jul 13, 2026Yi GuiAutomated Essay ScoringPsychometric Validation

    Measurement Incorporated

  15. When the Target Domain Changes: AI-Mediated Construct Drift in High-Stakes English Language AssessmenW

    Jul 13, 2026Yi GuiEducational AssessmentGenerative AI in Education

    Measurement Incorporated

  16. Validating LLMs in social science: Epistemic threats and emerging norms

    Jul 8, 2026Meera Desai, Dallas Card, Abigail Z. JacobsLLM EvaluationComputational Social Science

    School of Information, University of Michigan, Ann Arbor, USA · Center for the Study of Complex Systems, University of Michigan, Ann Arbor, USA.

  17. Measuring Intelligence Beyond Human Scale

    Jul 8, 2026Jerry Han, Rafael Moschopoulos, Ella Colby +6LLM EvaluationAI Agent Evaluation

    Princeton Superalignment

  18. The Dual Nature of LLM Persona: Aggregated Tendencies and Frame-Dependent Geometry

    Jul 2, 2026Yuan YuanPersona ConsistencyPersonality Modeling in Language Models

    Independent Researcher.

  19. Correct codes for the wrong reasons? validating LLMs as measurement instruments for theoretical constructs

    Jun 26, 2026Manuel PitaLLM EvaluationPsychometric Validation

    Artificial Intelligence, Social Interaction and Complexity Laboratory CICANT, Universidade Lusófona 376, Campo Grande, 1700-097 Lisbon, Portugal

  20. Apparent Psychological Profiles of Large Language Models are Largely a Measurement Artifact

    Jun 18, 2026Jelena Meyer, David Garcia, Dirk U. WulffLLM EvaluationPersonality Modeling in Language Models

    Max Planck Institute for Human Development. · University of Konstanz. · Barcelona Supercomputing Center. +1

  21. LLMs Struggle to Measure What Distinguishes Students of Different Proficiency Levels: A Study of Item Discrimination in Reading Comprehension Assessment

    Jun 17, 2026Han Chen, Ming Li, Chenguang Wang +4LLM EvaluationEducational Assessment

    MBZUAI · University of Maryland · Virginia Tech

  22. The Unsampled Truth: Quantifying Prompt Artifacts in LM Psychometrics

    Jun 2, 2026Nils Schwager, Christoph Hau, Simon Münker +1Prompt SensitivityLLM Prompting

    Trier University, Trier, Germany

  23. GenPT: Beyond Self-Report for Reliable LLM Psychometrics via Generative Projective Testing

    May 30, 2026Ming Wang, Shuang Wu, Bixuan Wang +7Psychometric Validation

    School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · Mental Health Education Center, Northeastern University, Shenyang 110819, China · School of Psychology, Northeast Normal University, Changchun 130024, China +3

  24. AI Cartography: Mapping the Latent Landscape of AI Benchmark Ecosystems

    May 24, 2026Michael Hardy, Anka Reuel, Lijin Zhang +6LLM EvaluationBenchmark Design

    Stanford University, Stanford, CA, USA · BroadMetrics, Edison, NJ, USA

  25. Generative-Evaluative Agreement: A Necessary Validity Criterion for LLM-Enabled Adaptive Assessment

    May 19, 2026Grandee Lee, Yue Wang, Che Yee Lye +1LLM EvaluationEducational Assessment

    Singapore University of Social Sciences

  26. Can We Trust AI-Inferred User States. A Psychometric Framework for Validating the Reliability of Users States Classification by LLMs in Operational Environments

    May 15, 2026Izabella Krzeminska, Michal Butkiewicz, Ewa KomkowskaLLM EvaluationPsychometric Validation

    Orange Research, AI Center, Warsaw, Poland

  27. The Association of Transformer-based Sentiment Analysis with Symptom Distress and Deterioration in Routine Psychotherapy Care

    May 11, 2026Douglas K. Faust, Peter Awad, Alexandre Vaz +1Sentiment AnalysisClinical Outcome Prediction

    Sentio University, Torrance, CA, USA · Western Washington University, Department of Mathematics, Bellingham, WA, USA

  28. Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence

    May 10, 2026Alex Bogdan, Adrian de Valois-FranklinAI Agent EvaluationAI Agent Monitoring

    Evolutionairy AI · Toronto, Canada

  29. The Proxy Presumption: From Semantic Embeddings to Valid Social Measures

    May 8, 2026Baishi Li, Ta Yu, Kelvin J. L. Koa +1Text EmbeddingsText Embedding Evaluation

    National University of Singapore · Asian Institute of Digital Finance

  30. The Pinocchio Dimension: Phenomenality of Experience as the Primary Axis of LLM Psychometric Differences

    May 6, 2026Hubert Plisiecki, Sabina Siudaj, Kacper Dudzic +4LLM EvaluationPersonality Modeling in Language Models

    IDEAS Research Institute · University of Warsaw