Human Judgment

Ask about this topic

Momentum

14 papers in the last four weeks, up 250% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 57

All topics
CardsList

  1. Collective intelligence through aggregation

    Oct 5, 2026Franz Dietrich, Christian ListCollective BehaviorsHuman Judgment

    We thank two anonymous referees and an editor for very helpful comments.

  2. Who Owns That? Evaluating Ownership Intuitions in Large Language Models

    Sep 30, 2026Xizhi Xiao, Yue Wu, Shan Xu +1Large Language Model DecisionsHuman Judgment

    College of AI, Tsinghua University · Department of Psychological and Cognitive Sciences, Tsinghua University · Faculty of Psychology, Beijing Normal University

  3. Multidimensional Observer Model and Perceptual Dimensions of Human Image Quality Assessment

    Sep 29, 2026Sheng Zhao, Weikai Lin, Yuhao ZhuImage Quality AssessmentMultimodal Evaluation

    Department of Computer Science University of Rochester

  4. JudgeCast: Time Series Forecasting with Experience-Informed Covariate Judgements

    Sep 29, 2026Donguk Kwon, Wooseok Jeong, Dongha LeeData-Driven ForecastingTime Series Forecasting

    Yonsei University · Konkuk University

  5. PlaylistEval: Can Video-Language Judges Be Trusted at Day Scale and Beyond?

    Sep 28, 2026Shayekh Bin Islam, Hwanjun SongLarge Language Model JudgesLong-Video Benchmarks

    KAIST

  6. Multi-Dimensional Comparative Scale Construction for Efficient Personalized Subjective Judgment in High-Traffic Applications

    Sep 27, 2026Xianglong Shi, Shifeng Liu, Sirui Zhao +2Model JudgmentsHuman Judgment

    University of Science and Technology of China · University of Electronic Science and Technology of China

  7. Knowing Is Not Choosing: What Explicit Verification Adds Beyond Generative Preference

    Sep 27, 2026Yilong Li, Chengpo Yan, Aayan Arish +1Large Language Model ResponsesFactual Recall

    Department of Computer Science University of Wisconsin-Madison Madison, WI 53703, USA

  8. When No One Owns the Judgment: Accountability Under Contribution Dissolution in Human-AI Collaboration

    Sep 24, 2026Hengzhi YeAccountabilityHuman-Ai Collaboration

    School of Computer Science Peking university Beijing, China

  9. Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factuality

    Sep 23, 2026Jiaju Huang, Hao Yang, Xinyu Ma +6Radiology Report GenerationClinician Trust

    Intelligent Medical Computing Laboratory, Faculty of Applied Sciences, Macao Polytechnic University · Department of Radiology, Netherlands Cancer Institute, Amsterdam, the Netherlands · Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, the Netherlands

  10. The Ethics of Artificial Intelligence in Military Operations

    Sep 22, 2026Nicolas Drapier, Florian Mauberger, Aladine Chetouani +1Artificial Intelligence GovernanceAccountability

    L2TI Laboratory, Universit´e Sorbonne Paris Nord, 99 Avenue Jean-Baptiste Cl´ement, Villetaneuse, 93430, France. · SAS Impact, 1 Rue Sainte-Anne, Orl´eans, 45000, France.

  11. Calibrated Decisions at Scale: Converting Police Crash Narratives into Probabilistic Crash Variables with a System One Model (Jev)

    Sep 21, 2026Amir Rafe, Subasish DasAccidentsCrashes

    Ingram School of Engineering, Texas State University, San Marcos, TX, USA

  12. Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judged

    Sep 17, 2026Aryan Ramchandra Kapadia, Eshwar Chandrasekharan, Koustuv SahaAdviceFinancial Strategy Research

    University of Illinois Urbana-Champaign, Urbana, IL, USA

  13. Language-model groups overstate consensus when replaying human deliberation on a reasoning task

    Sep 17, 2026Tengfei ShaoDeliberationLarge Language Model Decisions

    Global Education Center, Waseda University, Tokyo, Japan

  14. Measuring AI Leadership: Development and Validation of a Multidimensional Measure for AI-Native Organizations

    Sep 16, 2026Mustafa Akben, Leslie CoyneHuman JudgmentExploratory Factor Analysis

    Department of Management and Entrepreneurship Love School of Business, Elon University · Signalead LLC

  15. NovGauge: A Fine-Grained Benchmark for Diagnosing LLMs' Capability in Paper Novelty Assessment

    Sep 12, 2026Guoqiang Zhang, Kexin Tan, Ming Zhang +12Human-Annotated BenchmarkHuman Judgment

    College of Computer Science and Artificial Intelligence, Fudan University, Shanghai, China · Graduate School of Engineering, The University of Tokyo, Tokyo, Japan · AtomInnoLab 4Atom Infinite Pte. Ltd., Singapore +1

  16. Post-hoc Alignment of LLM-judges to Human Judgment Distribution

    Sep 1, 2026Sebastian Steindl, Nikos Voskarides, Alberto Gasparin +1Llm-As-A-JudgeHuman Judgment

    Amazon, Barcelona, Spain · Amazon, Berlin, Germany

  17. Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence

    Aug 31, 2026Zhiqin Yang, Jingwen Fu, Yuhan Liu +16Process-Level SupervisionLarge Reasoning Models

    The Hong Kong University of Science and Technology · Zhongguancun Academy · Xi’an Jiaotong University +6

  18. One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spread

    Aug 31, 2026Zhuoran Lu, Weilong Wang, Yangyang Yu +4CredibilityMisinformation

    Purdue University West Lafayette, Indiana, USA · St John’s University New York, New York, USA · Stevens Institute of Technology Hoboken, New Jersey, USA +2

  19. How Do Large Language Models Judge Social Attraction? Evidence from Theory-Grounded Persona Ratings Across Multiple LLMs and Humans

    Aug 10, 2026Hasan Mahmud, Khawaja Abaid Ullah, Mohammad Javad Khojasteh +2RaterPersonality

    School of Communication, Rochester Institute of Technology · Department of Electrical and Microelectronic Engineering, Kate Gleason College of Engineering, Rochester Institute of Technology Rochester, NY 14623, USA

  20. Forged Peer Judgments Mislead Multimodal LLM Judge Panels: Source-Blind Anchoring and Panel-Consensus Verification

    Aug 8, 2026Yang ShuLarge Language Model JudgesHuman Judgment

    Zhejiang University, Hangzhou, China

  21. The Judgment-Consequence Gap: LLM Moral Reasoning in Healthcare Decisions

    Aug 6, 2026Hadi Hosseini, Samarth Khanna, Leona PierceMoral ReasoningClinical Reasoning Training

    Pennsylvania State University

  22. The ethics of artificial intelligence in the life sciences: Universality, cultural diversity and an architecture of care

    Aug 5, 2026Jean-Pierre Changeux, Gustavo Deco, Morten L. KringelbachEthicsHuman Judgment

    Neuroscience Department, Institut Pasteur, Collège de France, Paris F-75005, France. · Center for Brain and Cognition, Computational Neuroscience Group, Faculty of Medicine and Life Sciences, Universitat Pompeu Fabra, Barcelona, Spain · Institució Catalana de la Recerca i Estudis Avançats (ICREA), Barcelona, Spain +4

  23. Responsibility in Multi-Agent Sequential Decision-Making: Comparing Human Judgments to Formal Models of Causal Attribution

    Aug 5, 2026Nripsuta Ani Saxena, Stelios Triantafyllou, Goran RadanovićHuman JudgmentCausal Reasoning

    University of Southern California Los Angeles, California, USA · Max Planck Institute for Software Systems Saarbrücken, Germany

  24. Query Timing Produces Opposite Positional Biases Between LLMs and Humans

    Aug 1, 2026Jasin Cekinmez, Addison J. Wu, Thomas L. GriffithsPrimingBiases

    Princeton University

  25. Language Models Agree With Each Other, Not With Readers

    Jul 31, 2026Kazuki Nakayashiki, Keisuke WatanabeInter-Annotator AgreementHuman Judgment

    Glasp Inc.

  26. Why Large Language Models and Humans Converge and Diverge in Evaluating Creativity

    Jul 24, 2026Pengzhao Lyu, Yeun Joon Kim, Hanlin Xiao +1CreativityLarge Language Model Evaluation

    Judge Business School, University of Cambridge, Cambridge, CB2 1AG, United Kingdom · Institute of Metabolic Science, School of Clinical Medicine, University of Cambridge, CB2 0QQ, United Kingdom · Department of Computer Science, University of Manchester, M13 9PL, United Kingdom +2

  27. Beyond Sycophancy: Structured Resistance and Compliance in LLM Moral Reasoning

    Jul 23, 2026Baihui Wang, Bernard KochMoral ReasoningSycophancy

    University of Chicago · 2Yale School of Management

  28. pAI-Econ-claude: A Gated Human-in-the-Loop Multi-Agent Architecture for AI-Assisted Economic Theory Development

    Jul 23, 2026Chen Zhu, Xiaolu Wang, Weilong ZhangEconomiesHuman-In-The-Loop

    China Agricultural University · University of Cambridge

  29. AI advice suppresses people's willingness to say "I don't know", even when the advice is wrong and accuracy is incentivized

    Jul 15, 2026Chiara Marcoccia, Walter Quattrociocchi, Valerio CapraroAdviceStudent Misconceptions

    Ecole Normale Supérieure, Paris, France · University of Rome “La Sapienza”, Rome, Italy · University of Milan-Bicocca, Milan, Italy

  30. LLM Judges Can Be Too Generous When There Is No Reference Answer

    Jul 14, 2026Chalamalasetti Kranti, Sowmya VajjalaLarge Language Model JudgesHuman Judgment

    Computational Linguistics, Department of Linguistics, University of Potsdam, Germany · National Research Council, Ottawa, Canada

  31. Practical Judgment, Virtue, and Intuition in the Use of Opaque AI-Enabled Systems

    Jul 14, 2026Nathan G. Wood, Andrew P. ReberaArtificial Intelligence DeploymentEthics

  32. Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders

    Jul 11, 2026Cedric Waterschoot, Nava Tintarev, Francesco BarilePreference Alignment LearningLarge Language Model Decisions

    Maastricht University Maastricht, The Netherlands

  33. Beyond Accuracy: How Humans Evaluate Legally Correct but Socially Controversial Legal Advice from Machines

    Jul 6, 2026Benjamin Minhao Chen, Zhiyu LiLegal Reasoning TasksHuman Judgment

    a Associate Professor, Faculty of Law, University of Hong Kong · b Associate Professor in Law and Policy, Durham Law School, Durham University

  34. Benchmarking the Alignment of Data-Quality Metrics, Human Judgment and Land-Cover Segmentation Performance for Earth Observation

    Jun 23, 2026Ümit Mert Çağlar, Alptekin TemizelSynthetic DataData Quality

    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey

  35. AI Alignment From Social Choice Perspectives

    Jun 19, 2026Daniel Halpern, Evi Micha, Ariel D. Procaccia +3Artificial Intelligence AlignmentReinforcement Learning From Human Feedback

    Google Research · University of Southern California · Harvard University

  36. MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revision

    Jun 15, 2026Ye Jin, Yangyang Xu, Jun Zhu +1Working MemoryPersonalization

    Beijing University of Posts and Telecommunications · Tsinghua University · Shanghai Jiao Tong University

  37. LLMs Can Better Capture Human Judgments--With the Right Prompts

    Jun 10, 2026Danica Dillion, Chen Cecilia Liu, Baihui Wang +5Human JudgmentMoral Reasoning

    Complexity Science Hub, Vienna · The Ohio State University · University of Cambridge +2

  38. Hidden Consensus:Preference-Validity Compression in Human Feedback

    Jun 9, 2026Dorcas Chia Ern Chua, Karen Myn Hui Lee, Jia Yue Tan +9Preference AlignmentReinforcement Learning From Human Feedback

    1YTL AI Labs · 2Universiti Malaya

  39. Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles

    Jun 4, 2026Upasana ChatterjeeIdeologyPolitical Discourse

    Department of Computer Science Columbia University

  40. Personalized to Persuade: The Effects of Contextualization and Warmth on Trust and Reliance in Conversational AI

    May 29, 2026Mert Yazan, Suzan Verberne, Frederik Bungaran Ishak SitumeangPersuasionArtificial Intelligence Literacy

    Amsterdam University of Applied Sciences Amsterdam, Netherlands · University of Leiden Leiden, Netherlands

  41. Label Over Logic? How Source Cues Bias Human Fallacy Judgments More Than LLMs

    May 28, 2026Mahjabin Nahar, Nafis Irtiza Tripto, Aiping Xiong +2Logical FallaciesHuman Judgment

    The Pennsylvania State University

  42. Argument Quality Assessment with Large Language Models: A Pairwise Bradley-Terry Approach

    May 27, 2026Nicolás Benjamín Ocampo, Agnes Paullate Nyiranziza, Davide CeolinHuman Judgment

    1Centrum Wiskunde & Informatica, The Netherlands · 2Vrije Universiteit Amsterdam, The Netherlands

  43. COCOTree: A Dataset and Benchmark for Open Tree-Structured Visual Decomposition

    May 21, 2026Junhyub Lee, Seunghun Chae, Hyosu KimLarge-Scale BenchmarkHuman Annotations

    Chung-Ang University

  44. Presupposition and Reasoning in Conditionals: A Theory-Based Study of Humans and LLMs

    May 18, 2026Tara Azin, Yongan Yu, Raj Singh +1Human JudgmentLLM Reasoning Strategies

    Department of Cognitive Science, Carleton University · School of Computer Science, McGill University · Mila – Quebec AI Institute

  45. MHGraphBench: Knowledge Graph-Grounded Benchmarking of Mental Health Knowledge in Large Language Models

    May 15, 2026Weixin Liu, Congning Ni, Shelagh A. Mulvaney +4Mental HealthMedical Ontology

    Vanderbilt University, Nashville, TN, USA · Vanderbilt University Medical Center, Nashville, TN, USA · Virginia Tech, Blacksburg, VA, USA

  46. Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis

    May 14, 2026Mor Ventura, Roy Hirsch, Yonatan Bitton +2Image EditingMulti-Modal Data

    1Technion – Israel Institute of Technology · 2Google Research · *Work done during an internship at Google Research.

  47. Why Expert Alignment Is Hard: Evidence from Subjective Evaluation

    May 6, 2026Tzu-Mi Lin, Wataru Hirota, Tatsuya Ishigaki +2Expert DemonstrationsLarge Language Model Alignment

    National Yang Ming Chiao Tung University, Taiwan · Stockmark, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Japan +1

  48. Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model Decisions

    Apr 23, 2026Jiseon Kim, Jea Kwon, Luiz Felipe Vecchietti +3Moral ReasoningSocial Reasoning

    1KAIST · 2MPI-SP

  49. Brief chatbot interactions produce lasting changes in human moral values

    Apr 23, 2026Yue Teng, Qianer Zhong, Kim Mai Tich Nguyen Thordsen +2Moral ReasoningChatbots

    Department of Psychology, The University of Hong Kong, Hong Kong SAR, China. · Techno-Entrepreneurship Core, The University of Hong Kong, Hong Kong SAR, China. · Department of Psychology, University of Copenhagen, Copenhagen, Denmark. +4

  50. Why teaching resists automation in an AI-inundated era: Human judgment, non-modular work, and the limits of delegation

    Apr 8, 2026Songhee HanArtificial Intelligence EducationAutomated

    Florida State University, Tallahassee, FL 32306, USA

  51. Not All Subjectivity Is the Same! Defining Desiderata for the Evaluation of Subjectivity in NLP

    Mar 30, 2026Urja Khurana, Michiel van der Meer, Enrico Liscio +2SubjectivityDesiderata

    Department of Intelligent Systems, Delft University of Technology · Leiden Institute of Advanced Computer Science (LIACS), Leiden University · Computational Linguistics and Text Mining Lab, Vrije Universiteit Amsterdam

  52. On the Context Sensitivity of LLM Moral Judgment

    Mar 24, 2026Adrian Sauter, Mona SchirmerMoral ReasoningLarge Language Model Decisions

    Helmholtz Munich · University of Amsterdam

  53. RegCheck: A tool for structured comparisons between study registrations and papers

    Jan 19, 2026Jamie Cummins, Beth Clarke, Ian Hussey +1Research AutomationReproducibility

    Institute of Psychology, University of Bern · Bennett Institute of Applied Data Science, University of Oxford

  54. P-Check: Advancing Personalized Reward Model via Learning to Generate Dynamic Checklist

    Jan 6, 2026Kwangwook Seo, Dongha LeeProgress Reward ModelingReward Functions

    Department of Artificial Intelligence,Yonsei University

  55. Unexplainability of Artificial Intelligence Judgments and Functional Implementation in Kant's Perspective

    Jul 12, 2024Jongwoo SeoHuman JudgmentEpistemology

    Busan, South Korea

  56. Verification of Adaptive Agentic Controllers through Finite Rule Revision

    Date pendingRoberto GarroneAgentic ControlRuntime Enforcement

    Open University of Cyprus

  57. Learning to Think Like a Cartoon Captionist: Incongruity-Resolution Supervision for Multimodal Humor Understanding

    Date pendingHatice Merve Vural, Doga Kukul, Ege Erdem Ozlu +4HumorHuman Judgment

    Koç University, Istanbul, Turkey · KUIS AI Center, Istanbul, Turkey · Air Mail and Cartoon Collections +1