Trust in AI

Ask about this topic

Overview

Trust in AI research studies how people judge AI systems and decide whether to accept, check, or delegate decisions to them, as well as how agents and institutions can verify one another. Researchers use controlled user studies, surveys, behavioral measures of reliance, and benchmarks, alongside methods such as uncertainty calibration, evidence-linked explanations, provenance records, and reputation or access-control protocols. Work spans settings including healthcare, education, information seeking, human-robot teams, and autonomous agents, where both system performance and interaction design shape trust. A central tension is that explanations, confidence signals, and warnings can change perceived trust without improving users’ ability to spot errors or rely appropriately, so evaluation must separate trust from accuracy, verification, and outcomes.

Latest papers

CardsList

174 papers21 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

  1. Developer Task Delegation to LLMs and the Trust Factor: A Mixed Methods Study

    Oct 25, 2026Samuel Ferino, Rashina Hoda, John Grundy +2AI-Assisted Software DevelopmentHuman-AI Collaboration

    Faculty of Information Technology, Monash University, Melbourne, Australia. · School of Computing and Information Systems, Singapore Management University, Singapore.

  2. Can LLMs Trust Appropriately? Evaluating Calibrated Reliance on Imperfect Partners

    Oct 25, 2026Mengdi Chu, Jintao HuangTrust in AILLM Reliability

    The Ohio State University.

  3. Knowing Whom to Trust is not Enough: The Trust--Agreement Gap in Repeated Multi-Party LLM Negotiation

    Oct 22, 2026Amit Sarker, Moumita Choudhury, Saaduddin Mahmud +1Multi-Agent LLM SystemsTrust in AI

    University of Massachusetts Amherst

  4. Who Is Sycophantic to Whom? Confident LLMs, Human Deference, and the Collapse of Trust Calibration

    Oct 22, 2026Deepthika S, Pawni Yadav, B. SankarTrust in AILLM Reliability

    Department of Electronics and Communication Engineering, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, 641112, India · Department of Information Technology, Netaji Subhas University of Technology New Delhi, 110078, India · Department of Mechanical Engineering, Indian Institute of Science (IISc), Bangalore, 560012, India

  5. PerMIT: Securing Persistent Memory for LLM Agents via Machine-Checked Integrity Theorems and Scalable Community Trust

    Oct 20, 2026Tanqiu Jiang, Min Bai, Sadat Shahriar +2LLM Agent MemoryAI Agent Security

    Stony Brook University · AWS AI Labs

  6. Following Delegation Traces to Study Human Oversight in Interaction with Multimodal AI

    Oct 15, 2026Agnese Chiatti, Matteo Matteucci, Viola SchiaffonatiHuman Oversight of AIHuman-AI Decision Making

    AI and Robotics Lab (AIRLab), Politecnico di Milano, Milan, Italy

  7. Toward Study on the Effects of Robot's Humorous Apology on Human's Trust Recovery

    Oct 12, 2026Gayoung Kim, Go-Eum Cha, Wonse JoTrust in HRIHuman-Robot Interaction

    A+HRI Laboratory, Department of Information and Telecommunication Engineering, Incheon National University, Incheon, South Korea. · Department of Computer Science, Purdue University, IN, USA.

  8. WisdomNet: trustable machine learning toward error-free classification

    Oct 11, 2026Truong X. Tran, Ramazan S. AygunClassificationTrust in AI

    Computer Science Department, The University of Alabama in Huntsville, USA.

  9. Trust Hinders Bidirectional Human-AI Alignment

    Oct 10, 2026Michaela Benk, Kacper SokolHuman-AI Decision MakingAI Alignment

    Department of Informatics, University of Zurich, Switzerland · Department of Informatics, USI Lugano, Switzerland

  10. Healthy skepticism in AI: a data visualization research agenda

    Oct 7, 2026G. Elisabeta Marai, Marc Baaden, Michael Behrisch +2Trust in AIData Visualization

    University of Illinois Chicago, Chicago, IL, 60607, U.S.A. · CNRS (French National Centre for Scientific Research), Paris, 75794, France · Utrecht University, Utrecht, 3584CC, The Netherlands +2

  11. Toward Trustworthy Physical AI for Human Interaction

    Oct 5, 2026Niccolò Pagliarani, Maximilian Stölzle, Cosima du Pasquier +6RoboticsRobot Safety

    The BioRobotics Institute, Scuola Superiore Sant’Anna, Pontedera, Italy. · CSAIL, Massachusetts Institute of Technology, Cambridge, MA, USA. · CHARM Lab, Stanford University, Stanford, CA, USA. +3

  12. TrustMI: Causally controlling how assistants trust their users

    Oct 5, 2026Théo Lasnier, Romain Froger, Maxence Lasbordes +1LLM SafetyTrust in AI

    Inria Paris · Sorbonne Université · Meta SuperIntelligence Labs +1

  13. Toward AI Trustworthiness: Finding Analytically Proven Forward-Invariant Sets for AI-Controlled Systems

    Oct 5, 2026Haoyang Song, Xikun Yang, Qixin WangNeural Network VerificationTrust in AI

    Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China.

  14. Trust-Gated Capability Control: Breaking the Trust-Vulnerability Paradox in Multi-Agent LLM Systems

    Oct 4, 2026Mehedi Hasan Nipu, Chinmoy Mitra, Tarannum Ahmed Nowshin +1Trust in AIMulti-Agent System Security

    Department of Electrical and Computer Engineering, North South University, Dhaka, Bangladesh · Department of Computer Science & Engineering Rajshahi University of Engineering & Technology Rajshahi, Bangladesh · Department of Computer Science and Engineering BRAC University,Dhaka, Bangladesh +1

  15. A study on human-agent teaming through spoken interaction: the impact of human individual traits and agent characteristics

    Oct 2, 2026Lara Gauder, Martin Bernardo Meza, Javier Krick +4Human-AI CollaborationTrust in AI

    Departamento de Computación, Facultad de Ciencias Exactas y Naturales, Universidad de Buenos Aires, Pabellón Cero+Infinito, Ciudad Universitaria, Buenos Aires, C1428EGA, Argentina · Instituto de Investigación en Ciencias de la Computación, UBA-CONICET, Pabellón Cero+Infinito, Ciudad Universitaria, Buenos Aires, C1428EGA, Argentina · Universidad Nacional de Córdoba, Pabellón Argentina, Av. Haya de la Torre s/n, Ciudad Universitaria, Córdoba, X5000HUA, Argentina +1

  16. Evolutionary Computation for Trustworthy AI: From Attacks and Defenses to Self-Evolving Era

    Oct 2, 2026Junhao Dong, Chenkai Wang, Xuanhui Lin +8Trust in AIAI Agent Safety

    Nanyang Technological University, Singapore · Google · Sichuan University, China +2

  17. Trustworthy Data- and ML-Ops for Intelligent Transportation Systems and Logistics

    Oct 1, 2026Antonio Emanuele Cinà, Giovanni Scodeller, Cecilia Caterina Pasquale +5Intelligent Transportation SystemsTrust in AI

  18. Understanding Parents' Complex Views of AI for Children's Pretend Play

    Sep 30, 2026Sungho Oh, Mohammad Namvarpour, Maxi Heitmayer +2Human-AI InteractionTrust in AI

    Sander Oh · Matt Namvarpour · Department of Psychology, Rowan University, Glassboro, NJ, USA +1

  19. Foundations of Proactive Agents: Principles, Technical Layers, and Proactivity-Gym

    Sep 29, 2026Jio Oh, Seunghyun Do, Young-Jun Lee +2LLM Agent EvaluationLong-Horizon Agent Evaluation

    KAIST · University of Minnesota

  20. A Polyphonic Conception of AI Understanding

    Sep 28, 2026Matthieu Queloz, Pierre BeckmannLLM InterpretabilityLLM Reliability

    University of Bern, Department of Philosophy · École Polytechnique Fédérale de Lausanne (EPFL) · Idiap Research Institute +1

  21. Trustworthy synthetic visual media: Evidence across the media lifecycle

    Sep 28, 2026Zexi Jia, Zhiqiang Yuan, Jie Zhou +1Data ProvenanceDigital Image Forensics

    Tencent WeChat AI, Beijing, China.

  22. LLM4Trust: Exploring the Capabilities of Large Language Models for Trust Evaluation

    Sep 27, 2026Jie Wang, Yanbo Sun, Zheng Yan +2LLM EvaluationTrust in AI

    State Key Laboratory of Integrated Services Networks, School of Cyber Engineering, Xidian University · Hangzhou Institute of Technology, Xidian University · Department of Computer Science, Purdue University

  23. Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews

    Sep 25, 2026Hariharan Gopinath, Jan Bosch, Helena Holmström OlssonTrust in AIAI Governance

    Chalmers University of Technology, Department of Computer Science and Engineering, Gothenburg, Sweden · Eindhoven University of Technology, Department of Mathematics and Computer Science, Eindhoven, Netherlands · Malmö University, Department of Computer Science and Media Technology, Malmö, Sweden

  24. How Children Design and Reason about Trustworthy AI Chatbots

    Sep 21, 2026Deniz Ozturk, Jiayu Li, Daksh Pratap Singh +9AI in EducationAI Literacy

    Georgie · North Carolina State University Raleigh, United States · Independent Researcher Raleigh, United States +2

  25. When Agentic Trust Crosses Organizational Boundaries: Structural Externalization and a Reference Model for Trust Evidence

    Sep 19, 2026Huafu Li, Jia XiaTrust in AIAI Agent Governance

    China Mobile Jiutian Artificial Intelligence Technology (Beijing) Co., Ltd.

  26. NostrAgent: A Decentralized Identity and Delegation Architecture for Sovereign Agentic Systems

    Sep 19, 2026Oliver Aleksander Larsen, Mahyar Tourchi MoghaddamAI Agent SecurityAI Agent Governance

    University of Southern Denmark, Odense, Denmark

  27. Trustworthy FinAInce: Unpacking How AI-Mediated Financial Advice is Judged

    Sep 17, 2026Aryan Ramchandra Kapadia, Eshwar Chandrasekharan, Koustuv SahaTrust in AIHuman-AI Decision Making

    University of Illinois Urbana-Champaign, Urbana, IL, USA

  28. Understanding AI Provider Recommendations in Local Service Markets

    Sep 16, 2026Hazem Ibrahim, Yasir ZakiRetrieval-Augmented GenerationLarge Language Model-Based Recommendation

    New York University Abu Dhabi Abu Dhabi, United Arab Emirates

  29. Building Trust in Artificial Intelligence: A Necessity for Railway Applications

    Sep 16, 2026Lefebvre Renard Clément, Lébé Vincent, Da Silva Ribeiro Pereira Ricardo +4AI AssuranceTrust in AI

    Alstom - Mobility Data Science and AI, Madrid, Spain · Alstom - Mobility Data Science and AI, Saint-Ouen, France · Alstom - Safety Engineering, Stockholm, Sweden +1

  30. Beyond "ChatGPT Can Make Mistakes": Designing Interventions to Support Metacognitive Monitoring in AI-Assisted Work

    Sep 15, 2026Manuel A. D. Santos, Paul Thiesse, Steeven Villa +4Human-AI InteractionHuman-AI Decision Making

    Aalto University, Espoo, Finland · LMU Munich, Munich, Germany · Department of Computer Science, Aalto University, Espoo, Finland