Human-in-the-Loop AI

Ask about this topic

Overview

Human-in-the-loop AI studies how people can teach, correct, guide, or oversee AI systems, from labeling examples in active learning to providing preferences in reinforcement learning and reviewing agent decisions. Common approaches include interactive interfaces, learning to defer uncertain cases to experts, and using human demonstrations or corrections to adapt robots and other systems during deployment. Applications range from medical decision support and education to robotics, scientific research, and software engineering, evaluated through benchmarks, user studies, and real-world trials. A central tension is how to make human input effective without creating excessive workload or encouraging overreliance, while preserving people’s ability to understand, challenge, and override AI decisions.

Latest papers

CardsList

290 papers30 papers in the last four weeks, down 9% on the four weeks before. 0.2% of all new papers.

  1. From Surface Learning to Deep Understanding: A Grounded AI Tutoring System for Moodle

    May 7, 2026Anna Ostrowska, Michał Kukla, Gabriela Majstrak +4Intelligent Tutoring SystemsAI in Education

    Faculty of Mathematics and Information Sciences, Warsaw University of Technology, Warsaw, Poland

  2. PersonaTeaming: Supporting Persona-Driven Red-Teaming for Generative AI

    May 7, 2026Wesley Hanwen Deng, Mingxi Yan, Sunnie S. Y. Kim +5Adversarial Prompt GenerationLLM Red Teaming

    Carnegie Mellon University Pittsburgh, Pennsylvania, USA · Apple Seattle, Washington, USA · Apple Cupertino, California, USA +1

  3. AICoFe: Implementation and Deployment of an AI-Based Collaborative Feedback System for Higher Education

    May 6, 2026Alvaro Becerra, Alejandra Palma, Ruth CobosGenerative AI in EducationHuman-in-the-Loop AI

    GHIA Group, School of Engineering, Universidad Autónoma de Madrid, Spain

  4. A Workflow-Oriented Framework for Asynchronous Human-AI Collaboration in Hybrid and Compute-Intensive HPC Environments

    May 5, 2026Sergio Mendoza, Cedric Bhihe, Natalia Zamora +5High-Performance ComputingHuman-in-the-Loop AI

    1Barcelona Supercomputing Center, Spain · 2NTT DATA, Spain

  5. AIs and Humans with Agency

    May 4, 2026David MumfordHuman-in-the-Loop AILLM Agents

  6. U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning

    May 4, 2026Christine P Lee, Xinyu Jessica Wang, Aws Albarghouthi +2LLM PlanningHuman-in-the-Loop AI

    University of Wisconsin–Madison, USA · George Mason University, USA

  7. Reliable AI Needs to Externalize Implicit Knowledge: A Human-AI Collaboration Perspective

    May 3, 2026Hengyu Liu, Tianyi Li, Zhihong Cui +5AI Agent ReliabilityHuman-in-the-Loop AI

    Department of Computer Science, Aalborg University, Aalborg, Denmark · Department of Informatics, University of Oslo, Oslo, Norway · School of Computing, Macquarie University, Sydney, Australia

  8. MILD: Mediator Agent System with Bidirectional Perception and Multi-Layered Alignment for Human-Vehicle Collaboration

    May 2, 2026Jiyao Wang, Yunbiao Wang, Yubo Jiao +6AI AlignmentAI Agent Safety

    Department of Civil Engineering, McGill University, Montreal H3A 0G4, Quebec, Canada · Systems Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, Guangdong, China · Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg L-4365, Luxembourg

  9. Virtual Speech Therapist: A Clinician-in-the-Loop AI Agent for Speech Therapy Planning

    May 1, 2026Shakeel Sheikh, Patrick Marmaroli, MD Sahidullah +4Speech ProcessingHuman-in-the-Loop AI

    The Kashmir Hub for Artficial Intelligence, The KHAIR, Basel, 4056, Switzerland. · Microsoft / Vocametrix, Tallinn, Estonia. · IAI, TCG CREST, West Bengal, India. +5

  10. Sketch-to-Layout: A Human-Centric Computational Agent for Constraint-Aware Synthesis of Modular Photobioreactors

    May 1, 2026Xiujin Liu, Shuqi Li, Yuxin LinHuman-in-the-Loop AI

    1Qrafty Technology Inc. · University of Michigan

  11. Skills as Verifiable Artifacts: A Trust Schema and a Biconditional Correctness Criterion for Human-in-the-Loop Agent Runtimes

    May 1, 2026Alfredo MetereAI Agent SecurityLLM Agent Verification

    Enclawed, LLC, California, USA

  12. Human-AI Coordination Zones: A Framework for Designing Human-in-the-Loop Experiences with Agentic AI

    May 1, 2026James Pierce, Vaiva Kalnikaitė, Siddharth Gupta +1Human-in-the-Loop AIHuman-AI Interaction

    Amazon Web Services

  13. Human-in-the-Loop Meta Bayesian Optimization for Fusion Energy and Scientific Applications

    Apr 30, 2026Ricardo Luna Gutierrez, Sahand Ghorbanpour, Ejaz Rahman +5Meta-LearningBayesian Optimization

    1Hewlett Packard Enterprise · University of Rochester

  14. TSAssistant: A Human-in-the-Loop Agentic Framework for Automated Target Safety Assessment

    Apr 27, 2026Xiaochen Zheng, Zhiwen Jiang, David Tokar +5LLM Agent OrchestrationHuman-in-the-Loop AI

    Predictive Modelling, Roche, Basel, Switzerland · Computational Sciences Center of Excellence, Roche, Basel, Switzerland · Translational Safety, Roche, Basel, Switzerland

  15. Learning Selective LLM Autonomy from Copilot Feedback in Enterprise Customer Support Workflows

    Apr 26, 2026Nikita Borovkov, Elisei Rykov, Olga Tsymboi +4Selective PredictionCustomer Support Automation

    T-Tech

  16. Revisable by Design: A Theory of Streaming LLM Agent Execution

    Apr 25, 2026Zhiyuan Zhai, Ming Li, Xin WangHuman-in-the-Loop AILLM Agents

    Fudan University · Guangming Lab

  17. AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report

    Apr 25, 2026Eduardo Oliveira, Michael Fu, Patanamon Thongtanunam +2Self-Regulated LearningGenerative AI in Education

    The University of Melbourne Melbourne, Australia · University of Eastern Finland Joensuu, Finland

  18. A Decoupled Human-in-the-Loop System for Controlled Autonomy in Agentic Workflows

    Apr 24, 2026Edward Cheng, Jeshua ChengAgentic WorkflowsHuman-in-the-Loop AI

  19. FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Lean

    Apr 24, 2026Jordan Meadows, Lan Zhang, Andre FreitasHuman-in-the-Loop AIAgentic Code Generation

    Independent Researcher · University of Manchester, UK · Idiap Research Institute, Switzerland +1

  20. Hi-WM: Human-in-the-World-Model for Scalable Robot Post-Training

    Apr 23, 2026Yaxuan Li, Zhongyi Zhou, Yefei Chen +5Robot Policy LearningRobot Policy Adaptation

    Current Robotics · Tsinghua University · Peking University +1

  21. Mind the Prompt: Self-adaptive Generation of Task Plan Explanations via LLMs

    Apr 22, 2026Gricel Vázquez, Alexandros Evangelidis, Sepeedeh Shahbeigi +2Explainable Artificial IntelligenceHuman-in-the-Loop AI

    University of York, UK · Cyprus University of Technology, Cyprus

  22. pAI/MSc: ML Theory Research with Humans on the Loop

    Apr 22, 2026Mahmoud Abdelmoneum, Pierfrancesco Beneventano, Tomaso PoggioMulti-Agent LLM SystemsAI-Assisted Scientific Research

    1Massachusetts Institute of Technology · 2Perseus Labs

  23. Auditing and Controlling AI Agent Actions in Spreadsheets

    Apr 22, 2026Sadra Sabouri, Zeinabsadat Saghi, Run Huang +4Human-in-the-Loop AIAI Agent Monitoring

    University of Southern California Los Angeles, USA · California State Polytechnic University Pomona, USA · Microsoft Redmond, USA

  24. From Fuzzy to Formal: Scaling Hospital Quality Improvement with AI

    Apr 21, 2026Patrick Vossler, Jean Feng, Venkat Sivaraman +9Human-in-the-Loop AIAutomatic Prompt Optimization

    University of California, San Francisco · 2Zuckerberg San Francisco General Hospital

  25. BONSAI: A Mixed-Initiative Workspace for Human-AI Co-Development of Visual Analytics Applications

    Apr 21, 2026Thilo Spinner, Matthias Miller, Fabian Sperrle-Roth +1Multi-Agent CollaborationHuman-in-the-Loop AI

    Thilo Spinner · Matthias Miller · Fabian Sperrle-Roth +1

  26. CoAct: Co-Active LLM Preference Learning with Human-AI Synergy

    Apr 19, 2026Ruiyao Xu, Mihir Parmar, Tiankai Yang +3RL for Language ModelsLLM Alignment

    Northwestern University · Google · University of Southern California +1

  27. An AI Co-Data-Scientist for Prioritizing Candidate Biomarkers from Wearable Sensor Data

    Apr 16, 2026Yubin Kim, Salman Rahman, Samuel Schmidgall +33AI Agents for Scientific DiscoveryScientific Discovery

    Google Research · Massachusetts Institute of Technology · Google DeepMind +7

  28. GDPR Auto-Formalization with AI Agents and Human Verification

    Apr 16, 2026Ha Thanh Nguyen, Wachara Fungwacharakorn, Sabine Wehnert +6Human-in-the-Loop AI

    Center for Juris-Informatics, ROIS-DS Tokyo, Japan · Ruhr-University Bochum, RC-Trust Bochum, Germany · Uniwersytet Jagielloński w Krakowie Kraków, Poland +1

  29. Agentic Driving Coach: Robustness and Determinism of Agentic AI-Powered Human-in-the-Loop Cyber-Physical Systems

    Apr 13, 2026Deeksha Prahlad, Daniel Fan, Hokeun KimHuman-in-the-Loop AICyber-Physical Systems

    Arizona State University Tempe, AZ, United States

  30. Toward Human-AI Complementarity Across Diverse Tasks

    Apr 13, 2026Yuzheng Xu, Annya Dahmani, Matthew D. Blanchard +13Human-AI ComplementarityHuman-AI Decision Making

    The University of Tokyo · UC Berkeley · University of Sydney +6