Human-in-the-Loop AI

Ask about this topic

Overview

Human-in-the-loop AI studies how people can teach, correct, guide, or oversee AI systems, from labeling examples in active learning to providing preferences in reinforcement learning and reviewing agent decisions. Common approaches include interactive interfaces, learning to defer uncertain cases to experts, and using human demonstrations or corrections to adapt robots and other systems during deployment. Applications range from medical decision support and education to robotics, scientific research, and software engineering, evaluated through benchmarks, user studies, and real-world trials. A central tension is how to make human input effective without creating excessive workload or encouraging overreliance, while preserving people’s ability to understand, challenge, and override AI decisions.

Latest papers

CardsList

289 papers30 papers in the last four weeks, down 9% on the four weeks before. 0.2% of all new papers.

  1. When, Where, and What to Correct: Human-Guided Adaptive Residual Correction for Robot Policies

    Oct 27, 2026Anukriti Singh, Maxime Caniot, Pratap Tokekar +1Robot Policy AdaptationResidual Policy Learning

    University of Maryland, College Park College Park, MD · Work done during internship at Enchanted Tools. · Enchanted Tools Paris, France

  2. I-HITL: Inalienable Human-in-the-Loop

    Oct 26, 2026Samuel Breckenridge, Dani Vilardell, Wenhao Wang +2Human-in-the-Loop AIAI Agent Safety

    Cornell Tech, IC3 · Yale University, IC3

  3. Dream to Assist: Intent-Conditioned World Models for Shared Vehicle Control

    Oct 26, 2026Jonathan DeCastro, Thomas Balch, Emily Sumner +9Shared AutonomyHuman-in-the-Loop AI

    Toyota Research Institute, Cambridge, MA 02139, USA · Toyota Research Institute, Los Altos, CA 94022, USA · Massachusetts Institute of Technology, Cambridge, MA 02139, USA

  4. InteractiveWorld: A Verifiable Human-Centric Environment for Building Better Interactive MLLM Assistants

    Oct 25, 2026Qinsi Wang, Wei Wen, Chong Zhou +7Multimodal Agent EvaluationHuman-in-the-Loop AI

    Meta · Duke University

  5. Numina Fuse: Interactive Autoformalization in Lean 4

    Oct 24, 2026Justin Asher, Yichuan Cao, Ruichen Qiu +2AutoformalizationLLM Agent Harnesses

    Project Numina · Academy of Mathematics and Systems Science, University of Chinese Academy of Sciences · University of Naples Federico II

  6. RSI Arena: Towards Recursive Self-Improvement with Human Feedback

    Oct 24, 2026Yue Huang, Yanbo Wang, Lichi Li +15LLM Agent Self-ImprovementLLM Agent Training

    Bake AI · University of Notre Dame · University of California, Los Angeles +8

  7. The As-If Machine: Personalized counterfactuals make distant policy risks feel close

    Oct 23, 2026Joshua Ashkinaze, Yubo Zhou, Pengyu Chen +6Large Language Model-Based Role-Play SimulationHuman-in-the-Loop AI

    University of Michigan

  8. When Human Corrections Travel: Safety in Federated VLA Adaptation

    Oct 23, 2026Vigneshwaran Subbaraju, Obaidullah Zaland, Monowar BhuyanVLA Model AdaptationHuman-in-the-Loop AI

    A*STAR, Singapore · Ume˚a University, Sweden

  9. COMET: A coordinated multi-layer runtime monitoring framework for human-supervised AI-enabled safety systems

    Oct 21, 2026Niclas Flehmig, Mary Ann Lundteigen, Shen YinAI SafetyAI Agent Monitoring

    Department of Mechanical and Industrial Engineering, Norwegian University of Science and Technology, Trondheim, Norway · Department of Cybernetics Engineering, Norwegian University of Science and Technology, Trondheim, Norway

  10. Training in Deployment: Human-in-the-loop Online Post-Training for Robot Manipulation

    Oct 21, 2026Chun Gu, Xiaofei Wei, Yiming Chen +4Robot LearningHuman-in-the-Loop AI

    School of Data Science, Fudan University · Shanghai Innovation Institute · Logos Robotics Group +1

  11. From Code Generator to Engineering Companion: A Plant-aware Agent for PLC Programming

    Oct 20, 2026Joschka Kersting, Gesa BenndorfCoding AgentsCode Generation

    Fraunhofer IOSB-INA, Lemgo, Germany

  12. Beyond Explicit Intent: Discovering and Shaping Artistic Intent through Human-AI Co-Creation

    Oct 15, 2026Renye Yan, Jialun Zhong, Jikang Cheng +3Human-AI Co-CreationHuman-in-the-Loop AI

    Peking University, China

  13. Diviner: Agentic RCA with Human-Governed Adaptation for Large-Scale Infrastructure

    Oct 15, 2026Pradipta Ghosh, Gaurav Mitra, Shripad Nadgowda +7Root Cause AnalysisLLM Agent Reliability

    Meta, Inc., USA

  14. Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance

    Oct 14, 2026Zhefei Gong, Hefeifei Jiang, Zehao Wang +1Mobile ManipulationRobotic RL

    Northeastern University · University of California, Riverside · Georgia Institute of Technology

  15. From Human Corrections to Learned Segmentations: A Critical Mathematical Review of Information, Learning, and Human Effort

    Oct 14, 2026Jon SporringHuman-in-the-Loop AIHuman-in-the-Loop Annotation

    Department of Computer Science, University of Copenhagen, DK-2100 Copenhagen, Denmark

  16. LabCompiler: A Framework for Verifiable Human-Machine Laboratory Execution from Imperfect Protocols

    Oct 14, 2026Jingyuan Li, Dongzhan Zhou, Minting Pan +10Laboratory AutomationHuman-in-the-Loop AI

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Fudan University +2

  17. REPORT-OPS: Hybrid Evidence-Guided Reporting with Human-Supervised Refinement for HPC

    Oct 13, 2026Mah Kadidia Konate, Mayur Akewar, Janki Bhimani +1Evidence-Grounded GenerationAI Agent Reliability

    NERSC, Lawrence Berkeley National Laboratory, Berkeley, California, USA · Florida International University, Miami, Florida, USA

  18. Comparing GenAI to Machine Learning and Manual Review for eDiscovery

    Oct 12, 2026Gordon V. Cormack, Maura R. GrossmanGenerative AI EvaluationLegal IR

    University of Waterloo, ON, Canada

  19. The interpreter as developer: An autoethnographic design study of building a computer-assisted interpreting tool through human-LLM co-creation

    Oct 12, 2026Zeming ZhaoHuman-AI Co-CreationHuman-in-the-Loop AI

    College of Foreign Languages, Capital Normal University, Beijing, China

  20. Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization

    Oct 10, 2026Changkun Ou, Sven Mayer, Daniel Buschek +1Human-in-the-Loop AIPreference Elicitation

    LMU Munich, Germany · University of Bayreuth, Germany

  21. Provenance-Aware Belief Updating in Human-AI Feedback Loops

    Oct 9, 2026Tianyi Huang, Eric Liu, Jay Chong +2Data Provenance in Language ModelsBelief Updating in LLMs

    Ryquo · App-In Club

  22. Leveraging Human-In-The-Loop Demonstrations in Reinforcement Learning for Digital Twin-Driven Robot Flexibility

    Oct 8, 2026Yuzhu Sun, Mien Van, Nguyen Minh Nhat +2Robotic RLHuman-in-the-Loop AI

    School of Electronics, Electrical Engineering and Computer Science, Queen’s University Belfast, Northern Ireland, UK

  23. Careful Judge: Safe and Efficient Human-AI Collaborative Decision Making

    Oct 6, 2026Chenyu Zhang, Rachel Luo, Boyi Li +3Human-AI Decision MakingHuman-in-the-Loop AI

    MIT · NVIDIA · NVIDIA, Stanford University

  24. Humanize: Judgement Engineering for Agentic Coding

    Oct 6, 2026Sihao Liu, Ligeng Zhu, Zijian Zhang +6Multi-Agent CodingLLM Agent Orchestration

    NVIDIA · UCLA · Tsinghua University +2

  25. An AI-Assisted Formalization of the Poincaré Conjecture

    Oct 6, 2026Zhiyuan Zhang, Axel Delaval, Leheng Chen +6Human-AI CollaborationHuman-in-the-Loop AI

    School of Mathematical Sciences, Peking University · Beijing International Center for Mathematical Research, Peking University · Zhongguancun Academy +5

  26. Human-in-the-Loop Neuro-Symbolic Drift Anticipation for Reliable Visual SLAM

    Oct 5, 2026Junhyun Nam, Wonse JoSimultaneous Localization and MappingHuman-in-the-Loop AI

    Department of Information and Telecommunication Engineering, Incheon National University, Incheon, South Korea 22012.

  27. Answering clinicians' questions over trial evidence tables with verifiable, feedback-driven language models

    Oct 1, 2026Manan Roy Choudhury, Suparno Roy Chowdhury, Swastik Sahoo +5Clinical QATable QA

    Arizona State University, Tempe, Arizona, USA · Mayo Clinic, Phoenix, Arizona, USA

  28. SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

    Oct 1, 2026Hyeonmin Lee, Zheng Wei, Kyungmin Kwon +3Human-in-the-Loop AI3D Scene Generation

    Sungkyunkwan University · The Hong Kong University of Science and Technology

  29. Recova: Agent-Guided Failure Recovery for Autonomous Robotic Manipulation

    Oct 1, 2026Isabella Liu, An-Chieh Cheng, Johan Bjorck +6Robot Failure RecoveryHuman-in-the-Loop AI

    University of California, San Diego · NVIDIA · University of Texas at Austin

  30. Community-Driven API and AI Writer Design for Openly Scaling Community Notes

    Sep 30, 2026Brad Miller, Jay Baxter, Jiansong Chao +3Human-in-the-Loop AIAutomated Fact-Checking

    Community Notes, SpaceXAI