Human in the Loop

Human-in-the-loop (HITL) systems integrate human expertise with artificial intelligence to improve the performance, robustness, and ethical considerations of AI systems. Current research focuses on optimizing HITL interactions across diverse applications, including autonomous driving, medical image analysis, and robotics, often employing techniques like active learning, reinforcement learning, and large language models to guide human input and improve model efficiency. The significance of HITL lies in its ability to address limitations of fully automated systems, particularly in complex or ambiguous tasks, leading to more accurate, reliable, and ethically sound AI solutions across various scientific and practical domains.

Papers

December 26, 2023

Learning-To-Rank Approach for Identifying Everyday Objects Using a Physical-World Search Engine
Kanta Kaneda, Shunya Nagashima, Ryosuke Korekata, Motonari Kambara, Komei Sugiura
Arbitrary Object Human in the Loop Service Robot Learning to Rank Home Robot User in the Loop

December 5, 2023

Expert-guided Bayesian Optimisation for Human-in-the-loop Experimental Design of Known Systems
Tom Savage, Ehecatl Antonio del Rio Chanona
Human in the Loop Bayesian Optimisation Decision Theory Multi Objective Optimisation Optimal Experimental Design Similar System

November 15, 2023

Human-in-the-loop: Towards Label Embeddings for Measuring Classification Difficulty
Katharina Hechinger, Christoph Koller, Xiao Xiang Zhu, Göran Kauermann
Machine Learning Model Jina Embeddings Supervised Learning Natural Language Inference Human in the Loop Label Embeddings Classification Difficulty

November 8, 2023

Learning the What and How of Annotation in Video Object Segmentation
Thanos Delatolas, Vicky Kalogeiton, Dim P. Papadopoulos
Video Generation Segmentation Mask Human in the Loop Video Object Segmentation Annotation Rather Object Annotation

November 6, 2023

Inclusive Portraits: Race-Aware Human-in-the-Loop Technology
Claudia Flores-Saviaga, Christopher Curtis, Saiph Savage
Human in the Loop Face Verification Portrait Image AI Service

October 25, 2023

Break it, Imitate it, Fix it: Robustness by Generating Human-Like Attacks
Aradhana Sinha, Ananth Balashankar, Ahmad Beirami, Thi Avrahami, Jilin Chen, Alex Beutel
Adversarial Example Human in the Loop Adversarial Framework

October 8, 2023

September 5, 2023

Detection of Unknown-Unknowns in Human-in-Plant Human-in-Loop Systems Using Physics Guided Process Models
Aranyak Maity, Ayan Banerjee, Sandeep Gupta
Data Detection Human in the Loop Multi Scenario Physic Based Hybrid Neural Network Unknown Unknown Safety Certificate

August 25, 2023

Temporal Uncertainty Localization to Enable Human-in-the-loop Analysis of Dynamic Contrast-enhanced Cardiac MRI Datasets
Dilek M. Yalcinkaya, Khalid Youssef, Bobak Heydari, Orlando Simonetti, Rohan Dharmakumar, Subha Raman, Behzad Sharif
Human in the Loop Cardiac Magnetic Resonance Temporal Localization

August 10, 2023

Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research
Hariharan Subramonyam, Jessica Hullman
Stronger Generalizability Human in the Loop Filling Gap VIS4ML Research

July 28, 2023

SAP-sLDA: An Interpretable Interface for Exploring Unstructured Text
Charumathi Badrinath, Weiwei Pan, Finale Doshi-Velez
Human in the Loop Unstructured Text Latent Dirichlet Allocation Interpretable by Design

July 20, 2023

Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback
Marcel Torne, Max Balsells, Zihan Wang, Samedh Desai, Tao Chen, Pulkit Agrawal, Abhishek Gupta
Reinforcement Learning Human in the Loop Active Exploration Pseudo Goal Goal Conditioned Exploration Incentivized Exploration Uninformed Exploration

July 12, 2023

July 7, 2023

Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systems
Amr Gomaa, Bilal Mahdy, Niko Kleer, Michael Feld, Frank Kirchner, Antonio Krüger
Synthesized View Human in the Loop Robotic Surgery Surgical Robotic System Autonomous Robotic Surgery Hybrid Learning Neuro Symbolic Learning

July 6, 2023

Improving the Efficiency of Human-in-the-Loop Systems: Adding Artificial to Human Experts
Johannes Jakubik, Daniel Weber, Patrick Hemmer, Michael Vössing, Gerhard Satzger
Machine Learning Artificial Intelligence Machine Learning Model High Efficiency Human in the Loop Synthetic to Real Human Expert

July 4, 2023

June 24, 2023

Are Good Explainers Secretly Human-in-the-Loop Active Learners?
Emma Thuong Nguyen, Abhishek Ghose
Active Learning Explainable AI Human in the Loop Model Prediction Quality Explanation Active Learner

Human in the Loop

Papers

Learning-To-Rank Approach for Identifying Everyday Objects Using a Physical-World Search Engine

Expert-guided Bayesian Optimisation for Human-in-the-loop Experimental Design of Known Systems

Human-in-the-loop: Towards Label Embeddings for Measuring Classification Difficulty

Learning the What and How of Annotation in Video Object Segmentation

Inclusive Portraits: Race-Aware Human-in-the-Loop Technology

Break it, Imitate it, Fix it: Robustness by Generating Human-Like Attacks

Generalizable Error Modeling for Human Data Annotation: Evidence From an Industry-Scale Search Data Annotation Program

Human-in-the-loop: The future of Machine Learning in Automated Electron Microscopy

Detection of Unknown-Unknowns in Human-in-Plant Human-in-Loop Systems Using Physics Guided Process Models

Temporal Uncertainty Localization to Enable Human-in-the-loop Analysis of Dynamic Contrast-enhanced Cardiac MRI Datasets

Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research

SAP-sLDA: An Interpretable Interface for Exploring Unstructured Text

Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback

Diagnosis, Feedback, Adaptation: A Human-in-the-Loop Framework for Test-Time Policy Adaptation

FAIRO: Fairness-aware Adaptation in Sequential-Decision Making for Human-in-the-Loop Systems

Teach Me How to Learn: A Perspective Review towards User-centered Neuro-symbolic Learning for Robotic Surgical Systems

Improving the Efficiency of Human-in-the-Loop Systems: Adding Artificial to Human Experts

IAdet: Simplest human-in-the-loop object detection

Optimal and Efficient Binary Questioning for Human-in-the-Loop Annotation

Are Good Explainers Secretly Human-in-the-Loop Active Learners?