Human in the Loop

Human-in-the-loop (HITL) systems integrate human expertise with artificial intelligence to improve the performance, robustness, and ethical considerations of AI systems. Current research focuses on optimizing HITL interactions across diverse applications, including autonomous driving, medical image analysis, and robotics, often employing techniques like active learning, reinforcement learning, and large language models to guide human input and improve model efficiency. The significance of HITL lies in its ability to address limitations of fully automated systems, particularly in complex or ambiguous tasks, leading to more accurate, reliable, and ethically sound AI solutions across various scientific and practical domains.

Papers

June 17, 2023

Human-In-the-Loop for Bayesian Autonomous Materials Phase Mapping
Felix Adams, Austin McDannald, Ichiro Takeuchi, A. Gilad Kusne
Human in the Loop Material SCIence Quantitative Phase Imaging Autonomous Exploration Mission Autonomous Experimentation

June 10, 2023

Human-in-the-Loop through Chain-of-Thought
Zefan Cai, Baobao Chang, Wenjuan Han
Multi Step Reasoning Human in the Loop Reasoning Performance

June 9, 2023

Overcoming Adversarial Attacks for Human-in-the-Loop Applications
Ryan McCoppin, Marla Kennedy, Platon Lukyanenko, Sean Kennedy
Adversarial Attack Human in the Loop Visual Attention Adversarial Image Human Centric Computer Vision

June 6, 2023

How Good is the Model in Model-in-the-loop Event Coreference Resolution Annotation?
Shafiuddin Rehan Ahmed, Abhijnan Nath, Michael Regan, Adam Pollins, Nikhil Krishnaswamy, James H. Martin
Full Model Human in the Loop Annotation Study Event Coreference Cross Document Event Coreference

May 24, 2023

A Human-in-the-Loop Approach for Information Extraction from Privacy Policies under Data Scarcity
Michael Gebauer, Faraz Maschhur, Nicola Leschke, Elias Grünewald, Frank Pallas
Information Extraction Privacy Policy Human in the Loop Data Scarcity Interpretable Representation Influential Data

May 21, 2023

On the Limitations of Simulating Active Learning
Katerina Margatina, Nikolaos Aletras
Active Learning Fundamental Limitation Human Annotation Human in the Loop ActIve Learning algORithm

May 16, 2023

Continually Learned Pavlovian Signalling Without Forgetting for Human-in-the-Loop Robotic Control
Adam S. R. Parker, Michael R. Dawson, Patrick M. Pilarski
Reinforcement Learning Human in the Loop Robotic Limb

April 6, 2023

From Explanation to Action: An End-to-End Human-in-the-loop Framework for Anomaly Reasoning and Management
Xueying Ding, Nikita Seleznev, Senthil Kumar, C. Bayan Bruss, Leman Akoglu
Line by Line Explanation Human in the Loop Action Feature Anomaly Class

April 5, 2023

A dynamic Bayesian optimized active recommender system for curiosity-driven Human-in-the-loop automated experiments
Arpan Biswas, Yongtao Liu, Nicole Creange, Yu-Chen Liu, Stephen Jesse, Jan-Chi Yang, Sergei V. Kalinin, Maxim A. Ziatdinov, Rama K. Vasudevan
Active Learning Recommender System Optical Experiment Human in the Loop Hysteresis Compensation Material Synthesis Atomic Force Microscopy

April 3, 2023

Efficient human-in-loop deep learning model training with iterative refinement and statistical result validation
Manuel Zahn, Douglas P. Perrin
Deep Learning Training Data Human in the Loop Iterative Refinement Experimental Validation Training Deep Quantitative Segmentation Ultrasound Segmentation Task

March 29, 2023

Did You Mean...? Confidence-based Trade-offs in Semantic Parsing
Elias Stengel-Eskin, Benjamin Van Durme
Semantic Parsing Human in the Loop Trade Offs Confidence Score Calibrated Confidence

March 21, 2023

AI-in-the-Loop -- The impact of HMI in AI-based Application
Julius Schöning, Clemens Westerkamp
Neural Network Global Impact Human in the Loop Human Machine Interaction Human Machine Interface Artificial Intelligence Architecture

March 14, 2023

Controllable Prosody Generation With Partial Inputs
Dan Andrei Iliescu, Devang Savita Ram Mohan, Tian Huey Teh, Zack Hodari
Generative Model Prosodic Feature Human in the Loop Partial Input

March 12, 2023

Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning
Siddharth Singi, Zhanpeng He, Alvin Pan, Sandip Patel, Gunnar A. Sigurdsson, Robinson Piramuthu, Shuran Song, Matei Ciocarlie
Reinforcement Learning Decision Making Autonomous Agent Human in the Loop Robotic Agent

March 7, 2023

February 11, 2023

The Impact of Expertise in the Loop for Exploring Machine Rationality
Changkun Ou, Sven Mayer, Andreas Butz
Global Impact Human in the Loop Domain Expertise Human Expert

February 9, 2023

Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow
Anjana Arunkumar, Swaroop Mishra, Bhavdeep Sachdeva, Chitta Baral, Chris Bryan
Language Model New Benchmark Human in the Loop Benchmark Study Visual Feedback Improved Benchmark

December 12, 2022

An adaptive human-in-the-loop approach to emission detection of Additive Manufacturing processes and active learning with computer vision
Xiao Liu, Alan F. Smeaton, Alessandra Mileo
Convolutional Neural Network Computer Vision Active Learning Human in the Loop Additive Manufacturing 3D Printing Signal Detection

November 20, 2022

A Blockchain Protocol for Human-in-the-Loop AI
Nassim Dehouche, Richard Blythman
AI System Human in the Loop Blockchain Network Natural Language Input Blockchain System Ethereum Network Behavior Primitive

Human in the Loop

Papers

Human-In-the-Loop for Bayesian Autonomous Materials Phase Mapping

Human-in-the-Loop through Chain-of-Thought

Overcoming Adversarial Attacks for Human-in-the-Loop Applications

How Good is the Model in Model-in-the-loop Event Coreference Resolution Annotation?

A Human-in-the-Loop Approach for Information Extraction from Privacy Policies under Data Scarcity

On the Limitations of Simulating Active Learning

Continually Learned Pavlovian Signalling Without Forgetting for Human-in-the-Loop Robotic Control

From Explanation to Action: An End-to-End Human-in-the-loop Framework for Anomaly Reasoning and Management

A dynamic Bayesian optimized active recommender system for curiosity-driven Human-in-the-loop automated experiments

Efficient human-in-loop deep learning model training with iterative refinement and statistical result validation

Did You Mean...? Confidence-based Trade-offs in Semantic Parsing

AI-in-the-Loop -- The impact of HMI in AI-based Application

Controllable Prosody Generation With Partial Inputs

Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning

ERUDITE: Human-in-the-Loop IoT for an Adaptive Personalized Learning System

adaPARL: Adaptive Privacy-Aware Reinforcement Learning for Sequential-Decision Making Human-in-the-Loop Systems

The Impact of Expertise in the Loop for Exploring Machine Rationality

Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow

An adaptive human-in-the-loop approach to emission detection of Additive Manufacturing processes and active learning with computer vision

A Blockchain Protocol for Human-in-the-Loop AI