Robot Demonstration Videos Should Include Transparency Disclosures
Organizations: Robotics & AI Institute Cambridge, MA 02476
Abstract
This paper argues that the robotics and AI community should adopt disclosure standards for demonstration videos. As physical and financial constraints limit direct public access to embodied AI, public dissemination of progress in robotics is mainly through curated demonstration videos rather than direct experience with the technology. In a large-scale (N=9,341), pre-registered experiment across six countries, we find that the general public struggles to discern both the visual authenticity (e.g., distinguishing real footage from CGI) and behavioral authenticity (e.g., distinguishing autonomy from teleoperation) of robot demonstration videos. The omission of these details distorts public perception, leading people to overestimate the ability of robots to perform tasks and navigate real world environments. Using evidence from behavioral science, we design a disclosure intervention and demonstrate that the inclusion of clear disclosures in robot demonstration videos significantly improves discernment of visual and behavioral authenticity, as well as understanding robots' capabilities. We propose the adoption of disclosure standards for robot demonstration videos to accurately calibrate public expectations and promote transparency in robotics research.
Figures & tables
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| File | Form Factor | CGI | Teleop | Human | Task | Disclosure text | Task |
| in scene | type | (shown to treatment group) | levels | ||||
| mani_1 | Quadruped | No | Yes | Yes | Manipulation | This is a real video of a robot arm lifting and placing a pan lid. The movement of the arm is actively remote controlled by a human operator, in order to test whether the robot is suitable for accomplishing this task. | 1) The robot can lift and place a pan lid; 2) The robot can lift and place common household items on the floor; 3) The robot can lift and place any common household item on top of a counter |
| mani_2 | Quadruped | No | Yes | No | Manipulation | This is a real video of a robot arm lifting and stacking blocks. The movement of the arm is actively remote controlled by a human operator, in order to test whether the robot is suitable for accomplishing this task. | 1) The robot can lift and stack blocks; 2) The robot can lift and place common household items on the floor; 3) The robot can lift and place any common household item on top of a counter |
| mani_3 | Arm | No | Yes | Yes | Manipulation | This is a real video of a robot opening a candy wrapper. The movement of the arms is actively remote controlled by a human operator, in order to record human demonstration data that can be used to train robots to complete this task autonomously. | 1) The robot can manipulate a candy wrapper; 2) The robot can pour an open bottle of wine into a glass; 3) The robot can load and unload dishes from a dishwasher |
| mani_4 | Arm | No | Yes | No | Manipulation | This is a real video of a robot opening a candy wrapper. The movement of the arms is actively remote controlled by a human operator, in order to record human demonstration data that can be used to train robots to complete this task autonomously. | 1) The robot can manipulate a candy wrapper; 2) The robot can pour an open bottle of wine into a glass; 3) The robot can load and unload dishes from a dishwasher |