Fluidic Body: Swarm Robots as a Fluid Extension of the Hand
Organizations: University of Tsukuba, Ibaraki, Japan · Cluster Metaverse Lab, Tokyo, Japan · OMRON SINIC X Corporation, Tokyo, Japan
Abstract
Swarm robots have attracted growing interest as a physical interface for human--computer interaction, since a swarm can reshape its formation to fit the objects and surroundings it works with. For a human operator, however, adapting the swarm's behavior remains difficult. Most existing methods require the user to specify where the swarm should go, and they offer no intuitive way to change the collective's behavior as each task demands. We present Fluidic Body, a system that lets a person operate a swarm of fluid-imitating robots as an extension of the hand. The system places a virtual fluid between the hand and the swarm, and the user adapts the swarm's behavior to each task by changing the fluid's properties through simple hand movements. When the user opens the hand, the swarm becomes soft enough to deform and flow around obstacles. Closing the hand turns it into a hard, cohesive body that can push objects. We evaluated the controller's performance and its operability in two simulation experiments and one demonstration with physical robots. First, our controller handled both obstacle avoidance and object transportation better than an existing method that behaves the same way in every task. Second, in a VR user study, 17 participants completed the combined avoidance-and-transportation task faster and more reliably than with that method. They also reported a lower workload and a stronger sense of agency. Finally, this experience carried over to physical robots in a real-world demonstration (88 participants). These results suggest that treating a swarm as a fluid, a material people already understand, allows a robot swarm to work as a deformable extension of the human body.
Figures & tables
| Parameter | Fluid soft | Fluid hard |
|---|---|---|
| Viscosity coefficient | 0.001 | 0.03 |
| Reference density | 0.4 | 0.6 |
| Avoidance | Transportation | |||
|---|---|---|---|---|
| Method | Success (%) | Time (s) | Success (%) | Time (s) |
| RVO | 16.0 (8/50) | 100.0 (50/50) | ||
| Fluid soft (Ours) | 98.0 (49/50) | 36.0 (18/50) | ||
| Fluid hard (Ours) | 70.0 (35/50) | 100.0 (50/50) | ||
| Subscale | Item |
|---|---|
| Body ownership | It felt like the swarm robot was my body. |
| It felt like some of the robots were my fingers. | |
| It felt like the swarm robots belonged to me. | |
| The swarm robot felt like a human hand. | |
| Agency | The movements of the swarm robot felt like they were my movements. |
| I felt like I was controlling the movements of the swarm robot. |
| Avoidance | Transportation | Avoidance & Transportation | ||||
|---|---|---|---|---|---|---|
| Controller | Success (%) | Time (s) | Success (%) | Time (s) | Success (%) | Time (s) |
| RVO | 100.0 (17/17) | 94.1 (16/17) | 47.1 (8/17) | |||
| Fluid (Ours) | 100.0 (17/17) | 94.1 (16/17) | 100.0 (17/17) | |||
| Construct | Item |
|---|---|
| Body ownership | Did you feel as if the robot swarm was part of your own body while operating it? |
| Agency | Did you feel that your hand movements directly controlled the robot swarm’s behavior? |
| Effectiveness of flexibility control | Did the flexibility of the robot swarm help you control them more effectively? |
Swarm Robotics
Swarm robotics studies how groups of robots coordinate through local sensing, communication, and interaction to accomplish shared tasks.
See all 109 papers