Move, don't think: sample-efficient collision avoidance with lossy proximity sensors
Organizations: Human Interaction and Robotics Group, University of Colorado Boulder · Correll Lab, University of Colorado Boulder
Abstract
Data-driven robots must learn to avoid collisions with as few demonstrations as possible to avoid collecting large datasets of destructive collision examples. We explore whole-body proximity sensors as inductive biases for learning reflexive collision-dodging behavior and find that lossy sensors with low resolution were stronger biases than high-resolution coverage. We also found that, perhaps unintuitively, anticipating when and where contact happens on the body of a robot reduced its learning sample efficiency. We investigated eight candidate representations in a reinforcement learning environment, which included latent compression, future contact anticipation, lossy corruption, and privileged state estimation. The candidate representations were tested by training over 200 humanoid robots to play a simplified version of dodgeball end-to-end under an intentionally constrained sample and compute budget.
Figures & tables
| Representation | Description | Distance | Direction | Dimension |
| Raw sensor observation. | – | – | ||
| Localizes the nearest object within sensing coverage relative to the base of the robot. | ||||
| Returns only the closest range measurement per sensor. | – | |||
| Returns a latent observation. | ||||
| Returns only binary activations per signal. | – | – | ||
| Returns . |
| Sensor Observation | 10% Success | 25% Success | NAUC | ||||
|---|---|---|---|---|---|---|---|
| Steps | Speedup | w/ PWM | Steps | Speedup | w/ PWM | ||
| 338 | faster | – | 427 | faster | – | 0.508 | |
| 625 | faster | slower | 770 | faster | slower | 0.39 | |
| 770 | faster | – | 1026 | faster | – | 0.299 | |
| 1738 | faster | slower | 2024 | faster | slower | 0.158 | |
| 1613 | faster | – | 2082 | faster | – | 0.140 | |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
Robot Collision Avoidance
Robot collision avoidance develops sensing, planning, and control methods that keep robots safely separated from people, obstacles, and other robots.
See all 163 papers