Biologically Inspired Event-Based Perception and Sample-Efficient Learning for High-Speed Table Tennis Robots
Organizations: National University of Defence Technology, Changsha 410073, Hunan, P.R.China · Defense Innovation Institute, AMS · Qiyuan Lab
Abstract
Perception and decision-making in high-speed dynamic scenarios remain challenging for current robots. In contrast, humans and animals can rapidly perceive and make decisions in such environments. Taking table tennis as a typical example, conventional frame-based vision sensors suffer from motion blur, high latency and data redundancy, which can hardly meet real-time, accurate perception requirements. Inspired by the human visual system, event-based perception methods address these limitations through asynchronous sensing, high temporal resolution, and inherently sparse data representations. However, current event-based methods are still restricted to simplified, unrealistic ball-only scenarios. Meanwhile, existing decision-making approaches typically require thousands of interactions with the environment to converge, resulting in significant computational costs. In this work, we present a biologically inspired approach for high-speed table tennis robots, combining event-based perception with sample-efficient learning. On the perception side, we propose an event-based ball detection method that leverages motion cues and geometric consistency, operating directly on asynchronous event streams without frame reconstruction, to achieve robust and efficient detection in real-world rallies. On the decision-making side, we introduce a human-inspired, sample-efficient training strategy that first trains policies in low-speed scenarios, progressively acquiring skills from basic to advanced, and then adapts them to high-speed scenarios, guided by a case-dependent temporally adaptive reward and a reward-threshold mechanism. With the same training episodes, our method improves return-to-target accuracy by 35.8%. These results demonstrate the effectiveness of biologically inspired perception and decision-making for high-speed robotic systems.
Figures & tables
| Dataset | Precision | Recall | Error (px) |
| real4* | 1.000 | 0.928 | 2.61 |
| real5* | 1.000 | 0.985 | 2.77 |
| real6* | 1.000 | 0.902 | 2.59 |
| real7* | 1.000 | 0.794 | 2.89 |
| Setting | Episodes | Simple | Case-based Reward | Ours |
| Rand pos., 3 m/s | 350 | 46% | 70% | 78% |
| 400 | 86% | 80% | 98% | |
| 600 | 92% | 98% | 100% | |
| Rand pos., 4 m/s | 600 | 46% | 60% | 72% |
| 800 | 60% | 80% | 92% | |
| 900 | 60% | 82% | 98% |