cs.ROJun 2, 2026

BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions

Authors: Zhe SunMeng WangLei WangYuxi WangWanxin LiYujia PengZhenliang Zhang

Organizations: State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · Peking University, Beijing, China

Abstract

Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often too complicated for children. We propose an interactive system that facilitates robot storytelling with tangible and natural language interactions. Children arrange the playground with their own stuff and create narratives with an LLM agent. The created narratives are transformed into a motion sequence based on the map and characters, and the motions are executed by self-navigating swarm robots. This system enhances robot storytelling with flexible scenarios, enabling young children to create robot dramas with everyday objects.

Explore similar work

CardsList
  1. RoboTales: ROBOTic Anthropomorphic LEarning Systems

    Jun 24, 2026Andrew Chen, Ju-Hung Chen, Phurinat Pinyomit +1Scalable Robot Learning