cs.ROSep 11, 2026

Freehand Sketching for End-User Programming of Robot Swarms

Authors: Riwa Karam, Ian Kuo, Magnus Egerstedt

Abstract

Robot swarms are increasingly used in applications where accessible interaction with non-expert users is desirable. This paper investigates freehand sketching as an end-user programming interface for specifying robot swarm geometries. Users communicate spatial intent through a drawing, while the swarm autonomously extracts target formation points, constructs a rigid formation graph, assigns robots to formation nodes, and executes distributed formation control with a guarantee against unintended reflected formations. The resulting sketch-to-swarm framework is evaluated through a human study examining the usability of freehand formation specification. Twenty participants generated 4242 geometric shapes, and the interface achieved a mean System Usability Scale score of 84.2584.25, which conventionally indicates high perceived usability. The results support freehand sketching as an intuitive interaction abstraction for human-swarm collaboration without requiring robotics or programming expertise.

Explore similar work

CardsList
  1. Human-in-the-Loop Swarms: A Bionic Swarm Approach to Real-World Soil Mapping

    May 27, 2026Petras Swissler, Mohammadali Rashidioun, Nicholas Sahu +3SwarmsAgricultural Robots