cs.ROAug 16, 2026

Tabletop Pen Manipulation With a Vision-Guided 4-DoF Arm

Authors: Anirudh Rangarajan, Bibit Bianchini

Organizations: Dougherty Valley High School, 10550 Albion Road, San Ramon, California 94582, United States of America · University of Pennsylvania, 3451 Walnut Street, Philadelphia, Pennsylvania 19104, United States of America

Abstract

Low-cost four-degree-of-freedom (DoF) arms are among the most accessible robotic platforms. But they are, in theory, underactuated for picking up in situations where objects are at arbitrary orientations, a task that appears to require five degrees of freedom: the planar position (x and y), the height (z), a wrist rotation to align the gripper with the object, and gripper actuation, of which a four-DoF arm lacks the wrist rotation. This work shows that perception and motion planning can enable such an arm, a roughly $200 Waveshare RoArm-M2-S, under a fixed overhead camera to detect and color-sort writing utensils without that joint. A YOLO11n-OBB (You Only Look Once, oriented bounding box) detector locates each writing utensil; camera intrinsics and an ArUco reference pose convert its pixel coordinates to robot coordinates; and a color classifier labels it. The detected orientation angle determines the motion strategy: utensils close to the arm's fixed approach direction are picked up directly, and those at steeper angles are reoriented via corrective sweeps until they are graspable, after which they are picked up and sorted into the assigned color bin. Across 326 logged motions on seven writing utensils, the arm made 196 direct grasps and 130 corrective sweep passes, correcting misalignments up to 90 degrees, suggesting that clever task-informed engineering can compensate for a missing degree of freedom on tasks like this one.

Explore similar work

CardsList
  1. EyeRobot 2.0: Active Gaze for Precise Manipulation without Wrist Cameras

    Oct 2, 2026Kush Hari, Justin Kerr, Nidhya Shivakumar +7Active Vision for Robot ManipulationActive Vision

  2. MAAP: Multi-Agent Active Perception for Collaborative Manipulation

    Sep 18, 2026Bruno N. Y. Chen, Li Kang, Heng Zhou +4Active Vision for Robot ManipulationRobotic Manipulation

  3. Vision-Based Hand Shadowing for Robotic Manipulation via Inverse Kinematics

    Mar 11, 2026Hendrik Chiche, Antoine Jamme, Trevor Rigoberto Martinez +1Motion RetargetingRobotic Manipulation