Ctrl-F: Force as an Interface for Humanoid Loco-Manipulation
Organizations: University of California, Berkeley
Abstract
Humanoid motion tracking has scaled to general policies that reproduce diverse human motion, but the resulting behavior is in free-space: the tracker knows where the body should be, not how it should interact with the environment. Other work makes the object part of the objective, yet abstracts that interaction to contact or geometry, which leaves the demanding cases under-explored. We argue that force is a natural command channel between motion imitation and object interaction, one that specifies not just where to make contact but how hard. We present Ctrl-F, a hierarchical motion-force framework that augments motion tracking with an explicit force command, a 3-D force at each designated contact body such as a hand or a foot. The hierarchical framework comprises: (1) A unified motion-force controller tracks the reference motion while applying the commanded force to the world. (2) A high-level force planner that issues a force command online based on object state and proprioception observations. In simulation and on hardware, Ctrl-F completes loco-manipulation that demands large, sustained interaction force and adjusts its command online as the load changes, both out of reach of a force-blind tracker. On hardware, Ctrl-F demonstrates hand-based dragging, pushing, and lifting, as well as foot-based kicking, successfully manipulating boxes weighing up to 20kg in pushing and kicking tasks where the force-blind baseline fails, while adapting online to additional loads introduced mid-task.
Figures & tables
| Raised box | Tethered box | Kicked box | Pushed box | Dragged crate | |
|---|---|---|---|---|---|
| Mass (kg) | – | – | – | – | – |
| Friction | — |
| Ours | SONIC | |
|---|---|---|
| Forced-body error, local | 2.96 | 5.89 |
| Forced-body error, global | 5.39 | 9.40 |
| Whole-body error, local | 3.10 | 3.75 |
| Whole-body error, global | 4.98 | 9.00 |
| Completion (%) | 100.0 | 80.2 |
| Task | no cmd. | BC only | Ours |
|---|---|---|---|
| Raise box | 19.45 (0) | 26.03 (6) | 4.59 (100) |
| Tethered lift | 25.25 (48) | 23.65 (0) | 6.26 (100) |
| Tethered hold | 26.40 (75) | 21.05 (84) | 6.28 (100) |
| Push box | 29.45 (0) | 24.80 (0) | 4.91 (84) |
| Drag crate | 32.05 (19) | 5.33 (100) | 6.95 (100) |
Humanoid Loco-Manipulation
Humanoid loco-manipulation studies how robots coordinate walking, balance, and whole-body interaction to move and handle objects.
See all 97 papers