Humanoid motion tracking has scaled to general policies that reproduce diverse human motion, but the resulting behavior is in free-space: the tracker knows where the body should be, not how it should interact with the environment. Other work makes the object part of the objective, yet abstracts that interaction to contact or geometry, which leaves the demanding cases under-explored. We argue that force is a natural command channel between motion imitation and object interaction, one that specifies not just where to make contact but how hard. We present Ctrl-F, a hierarchical motion-force framework that augments motion tracking with an explicit force command, a 3-D force at each designated contact body such as a hand or a foot. The hierarchical framework comprises: (1) A unified motion-force controller tracks the reference motion while applying the commanded force to the world. (2) A high-level force planner that issues a force command online based on object state and proprioception observations. In simulation and on hardware, Ctrl-F completes loco-manipulation that demands large, sustained interaction force and adjusts its command online as the load changes, both out of reach of a force-blind tracker. On hardware, Ctrl-F demonstrates hand-based dragging, pushing, and lifting, as well as foot-based kicking, successfully manipulating boxes weighing up to 20kg in pushing and kicking tasks where the force-blind baseline fails, while adapting online to additional loads introduced mid-task.
Figures & tables
Figure 1: Ctrl-F on hardware, running the raise-walk-kick sequence with a 1 kg box in the hands and an 8 kg cart to kick. Raising the box is already a force task: the hands slide off a box they do not press into, and a tracker without a force command does not lift it at all.
Figure 2: Ctrl-F. Stage 1 trains the motion–force tracker without objects: a force command is randomly sampled and its corresponding inverse force is applied to the robot, teaching the tracker to follow its reference while exerting the commanded load. Stage 2 freezes that tracker and learns the force command itself from object and robot state, supervised by the analytical force model and refined by reinforcement learning.
Figure 3: Response of the low-level tracker to an external wrench and a force command, during a static hold with a fixed reference posture.
Raised box
Tethered box
Kicked box
Pushed box
Dragged crate
Mass (kg)
1.8 – 6.0
3.6 – 7.0
3.0 – 6.0
4.6 – 13.0
7.0 – 8.8
Friction
0.60
—
0.25
0.38
0.57
Table 1: Objects. Mass denotes the range sampled during evaluation; friction denotes the coefficient at the task-relevant contact surface: the palms for the raised box and the floor for all other tasks.
Figure 4: The nine simulated tasks, in the reading order of the three families: hand tasks raise, push, drag, lift and hold; foot tasks sweep and kick; composite tasks carry a box while kicking or sweeping. Green arrows indicate the commanded force at each designated contact body, as specified by the high-level force planner and realized by the low-level controller.
Ours
SONIC
Forced-body error, local
2.96
5.89
Forced-body error, global
5.39
9.40
Whole-body error, local
3.10
3.75
Whole-body error, global
4.98
9.00
Completion (%)
100.0
80.2
Table 2: Q1(a): Tracking with the force command zeroed and no external load, averaged across all twelve clips of the three task families. Errors are in cm; “forced” denotes the bodies specified by each clip’s load mask. Local errors are root-anchored and global errors are measured in the world frame. Each family uses its own tracker; results are therefore averaged across clips, with the two policies paired within each clip.
Figure 5: (a) Q1(b): completion and forced-body error as the replayed wrench is scaled, averaged over all twelve clips. One trace per clip is replayed identically to the four settings and scaled together with the command each is given, so the settings differ only in the command they receive. The three command variants are one policy and coincide at zero load. The scale is the fraction of the per-body command range the wrench uses, so 1.0 means the same thing on a wrist ( 60 N) and an ankle ( 30 N) and nothing plotted is out of distribution. Dashed line is the 90% completion level. Errors are over all active steps, a convention that flatters a setting that terminates early. (b) Commanded force through an in-episode mass change on the tethered hold and the raised box, summed over force bodies. The solid line is a moving average and the shaded band is the spread it removed, the minimum and maximum within the same window; the grey column is the mass ramp; the dashed line adds gΔm , the change in the object’s weight, to the force before the change. A tethered box is an undamped pendulum and the commanded force oscillates with its swing, so the trend rather than the raw trace carries the reading.
Figure 6: Left: Task performance as object mass increases, averaged over the five hand tasks. Nominal is each object’s trained-band midpoint, so 1.0× is the same relative position in every band. Completion is over all active steps; a setting that terminates early is read together with its survival. The dashed line is 90% completion. Right: success at nominal mass, per task, for the hand policy (push: surviving 4 s); the tethered tasks have mirrored left and right clips and we draw the right one of each.
Task
no cmd.
BC only
Ours
Raise box
19.45 (0)
26.03 (6)
4.59 (100)
Tethered lift
25.25 (48)
23.65 (0)
6.26 (100)
Tethered hold
26.40 (75)
21.05 (84)
6.28 (100)
Push box
29.45 (0)
24.80 (0)
4.91 (84)
Drag crate
32.05 (19)
5.33 (100)
6.95 (100)
Table 3: Training-recipe comparison over the five hand tasks. 3-D object position error in cm, completion in % in parentheses. “no cmd.” is our policy with the force command removed; “BC only” is the same architecture trained by behavior cloning alone. Where a task has mirrored left and right clips we report the side our own policy does worse on.
Figure 7: Hardware deployment on a Unitree G1 using onboard sensing and AprilTag-based object pose estimation, by task family. Hand tasks: dragging the cart, pushing the box and raising the bin. Foot tasks: kicking the box and sweeping a 1 kg box. Composite: raise-walk-kick, carrying a 1 kg box and kicking a cart loaded with 8 kg. The pushed and kicked boxes reach 20 kg, the heaviest load tested.
Figure 8: Force realization on hardware. The hand pulls on a crane scale while the low-level tracker is commanded 10 , 20 and 30 N in one continuous take; the scale reads 0.90 , 1.70 and 2.50 kg ( 8.8 , 16.7 and 24.5 N).
Figure 9: Weight added mid-task on hardware. Top: adapting to weight added mid-drag. In every setting the cart is loaded while the robot is already dragging the cart, whose wheels stay locked throughout (arrow marks the loading). Frames are composited at equal time intervals; the spacing between poses is therefore speed. SONIC is given the easier test, an empty cart that takes 8 kg, because it cannot start a loaded cart moving at all; even so, it stops once the weight goes in. The two variants of our method start at 8 kg and take a further 6 kg. Under a command frozen at what the high-level force planner itself issued for the initial load, the robot keeps walking but slows, its poses bunching together after the change, while the full hierarchy holds its pace. Those two share a tracker, an interface and a starting force command, and differ only in whether that command is allowed to change. Bottom: An additional 1 kg is added to a 1 kg bag hanging from the forearm. The dashed line indicates the wrist height before loading. With zero force command, the wrist drops below this line, whereas the high-level force planner adapts its command to maintain the original height.
Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We collect robot-free demonstrations using two force-sensing UMI-style handheld grippers for hand motion and contact wrenches, and wearable trackers for body motion. A force-reactive diffusion policy takes vision, proprioception, and measured wrenches as input, then predicts actions and per-hand force commands. A hybrid compliance whole-body controller with force tracking executes these commands while maintaining balance: an integral of the force error measured by real force/torque (F/T) sensors lets each hand track force accurately along the commanded direction and remain compliant along the others. In simulation, the controller tracks per-hand force commands of varied magnitude and direction, with little loss in whole-body motion accuracy. Across three contact-rich tasks on the robot, the force-reactive policy succeeds in 80% of rollouts, compared with 26.7% for a position-only policy trained on the same demonstrations and executed by the same controller. For more details, please visit our website: https://louis-leee.github.io/FLoRe/.
Sihang Li, Xiaofeng Guo, Jinkun Cao +5
Amazon FAR (Frontier AI & Robotics) · New York University · Carnegie Mellon University +1
Humanoid loco-manipulation requires coordinated locomotion, balance regulation, and manipulation under frequent contacts, making teleoperated demonstration collection difficult: a practical controller must simultaneously provide precision, stability, and contact awareness. We propose FORGE, a force-aware multi-granularity control system with a coarse-to-fine command space spanning velocity navigation, planar foot placement, wrist-pose tracking, and optional force-conditioning inputs. Policy training requires no full-body human motion trajectories or joint-angle references; deployment consumes only sparse bilateral wrist poses relative to the pelvis, coarse motion commands, and optional desired wrist-load inputs. For sustained contact, FORGE combines a momentum observer with a learned correction trained using simulator contact-force supervision. At deployment, it estimates low-frequency, wrist-equivalent interaction forces from proprioception and reconstructed low-level arm PD torques, without wrist force/torque sensors. A quasi-static virtual-target loop uses this estimate and an optional desired applied-force input to adapt the wrist target. A frozen locomotion prior and asymmetric residual actions stabilize manipulation-induced whole-body corrections. Experiments evaluate unified-control stability, task-space tracking, quasi-static wrist-equivalent force estimation, squeezing forces during sustained contact with a rigid box, and downstream diffusion-policy execution of a squat-and-lift task across payload conditions. Website: https://bb0928.github.io/forge/.
Liangjun Xing, Ke Fan, Kailin Li +8
Shanghai AI Laboratory · Tsinghua University · Shanghai Jiao Tong University +2
Contact-rich manipulation demands human-like integration of perception and force feedback: vision should guide task progress, while high-frequency interaction control must stabilize contact under uncertainty. Existing learning-based policies often entangle these roles in a monolithic network, trading off global generalization against stable local refinement, while control-centric approaches typically assume a known task structure or learn only controller parameters rather than the structure itself. In this paper, we formalize a physically grounded interaction frame, an instantaneous local basis that decouples force regulation from motion execution, and propose a method to recover it from demonstrations. Based on this, we address both issues by proposing Force Policy, a global-local vision-force policy in which a global policy guides free-space actions using vision, and upon contact, a high-frequency local policy with force feedback estimates the interaction frame and executes hybrid force-position control for stable interaction. Real-world experiments across diverse contact-rich tasks show consistent gains over strong baselines, with more robust contact establishment, more accurate force regulation, and reliable generalization to novel objects with varied geometries and physical properties, ultimately improving both contact stability and execution quality. Project page: https://force-policy.github.io/
Hongjie Fang, Shirun Tang, Mingyu Mei +9
Noematrix · Shanghai Jiao Tong University · Zhejiang University +2