Shared Execution-Clock Drifting Policy for Dynamic Precision Manipulation
Organizations: The Hong Kong Polytechnic University. · University of California San Diego. · Zhejiang University. · Universit´e Paris-Saclay. · Shanghai University of Engineering Science.
Abstract
Manipulation under time constraints requires both accurate actions and an execution rhythm that matches the evolving scene. This becomes critical when a robot must intercept moving objects or complete a sequence of adjustments before a deadline. Although one-step policies reduce generation cost, their directly predicted action sequences leave temporal allocation implicit. We propose Shared Execution-Clock Drifting (SECD), which makes execution rhythm an explicit part of one-step action generation. Conditioned on an observation and a latent sample, the policy jointly predicts a progress-indexed action curve and a shared monotone clock that maps fixed control times to locations on the curve. Demonstration-derived alignment anchors this decomposition, which is trained jointly through drifting on the decoded actions. The resulting policy retains a fixed-rate control interface and requires one network evaluation. We evaluate SECD across four real-robot tasks with inference on NVIDIA Thor. Across 300 trials, it achieves 77.00% task-averaged success and outperforms the evaluated one-step baselines on every task, including 91% success in cup retrieval from a 16 m/min conveyor and 54% in restoring and folding a crumpled shirt within 90 s. A fixed-clock variant reaches 79% on the same conveyor protocol. Complementary state-based RoboMimic experiments, including cross-seed ablations on Transport and Square, further support the joint design of the temporal representation and demonstration alignment. Project page: https://secd-anonymous-ewn.pages.dev/
Figures & tables
| Method | NFE | Lat. (ms) | Cup Place | Fold (Flat) | Fold (Crumpled) | Conveyor Cup | Avg. |
|---|---|---|---|---|---|---|---|
| DP [ 1 ] | 16 | 252 | 98.0 | 74.0 | 30.0 | 0.0 | 50.50 |
| OneDP [ 4 ] | 1 | 26 | 71.0 | 38.0 | 22.0 | 31.0 | 40.50 |
| Native Drifting [ 7 ] | 1 | 24 | 83.0 | 48.0 | 26.0 | 56.0 | 53.25 |
| SECD (ours) | 1 | 25 | 95.0 | 68.0 | 54.0 | 91.0 | 77.00 |
| Method | NFE | Lift | Can | Square | Transport | Avg. |
|---|---|---|---|---|---|---|
| DP [ 1 ] † | 100 | 1.00 (1.00) | 1.00 (0.98) | 0.96 (0.92) | 0.73 (0.62) | 0.92 (0.88) |
| Flow [ 22 ] † | 9 | 1.00 (1.00) | 1.00 (0.98) | 0.95 (0.90) | 0.74 (0.59) | 0.92 (0.87) |
| MIP [ 23 ] † | 2 | 1.00 (1.00) | 1.00 (0.98) | 0.96 (0.88) | 0.71 (0.58) | 0.92 (0.86) |
| CP [ 3 ] † | 1 | 1.00 (1.00) | 0.99 (0.96) | 0.88 (0.82) | 0.32 (0.24) | 0.80 (0.76) |
| MP1 [ 6 ] † | 1 | 1.00 (1.00) | 1.00 (0.97) | 0.96 (0.88) | 0.52 (0.39) | 0.87 (0.81) |
| Native Drifting [ 7 ] † | 1 | 1.00 (1.00) | 0.99 (0.96) | 0.97 (0.90) | 0.68 (0.58) | 0.91 (0.86) |
| Transport | Square | |||
|---|---|---|---|---|
| Variant | Best | Final | Best | Final |
| A: Direct drifting | 0.68 | 0.58 | 0.97 | 0.90 |
| B: Uniform clock + MSE | 0.74 | 0.60 | 0.96 | 0.92 |
| C: SECD w/o alignment | 0.70 | 0.56 | 0.97 | 0.88 |
| D: Complete SECD | 0.78 | 0.68 | 0.97 | 0.90 |