Seeing What Still Holds: How Waiting Control Changes Cooperative Recovery
Organizations: School of Computer Science and Artificial Intelligence, Shandong Normal University
Abstract
Changing the holding reference during a fixed-duration wait can reverse the ranking of visual recovery methods. We introduce AuditEmbodied, a paired execution and trajectory evaluation framework that independently varies holding references and waiting duration while keeping recovery executors frozen. A 960-execution factorial on 20 initialization seeds compares CAD-feedback and landmark-based recovery from identical post-wait physical states within each holding and waiting condition. Protected completion requires successful recovery under the declared execution constraints. At a 1 s wait with registered wrist references, their protected completion counts change from 6/40 versus 19/40 under registered holding to 34/40 versus 22/40 under position-only holding. Trajectory analysis localizes the main separation to grasp formation: small observation-time target residuals precede large tracking errors. Joint diagnostics and controlled interventions characterize persistent tracking constraints. On fresh seeds, gradual position reanchoring improves CAD recovery's long-wait completion by 42.5 percentage points and reduces mean complete recovery time by 6.06 s relative to registered holding. Additional evaluations with pretrained policies, handover, and a mass-matched geometry characterize holding-reference sensitivity across executors and physical regimes. These findings establish holding reference as an explicit evaluation condition for comparing visual recovery performance.
Figures & tables
| Executor | Hold target | Protected completion | Healthy | Complete time (s) | ||
|---|---|---|---|---|---|---|
| CAD feedback | Registered | 36/40 | 6/40 | 40/40 | 27.01 | 35.58 |
| CAD feedback | Position only | 34/40 | 34/40 | 40/40 | 26.58 | 27.97 |
| CAD feedback | Rotation only | 35/40 | 9/40 | 40/40 | 27.03 | 34.41 |
| CAD feedback | Position + rotation | 36/40 | 36/40 | 40/40 | 27.00 | 28.21 |
| Landmark | Registered | 21/40 | 19/40 | 38/40 | 30.74 | 31.67 |
| Policy | Boundary | Registered holding | Position-only holding | Interaction [95% CI] | ||
|---|---|---|---|---|---|---|
| Diffusion Policy | 32 | 18/20 | 19/20 | 17/20 | 19/20 | [0.0,15.0] |
| Diffusion Policy | 272 | 19/20 | 19/20 | 19/20 | 19/20 | [0.0,0.0] |
| LSTM–GMM | 32 | 9/20 | 11/20 | 13/20 | 13/20 | [-40.0,25.0] |
| LSTM–GMM | 272 | 8/20 | 8/20 | 7/20 | 8/20 | [-15.0,25.0] |
| Operating regime | Long-wait outcome | Interaction (pp) | Interpretation | |
|---|---|---|---|---|
| Registered | Position only | |||
| Core CAD feedback | 6/40 | 34/40 | Large reference-dependent response | |
| Arrival-adaptive CAD | 8/40 | 37/40 | Persists with bounded tracking | |
| Released CNN grasp recovery | 17/20 | 18/20 | Capable recovery; small response | |
| Mass-matched geometry, CAD | 37/40 | 36/40 | Dual grasps formed; balance-limited completion | |
| Handover, local recovery | 36/40 | 36/40 | Better tracking; unchanged completion | |
Robotic Manipulation
Robotic manipulation studies how robots perceive, plan, and control physical interactions to grasp, move, assemble, and use objects.
See all 1,842 papers