Practice Is Not Free: Measuring the Embodied Cost of Reset-Free Robot Practice
Organizations: Independent Researcher · University of Limerick
Abstract
When a robot practices without human resets, every attempt still costs wall-clock time, actuator wear, and sometimes a person's attention, yet the schedulers that decide what to practice next treat attempts as free. We present an open, low-cost testbed for measuring these costs: a self-built SO-101 arm runs two demonstration-trained ACT policies that reset each other, with a vision-based success detector and a ledger that records the time, joint travel, and human interventions of every attempt. We formulate cost-aware practice scheduling, in which task selection is rewarded by measured competence gain net of embodied cost, and specify in advance the comparison that will test it. Its first two conditions, run on hardware for 51 minutes of robot time, show that a fixed retry limit did not reduce the share of execution time lost to failures (36%, against 27% for a feasibility rule; not significant) and saved no robot time. The logs suggest why: failures showed no sign of clustering, so a retry right after a failure was as likely to succeed as any other attempt. The ledger also shows that most of the retry rule's extra human time came from cubes knocked out of reach rather than from the rule itself, and a cost-aware rule replayed on the logs recovers the sensible choice without a hand-set limit. We also report lessons from building the system, including a coverage effect in which concentrating demonstrations in a smaller workspace raised success there from 8/20 to 10/10.
Figures & tables
| Condition | Action set | Reward | Role |
|---|---|---|---|
| A. Feasibility | attempt only | none | the pilot baseline |
| B. Fixed retry limit | attempt, request help | none | requests help after consecutive failures, a fixed reset budget in the spirit of Leave No Trace |
| C. Cost-blind bandit | attempt, reposition, request help | success, | isolates the effect of a learned schedule |
| D. Cost-aware bandit | attempt, reposition, request help | success | the proposed method |
| Metric | A. Feasibility | B. Retry limit ( ) |
|---|---|---|
| Sessions, robot minutes | 3, 30.9 | 2, 20.1 |
| Valid attempts | 47 | 32 |
| Success rate (95% CI) | 78.7% (65.1–88.0) | 65.6% (48.3–79.6) |
| Place, retrieve successes | 17/26, 20/21 | 11/21, 10/11 |
| Execution time on failed attempts ∗ | 26.6% | 35.7% |
| Successes per robot minute | 1.20 | 1.05 |
Robot Learning
Robot learning develops methods for robots to acquire skills and adapt from demonstrations, interaction, data, and physical models.
See all 343 papers