BioAgent: Self-Directed Skill Acquisition and Capability Growth for Long-Horizon Laboratory Protocols
Organizations: Shanghai Jiao Tong University · University of Sussex
Abstract
Executing an unfamiliar laboratory protocol requires a robot to identify missing capabilities and determine whether each operation remains valid as the experiment progresses. This letter presents BioAgent, an embodied agent that addresses these coupled challenges of capability sufficiency and experimental validity. It matches human-reviewed requirements to validated skills and task packages, selects tool-based implementations for missing behaviors, and requests human teaching when needed during learning. Learned skills undergo sequential task-package validation to check outcomes and compatibility between successive operations. During execution, precondition, outcome, and experimental-state checks govern progression, autonomous recovery, or termination. Execution evidence guides tool selection, while accepted experience supports offline policy updates and task packaging. On the second task, BioAgent reuses 17 skill types unchanged, revises two existing implementations, and acquires five new types. On two dual-arm laboratory tasks with 20 and 31 ordered skill invocations, BioAgent achieves complete-task success rates of 66% and 58% with autonomous recovery over 50 runs per task. Across 25 atomic skills evaluated over 50 autonomous trials each with recovery disabled, success rates range from 84% to 100%, with 17 skills achieving 50/50.
Figures & tables
| Module or pipeline | Type | Function in BioAgent |
|---|---|---|
| VLA policy inference | Execution module | Predict manipulation actions from visual observations, robot state, and task instructions using [ 17 ] . |
| Reviewed trajectory replay | Execution backend | Execute a reviewed demonstration trajectory under its specified starting conditions. |
| Visual alignment and trajectory adaptation | Execution pipeline | Align task-relevant objects with demonstration references and adapt the recorded trajectory to the current scene. |
| Object-pose-guided trajectory replay | Execution pipeline | Use estimated object poses to adapt and execute a reviewed object-relative trajectory. |
| Instrument command execution | Device interface | Execute supported instrument command sequences and return execution status. |
| 6D object pose estimation | Perception tool | Estimate the target object’s pose in a specified coordinate frame, e.g., using FoundationPose [ 18 ] . |
| Complete-task count (SR) | |||||
|---|---|---|---|---|---|
| Task | Ordered invocations | Distinct skills | Runs per condition | Without recovery | With recovery |
| Task 1 | 20 | 20 | 50 | 27/50 (54%) | 33/50 (66%) |
| Task 2 | 31 | 24 | 50 | 20/50 (40%) | 29/50 (58%) |
| Success rate (%): 50 trials per method and skill | |||||
| No. | Atomic skill / operation binding | ProtoAct [ 6 ] (SmolVLA) | BioProVLA [ 5 ] (AugSmolVLA) | ENPIRE [ 10 ] | BioAgent |
| Plate handling | |||||
| 1 | Pick up the six-well culture plate from the target bench position | 42 | 66 | 50 | 100 |
| 2 | Retrieve the six-well culture plate from the tray inside the incubator | 38 | 68 | 48 | 94 |
| 3 | Place the six-well culture plate at the target position on the bench | 70 | 82 | 66 | 100 |
| 4 | Place the six-well culture plate onto the tray inside the incubator | 36 | 56 | 46 | 100 |
| Development quantity | Task 1 | Task 2 |
| Initial validated skill types | 0 | 20 |
| Required distinct types | 20 | 24 |
| Planner gap flags | 20 | 7 |
| Reference-confirmed implementation gaps | 20 | 7 |
| Unchanged reused types | 0 | 17 |
| Revised existing types | 0 | 2 |
| Task 1: 20 invocations | |||||
|---|---|---|---|---|---|
| Condition | 10 | 15 | 20 | Final | |
| No recovery | 38 | 34 | 27 | 21 | 20 |
| R1 only | 38 | 35 | 29 | 24 | 22 |
| R1+R2 | 39 | 37 | 32 | 27 | 26 |
| Task 2: 31 invocations | |||||
| Condition | 16 | 24 | 31 | Final | |