ProtAgent: Post-Training Compact Protein Tool Agents with Interaction-Level Credit Assignment
Abstract
Protein annotation agents must choose suitable bioinformatics tools, interpret their outputs, and use the resulting evidence in the final answer. Most existing systems rely on frontier-scale models. We ask whether a compact model can instead learn this behavior through post-training with real tool interaction. We present ProtAgent, a two-stage pipeline that uses supervised fine-tuning (SFT) to learn the tool interface and standard on-policy REINFORCE to improve the interaction policy. Intermediate tool calls receive action rewards, and the final response receives a terminal answer reward. Step-level returns assign these rewards to the responses that produced them and to preceding actions. The episode-level baseline instead assigns one episode return to every action. On a fixed closed-loop protocol with real bioinformatics tools, ProtAgent-8B achieves 61.00% success under the annotation-coverage metric, compared with 41.60% for DeepSeek-V3.2-Thinking 671B and 60.80% for the strongest evaluated frontier system. In the three-seed comparison, mean success is 42.70% with episode-level returns and 61.40% with step-level returns under identity return normalization; the corresponding group-relative results are 36.50% and 58.20%. The metric measures recovery of reference annotations under this protocol; it does not by itself establish biological correctness or complete evidence grounding.
Figures & tables
| Method | Enzyme | Domain | GO/IPR | Signal | Disorder | Aggregate |
|---|---|---|---|---|---|---|
| DeepSeek-V3.2-Thinking 671B | 1.00 | 25.50 | 1.50 | 99.00 | 81.00 | 41.60 |
| DeepSeek-V4-Flash | 7.00 | 29.00 | 42.50 | 99.00 | 94.50 | 54.40 |
| DeepSeek-V4-Pro | 14.50 | 30.00 | 27.00 | 98.50 | 92.00 | 52.40 |
| GPT-5.5 | 53.50 | 35.00 | 43.00 | 99.00 | 73.50 | 60.80 |
| ProtAgent-8B (closed-loop) | 58.00 | 35.00 | 54.50 | 73.50 | 84.00 | 61.00 |
| Category | Base | SFT | Full | No tools |
|---|---|---|---|---|
| Enzyme | 3.00 | 23.50 | 58.00 | 11.50 |
| Domain | 0.50 | 17.00 | 35.00 | 1.50 |
| GO/IPR | 7.00 | 17.50 | 54.50 | 10.50 |
| Signal | 51.00 | 78.50 | 73.50 | 31.00 |
| Disorder | 9.00 | 64.50 | 84.00 | 73.00 |
| Aggregate | 14.10 | 40.20 | 61.00 | 25.50 |
| Arm | Return norm. | Mean SD |
|---|---|---|
| Batched Step-Level REINFORCE | Identity | |
| Step-Level GRPO | Group-rel. | |
| Batched Episode-Level REINFORCE | Identity | |
| Episode-GRPO | Group-rel. |
| System and provenance | R-1 | R-L |
| Qwen3-Max (PFUA-reported) | 64.33 | 46.16 |
| GPT-5.5 (evaluated by us) | 61.41 | 44.66 |
| Qwen3-8B base (evaluated by us) | 53.62 | 35.33 |
| Qwen3-8B SFT (evaluated by us) | 54.47 | 37.68 |
| ProtAgent-8B PFUA (evaluated by us) | 60.15 | 41.62 |
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Arm | Return | Return norm. | TGSVR | Seed | Mean SD | ||
|---|---|---|---|---|---|---|---|
| 42 | 43 | 44 | |||||
| Batched Step-Level REINFORCE | Step | Identity | On | 63.40 | 59.20 | 61.60 | |
| Off | 62.10 | 58.90 | 61.10 | ||||
| Step-Level GRPO | Step | Group-rel. | On | 59.80 | 56.50 | 58.30 | |
| Off | 59.20 | 56.80 | 57.80 | ||||
| Batched Episode-Level REINFORCE | Episode | Identity | On | 44.20 | 41.00 | 42.90 | |
| Component | Weight | Applied at | Role |
|---|---|---|---|
| Answer coverage | Terminal answer | Reference-annotation recovery shaping | |
| Required-tool coverage | Terminal answer | Task-relevant tool completion | |
| Reasoning / efficiency / structure | Terminal answer | Bounded behavior and schema terms | |
| Similarity | Terminal answer | Training-only character-Jaccard shaping | |
| Completed-tool guard | if | Terminal answer | Removes schema-only reward without a completed tool |
| Trajectory-local fidelity | Terminal answer | Disorder / categorical agreement with same-rollout observations |
| System | Enzyme | Domain | GO/IPR | Signal | Disorder | Aggregate |
|---|---|---|---|---|---|---|
| Qwen3-8B (base) | 3.00 | 0.50 | 7.00 | 51.00 | 9.00 | 14.10 |
| ProtAgent-8B (SFT) | 23.50 | 17.00 | 17.50 | 78.50 | 64.50 | 40.20 |
| ProtAgent-8B (full method) | 58.00 | 35.00 | 54.50 | 73.50 | 84.00 | 61.00 |
| ProtAgent-8B (tools ablated) | 11.50 | 1.50 | 10.50 | 31.00 | 73.00 | 25.50 |
| Diagnostic / system | Enzyme | Domain | GO/IPR | Signal | Disorder | Aggregate |
|---|---|---|---|---|---|---|
| All-episode success — primary outcome | ||||||
| ProtAgent-8B | 58.00 | 35.00 | 54.50 | 73.50 | 84.00 | 61.00 |
| DeepSeek-V3.2-Thinking | 1.00 | 25.50 | 1.50 | 99.00 | 81.00 | 41.60 |
| Answer rate — stopping behavior | ||||||
| ProtAgent-8B | 99.00 | 99.00 | 99.00 | 99.00 | 96.50 | 98.50 |
| DeepSeek-V3.2-Thinking | 100.00 | 100.00 | 100.00 | 99.00 | 99.00 | 99.60 |
| Primary category | Operational definition | Audit evidence |
|---|---|---|
| Tool selection | No task-relevant tool is called before termination, or the selected tool cannot produce evidence for the requested annotation. | Ordered tool calls, task-to-tool eligibility map, and termination state. |
| Tool failure | A relevant call is attempted but execution, parsing, dependency, or database access fails. | Tool status, stderr/error field, observation schema, and native-backend manifest. |
| Premature stopping | The policy emits a terminal answer while an indicated evidence gap remains, or before a necessary completed observation is available. | Final action position, completed-call set, and task-required evidence fields. |
| Evidence omission | Relevant evidence is present in an actual observation but the final answer omits the annotation needed by the reference-coverage scorer. | Same-trajectory observations, extracted answer, and reference annotation. |
| Unsupported claim | The final answer states an identifier, range, or function that is absent from or contradicted by the trajectory’s observations. | Claim-to-observation alignment with exact identifier and span matching, followed by manual adjudication. |
| Formatting / truncation | Content cannot be scored because the answer wrapper or required schema is malformed, or generation ends at the response/token limit. | Parser outcome, finish reason, response length, and raw terminal output. |
| Credit-assignment setting | OOD-100 success (%) |
|---|---|
| Continuation control (default, ) | 51.00 |
| Token-level | |
| 48.00 | |
| 41.00 | |
| 51.00 | |
| 52.00 | |
| Arm | Return | Return norm. | Held-out reward | All-episode success (%) |
|---|---|---|---|---|
| Batched Step-Level REINFORCE † | Step | Identity | ||
| Step-Level GRPO † | Step | Group-rel. | ||
| Batched Step-Level REINFORCE + PPO clip | Step | Identity | ||
| GiGPO-style dual-level | Step+Ep. | Dual | ||
| Batched Episode-Level REINFORCE † | Episode | Identity | ||
| Episode-Level Agentic REINFORCE | Episode | Identity |
| ProtAgent- 8B | DeepSeek- V3.2- Thinking | 95% CI | ||
|---|---|---|---|---|
| 0.30 | 87.20 | 60.20 | +27.00 | [+23.90, +30.20] |
| 0.40 | 78.30 | 49.00 | +29.30 | [+25.90, +32.80] |
| 0.50 | 61.00 | 41.60 | +19.40 | [+15.90, +23.00] |
| 0.60 | 40.90 | 23.70 | +17.20 | [+14.00, +20.40] |
| 0.70 | 22.90 | 16.50 | +6.40 | [+3.50, +9.20] |
| Method and provenance | Func. | Cat. | Dom. | Desc. | Avg. |
|---|---|---|---|---|---|
| PFUA-published tool-powered reasoning (prior work) | |||||
| DeepSeek-R1 † (671B) | 59.71/38.31 | 47.95/34.15 | 48.36/34.36 | 58.11/35.70 | 53.53/35.63 |
| Kimi-K2-Thinking ‡ (1T) | 57.98/35.73 | 67.68/46.90 | 39.76/28.56 | 60.08/36.78 | 56.38/36.99 |
| Qwen3-Max ♠ (preview) | 66.43/44.29 | 72.32/54.18 | 54.98/44.26 | 63.60/41.90 | 64.33/46.16 |
| Frontier APIs evaluated by us (reproductions / extensions) | |||||
| DeepSeek-R1 (671B) | 59.57/37.49 | 53.09/37.10 | 46.33/31.89 | 57.61/35.48 | 54.15/35.49 |
| Method | Func. | Cat. | Dom. | Desc. | Avg. |
|---|---|---|---|---|---|
| Supervised Fine-tuning | |||||
| BioMedGPT (10B) | 5.98/4.28 | 7.97/6.28 | 1.81/1.81 | 4.84/4.12 | 5.15/4.12 |
| ProtT3 (1.6B) | 15.46/10.81 | 17.36/12.41 | 16.83/12.22 | 19.49/15.96 | 17.28/12.85 |
| Prot2Text (0.9B) | 16.56/11.61 | 18.24/13.05 | 11.49/9.37 | 49.14/47.38 | 23.86/20.35 |
| Qwen2.5-3B-SFT | 40.74/30.85 | 41.45/34.52 | 42.60/32.13 | 33.95/25.68 | 39.69/30.79 |
| Text-based Reasoning | |||||
| Tool | Category | Backend | Database / dependency |
| Native / heuristic computation | |||
| seq_basic_props | Sequence properties | Native (heuristic) | None |
| mmseqs2_besthit_uniprot | Homology search | Native (MMseqs2) | Swiss-Prot |
| pfam_hmmscan | Domain detection | Native (HMMER) | Pfam-A |
| tmbed_predict | Membrane topology | Native (TMbed) | TMbed weights |
| signalp_predict | Signal peptide | Native (SignalP 6.0) / heuristic | SignalP 6.0 weights |
Tool-Using Agents
Tool-using agents plan and act through external tools, APIs, software interfaces, and environments to complete tasks beyond language generation.
See all 289 papers