FedReady: Bounded Agents for Federation Formation
Organizations: NVIDIA
Abstract
Federated learning (FL) runtimes standardize aggregation and deployment, but each new study still requires federation formation: selecting task-eligible sites and preparing their local data and task code for federated training or analysis. This preparation recurs when the target changes, while raw records and site-private mappings are excluded from cross-site FL messages. We present FedReady, a system that performs federation formation with bounded LLM agents. Agents propose shared contracts, local adapters, and task code; the runtime owns workflow state and accepts artifacts only after checks tied to their digests. Candidate site discovery prioritizes recall; local eligibility verification checks task support before site admission. Once participating sites and artifacts are fixed, conventional federated training or analysis proceeds without readiness agents. Across 39 simulated retinal sites and four tasks, discovery reaches recall 1.00 at precision 0.65; local eligibility verification removes all 17 false positives without losing an eligible site-task pair. The participating sites supply 45,575 task-record instances and complete four 100-round jobs, including one with a runtime-generated contract. Across ten patient cohorts, preparation supports seven patient populations and holds endpoints at three sources as unsupported. Comparison with manually prepared reference populations and analysis (the manual reference) gives a maximum survival-curve difference of 0.001133. We also analyze 19 development failures, targeted classification ablations, and standalone and heterogeneous agent configurations. These results establish the feasibility of task-specific data preparation before ordinary FL training or analysis.
Figures & tables
| Work | Primary objective | Main mechanism or output |
|---|---|---|
| FedAgentBench ( Saha et al., 2025 ) | Automate and benchmark medical FL workflows | Server–client agents coordinate client selection, preprocessing, label harmonization, and training. |
| Helmsman ( Li et al., 2026 ) | Synthesize FL systems from user specifications | Agents generate plans and modular FL code, then evaluate and refine implementations in simulation. |
| Auto-FL-Research ( Roth et al., 2026 ) | Search training algorithms within an existing federation | Coding agents propose and evaluate changes to FL training recipes. |
| FederatedSkill ( Yang et al., 2026 ) | Improve agents through collaborative skill evolution | Agents share semantic skill patches to update personalized skill libraries. |
| This work (FedReady) | Select eligible sites and prepare task-compatible inputs | Agents propose contracts, local adapters, and task code; the runtime controls acceptance and site admission using local evidence and execution checks. |
| Role | Permitted view/output | Authority boundary |
|---|---|---|
| FL runtime | Typed messages, contract, site list, digests; dispatch, checks, export, training | Owns transport, state, verification records, and terminal evidence; does not infer private label meaning |
| Server planner/coder | Task, redacted summaries, synthetic test data; inquiry, contract, task code | No raw site evidence, direct client calls, or artifact acceptance |
| Site adapter coder | Authorized local structure, documentation, contract; adapter or abstention | No sibling access, contract mutation, or visual-verdict ownership |
| Local visual witness | Bounded raw input and contract-owned rendering; structured observations | No cross-site images, code edits, or site admission |
| Local verifiers | Owning-site artifacts; structure, provenance, and execution checks | No invented semantics, silent repairs, or reference-code substitution |
| Disclosure filters | Message payloads; field checks and redaction | No artifact acceptance or site admission |
| Source | Native columns | Task selection and interpretation | Additional evidence |
|---|---|---|---|
| GSE14333 | DFS_Time , DFS_Cens , DukesStage | DFS for supported Dukes B/C; months/12; event . Completeness alone does not confer eligibility. | Published methods for this patient cohort ( Jorissen et al., 2009 ) , recurrence counts, duration distributions. |
| Ethiopia | TIME , VSTATUS , statusfn ; Date_Dx , Date_death | CRC-specific survival, not all-cause OS; months/12; 1 means CRC death. Hold contradictory chronology. | Endpoint definition ( Teka et al., 2021 ) , duplicate status, published person-months/life table. |
| TCGA COAD/READ | demographic : vital_status , days_to_death ; diagnoses : days_to_last_follow_up ; follow_ups : days_to_follow_up | Case-level OS: death days for dead cases; latest applicable nonnegative follow-up for alive cases; days/365.25. Follow-up cannot replace missing death time. | GDC dictionary/release guidance ( NCI Genomic Data Commons, n.d. ) ; clinical outcome methods ( Liu et al., 2018 ) . |
| GSE35896 | Mirror ID_REF , DFS (in months) , DFS event , Gender ; GEO ^SAMPLE | All 62 accessions join, but targets remain held: linkage does not authenticate secondary clinical fields. | Primary-source comparison; 32 joined-record sex conflicts and unresolved mirror provenance. |
| Workload | Supplied specification | Agent-produced artifacts |
|---|---|---|
| Segmentation; classification | Built-in data contract | Site mappings, adapters, task code |
| Detection | Generic field/storage checks | Contract, materializer, local conversions, trainer |
| Clinical tables | Output fields and screening categories | Endpoint/selection rules, adapters, measurable assertions, analysis code |
| Task | Candidates (precision) | Screened out | Admitted | Records |
|---|---|---|---|---|
| Disc segmentation | 12 (0.67) | 4 | 8 | 6,482 |
| Cup segmentation | 8 (0.75) | 2 | 6 | 6,062 |
| Glaucoma classification | 19 (0.53) | 9 | 10 | 26,549 |
| Disc detection | 10 (0.80) | 2 | 8 | 6,482 |
| Total | 49 (0.65) | 17 | 32 | 45,575 |
| Configuration | Incorrect admissions | Eligible excluded | Relative tokens |
|---|---|---|---|
| Full workflow | 0 | 0 | 1.000 |
| Without semantic-evidence and class-coverage checks | 0 | 1 * | 0.894 |
| Without candidate site discovery | 0 | 0 | 1.099 |
| Task | Shared data contract | Participating sites | Rounds completed | Final validation result |
|---|---|---|---|---|
| Disc segmentation | Predefined | 8 | 100/100 | Dice: 0.9383 |
| Cup segmentation | Predefined | 6 | 100/100 | Dice: 0.7740 |
| Glaucoma classification | Predefined | 10 | 100/100 | Accuracy: 0.8827; AUC: 0.9150 |
| Disc detection | Agent-generated | 8 | 100/100 | GT [email protected]: 0.9316 |
| Endpoint | Sites | Agent | Manual | Max. |
|---|---|---|---|---|
| OS | 5 | 1,410/410 | 1,417/412 | 0.001133 |
| DFS | 1 | 185/48 | 185/48 | 0 |
| CRC-specific | 1 | 160/74 | 160/74 | 0 |
| Task | Expected | Initial R2 | Latest |
|---|---|---|---|
| Disc segmentation | 4 / 4 | 4 / 2 | 4 / 4 |
| Glaucoma classification | 5 / 5 | 5 / 2 | 5 / 4 |
| Cup segmentation | 3 / 3 | 3 / 2 | 3 / 3 |
| Disc detection | 4 / 4 | 4 / 4 | - / - |
| Task | Eligible | Luna missed | Nemotron missed |
|---|---|---|---|
| Disc segmentation | 8 | 1 | 0 |
| Cup segmentation | 6 | 1 | 2 |
| Glaucoma classification | 10 | 2 | 1 |
| Disc detection | 8 | 1 | 2 |
| Total | 32 | 5 | 5 |
Appendix figures & tables8 assets
Supplementary material from the paper’s appendix.
Appendix
| Campaign | Model, harness, and reasoning | Budgets and retries | Retained artifacts |
|---|---|---|---|
| Historical imaging | Codex; model ID, CLI version, and reasoning NR. Local VLM: Qwen3-VL-8B-Instruct; serving version NR. | Four 100-round jobs. Agent deadlines, attempt limits, and request retries NR. | [I]: materialization traces, training plots, failure index; full run environments incomplete. |
| Classification ablations | gpt-6-sol /HIGH through Codex; CLI version NR. | Control/semantic-check pair: one adapter attempt, zero local retries, 1,200-s request deadline, no shared guidance. One run per arm. Discovery-arm local budget and provider retries NR. | Author-supplied matched protocol and token totals; frozen run bundle not supplied. |
| Heterogeneous checkpoint | Sol server; 20 gpt-6-sol /HIGH and 19 gpt-6-luna /LOW site agents; Codex CLI 0.162.0. | One initial adapter request per site plus at most one visual revision; up to five paired guidance waves. Request deadline, transport/provider retries, and repetitions NR. | Author-confirmed settings; [H] design/configuration records. Complete run bundle not supplied. |
| Luna-only | Luna/LOW through Codex; run-linked model ID and CLI version NR. | 39 sites per task, no shared guidance. Deadlines, attempts, retries, and repetitions NR. | Author-supplied task-level outcomes; complete run bundle not supplied. |
| Pi/Nemotron | nvidia/nvidia/nemotron-3.5-super-text-preview /HIGH; Pi 0.85.0. | 39 sites per task. Deadlines, attempts, retries, and repetitions NR. | Author-supplied model pin, harness version, and outcomes; complete four-task bundle not supplied. |
| Clinical survival | gpt-5.6-sol /HIGH; Codex CLI 0.159.2; three isolated workers. | At most five corrective cycles and five analysis attempts; one cycle and two analysis attempts used. Preparation requests: 3,600 s; analysis deadline and provider retries NR. | [S]: fresh-run manifest, selector, prompts, accepted reviews, generated KM code, verification, and reference curves. |
| Task | Eligible | Ready | Implementation failures | Incorrect admissions |
|---|---|---|---|---|
| Disc segmentation | 8 | 8 | 0 | 0 |
| Cup segmentation | 6 | 4 | 2 | 0 |
| Glaucoma classification | 10 | 9 | 1 | 0 |
| Disc detection | 8 | 6 | 2 | 0 |
| Total | 32 | 27 | 5 | 0 |
| ID | Boundary failure | Consequence at occurrence | Protocol-level repair |
|---|---|---|---|
| WF-001 | Weak path token treated as record-level evidence, then used in candidate site discovery | Silent : one eligible site and 4,217 records omitted from a completed run | Narrow observation ownership; typed replay recovered and verified all 4,217 records |
| WF-003/008 | Generated materializer invented invariants not declared by the contract | 1,949 valid records across two sites dropped after successful adapter work | Contract-declared invariants became the complete authority; focused retries recovered both sites |
| WF-004 | Host synthetic test data constructor erased fields from an approved generated contract | Seven coding-agent revisions blamed the trainer; the one-client simulation was never reached | Preserve the negotiated contract end to end and validate a complete synthetic test record |
| WF-005 | Shell-valid JSON fragmented by the deployed FL runner’s tokenizer | Valid manifests appeared to lack required fields despite static validation | Validate compact arguments with the actual deployed tokenizer |
| WF-016 | Static checks missed CLI, device, update-delta, and installed-API defects | Four runtime incompatibilities; generated package unusable | Execute the exact exported interface in the one-client simulation; the third runtime revision succeeded |
| WF-006 | Any ERROR line overrode stronger completion evidence | A valid 100-round run was labeled failed and an unnecessary rerun started | Model, metric, and controller terminal state now govern; recoverable events remain warnings |
| ID | Grade | Observed failure |
|---|---|---|
| WF-001 | E1 | Weak path token erased classification evidence and silently excluded 4,217 valid records. |
| WF-003 | E1 | A generated materializer invented an undeclared pixel-uniqueness invariant and dropped a valid site. |
| WF-004 | E1 | Host synthetic test data construction erased approved contract fields, causing seven misdirected coding-agent revisions. |
| WF-005 | E1 | Shell-valid JSON was fragmented by the deployed runner tokenizer. |
| WF-006 | E1 | A recoverable communication event overrode stronger evidence of completed 100-round training. |
| WF-007 | E2 | Privacy hardening redacted target vocabulary required by candidate site discovery, reducing participating sites for all tasks. |
| Artifact or message | Producer and consumer | Information carried | Check before state effect |
|---|---|---|---|
| Client inquiry (v1) | Controller to client executor (server-to-client) | Task intent and bounded candidate site discovery instructions | Header binding, allow-listed action/phase, client policy authorization |
| Client response (v1) | Client executor to controller (client-to-server) | Redacted aggregate profile, applicability, counts, privacy metadata | Schema and redaction checks; exact session, correlation, task, site, and payload-identity binding |
| Site extraction policy (v1) | Server decision flow to selected client | Locked contract, site policy, adapter rule, strategy digest, optional materializer source and digest | Server disclosure filter; client action/phase/schema authorization; contract and materializer integrity |
| Local adapter manifest (v1) | Site agent to adapter runtime (local) | Candidate adapter entry point and private record bindings | Pre-agent source snapshot, compilation, sample adapter checks, provenance, schema, and source-digest checks |
| Local visual verdict (v1) | Local visual witness to client runtime (local) | Reference-conditioned finding for one raw input and optional contract-owned label rendering | Localhost-only endpoint, reference digest, bounded issue schema, concordance/fallback policy; never sufficient alone for site admission |
| Runtime verification record (v1) | Adapter runtime to client executor (local) | Harness-owned executable verdict bound to exact adapter source | Required local checks complete; agent-reported status is overwritten by runtime facts |
| Source patient cohort | Target or candidate-target fields | Identity, population, and covariate fields |
|---|---|---|
| GSE14333 | DFS_Time , DFS_Cens | ^SAMPLE , DukesStage , Age_Diag , Gender , Location . Packed characteristic parsing. |
| GSE17536 and GSE17537 | overall survival follow-up time ; overall_event (death from any cause) | ^SAMPLE , !Sample_title ; age , gender , ajcc_stage , grade . Other DFS/DSS fields are not OS aliases. |
| GSE33113 | meta or recurrence within 3 years ; time to meta or recurrence | ^SAMPLE , tissue ; age at diagnosis , Sex , disease status . Tumors and normal mucosa require different dispositions. |
| GSE35896 | DFS (in months) , DFS event in a secondary clinical CSV | CSV ID_REF joined to GEO ^SAMPLE ; Age (in years) , Gender , Dukes Stage , Location ; direct GEO microsatellite.status and sex metadata. |
| GSE37892 | date at surgery , date at distant metastasis , date at last contact | ^SAMPLE ; age at diagnosis , gender , Stage , localisation . Date-derived intervals are candidates only. |
| GSE39582 | os.delay (months) , os.event | dataset , tnm.stage , tnm.m ; age.at.diagnosis (year) , Sex , tumor.location , mmr.status . RFS remains a different endpoint family. |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 1,037 papers