Agentic Federated Learning: The Future of Distributed Training Orchestration
Organizations: Institute of Computing, University of Campinas and Hub of Artificial Intelligence and Cognitive Architectures - H.IAAC, Campinas, Brazil
Abstract
Although Federated Learning (FL) promises privacy and distributed collaboration, its effectiveness in real-world scenarios is often hampered by the stochastic heterogeneity of clients and unpredictable system dynamics. Existing static optimization approaches fail to adapt to these fluctuations, resulting in resource underutilization and systemic bias. In this work, we propose a paradigm shift towards Agentic-FL, a framework where Language Model-based Agents (LMagents) assume autonomous orchestration roles. Unlike rigid protocols, we demonstrate how server-side agents can mitigate selection bias through contextual reasoning, while client-side agents act as local guardians, dynamically managing privacy budgets and adapting model complexity to hardware constraints. More than just resolving technical inefficiencies, this integration signals the evolution of FL towards decentralized ecosystems, where collaboration is negotiated autonomously, paving the way for future markets of incentive-based models and algorithmic justice. We discuss the reliability (hallucinations) and security challenges of this approach, outlining a roadmap for resilient multi-agent systems in federated environments.
Figures & tables
| Cifar 10 | ||||||||||
| Models | Prompt | PoC | Random | Oort | ||||||
| K avg | Acc. (%) | ST (s) | K avg | Acc. (%) | ST (s) | K avg | Acc. (%) | ST (s) | ||
| Qwen3 | DO | 7 5 | 38 13 | 3,79 | 6 5 | 39 11 | 4,71 | 12 6 | 39 14 | 4,45 |
| Few-Shot | 6 4 | 38 13 | 1,43 | 5 4 | 38 15 | 2,28 | 9 5 | 38 15 | 2,96 | |
| CoT | 7 5 | 39 13 | 1,79 | 5 4 | 37 14 | 1,65 | 9 4 | 39 13 | 2,53 | |
| Llama3.1 | DO | 10 0 | 37 13 | 0,18 | 10 0 | 38 10 | 0,38 | 9 2 | 38 13 | 0,19 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| N° Clients | Approachs | Completion Tokens | Prompt Tokens | Total Cost ($) | Total Tokens | Accuracy |
| 5 | LLM | 178 52 | 1336 15 | 0.000308 0.000031 | 1515 54 | 0.766264 0.105471 |
| Tool Agent | 164 122 | 6193 1963 | 0.000804 0.000241 | 6358 2072 | 0.792612 0.101721 | |
| 10 | LLM | 218 56 | 2259 28 | 0.000470 0.000035 | 2478 64 | 0.693686 0.066431 |
| Tool Agent | 289 218 | 8367 3103 | 0.001149 0.000431 | 8657 3297 | 0.785554 0.085655 | |
| 25 | LLM | 254 67 | 5035 73 | 0.000908 0.000041 | 5289 97 | 0.637390 0.090126 |
| Tool Agent | 248 244 | 8056 3275 | 0.001080 0.000484 | 8305 3493 | 0.882115 0.146230 |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 921 papers