cs.LGSep 4, 2026

Optimal Rates for Agentic Networked Information Aggregation

Authors: MohammadHossein Bateni, Zahra Hadizadeh, MohammadTaghi Hajiaghayi, Mahdi JafariRaviz, Shayan Taherijam

Organizations: Google Research · University of California, Irvine · University of Maryland

Abstract

Building on the pioneering paper of Kearns, Roth, and Ryu (SODA'26), we study information aggregation in a networked learning model. The model captures a central pattern in agentic AI: each agent sees only part of the data and passes on only its own conclusion. Their model considers a linear regression problem with the mean squared error (MSE) loss. Agents sit in a DAG and each sees only a subset of the features and its parents' predictions, fits a linear predictor, and passes only its prediction forward. The benchmark is the full-feature learner that sees all raw features. A path of depth DD is MM-covered if every block of MM consecutive agents collectively sees all raw features. Kearns, Roth, and Ryu proved that the excess mean squared error of the last agent on such a path is O(M/D)O(M/\sqrt D), and gave a cyclic instance with excess error Ω(M/D)Ω(M/D) for D<M2D<M^2. We close this gap: the correct rate is constant up to depth M2M^2, and Θ(M2/D)Θ(M^2/D) beyond it. We first give a sharper analysis of the cyclic instance and improve its lower bound to Ω(M/D)Ω(\sqrt{M/D}) for D<M2D<M^2. We then construct, for every depth D≥M2D\ge M^2, an MM-covered path of depth DD with excess error Ω(M2/D)Ω(M^2/D). The same instance gives the constant lower bound for all D<M2D < M^2. We also show that for any fixed distribution the excess error contracts geometrically along the path, ruling out any single instance that witnesses any polynomial lower bound at every depth. Finally, we prove the same optimal rate for logistic classification in the logit-passing model of Bateni et al., which considers the binary cross-entropy (BCE) loss. The same improved upper bound of O(M2/D)O(M^2/D) holds, and we transfer all the regression lower bounds by showing that on those examples the logistic path follows the least-squares path up to rescaling.

Explore similar work

Aug 16, 2026

Optimal Lower Bounds for Networked Information Aggregation

The problem of networked information aggregation, studied in Kearns et al. (2026), involves a group of learners situated on the vertices of a directed acyclic graph GG, each learning a linear predictor Y^\widehat Y for a fixed random variable YY given access to a local feature, as well as the predictors learnt by its parents. Learning proceeds iteratively, with learners ordered according to a topological sort of GG. The main quantity of interest is the error incurred by the current learner, constrained to this flow of information, with respect to the best linear predictor using all the features seen so far. When the studied error is the MSE, i.e., E(Y^−Y)2\mathbb{E} (\widehat Y - Y)^2, Kearns et al. (2026) show that the error is at most O(1/D)O(1/\sqrt{D}) along a path of length DD. They also obtain a hard instance where the MSE is lower bounded by Ω(1/D)Ω(1/D), leaving the correct order open. In this work, we resolve this central open problem, and obtain a family of worst case problem instances with a MSE lower bound of Ω(1/D)Ω(1/\sqrt{D}). By exploiting invariances in the structure of the learnt predictors, our analysis generalizes to all convex loss functions ℓ(Y^,Y)\ell(\widehat Y, Y) satisfying regularity conditions which include strong convexity in a ball around the origin, and that the ideal predictor minimizing the population loss is positively correlated with the label. We show that networked information aggregation on a gaussian instance in our worst case family incurs an ℓ\ell-error lower bounded by Ω(1/D)Ω(1/\sqrt{D}) with respect to this ideal predictor. We demonstrate that a variety of common losses satisfy these regularity conditions. In particular, the logistic loss satisfies them, and hence our analysis also closes the gap between the upper and lower bounds in Bateni et al. (2026).
May 1, 2026

Networked Information Aggregation for Binary Classification

We study networked binary classification on a directed acyclic graph (DAG) where each agent observes only a subset of the feature columns of a shared dataset. Agents act sequentially along the DAG: each receives prediction columns from its parents (if any), augments its local features with these columns, fits a logistic predictor by minimizing binary cross-entropy (BCE), and forwards its prediction column to its outgoing neighbors. We ask whether this sequential distributed training procedure achieves information aggregation, meaning that some agent attains small excess loss compared to the best logistic predictor trained with access to all feature columns. This question was studied for linear regression under squared loss by Kearns, Roth, and Ryu (SODA 2026). Extending their guarantees to classification is nontrivial because their analysis relies on quadratic structure that does not directly transfer to BCE with a logistic link. We analyze the resulting sequential logit-passing protocol and prove: (i) an excess loss upper bound of O(M/D)O(M/\sqrt{D}) on depth-DD paths under the condition that every MM contiguous subsequence of MM agents collectively observe all features, and (ii) a close lower bound showing instances with excess loss of at least Ω(k/D)Ω(k/D) where kk is the dimension of the feature space. Together, these results identify network depth as a fundamental bottleneck for information aggregation in networked logistic regression.
Sep 28, 2026

Optimal Networks for Agentic Information Aggregation

We study information aggregation in the networked learning model introduced by Kearns, Roth, and Ryu (SODA 2026). There is a fixed distribution over dd features and a common label. Agents learn in topological order on a directed acyclic graph. Each observes a subset of the features and its parents' predictions, fits a linear predictor to minimize mean squared error, and passes only its prediction forward. The global predictor is the best linear predictor using all features. Kearns, Roth, and Ryu show that the output agent's error approaches the global predictor's error along sufficiently deep paths with suitable feature coverage, while insufficient depth can prevent aggregation even in large networks. In contrast to their main focus on a given graph and feature allocation, we consider the limits of the model under two settings. In the adaptive designer setting, a designer chooses the graph, feature allocation, and output agent knowing the distribution. In the oblivious designer setting, the designer fixes all three before an adversary chooses the distribution. Each agent observes one feature and receives predictions from a limited number of parents. We call the aggregation exact when the output agent matches the global predictor exactly. For d≥3d\ge3, we show that no finite depth guarantees exact aggregation for every distribution with one parent per agent, even when the designer knows the distribution. In contrast, two parents per agent suffice for exact aggregation even in the oblivious designer setting. A fixed graph, feature allocation, and output agent achieve this for every distribution at depth O(dlog⁡d)O(d\log d). Knowing the distribution reduces the depth to O(d)O(d). Both constructions use O(d2)O(d^2) agents, with a very large constant for two parents. We show the bounds on the depth and number of agents are all optimal up to constant factors.