cs.AIAug 15, 2026

A concentration result for multilayer feedforward neural networks

Authors: Vera Koponen

Abstract

We consider for an arbitrary fixed ρρ and for each positive integer nn a multilayer feedforward artificial neural network with ρρ layers, nn neurons in the first layer (the input layer) and only one neuron, the output neuron, in the last layer. Very roughly formulated, the main result is that if the distribution of weights of connections from a layer to the next are, for all large nn, approximated well by a fixed continuous (but otherwise arbitrary) curve which does not depend on nn, and if the values of the nn input neurons are independently and identically distributed with a continuous probability density function, then there is a number ψψ such that for all ε>0\varepsilon > 0 the probability that the value of the output neuron is in [ψε,ψ+ε][ψ- \varepsilon, ψ+ \varepsilon] tends to 1 as nn tends to infinity.

Explore similar work

CardsList