cs.LGJun 7, 2026

Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

Authors: Mohammadnavid GhaderSaeed Reza KheradpishehBahar FarahaniMahmood Fazlali

Organizations: Department of Computer and Data Science, Faculty of Mathematical Sciences, Shahid Beheshti University, Tehran, Iran · Cyberspace Research Institute, Shahid Beheshti University, Tehran, Iran · Cybersecurity and Computing Systems Research Group, University of Hertfordshire, Hatfield, United Kingdom

Abstract

The Forward-Forward (FF) algorithm offers a biologically inspired alternative to backpropagation by replacing gradient-based credit assignment with local, forward-only objectives. While recent extensions have adapted FF to convolutional neural networks (CNNs), existing formulations rely on static channel-class partitions and struggle to perform effectively in complex tasks. In this work, we introduce a learnable channel-class assignment mechanism that enables adaptive, data-driven specialization of convolutional channels, supported by entropy and orthogonality regularization to promote learning performance. We further propose a loss-aware layer contribution strategy that adaptively weights intermediate-layer predictions based on their validation performance, enhancing the effectiveness of forward-only inference. Integrated into residual CNNs, the proposed method achieves consistently superior performance across CIFAR-10, CIFAR-100, and Tiny-ImageNet compared to existing similar forward-only methods. Notably, it establishes new state-of-the-art performance among FF-based models, substantially narrowing the gap with backpropagation. These findings demonstrate that introducing learnable channel specialization and layer contribution weighting significantly enhances the representational capacity of forward-only learning in deep CNNs.

Explore similar work

CardsList