Predictive Coding

Follow this topic Ask about this topic

Momentum

0 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 31

All topics

A Study of Hidden-State Optimization Order in Predictive Coding Networks
Sep 1, 2026Xueyuan Li, Danilo Vasconcellos VargasPredictive Coding Singular Learning Theory
Topological Simplification in Predictive Coding Networks
Aug 3, 2026Adam Shaw, Jiayu Li, Michael Sperling +2Predictive Coding Compressed Model
University of Southern California 3551 Trousdale Parkway, Los Angeles, CA 90089
Predictive Set Theory: A Generative Framework for Cognitive Architecture with Operationalized Core Mechanisms
Aug 3, 2026Yiyang YuPredictive Coding Cognitive Science
Recursive Gaussian Processes and the Bayesian Brain
Aug 1, 2026Moumita Das, Dipanjan Ray, Sourabh BhattacharyaPredictive Coding Gaussian Process
1Indian Institute of Management, Udaipur, India · Department of Psychology and Cognitive Sciences, Ashoka University, Haryana, India · 3Koita Centre for Digital Health at Ashoka (KCDH-A), Haryana, India +1
The Bayesian Reflex: A Predictive Coding Engine for Artificial Intelligence
Aug 1, 2026Sourabh BhattacharyaPredictive Coding Bayesian Neural Networks
Interdisciplinary Statistical Research Unit Indian Statistical Institute, Kolkata
Dreamer-CPC: Message Learning with World Models for Decentralized Multi-agent Reinforcement Learning
Jul 22, 2026Taisuke Takayama, Naoto Yoshida, Tadahiro TaniguchiMulti-Agent Reinforcement Learning Latent States
Graduate School of Informatics, Kyoto University, Kyoto, Japan · Research Organization of Science and Technology, Ritsumeikan University, Shiga, Japan
Weight Feedback Computes the Jacobian Transpose Locally in Modern Deep Networks
Jul 15, 2026Junlong Shen, Xingyu LiBackpropagation Predictive Coding
Department of Electrical and Computer Engineering, University of Alberta, Edmonton, Canada · Alberta Machine Intelligence Institute (Amii), Edmonton, Canada
Constructed Reality, Contested Priors: Decoupling and the Architecture of Cognitive Relapse Under the Free Energy Principle
Jul 12, 2026MD Ibrahim Hossain RidoyPredictive Coding Cognitive Science
Independent Researcher
Contrastive Predictive Coding with Compression for Enhanced Channel State Feedback in Wireless Networks
Jun 26, 2026Ahmed Y. Radwan, Fahad Syed Muhammad, Matthew Baker +1Channel State Information Predictive Coding
Department of Electrical Engineering and Computer Science, York University, Toronto, ON M3J 1P3, Canada · Nokia Networks, 12 rue Jean Bart, Paris-Saclay, Massy, 91300, France · Nokia UK, Broers Building, 21 JJ Thomson Avenue, Cambridge, CB3 0FA, United Kingdom
Accelerating Hierarchical Sparse Predictive Coding with Hybrid Amortized Inference
Jun 26, 2026Kazuhisa FujitaPredictive Coding Multi-Image Editing Benchmarks
Department of Clinical Engineering, Komatsu University, 10-10 Doihara-Machi, Komatsu, Ishikawa, Japan 923-0921
Error Highways: Scaling Predictive Coding to Very Deep Networks
Jun 22, 2026Amirhossein Mohammadi, Alexander G. OrorbiaPredictive Coding Jacobian
SingularityNET Zug, Switzerland · Rochester Institute of Technology Rochester, NY, USA
Can Deep Neural Networks Improve Compression of Very Large Scientific Data?
Jun 12, 2026Muhannad Alhumaidi, Guozhong Li, Spiros Skiadopoulos +1Task-Aware Compression Data Compression Methods
King Abdullah University of Science and Technology · Thuwal, Saudi Arabia · University of the Peloponnese +1
Robust Auto-associative Memory via Convolutional Restricted Hopfield Networks
Jun 11, 2026Ci Lin, Tet Yeap, Iluju KiringaDense Associative Memory Hopfield Networks
Electrical Engineering and Computer Science University of Ottawa
Predictive Assistance and the Temporal Dynamics of Exploratory Compression
Jun 8, 2026Balaraju BattuPredictive Coding Stochastic Exploration
European University Institute, Florence, Italy · New York University Abu Dhabi, UAE
Predictive Coding with Bayesian Priors via Proximal Gradients
Jun 6, 2026Francesco BulloPredictive Coding Posterior Predictive Distribution
Mechanical Engineering, 2325 Engineering Bldg II, UCSB, Santa Barbara, CA 93106-5070, USA
From Prediction to Self: Developmental Conditions for Agency in Minimal Neural Systems
Jun 4, 2026Evan YePredictive Coding Self
Independent Researcher
Training a Predictive Coding Network on ImageNet using Equilibrium Propagation
Jun 2, 2026Tugdual Kerjan, Rasmus Høier, Benjamin ScellierPredictive Coding Imagenet
Rain AI
Augmented Lagrangian Predictive Coding
May 29, 2026Jeffrey Seely, Julian GouldPredictive Coding Deep Network
Sakana AI
Ontology-constrained multi-LLM scoring of hypothesis support in the predictive processing literature
May 23, 2026Hamed Nejat, Alexander Maier, Jesse Spencer-Smith +1Predictive Coding Hypothesis
Department of Psychology and Vanderbilt Brain Institute, Vanderbilt University · Data Science Institute, Vanderbilt University
Closed-form predictive coding via hierarchical Gaussian filters
May 19, 2026Aleksandrs Baskakovs, Sylvain Estebe, Kenneth Enevoldsen +3Predictive Coding Hebbian Learning
Center for Humanities Computing Aarhus University Aarhus, Denmark · Interacting Minds Center Aarhus University Aarhus, Denmark
Inter-LPCM: Learning-based Inter-Frame Predictive Coding for LiDAR Point Cloud Compression
May 18, 2026Chang Sun, Hui Yuan, Shiqi Jiang +3Light Detection And Ranging Point Clouds Point Clouds
School of Control Science and Engineering, Shandong University, Jinan 250061, China · Key Laboratory of Machine Intelligence and System Control, Ministry of Education, Jinan 250061, China · School of Computer Science and Technology, Shandong University, Qingdao, 266237, China +1
Pretraining Strategies and Scaling for ECG Foundation Models: A Systematic Study
May 12, 2026M A Al-Masud, Nils StrodthoffElectrocardiogram Foundation Models Electrocardiography
AI4Health Division Carl von Ossietzky Universität Oldenburg Oldenburg, Lower Saxony, Germany
Understanding Sample Efficiency in Predictive Coding
May 12, 2026Gaspard Oliviers, Elene Lominadze, Rafal BogaczPredictive Coding Deep Network
Nuffield Department of Clinical Neurosciences, University of Oxford, United Kingdom · MRC Centre of Research Excellence in Restorative Neural Dynamics, United Kingdom
Emergent Communication for Co-constructed Emotion Between Embodied Agents via Collective Predictive Coding
May 10, 2026Zehang Zhang, Nguyen Le Hoang, Tadahiro Taniguchi +1Predictive Coding Emotion
Graduate School of Engineering Science, The University of Osaka, Toyonaka 560-8531, Japan · Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan
Dynamic Representational Synchrony through Collective Predictive Coding: A Computational Model of Parent-Infant Homeostatic Co-Regulation
May 8, 2026Yushi Tsubamoto, Takato HoriiPredictive Coding Inference Dynamics
Graduate School of Medicine The University of Osaka 565-0871, Yamadaoka, Suita, Osaka · Graduate School of Engineering Science The University of Osaka 560-0043, Machikaneyama, Toyonaka Osaka
Online Generalised Predictive Coding
May 4, 2026Mehran H. Z. Bazargani, Szymon Urbas, Adeel Razi +2Predictive Coding Data Assimilation
Insight Research Ireland Centre, UCD, Dublin, Ireland. · UCD School of Mathematics and Statistics, UCD, Belfield, Dublin, Ireland. · Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia. +5
Response time of lateral predictive coding and benefits of modular structures
Apr 22, 2026Guanghui Cai, Zhen-Ye Huang, Weikang Wang +1Predictive Coding Latent Prediction
Institute of Theoretical Physics, Chinese Academy of Sciences, ZhongGuanCun East Road 55, Beijing 100190, China · Westlake Institute for Advanced Study, Hangzhou 310024, China · Center for Interdisciplinary Studies and Department of Physics, School of Science, Westlake University, Hangzhou 310030, China +2
Lossless Compression via Chained Lightweight Neural Predictors with Information Inheritance
Apr 16, 2026Yuriy Kim, Evgeny BelyaevTask-Aware Compression Predictive Coding
ITMO University, Saint-Petersburg, Russia
Learning Long-Range Dependencies with Temporal Predictive Coding
Feb 20, 2026Tom Potter, Oliver RhodesPredictive Coding Long-Range Temporal Dependencies
International Centre for Neuromorphic Systems, The University of Manchester, Manchester, United Kingdom
Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learning
Mar 22, 2025Alexander Ororbia, Karl Friston, Rajesh P. N. RaoPredictive Coding Self-Supervised Learning
Rochester Institute of Technology · Rochester, New York, USA · VERSES AI Research Lab +3
Building Expressive and Tractable Probabilistic Generative Models: A Review
Feb 1, 2024Sahil Sidheekh, Sriraam NatarajanProbabilistic Model Generative Models
The University of Texas at Dallas

Sep 1, 2026, cs.LGJ/K move · Enter open · S save

A Study of Hidden-State Optimization Order in Predictive Coding Networks

Xueyuan Li, Danilo Vasconcellos Vargas

Predictive Coding Singular Learning Theory Deep Network Hidden States Order

Open paper AskPDF arXiv

Local learning methods offer an alternative to end-to-end backpropagation, but their unstructured local objectives can produce weak feature learning in deep networks. We study whether the order of hidden-state optimization can address this limitation. We propose a boundary-first inference schedule that partitions a model into chunks, first coordinates hidden states at chunk boundaries, and then refines representations within each chunk. We instantiate this schedule in predictive coding networks (PCNs), a local-learning framework in which hidden activities and prediction errors are explicitly exposed during inference. On CIFAR-10, the resulting boundary-first predictive-coding instantiation improves accuracy over standard predictive coding by

9.77\%

under a standard parametrization and by

5.51\%

under a

μ

-parametrization. Diagnostic analyses further show more non-trivial early-layer updates, lower initial-to-final CKA, and more diverse layerwise gradients, consistent with stronger feature learning. These results support boundary-first, chunk-based inference as a practical design principle for predictive-coding training and motivate its study in broader local-learning systems.

Momentum

Related topics

Latest papers 31