Predictive Coding

Follow this topic Ask about this topic

Predictive coding studies how systems can infer, learn, or compress information by predicting incoming data and correcting mismatches. In neuroscience, hierarchical Bayesian and free-energy models use precision-weighted prediction errors to explain perception and action; in machine learning, predictive coding networks use local updates, while equilibrium propagation, feedback pathways, and amortized inference aim to make training faster and deeper. Related predictive methods forecast future inputs or code residuals for tasks such as video, language, and data compression, with evaluations spanning CIFAR and ImageNet, time-series benchmarks, and alignment to visual-cortex responses. A central tension is whether local, biologically inspired computation can match backpropagation and scale to deep or long-range tasks without giving up efficiency or hardware simplicity.

Latest papers

59 papers6 papers in the last four weeks, up 20% on the four weeks before. 0.0% of all new papers.

Neural Video Coding under Limited Delay: Theoretical Optimality and System Design
Oct 19, 2026Likun Cai, Jun Chen, Ashish KhistiNeural Video Compression Video Compression
University of Toronto · McMaster University
AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding
Oct 13, 2026Xu Yang, Jiapeng Zhang, Zhiwei Zuo +5KV-Cache Compression Memory Compression
Hunan University · Central China Normal University · Tencent
Error-Based Bidirectional Predictive Coding Enables Deep, 4-Bit Predictive Coding Networks
Oct 11, 2026Garrett Kinman, Zeljko ZilicPredictive Coding 4-Bit Quantization
Department of Electrical and Computer Engineering, McGill University, Montréal, Québec, Canada
DeltaNet-PC: Test-Time Memory Without Backpropagation Through Time
Oct 10, 2026Todd Morrill, Richard ZemelNeural Network Memorization Predictive Coding
Computer Science, Columbia University New York, NY, USA
PotentialEP: Backprop-Free Training of CIFAR-Scale Generative Models via Equilibrium Propagation
Oct 10, 2026Alex GowerImage Generation Equilibrium Propagation
University of Cambridge & Nokia Bell Labs
Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video
Sep 30, 2026Chang-Bae Bang, Hyungjin Chung, Byung-Hoon KimVideo Diffusion Models Predictive Coding
Department of Psychiatry, Yonsei University College of Medicine · Institute of Behavioral Sciences in Medicine, Yonsei University College of Medicine · Department of Biomedical Systems Informatics, Yonsei University College of Medicine +2
Analog-Friendly Predictive Coding without Activation Derivatives
Sep 26, 2026Francesco InnocentiAnalog Computing Predictive Coding
Brain Network Dynamics Unit University of Oxford, UK
Predictive Suppression Layers for Communication-Efficient Spiking Neural Networks
Sep 18, 2026Aidin Attar, Michele RossiSpiking Neural Networks Predictive Coding
University of Padova Department of Information Engineering Padova, Italy · University of Padova Dept. of Inf. Eng. and Dept. of Mathematics Padova, Italy
Predictive-Coding-Based Autonomous Regulation of Internally Generated and Externally Coupled Processing in Human-Robot Interaction
Sep 7, 2026Henrique Oyama, Hiroki Sawada, Jun TaniPredictive Coding Human-Robot Interaction
Cognitive Neurorobotics Research Unit Okinawa Institute of Science and Technology Graduate University Okinawa
Cadence: Error-Bounded Lossy Compression of Demand Time Series with a Time-Series Foundation Model
Sep 5, 2026Roberto TacconelliPredictive Coding Time Series Modeling
Independent Researcher
A Study of Hidden-State Optimization Order in Predictive Coding Networks
Sep 1, 2026Xueyuan Li, Danilo Vasconcellos VargasPredictive Coding Neural Network Optimization
Single State Update Predictive Coding training for Time Series Forecasting and Anomaly Detection
Aug 25, 2026Matteo Cardoni, Sam LerouxPredictive Coding Online Anomaly Detection
IDLab, Department of Information and Technology, Ghent University—imec, 9052 Ghent, Belgium
Free-Energy-Gated Plasticity for Real-Time Online Motor Learning in Physical Human-Robot Interaction
Aug 24, 2026Hiroki Sawada, Jun TaniOnline Continual Learning Continual Robot Learning
Cognitive Neurorobotics Research Unit, Okinawa Institute of Science and Technology Graduate University, Okinawa, Japan 904-0302
A Hierarchical Energy-Based Model for Multimodal Cognition
Aug 8, 2026Subir VarmaComputational Cognitive Modeling Cognitive Modeling
General Cognitics
Topological Simplification in Predictive Coding Networks
Aug 3, 2026Adam Shaw, Jiayu Li, Michael Sperling +2Predictive Coding Topological Representation Learning
University of Southern California 3551 Trousdale Parkway, Los Angeles, CA 90089
Predictive Set Theory: A Generative Framework for Cognitive Architecture with Operationalized Core Mechanisms
Aug 3, 2026Yiyang YuCognitive Architectures for AI Agents Computational Cognitive Modeling
Recursive Gaussian Processes and the Bayesian Brain
Aug 1, 2026Moumita Das, Dipanjan Ray, Sourabh BhattacharyaComputational Cognitive Modeling Predictive Coding
1Indian Institute of Management, Udaipur, India · Department of Psychology and Cognitive Sciences, Ashoka University, Haryana, India · 3Koita Centre for Digital Health at Ashoka (KCDH-A), Haryana, India +1
The Bayesian Reflex: A Predictive Coding Engine for Artificial Intelligence
Aug 1, 2026Sourabh BhattacharyaAdaptive Inference Predictive Coding
Interdisciplinary Statistical Research Unit Indian Statistical Institute, Kolkata
Dreamer-CPC: Message Learning with World Models for Decentralized Multi-agent Reinforcement Learning
Jul 22, 2026Taisuke Takayama, Naoto Yoshida, Tadahiro TaniguchiPredictive Coding Partially Observable RL
Graduate School of Informatics, Kyoto University, Kyoto, Japan · Research Organization of Science and Technology, Ritsumeikan University, Shiga, Japan
DCVC-MB: Neural B-Frame Video Compression using State Space Models
Jul 15, 2026Arjun Arora, Calvin-Khang Ta, Carlos Restrepo-Galeano +7Predictive Coding Neural Video Compression
Dolby Laboratories · Voia · University of Delaware +1
Weight Feedback Computes the Jacobian Transpose Locally in Modern Deep Networks
Jul 15, 2026Junlong Shen, Xingyu LiPredictive Coding Local Learning
Department of Electrical and Computer Engineering, University of Alberta, Edmonton, Canada · Alberta Machine Intelligence Institute (Amii), Edmonton, Canada
Accelerating Hierarchical Sparse Predictive Coding with Hybrid Amortized Inference
Jun 26, 2026Kazuhisa FujitaSparse Recovery Efficient Inference
Department of Clinical Engineering, Komatsu University, 10-10 Doihara-Machi, Komatsu, Ishikawa, Japan 923-0921
Error Highways: Scaling Predictive Coding to Very Deep Networks
Jun 22, 2026Amirhossein Mohammadi, Alexander G. OrorbiaPredictive Coding Local Learning
SingularityNET Zug, Switzerland · Rochester Institute of Technology Rochester, NY, USA
Online Predictive Coding for Dual-Mode Self-Supervised Speech Model
Jun 19, 2026Keita Goto, Takashi Maekaku, Jin Sakuma +3Predictive Coding Streaming ASR
LY Corporation, Tokyo, Japan · Carnegie Mellon University, PA, USA
Can Deep Neural Networks Improve Compression of Very Large Scientific Data?
Jun 12, 2026Muhannad Alhumaidi, Guozhong Li, Spiros Skiadopoulos +1Predictive Coding
King Abdullah University of Science and Technology · Thuwal, Saudi Arabia · University of the Peloponnese +1
Predictive Coding with Bayesian Priors via Proximal Gradients
Jun 6, 2026Francesco BulloPredictive Coding Markov Random Fields
Mechanical Engineering, 2325 Engineering Bldg II, UCSB, Santa Barbara, CA 93106-5070, USA
Dimensionality Reduction for Cyberattack Classification: A Comparative Evaluation of PCA and Linear Predictive Coding
Jun 4, 2026Nelly Elsayed, Zag ElSayed, Navid AsadizanjaniPredictive Coding Principal Component Analysis
School of Information Technology University of Cincinnati Ohio, United States · Dept. of Electrical & Computer Engineering University of Florida Florida, United States
Residual Modeling for High-Fidelity Learned Compression of Scientific Data
Jun 3, 2026Liangji Zhu, Sanjay Ranka, Anand RangarajanPredictive Coding
Department of Computer & Information Science & Engineering University of Florida Gainesville, FL, USA
Training a Predictive Coding Network on ImageNet using Equilibrium Propagation
Jun 2, 2026Tugdual Kerjan, Rasmus Høier, Benjamin ScellierEquilibrium Propagation Predictive Coding
Rain AI
AdaCodec: A Predictive Visual Code for Video MLLMs
Jun 1, 2026Haowen Hou, Zhen Huang, Zheming Liang +8Predictive Coding Efficient VLM Inference
Shanghai Jiao Tong University · Shanghai Innovation Institute

Oct 19, 2026J/K move · Enter open · S save

Neural Video Coding under Limited Delay: Theoretical Optimality and System Design

Likun Cai, Jun Chen, Ashish Khisti

University of Toronto · McMaster University

Neural Video Compression Video Compression Predictive Coding Rate-Distortion Theory

Open paper AskPDF arXiv

Traditional neural video compression (NVC) methods predominantly follow strictly causal predictive-coding paradigm, treating zero-frame delay as a fixed constraint rather than delay as an explicit design parameter. From an information-theoretic perspective, allowing limited frame delay enables a codec to exploit correlations with future frames within the delay window, thereby reducing uncertainty that is inaccessible to strictly causal prediction and potentially improving the rate-distortion tradeoff. In this work, we formalize this intuition through a rigorous rate-distortion analysis builds on the clique factorization of Markov networks, and propose Graph-Factored Sequential Coding (GFSC), a principled framework for sequential video coding under limited delay. To our knowledge, we provide the first theoretical result showing that, for general

K

-order Markov sources with positive distributions, a

K

-frame delay is sufficient to attain joint-coding rate-distortion optimality over a nontrivial distortion region, a guarantee unavailable to zero-delay causal coding in general. In practice, we instantiate GFSC through lightweight neural modules, allowing existing causal predictive codecs to be augmented without modifying their core architectures. Experiments across multiple NVC models and datasets show that GFSC consistently improves rate-distortion performance over the corresponding causal counterparts. Under matched delay budgets, GFSC also achieves competitive performance compared with representative bidirectional codecs.