Overview

Residual learning studies how models can build on an existing representation or prediction by adding learned updates, rather than learning the entire transformation from scratch. In deep networks, skip connections and newer approaches such as attention-based routing and multi-stream hyper-connections shape information and gradients across layers; in hybrid models, learned corrections refine physics-based, statistical, or frozen-model predictions. These methods are evaluated in settings including image classification, language modeling, diffusion, time-series forecasting, scientific simulation, and control. A central challenge is determining when residual pathways improve depth, stability, and generalization—and when their complexity, added compute, or poorly transferable corrections instead hurt performance.

Latest papers

CardsList

170 papers17 papers in the last four weeks, down 48% on the four weeks before. 0.1% of all new papers.

  1. AnchorUp: Anchoring Feature Upsampling on a Classical Interpolation

    Nov 18, 2026Kotaro Horikawa, Keisuke Toida, Junya Komori +1Residual LearningVision Foundation Model Adaptation

  2. CorrectCast: Selective Multimodal Context for Scale-Aware Residual Correction in Precipitation Nowcasting

    Nov 17, 2026Henan Wang, Shengwu Xiong, Yifang Zhang +1Precipitation NowcastingTime Series Forecasting

  3. MORA: Correcting Time Series Forecasts with Coarse Future Signals

    Nov 11, 2026Hu Li, Kenan Li, Haonan Xu +4Time Series Forecast CorrectionTime Series Forecasting

  4. TIRAD: Text-guided Image Residual Learning for Generalist Anomaly Detection

    Nov 9, 2026Seongsu Lee, Seunghyun Oh, Seungjae Moon +1Anomaly DetectionIndustrial Anomaly Detection

  5. Clinical Evidence-Guided Residual Learning for Medication Recommendation with Dynamic DDI Regularization

    Nov 7, 2026Zesheng Li, Chengchang Pan, Honggang QiMedication RecommendationClinical Decision Support

  6. FARR: Forecast-Aware Residual Refinement with Matched Endpoint Evidence for Long-Horizon Time-Series Forecasting

    Nov 5, 2026Yiyang Zhang, Yuli Zheng, Bin Li +2Time Series ForecastingLong-Term Time Series Forecasting

  7. M3Former: Fine-Grained Cross-Layer Mixing for Transformers

    Nov 2, 2026Jiasong Han, Yunkai Chai, Tong Zhu +5TransformerResidual Learning

  8. Hierarchical Residuals: A Minimalist Decoupling of Residual Width from Compute Width

    Oct 30, 2026Ziteng Wang, Jianqiao Lu, Xinyu Ma +4TransformerResidual Learning

  9. Single-Annotation, Multi-Hypothesis Segmentation with Semantic-Spatial Residual Banks

    Oct 29, 2026Armin Dadras, Robert Sablatnig, Franziska Proksa +1Image SegmentationSemantic Segmentation

  10. Generative Refinement Learning for Temporal Interpolation in Scientific Machine Learning

    Oct 27, 2026Pu Ren, Michael W. Mahoney, N. Benjamin ErichsonScientific MLResidual Learning

  11. Kronecker-Structured Video Completion with Cross-Fitted Self-Supervised Residual Learning

    Oct 26, 2026Qi Qi, Yanfei Wang, Yanjun Cui +1Tensor DecompositionResidual Learning

  12. Guarded Agent-in-the-Loop Residual Adaptation for Evolving Wind Power Regimes

    Oct 26, 2026Yuhang Dong, Min Xia, Jinghong Li +3Wind Power ForecastingNon-Stationary Time Series Forecasting

  13. Sliding Networks: A Family of Residual Structures Preserving Feature Learning and Feature Diversity

    Oct 24, 2026Datong Zhou, Blake BordelonNeural Scaling LawsResidual Learning

  14. Early learning in large residual networks

    Oct 22, 2026Vladimir Narovlansky, Boris HaninNeural Network Training DynamicsResidual Learning

  15. Width and Depth Limits Commute During Training in Linear Residual Networks

    Oct 22, 2026Ruijia Zhang, Soufiane HayouNeural Network Training DynamicsDeep Linear Networks

  16. Local and Global Recursive Ridge Regression for Online Residual Correction of Frozen Multivariate Forecasters under Label Delay

    Oct 21, 2026Takumi Fujimoto, Hiroaki NishiTime Series Forecast CorrectionMultivariate Time Series Forecasting

  17. AGGR-Mamba: Mamba-based Network with Attention-Guided Gated Residual Refinement for Undersampled MRI Reconstruction

    Oct 20, 2026Yue Zhuo, Wenbin Deng, Lingjun Liu +2Accelerated MRI ReconstructionResidual Learning

  18. Paloma: Phase-Conditioned Residual Modulation for Time Series Forecasting

    Oct 18, 2026Jingru Fei, Wei Fan, Kun Yi +2Time Series ForecastingResidual Learning

  19. Synergy-Aware Residual Flow Matching for Single-Cell Perturbation Prediction

    Oct 18, 2026Jingrui Wu, Wangyun DanSingle-Cell Perturbation ModelingFlow-Based Generative Modeling

  20. Enhancing analytical photon transport in turbid media through physics-guided neural network corrections

    Oct 17, 2026Guojun Tang, Paul D. Teal, Alexander DoroninRadiative TransferNeural Surrogate Modeling

  21. On-Policy Residual Learning for Diffusion Language Models

    Oct 14, 2026Yifan Yu, Yuqing Jian, Jisen Li +9Diffusion Language ModelsDiffusion Language Model Inference

  22. Two-stage Residual Learning for Modelling Strength-Informed Optimisation of Thermal Systems

    Oct 14, 2026Talha Ansar, Waqar Muhammad Ashraf, Abdulelah S. Alshehri +1Surrogate ModelingSurrogate-Assisted Optimization

  23. Historical-Feature Residual Adaptation for Sequential Screening

    Oct 13, 2026Yixiang Hong, Yuchen ZhangSequential Decision MakingLearning to Rank

  24. Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completion

    Oct 13, 2026Chih-Hai Su, Tsung-Wei Ke, Yu-Lun LiuResidual LearningMotion Representation Learning

  25. Multi-Stream Residual Computation in Diffusion Language Models

    Oct 13, 2026Ekaterina Alimaskina, Suren Kazarian, Gleb Molodtsov +1Diffusion Language ModelsMasked Diffusion Models

  26. On the Depth Transfer of Neural Optimizers via L-Smoothness

    Oct 9, 2026Maximilian Wong, Chenyu Xu, Jiajin Li +1Deep Learning OptimizationHyperparameter Transfer