Residual Connections

Ask about this topic

Momentum

2 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 34

All topics
CardsList

  1. LARC: Low-Rank Adaptive Residual Connections for Learning in Frozen Models

    Sep 30, 2026Junyi Zou, Avrova DonzResidual ConnectionsPhase Space

    MMLA-org · Communication University of China (CUC), No. 1 Dingfuzhuang East Street, Chaoyang District, Beijing 100024, China

  2. ResARC: Residual-Aware AutoRegressive Coding for Ultra-Low Bitrate Image Compression

    Sep 30, 2026Qin Yan, Ruixiao Dong, Yutao Xie +5Ultra-Low BitratesAutoregressive Image Generation

    University of Science and Technology of China · Alibaba Group

  3. LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction

    Sep 28, 2026Binbin Yong, Zhao Su, Lan Guo +3Residual ConnectionsShort-Horizon Forecasting

    Lanzhou University · Monash University · University of Wollongong

  4. Geometry-Aware Hyperbolic Residual Quantization

    Sep 22, 2026Alessio Colombo, Melika AyoughiHyperbolic SpaceResidual Connections

    Universiteit van Amsterdam, Amsterdam, Netherlands

  5. ZK-Trace: Certified Collusion Tracing with Zero-Knowledge Credentials for Federated GNSS Interference Monitoring

    Sep 8, 2026Redwanul Karim, Nisha L. Raichur, Lucas Heublein +3Global Navigation Satellite SystemZero-Knowledge Proofs

    Fraunhofer Institute for Integrated Circuits IIS, 90411 Nürnberg, Germany

  6. TEMPER: Tensorized Efficient Manifold-constrained Parameterization for Expressive Residual Routing

    Aug 8, 2026Yuxuan Gu, Wuyang Zhou, Huijun Xing +1Residual ConnectionsReparameterization

    Department of Electrical and Electronic Engineering, Imperial College London

  7. Dense-Cast: A lightweight ensemble of deep learning architectures for precipitation nowcasting

    Aug 6, 2026Gourav Jyoti Kalita, Hidam Kumarjit SinghPrecipitation NowcastingRainfall

    Department of Electronics and Communication Technology, Gauhati University, Guwahati-781014, Assam, India

  8. Beyond Residual Connections: Manifold-Constrained Hyper-Connections for Robust Speaker Representation Learning

    Aug 6, 2026Zezhong Jin, Xiaoyu Wang, Zhe Li +4Residual ConnectionsDiscrete Speech Representations

    Dept. of EEE, The Hong Kong Polytechnic University · Baidu Inc. · Speech, Language, and Cognition Laboratory, The University of Hong Kong, Hong Kong SAR

  9. Training Crossroads for Recurrent Vision Transformers: Recurrence, Neural ODEs, and Deep Supervision

    Aug 5, 2026Grzegorz Gruszczynski, Pawel Olszowiec, Michal Byra +2Self-Supervised Vision TransformersVision Transformer

    Samsung AI Center, Warsaw, Poland · Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland

  10. Sphere Retraction Normalizations

    Aug 2, 2026Jie Zhang, Cheng-Fang Su, Yi-Jui Huang +1Residual ConnectionsGeodesic

    Department of Computer Science and Information Engineering, National Central University, Taiwan · Department of Applied Mathematics, National Yang Ming Chiao Tung University, Taiwan · Department of Mathematics, National Central University, Taiwan

  11. Certifying Residual Architectures from Their Primitives: A Sharp Stability Threshold

    Jul 16, 2026Hyemin Gu, Michael Tyrrell, Tuhin Sahai +1Residual NetworksResidual Connections

    University of Massachusetts Amherst · SRI International

  12. Muon as a Residual Connection

    Jul 1, 2026Hao HuangMuonResidual Connections

    College of Computer Science and Technology Zhejiang University Hangzhou, Zhejiang, China

  13. Review Residuals: Update-Conditioned Residual Gating for Transformers

    Jun 30, 2026Kyle KramerResidual ConnectionsBatch Normalization

    NeraTech LLC

  14. MambaRaw: Selective State Space Modeling for Efficient 4K Raw Image Reconstruction

    Jun 23, 2026Peize Li, Fanhu Zeng, Tongda Xu +5Image ReconstructionTopomamba

    Institute for AI Industry Research (AIR), Tsinghua University · King’s College London · Dalian University of Technology +3

  15. Exploding and vanishing gradients in deep neural networks: the effect of residual connections

    Jun 15, 2026Vivek S BorkarResidual ConnectionsGradient

  16. A Large Scale Open-Source Image and Video Dataset for Robust Wildfire Detection and Classification

    Jun 8, 2026Emadeldeen Hamdan, Yingyi Luo, B. Ugur Toreyin +4Wildfire DetectionWildfire

    Department of Electrical and Computer Engineering, University of Illinois Chicago, Chicago, IL, USA · Informatics Institute, Istanbul Technical University, ˙Istanbul, Türkiye · USDA Forest Service Pacific Wildland Fire Sciences Laboratory, Washington, USA +1

  17. Classifying galaxies in the Galaxy10 DECals dataset using Inception and Residual CNNs

    Jun 7, 2026Lanz Anthonee A. Lagman, Prospero C. Naval, Reinabelle C. ReyesConvolutional Neural NetworksAstronomical Images

    Data Science Program, College of Science, University of the Philippines - Diliman, Philippines · Department of Computer Science, College of Engineering, University of the Philippines - Diliman, Philippines · National Institute of Physics, College of Science, University of the Philippines - Diliman, Philippines

  18. Modeling Nonlinear Feature Interactions with Product-Unit Residual Networks

    Jun 5, 2026Ziyuan Li, Uwe Jaekel, Babette DellenHigh-Order CorrelationsMultilayer Perceptrons

    Department of Mathematics, Informatics and Technology, University of Applied Sciences Koblenz, Joseph-Rovan-Allee 2, 53424 Remagen, Germany · Technical University of Munich, Munich, Germany

  19. Speech Emotion Recognition using Attention-based LSTM-Network with Residual Connection

    Jun 2, 2026Daniil Krasnoproshin, Maxim VashkevichCnn-LstmBidirectional Long Short-Term Memory

    Embedded System Department of Belarusian State University of Informatics and Radioelectronics 6, P. Brovky st., 220013, Minsk, Belarus

  20. Student Capacity Moderates Knowledge Distillation Effectiveness: A Systematic Study Across ResNet Teacher-Student Pairs on CIFAR-10

    May 29, 2026Umut Onur YasarKnowledge DistillationTeacher

  21. SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training

    May 26, 2026Mohammed Adnan, Rohan Jain, Tom Jacobs +4Batch NormalizationNeural Network Optimization

    University of Calgary · 2Vector Institute · 3CISPA Helmholtz +2

  22. CodecCap: High-Fidelity Codec-Inspired Residual Modeling for Dense Video Captioning

    May 26, 2026Zihan Lin, Songhe Deng, Shuwei He +6Video CaptioningCaptions

    ERNIE Team, Baidu · College of Artificial Intelligence, Inner Mongolia University

  23. Interpretation, Learning, and Empathy as One Constraint: A Residual-Adequacy Architecture with Accountable Abstention

    May 24, 2026Chainarong AmornbunchornvejAbstentionAbductive Reasoning

    National Electronics and Computer Technology Center (NECTEC), 112 Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand

  24. The Transformer as a Polar State Estimator

    May 10, 2026Peter RacioppoEnergy-Based TransformerTransformer Architectures

    Independent Researcher Los Angeles, CA

  25. L2A: Learning to Accumulate Pose History for Accurate 3D Human Pose Estimation

    May 9, 2026Zehua Wang, Changwang Mei, Huaijiang Sun +2Wifi-Csi 3D Human Pose EstimationSpatio-Temporal Transformers

    Nanjing University of Science and Technology · Lenovo

  26. The EΔΔ-MHC-Geo Transformer: Adaptive Geodesic Operations with Guaranteed Orthogonality

    May 7, 2026Arash ShahmansooriResidual ConnectionsOrthogonality

    Independent Researcher

  27. Why Geometric Continuity Emerges in Deep Neural Networks: Residual Connections and Rotational Symmetry Breaking

    May 6, 2026Kyungwon Jeong, Won-Gi Paeng, Honggyo SuhResidual ConnectionsDeep Network

    Hyntel

  28. Can an MLP Absorb Its Own Skip Connection?

    Apr 26, 2026Antonij Mijoski, Marko KarbevskiResidual ConnectionsResidual Networks

    IRMA, Universit´e de Strasbourg, France · Independent Researcher

  29. Discovering a Shared Logical Subspace: Steering LLM Logical Reasoning via Alignment of Natural-Language and Symbolic Views

    Apr 21, 2026Feihao Fang, My T. Thai, Yuanyuan LeiLLM Reasoning StrategiesReasoning Chain

    University of Illinois Urbana-Champaign, Champaign, IL · Computer & Information Science and Engineering, University of Florida, Gainesville, FL

  30. Feature Perturbation Pool-based Fusion Network for Unified Multi-Class Industrial Defect Detection

    Apr 21, 2026Yuanchan Xu, Wenjun Zang, Ying WuDefect DetectionFeature Pyramid

    School of Information Engineering, Sichuan University, China

  31. Class Unlearning via Depth-Aware Removal of Forget-Specific Directions

    Apr 16, 2026Arman Hatami, Romina Aalishah, Ilya E. MonosovExact UnlearningUnlearning Method

    Johns Hopkins University

  32. ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs

    Jan 12, 2026Haoqian Meng, Yilun Luo, Yafei Zhao +3Full-Precision PerformanceEfficient Large Language Model

    School of Computer Science and Technology, Tianjin University

  33. Hard-constraint physics-residual networks for hydrogen crossover prediction and high-pressure extrapolation in PEM water electrolysis

    Nov 8, 2025Yong-Woon Kim, Jihyeok Lee, Chulung Kang +1Hydrogen System ComponentsPolymer Property Prediction

    Department of Computer Engineering, Jeju National University, Jeju, 63243, South Korea · Faculty of Applied Energy System, Jeju National University, Jeju, 63243, South Korea · Department of Mechanical System Engineering, Jeju National University, Jeju, 63243, South Korea +1

  34. RDQ: Residual Distribution Quantization for Large Language Models

    Date pendingPrateek SinghLarge Language Model QuantizationResidual Connections