Singular Learning Theory

Ask about this topic

Momentum

10 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 66

All topics
CardsList

  1. MetaLearnNCA: Few-Shot Offline Meta-Learning via Interacting Neural Cellular Automata

    Oct 6, 2026Etienne Guichard, Stefano NicheleMeta-LearningNeural Cellular Automata

    Department of Computer Science and Communication hiof.no

  2. LFHE: Local-First Heuristic Evolution for Bounded Local Topology Search in Decentralized Learning with Non-IID Data

    Oct 6, 2026Yin-Kuan Liang, Yan Gao, Yang LongDecentralized LearningSingular Learning Theory

    Durham University · University of Cambridge

  3. Population Scaling or Data Dilution? Dynamics of Local Topology Evolution in Decentralized Learning

    Oct 4, 2026Yin-Kuan Liang, Yan Gao, Yang LongDecentralized LearningSingular Learning Theory

    Durham University · University of Cambridge

  4. Distributed Subliminal Learning: Replacing Model Updates with Random-Carrier Outputs

    Oct 4, 2026Dario Fenoglio, Gabriele Dominici, Martin Gjoreski +1Federated LearningSingular Learning Theory

    Università della Svizzera italiana (USI), Lugano, Switzerland · MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, USA

  5. Distributed Learning with Selective State Space Models: Architecture-Aware Convergence Analysis

    Oct 2, 2026Adam Piaseczny, Md Kamran Chowdhury Shisher, Shiqiang Wang +1Singular Learning Theory

    Purdue University · University of Colorado Colorado Springs · University of Exeter

  6. Local Support Learning

    Oct 1, 2026Assaf Ben-Kish, Akarsh Kumar, James Glass +1Catastrophic ForgettingLarge Language Model Memory

    Tel Aviv University · MIT CSAIL

  7. Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization

    Oct 1, 2026Jeeyoung Yun, Seohwan Yun, Sungwoong KimNeural Speech CodecsAudio Tokenizers

    Korea University, Seoul, Republic of Korea

  8. Hyperbolic Prototype Routing for Rehearsal-Free Class-Incremental Learning

    Sep 30, 2026HongWei Zhao, Rui Liu, Yong ChenClass-Incremental LearningLearnable Prototypes

    Beihang University · Beijing University of Posts and Telecommunications

  9. Awakening of the Buddha: Subspace Learning During Population-Loss Plateaus

    Sep 30, 2026Akash KumarAnisotropic Loss LandscapesSingular Learning Theory

    Department of Computer Science & Engineering University of California-San Diego

  10. Learning Beyond Full Imitation: Task-Preserving Knowledge Distillation

    Sep 30, 2026Qianfeng Yuan, Wenbing TaoKnowledge DistillationKullback-Leibler Divergence

    Huazhong University of Science and Technology

  11. SOLO: Pretraining Billion-Parameter Language Models with Shared-Output Local Learning

    Sep 28, 2026Bojian Yin, Shurong Wang, Yuqi Pan +1Large Language Model PretrainingSingular Learning Theory

    Institute of Automation, Chinese Academy of Sciences

  12. Online local learning for generative thermodynamic computing

    Sep 14, 2026Huilin Wang, Weibing DengThermodynamicsLangevin Dynamics

    Key Laboratory of Quark and Lepton Physics (MOE) and Institute of Particle Physics, Central China Normal University, Wuhan 430079, China

  13. Local Updates, Global Learning (LUGL): Playing Games with non-incremental Learners

    Sep 3, 2026David Milec, Spyridon Samothrakis, Michael Fairbank +1Singular Learning TheoryImperfect-Information Games

    Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic · School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom · Maastricht University, the Netherlands

  14. A Study of Hidden-State Optimization Order in Predictive Coding Networks

    Sep 1, 2026Xueyuan Li, Danilo Vasconcellos VargasPredictive CodingSingular Learning Theory

  15. Interpretable AI with Local Distillation

    Aug 24, 2026Erin Craig, Yiling Huang, Snigdha PanigrahiInterpretabilitySingular Learning Theory

    Department of Biostatistics, University of Michigan · Department of Statistics, University of Michigan

  16. Beyond Parameter Space: NTK-Guided Personalized Aggregation for Robust Federated Learning

    Aug 12, 2026Mirko Konstantin, Stefan Zachow, Anirban MukhopadhyayFederated LearningSingular Learning Theory

    Zuse Institute Berlin (ZIB) Takustraße 7 14195 Berlin, Germany · Technical University of Darmstadt Karolinenplatz 5 64289 Darmstadt, Germany

  17. Noise in Diffusion Models Is a Learnable Input

    Aug 3, 2026Shengzhi Deng, Chenqi Ye, Yanze GuoDiffusion ModelsGenerative Quality

    School of Mathematics, Harbin Institute of Technology, Harbin, China · Software College, Northeastern University, Shenyang, China

  18. Relative Parameter Importance in Task-Agnostic Replay-Free Continual Learning

    Aug 1, 2026Malavika Suresh, Ikechukwu Nkisi-Orji, Nirmalie WiratungaReplay-Based Continual LearningContinual Learning

    Robert Gordon University

  19. The Off-Support Barrier: Why Semantic Safety Constraints Are Not Learning-Problem Invariants, and What Follows for Prior Design, Containment, and Verification

    Aug 1, 2026Yoshinori WatanabeSafety ConstraintsBarriers

  20. Versatile On-device Adaptation at the Edge by Unifying Few-shot, Zero-shot, Continual, and In-context Learning

    Jul 31, 2026Douwe den Blanken, Martin Lefebvre, Charlotte FrenkelEdge DevicesFew-Shot Learning

    Microelectronics Department (EEMCS Faculty), Delft University of Technology, 2628 CD Delft, Netherlands

  21. The Art of Not Forgetting A Local Learning Architecture for Continual Learning

    Jul 29, 2026Ashmith Atmuri, Yashaswini Rao BhogarajulaCatastrophic ForgettingReplay-Based Continual Learning

    Arkadhi Research

  22. A Leakage-Free Stacked Ensemble Method for Multiclass Classification

    Jul 24, 2026S. P. Sharmila, Aruna TiwariMulticlass ClassificationEnsemble

    Indian Institute of Technology Indore, Madhya Pradesh, India. · Siddaganga Institute of Technology, Tumakuru, Karnataka, India.

  23. FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts

    Jul 24, 2026Yunan Zhang, Yang Fan, Heng Li +2Named-Entity RecognitionReplay-Based Continual Learning

    School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, Guangdong, China

  24. Alleviating Regional Shortcuts for Few-Shot Class-Incremental Learning

    Jul 24, 2026Haichen Zhou, Yazhe Lyu, Yixiong Zou +2Class-Incremental LearningFew-Shot Learning

    School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China

  25. Workflow-Localized Mechanism Learning: Attribution-Guided Repair and Knowledge Reuse for Structured Agent Skills

    Jul 23, 2026Zibin Lin, Shengli Zhang, Taotao Wang +3Reusable KnowledgeRepair

    Shenzhen University, Shenzhen, China

  26. Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization

    Jul 15, 2026Jiaxuan ChengPlasticitySingular Learning Theory

    Massachusetts Institute of Technology, Cambridge, MA, USA.

  27. Virtual Category-Guided Continual Generalized Category Discovery

    Jul 6, 2026Jiahui Xiong, Qiuxia Lai, Hongsong WangGeneralized Category DiscoveryImage Classification

    School of Computer Science and Engineering, Southeast University, Nanjing 210096, China · State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China · Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China

  28. Convergence of Continual Learning in Homogeneous Deep Networks

    Jun 29, 2026Matan Schliserman, Gon Buzaglo, Itay Evron +1Replay-Based Continual LearningSingular Learning Theory

    Blavatnik School of Computer Science and AI, Tel Aviv University · Princeton University · Department of Electrical and Computing Engineering, Technion

  29. Singular Learning and Occam's Razor in Deep Monomial Networks

    Jun 26, 2026Kathlén Kohn, Giovanni Luca Marchetti, Farhan Shabir +2Activation FunctionsStationary Point

    KTH Stockholm · No Affiliation · Umeå University +1

  30. Local Pheromone Network: Sparse Local Learning with Multi-Scale Synaptic Trails, Consolidation, and Replay

    Jun 22, 2026Xingcheng Fu, Xianjun Chen, Zhihao LiHebbian LearningSynaptic Plasticity

  31. Noise-Debiased Thermodynamic Variance for Local Learning Coefficient Probes

    Jun 21, 2026Yingjia CaiAnisotropic Loss LandscapesSingular Learning Theory

  32. From Handcrafted Features to Functional Edge Learning: Evolution of EEG Seizure Detection Frameworks

    Jun 20, 2026Sepideh Kheirollahi, Mohammad Rasoul RoshanshahSeizure DetectionElectroencephalography

    School of Electrical and Computer Engineering College of Engineering, University of Tehran Tehran, Iran

  33. Dead Directions: Geometric Singular Learning

    Jun 4, 2026Tejas Pradeep ShirodkarSingularityDeep Network

    IIIT, Hyderabad

  34. Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Training

    Jun 4, 2026Yucheng ChenForward PropagationSingular Learning Theory

    Amplimit Toronto, ON, Canada

  35. Continual Learning as a Multiphase Moving-Boundary Problem

    Jun 1, 2026Snigdha Chandan KhilarContinual LearningPlasticity

    Independent Researcher

  36. Forgetting Has Neighbors: Localized Collateral Forgetting in Machine Unlearning

    May 29, 2026Polina Dolgova, Sebastian U. StichMachine UnlearningUnlearning Method

    CISPA Helmholtz Center for Information Security · Universität des Saarlandes · Saarbrücken, Germany

  37. Learning Through Noise: Why Subliminal Learning Works and When It Fails

    May 22, 2026Vincent C. Brockers, Roman D. Ventzke, Valentin Neuhaus +2Singular Learning Theory

    Max Planck Institute for Dynamics and Self-Organization, Göttingen · Faculty of Physics, Institute for the Dynamics of Complex Systems, University of Göttingen

  38. Sparse In-Network Learning via Shortest-Path Backpropagation and Finite-Rate Gating

    May 22, 2026Mohammad Reza Deylam SalehiSingular Learning TheoryNeural Network Inference

    Nice, France

  39. Your Neighbors Know: Leveraging Local Neighborhoods for Backdoor Detection in Decentralized Learning

    May 19, 2026Sayan Biswas, Antoine Boutet, Davide Frey +7Clean Label Backdoor AttackDecentralized Learning

    1EPFL · 2Inria, INSA Lyon, CITI · 3Univ. Rennes, Inria, CNRS, IRISA

  40. Self-supervised local learning rules learn the hidden hierarchical structure of high-dimensional data

    May 18, 2026Ariane Delrocq, Wu S. Zihan, Guillaume Bellec +1Singular Learning TheorySynaptic Plasticity

    School of Life Science and School of Computer and Communications Sciences, EPFL, Lausanne, Switzerland · Machine Learning Research Unit, TU Wien, Vienna, Austria

  41. Soft Learning

    May 16, 2026Mohammed Aledhari, Ali Aledhari, Fatimah Aledhari +1Support Vector MachinesSingular Learning Theory

    Department of Data Science & Department of Computer Science and Engineering, University of North Texas, Denton, TX 76207, USA · Department of Computer and Information Science, Fordham University, New York, NY 10458, USA

  42. How Few-Shot Examples Add Up: A Causal Decomposition of Function Vectors in In-Context Learning

    May 15, 2026Entang Wang, Yiwei Wang, Aleksandra Bakalova +1In-Context LearningFew-Shot Learning

    Saarland Informatics Campus, Saarland Univesity, Saarbrücken, Germany.

  43. Shapley Neuron Values for Continual Learning: Which Neurons Matter Most?

    May 15, 2026Mohammad Ali Vahedifar, Abhisek Ray, Qi ZhangReplay-Based Continual LearningContinual Learning

    DIGIT and Department of Electrical and Computer Engineering, Aarhus University, Denmark

  44. What is Learnable in Valiant's Theory of the Learnable?

    May 13, 2026Steve Hanneke, Anay Mehrotra, Grigoris Velegkas +1LearnabilityO(\Bar{K}\Log N)$

    Purdue University · Stanford University · Google Research +1

  45. LightSplit: Practical Privacy-Preserving Split Learning via Orthogonal Projections

    May 13, 2026Mert Cihangiroglu, Alessandro Pegoraro, Phillip Rieger +2Privacy-Preserving Machine LearningSingular Learning Theory

    University of Pavia · 2Technical University of Darmstadt

  46. KAN-CL: Per-Knot Importance Regularization for Continual Learning with Kolmogorov-Arnold Networks

    May 12, 2026Minjong CheonCatastrophic ForgettingKolmogorov-Arnold Networks

    Sejong University Department of Computer Science and Engineering

  47. Information theoretic underpinning of self-supervised learning by clustering

    May 12, 2026Josef Kittler, Sara Atito, Muhammad AwaisSelf-Supervised LearningKullback-Leibler Divergence

    Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, Guildford, Surrey GU2 7XH, UK · Surrey Institute for People-Centred AI (PAI), University of Surrey, Guildford, Surrey GU2 7XH, UK

  48. Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning

    May 11, 2026Salar Beigzad, Vansh VermaSingular Learning TheoryForward Propagation

    Computer Engineering University of St. Thomas Minnesota, USA

  49. Modulated learning for private and distributed regression with just a single sample per client device

    May 8, 2026Praneeth Vepakomma, Amirhossein Reisizadeh, Samuel Horváth +1Federated LearningSingular Learning Theory

    Massachusetts Institute of Technology (MIT) · Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)

  50. From Surface Learning to Deep Understanding: A Grounded AI Tutoring System for Moodle

    May 7, 2026Anna Ostrowska, Michał Kukla, Gabriela Majstrak +4TutorsArtificial Intelligence Education

    Faculty of Mathematics and Information Sciences, Warsaw University of Technology, Warsaw, Poland

  51. Continual Learning of Feedback-based Molecular Communication

    May 1, 2026Siddhant Setia, Junichi Suzuki, Tadashi NakanoReplay-Based Continual LearningContinual Learning

    Department of Computer Science, University of Massachusetts, Boston Boston, MA, 02125, USA · Graduate School of Informatics, Osaka Metropolitan University Osaka, Japan

  52. Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networks

    Apr 27, 2026Kevin McKee, Thomas Hazy, Yicong Zheng +2Replay-Based Continual LearningSingular Learning Theory

    Astera Institute

  53. Incremental learning for audio classification with Hebbian Deep Neural Networks

    Apr 20, 2026Riccardo Casciotti, Francesco De Santis, Alberto Antonietti +1Hebbian LearningClass-Incremental Learning

    Signal Processing Research Centre, Tampere University, Tampere, Finland · Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, Italy

  54. PAC-Bayes Bounds for Gibbs Posteriors via Singular Learning Theory

    Apr 19, 2026Chenyang Wang, Yun YangPac-Bayesian TheoryGeneralization Bounds

    Department of Statistics, University of Illinois Urbana-Champaign · Department of Mathematics, University of Maryland, College Park

  55. CI-CBM: Class-Incremental Concept Bottleneck Model for Interpretable Continual Learning

    Apr 16, 2026Amirhosein Javadi, Tuomas Oikarinen, Tara Javidi +1Replay-Based Continual LearningContinual Learning

    Department of Electrical and Computer Engineering, University of California San Diego · Department of Computer Science and Engineering, University of California San Diego · Halıcıoğlu Data Science Institute, University of California San Diego

  56. Mistake gating leads to energy and memory efficient continual learning

    Apr 15, 2026Aaron Pache, Mark CW van RossumContinual LearningPlasticity

    School of Mathematical Sciences University of Nottingham, Nottingham NG7 2RD, United Kingdom · School of Psychology University of Nottingham, Nottingham NG7 2RD, United Kingdom

  57. The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks

    Mar 26, 2026Gabriele Farné, Fabrizio Boncoraglio, Lenka ZdeborováMemorizationSingular Learning Theory

    Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL) CH-1015 Lausanne

  58. Convergence Rate of a Functional Learning Method for Contextual Stochastic Optimization

    Mar 13, 2026Noel Smith, Andrzej RuszczynskiStochastic OptimizationOptimal Learner

    Department of Management Science and Information Systems, Rutgers University

  59. Automatic Extraction of Road Networks by using Teacher-Student Adaptive Structural Deep Belief Network and Its Application to Landslide Disaster

    Nov 4, 2025Shin Kamada, Takumi IchimuraLandslidesRoad Networks

    S. Kamada is with Hiroshima City University, Hiroshima, Japan · T. Ichimura is with Prefectural University of Hiroshima, Hiroshima, Japan

  60. Learnable Mixed Nash Equilibria are Collectively Rational

    Oct 16, 2025Geelon So, Yi-An MaNash EquilibriumEquilibrium

    University of California, San Diego