Nonlinearity

Ask about this topic

Momentum

8 papers in the last four weeks, up 60% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 104

All topics
CardsList

  1. Plug-and-Play Spiking Operators: Breaking the Nonlinearity Bottleneck in Spiking Transformers

    May 19, 2026Xinzhe Yuan, Xiang Peng, Bin Gu +1Spiking Neural NetworksTime-To-First-Spike

    IASM, Harbin Institute of Technology · IASM, Harbin Institute of Technology, China · School of Artificial Intelligence, Jilin University +1

  2. Activation Functions, Statistics and Learning of Higher-Order Interactions in Restricted Boltzmann Machines

    May 18, 2026Giovanni di Sarra, Yasser RoudiActivation FunctionsNeurons

    Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, 7491 Trondheim, Norway · Department of Mathematics, King’s College London, London, Strand, WC2R 2LS, UK

  3. Information Processing Capacity of Stationary Physical Systems: Theory, Data-efficient Estimation Methods, and Photonic Demonstration

    May 18, 2026Rahul Uma Ramachandran, Serge MassarPhotonic Transformer AcceleratorsSingle-Photon Avalanche Diode

    Laboratoire d’Information Quantique CP224, Universit´e libre de Bruxelles, Av. F. D. Roosevelt 50, B-1050 Bruxelles, Belgium

  4. Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic

    May 18, 2026Thomas Sommariva, Francesca Morandi, Simone Calderara +1Model Fine-TuningContinual Fine-Tuning

    ImageLab, Department of Engineering “Enzo Ferrari”, University of Modena and Reggio Emilia, Italy · University of Pisa, Italy

  5. The Geometry of Projection Heads: Conditioning, Invariance, and Collapse

    May 16, 2026Faris ChaudhryProjection HeadsSelf-Supervised Learning

    Department of Computing, Imperial College London, United Kingdom.

  6. Pretraining Objective Matters in Extreme Low-Data FGVC: A Backbone-Controlled Study

    May 15, 2026Alexander Hackett, Srikanth Thudumu, Ginny Fisher +1Frozen EncoderPretraining

    Santa Clara University · IAAIR

  7. Non-linear Interventions on Large Language Models

    May 14, 2026Sangwoo KimLatent Feature InterventionsNonlinearity

    Department of Linguistics, Seoul National University, Republic of Korea.

  8. ArcGate: Adaptive Arctangent Gated Activation

    May 14, 2026Avik Bhattacharya, Siddhant Dnyanesh Gole, Subhasis Chaudhuri +2Activation FunctionsDeep Network

    Microwave Remote Sensing Lab Center of Studies in Resources Engineering Indian Institute of Technology Bombay, India · Centre of Machine Intelligence and Data Science Indian Institute of Technology Bombay, India · Department of Electrical Engineering Indian Institute of Technology Bombay, India +1

  9. Causal Learning with the Invariance Principle

    May 13, 2026Francesco Montagna, Francesco LocatelloCausal Discovery MethodsCausal Graph

    Institute of Science and Technology Austria

  10. Kernel-based guarantees for nonlinear parametric models in Bayesian optimization

    May 13, 2026Rafael OliveiraBayesian OptimizationNonlinearity

    The Commonwealth Scientific and Industrial Research Organisation (CSIRO) Sydney, Australia

  11. A nonlinear extension of parametric model embedding for dimensionality reduction in parametric shape design

    May 12, 2026Andrea Serani, Giorgio Palma, Matteo Diez1B ParametersDimensionality Reduction

    National Research Council-Institute of Marine Engineering, Rome, Italy

  12. The First Drop of Ink: Nonlinear Impact of Misleading Information in Long-Context Reasoning

    May 11, 2026Muhan Gao, Zih-Ching Chen, Kuan-Hao HuangLong-Context ReasoningDistractor

    Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA · NVIDIA AI Technology Center, NVIDIA Corporation, Santa Clara, CA, USA

  13. On the global convergence of gradient descent for wide shallow models with bounded nonlinearities

    May 11, 2026Romain Petit, Clarice Poon, Gabriel PeyréGradient DescentFlat Minima

    CNRS and ENS, PSL Universit´e · Mathematics Institute, University of Warwick

  14. Decentralized Contingency MPC based on Safe Sets for Nonlinear Multi-agent Collision Avoidance

    May 11, 2026Max Studt, Georg SchildbachCollision AvoidanceModel Predictive Control

    Institute for Electrical Engineering in Medicine, University of Luebeck, Luebeck, Germany

  15. A Nonlinear Complexity Index for Wearable PPG Cardiovascular Stability: Multiscale Validation, Systematic Evaluation Correction, and Bayesian Parameter Optimization

    May 11, 2026Timothy Oladunni, Farouk Ganiyu AdewumiRemote PhotoplethysmographyCardiac

    Department of Computer Science, Morgan State University, Baltimore, MD 21251, USA

  16. Multifidelity Gaussian process regression for solving nonlinear partial differential equations

    May 11, 2026Fatima-Zahrae El-Boukkouri, Josselin Garnier, Olivier RoustantPartial Differential EquationsMulti-Fidelity

    Institut de Mathématiques de Toulouse, Université de Toulouse, INSA, Toulouse, 31077, France · CMAP, CNRS, Ecole polytechnique, Institut Polytechnique de Paris, Palaiseau, 91120, France

  17. Signature Approach for Contextual Bandits with Nonlinear and Path-dependent Rewards

    May 11, 2026Xin Guo, Grace He, Xinyu LiContextual Bandit FrameworkBandits

    University of California, Berkeley, Berkeley, CA · University of Oxford, Oxford, UK

  18. Safe Exploration for Nonlinear Processes Using Online Gaussian Process Learning

    May 10, 2026Stefano Tonini, Soroush Rastegarpour, Hamid Reza Feyzmahdavian +2Lyapunov FunctionControl Architecture

    ABB Corporate Research, Väster˚as, Sweden · KTH Royal Institute of Technology, Stockholm, Sweden

  19. Controlled Paraphrase Geometry in Sentence Embedding Space: Local Manifold Modeling and Latent Probing

    May 1, 2026Leonid BedratyukSemantic GeometryGeometry-Aware

  20. A Dirac-Frenkel-Onsager principle: Instantaneous residual minimization with gauge momentum for nonlinear parametrizations of PDE solutions

    Apr 30, 2026Matteo Raviola, Benjamin PeherstorferPartial Differential EquationsMomentum

    EPFL, Lausanne, Switzerland · Courant Institute of Mathematical Sciences, New York University, New York, NY, USA

  21. Man, Machine, and Mathematics

    Apr 29, 2026Akshunna S. DograUnified FormulationMathematics

    The NSF AI Institute for Artificial Intelligence and Fundamental Interactions (IAIFI), USA · EPSRC Centre for Doctoral Training: Mathematics of Random Systems, UK · Center of Mathematical Sciences and Applications, Harvard University, USA +3

  22. Iterative Model-Learning Scheme via Gaussian Processes for Nonlinear Model Predictive Control of (Semi-)Batch Processes

    Apr 24, 2026Tai Xuan Tan, Alexander Mitsos, Eike CramerGaussian ProcessModel Predictive Control

    Process Systems Engineering (AVT.SVT), RWTH Aachen University, Forckenbeckstraße 51, 52074 Aachen, Germany · JARA-CSD, 52056 Aachen, Germany · Institute of Climate and Energy Systems: Energy Systems Engineering (ICE-1), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany +1

  23. The Exact Replica Threshold for Nonlinear Moments of Quantum States

    Apr 24, 2026Shuai ZengQubitOptimal Sample Complexity

    School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, P.R. China

  24. AC-SINDy: Compositional Sparse Identification of Nonlinear Dynamics

    Apr 20, 2026Peter RacioppoSystem IdentificationNonlinear Dynamics

    Independent Researcher Los Angeles, CA 90731

  25. Choose Your Own Adventure: Non-Linear AI-Assisted Programming with EvoGraph

    Apr 20, 2026Vassilios Exarhakos, Jinghui Cheng, Jin L. C. GuoAi-Assisted Programming TasksNonlinearity

    McGill University Montreal, Quebec, Canada · Polytechnique Montreal Montreal, Quebec, Canada

  26. Monotone but Exciting: On Evolving Monotone Boolean Functions with High Nonlinearity

    Apr 19, 2026Claude Carlet, Marko Čupić, Marko Ðurasevic +3MonotonicityGenetic Algorithms

    University of Paris 8, 2 rue de la liberté, 93526 Saint-Denis Cedex, France · University of Bergen, Bergen, Norway · Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, Zagreb, Croatia +2

  27. Fisheye3R: Adapting Unified 3D Feed-Forward Foundation Models to Fisheye Lenses

    Mar 30, 2026Ruxiao Duan, Erin Hong, Dongxu Zhao +3Feed-Forward 3D Reconstruction3D Foundation Models

    Yale University · Google

  28. Dataset Distillation Efficiently Encodes Low-Dimensional Representations from Gradient-Based Learning of Non-Linear Tasks

    Mar 16, 2026Yuri Kinoshita, Naoki Nishikawa, Taro ToyoizumiDiffusion-Based Dataset DistillationDataset Distillation

    The University of Tokyo, Tokyo, Japan · Laboratory for Neural Computation and Adaptation, RIKEN Center for Brain Science, Wako, Japan · RIKEN Center for Advanced Intelligence Project, Nihonbashi, Japan

  29. Provable Subspace Identification of Nonlinear Multi-view CCA

    Feb 27, 2026Zhiwei Han, Stefan Matthes, Hao ShenIdentifiabilitySubspace

    Chair of Data Processing, Technical University of Munich, Germany · fortiss GmbH, Munich, Germany

  30. CeRA: Breaking the Linear Ceiling of Low-Rank Adaptation with Non-linearity Retained at Inference

    Feb 26, 2026Hung-Hsuan ChenLow-Rank Adaptation FrameworkRapid Adaptation

    Computer Science and Information Engineering National Central University Taoyuan, Taiwan

  31. Patches of Nonlinearity: Instruction Vectors in Large Language Models

    Feb 8, 2026Irina Bigoulaeva, Jonas Rohweder, Subhabrata Dutta +1Instruction-Tuned ModelsMechanistic Interpretability

    Ubiquitous Knowledge Processing Lab (UKP Lab) · Department of Computer Science, Technical University of Darmstadt · National Research Center for Applied Cybersecurity ATHENE, Germany

  32. Physical Analogue Kolmogorov-Arnold Networks based on Reconfigurable Nonlinear-Processing Units

    Feb 7, 2026Manuel Escudero, Mohamadreza Zolfagharinejad, Sjoerd van den Belt +2Kolmogorov-Arnold NetworksNeuromorphic Computing

    1NanoElectronics Group, MESA+ Institute and BRAINS Center for Brain-Inspired Computing, University of Twente, P.O. Box 217, Enschede,2026 7500 AE, The Netherlands. · 2CAESUniversity GroupofandTwente,BRAINSEnschede,Center 7500for Brain-InspiredAE, The Netherlands.Computing · Institute of Physics, University of Münster, Münster, 48149 Germany.

  33. Nonlinearity as Rank: Generative Low-Rank Adapter with Radial Basis Functions

    Feb 5, 2026Yihao Ouyang, Shiwei Li, Haozhao Wang +5Radial Basis FunctionNonlinearity

    Huazhong University of Science and Technology, Wuhan, China

  34. Linearized subspace refinement framework to expose hidden accuracy in trained neural networks

    Jan 20, 2026Wenbo Cao, Weiwei ZhangLeast SquaresSubspace

    Institute of AI for Industries, Chinese Academy of Sciences, Nanjing 211135, China · Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China · School of Aeronautics, Northwestern Polytechnical University, Xi’an 710072, China +2

  35. Test time training enhances in-context learning of nonlinear functions

    Sep 30, 2025Kento Kuwataka, Taiji SuzukiIn-Context LearningTest-Time Training

    Department of Mathematical Engineering and Information Physics The University of Tokyo Hongo 7-3-1, Bunkyo-ku, Tokyo

  36. Policy Gradient with Self-Attention for Model-Free Distributed Nonlinear Multi-Agent Games

    Sep 22, 2025Eduardo Sebastián, Maitrayee Keskar, Eeman Iqbal +3Multi-Agent Reinforcement LearningPolicy Gradient

    Department of Computer Science and Technology, University of Cambridge, UK · Department of Electrical and Computer Engineering, University of California San Diego, USA · RoPeRt group, at DIIS - I3A, Universidad de Zaragoza, Spain

  37. Breaking the Weak Recovery Limit in Random Phase Retrieval with Learned Regularizers

    Sep 18, 2025Stanislas Ducotterd, Zhiyuan Hu, Michael Unser +1Bayesian Inverse ProblemsVisual Priors

    Biomedical Imaging Group, ´Ecole Polytechnique F´ed´erale de Lausanne

  38. Non-Linear Model-Based Sequential Decision-Making in Agriculture

    Sep 2, 2025Sakshi Arya, Wentao LinSequential Decision MakingMediterranean Greenhouses

    Department of Mathematics, Applied Mathematics and Statistics, Case Western Reserve University, Cleveland, OH 44106, USA · CTrees, Pasadena, CA 91105, USA

  39. Learning thermodynamic master equations for open quantum systems

    Jun 2, 2025Peter Sentz, Stanley Nicholson, Yujin Cho +3Quantum LearningHamiltonian

    Department of Data and Decision Sciences, Emory University, Atlanta, GA 30322 · 2Division of Applied Mathematics, Brown University, Providence, RI 02912 · 3Lawrence Livermore National Laboratory, Livermore, CA 94550

  40. Tailored minimal reservoir computing: on the bidirectional connection between nonlinearities in the reservoir and in data

    Apr 24, 2025Davide Prosperino, Haochun Ma, Christoph RäthReservoir ComputingReservoir

    Ludwig-Maximilians-Universität München, Faculty of Physics, Geschwister-Scholl-Platz 1, 80539 Munich, Germany · Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institute for Frontier Materials on Earth and in Space, Linder Höhe, 51147 Cologne, Germany

  41. Bridging Neural Networks and Wireless Systems with MIMO-OFDM Semantic Communications

    Jan 28, 2025Hanju Yoo, Dongha Choi, Yonghwi Kim +4Orthogonal Frequency-Division MultiplexingSemantic Communications

    School of Integrated Technology, Yonsei University, Seoul 03722, South Korea · Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA, USA

  42. Network Dynamics-Based Framework for Understanding Deep Neural Networks

    Jan 5, 2025Yuchen Lin, Yong Zhang, Sihan Feng +1Neural NetworkDeep Learning

    Department of Physics, Xiamen University, Xiamen 361005, China · 2Lanzhou Center for Theoretical Physics, Lanzhou University, Lanzhou 730000, China · 3Shenzhen Angel FOF Management Co., Ltd., Shenzhen 518000, China

  43. A Generalization Bound for Nearly-Linear Networks

    Jul 9, 2024Eugene GolikovGeneralization BoundsNonlinearity

    Chair of Statistical Field Theory École Polytechnique Fédérale de Lausanne (EPFL)

  44. On Universality of Non-Separable Approximate Message Passing Algorithms

    Date pendingMax Lovig, Tianhao Wang, Zhou FanApproximationMessage Passing Neural Networks

    Department of Statistics and Data Science, Yale University · Halicioglu Data Science Institute, University of California, San Diego