Activation Functions

Recent momentum

-45%

6 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

5 new papers

A weekly snapshot of new work published in Activation Functions.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Activation Functions.

92 papers

Latest in Activation Functions

Open your feed →
CardsList
  1. The Boolean Power of ReLU

    Aug 12, 2026Pablo Barceló, Floris Geerts, Matthias Lanzinger +2Rectified Linear UnitActivation Functions

  2. Motif 3: Technical Report

    Aug 10, 2026Junghwan Lim, Joon Son Chung, Sungmin Lee +24Mixture-Of-Expert Language ModelsContext Length

  3. Rethinking Neural Nonlinearity as Gating

    Jul 3, 2026Muhammad Sabih, Frank Hannig, Jürgen TeichActivation FunctionsDiscontinuous Gating

  4. Singular Learning and Occam's Razor in Deep Monomial Networks

    Jun 26, 2026Kathlén Kohn, Giovanni Luca Marchetti, Farhan Shabir +2Activation FunctionsDeep Neural Network

  5. Effects of sparsity and superposition on loss in simple autoencoders

    Jun 16, 2026Mriganka Basu Roy Chowdhury, Eric McLaughlin WeinerSuperpositionAutoencoder

  6. Fermi-Dirac machines as quantizations of neurons

    May 23, 2026Alexander He, Nana Liu, Mark M. WildeQuantum ComputingHamiltonian

  7. ArcGate: Adaptive Arctangent Gated Activation

    May 14, 2026Avik Bhattacharya, Siddhant Dnyanesh Gole, Subhasis Chaudhuri +2Activation FunctionsRemote Sensing