Overview

Fisher information measures how much observable data or predictions change when parameters change, giving a geometric view of sensitivity and uncertainty. In machine learning, researchers use Fisher matrices and approximations such as diagonal or Kronecker-factored forms for continual-learning methods like elastic weight consolidation, model compression, fine-tuning, robustness analysis, and data selection. Related work studies quantum Fisher information, where measurement choices affect how much information about a quantum state is accessible, as well as uses in sampling and causal discovery. A central challenge is making these measures computationally tractable while understanding when their estimates reflect meaningful importance: results can depend on the data, model, readout, and whether sensitivity is measured locally or across a training trajectory.

Latest papers

CardsList

26 papers4 papers in the last four weeks, down 43% on the four weeks before. 0.0% of all new papers.

  1. Fisher-Glass Learning: Classification Bounds and Subpopulation Audits

    Nov 9, 2026El Mustapha MansouriLearning with Distribution ShiftSubgroup Robustness

  2. Beyond Parameter Protection: Fisher-Shaped EWC for Replay-Free Continual Learning

    Oct 27, 2026Liying Wang, Simone Magistri, Joost van de WeijerElastic Weight ConsolidationRegularization-Based Continual Learning

  3. Lower expected Fisher rank implies better PAC generalization

    Oct 23, 2026Marco Miani, Albert Kjøller Jacobsen, Albert Lopez i Serrano +2Neural Network GeneralizationPAC-Bayesian Generalization Bounds

  4. FisherEdit: Fisher Information Guided Knowledge Editing for Large Language Models

    Oct 19, 2026Yizhou Yang, Jiahong Fu, Zhiwu Wang +6Sequential Knowledge EditingKnowledge Editing

  5. Fisher information and the geometry of memorization in neural networks

    Oct 12, 2026Daniel T. Bernstein, Chase Goddard, Luca Di Carlo +2Neural Network MemorizationNeural Network Generalization

  6. What Does the Effective Dimension of a Hybrid Quantum Neural Network Actually Measure?

    Oct 7, 2026Md Masum Mia, Amith Khandakar, Mohamed Arselene AyariQuantum Neural NetworksHybrid Quantum-Classical ML

  7. Local Fisher Information Enables Sparse Causal Discovery

    Oct 3, 2026Byeongguk Kang, Donghyeon Lee, Euijong Song +1Causal DiscoveryFisher Information

  8. Fisher-Guided Submodular Data Selection for Continual Pre-Training of Large Language Models

    Oct 1, 2026Zhenghao Zhao, Gaowen Liu, Zhiling Lan +1Continued PretrainingCatastrophic Forgetting

  9. Predictive Geometry of Hidden Trajectories in Transformers

    Sep 29, 2026Timur Mudarisov, Mikhail Burtsev, Tatiana Petrova +1Decoder-Only Language ModelsRepresentation Geometry in Language Models

  10. Understanding LLM Parameter Update Sparsity through the Lens of Fisher

    Sep 28, 2026Yufan Zhang, Sagnik Mukherjee, Hao PengNeural Network Training DynamicsSparse Fine-Tuning

  11. Fisher Simplicity in Kolmogorov-Arnold Networks and Multilayer Perceptrons

    Sep 26, 2026Ami Tavory, Meir FederNeural Network InterpretabilityKolmogorov-Arnold Networks

  12. Shot noise can decide capacity comparisons of quantum models

    Sep 13, 2026Pavel Sulimov, Claude LehmannFisher InformationVariational Quantum Circuits

  13. Task-Resolved Fisher Spectroscopy for Quantum Reservoir Computing

    Aug 26, 2026Yang PengReservoir ComputingQuantum Reservoir Computing

  14. Loss-Parameterized Fisher Width Along Learning Trajectories

    Aug 21, 2026Vu Khac KyFisher InformationNeural Network Training Dynamics

  15. Rethinking Quantum Continual Learning with Quantum Fisher Information

    Jul 17, 2026Yu-Chao Hsu, Yu-Cheng Lin, Tai-Yue Li +2Quantum Machine LearningVariational Quantum Circuits

  16. Fisher Rank Inflation: A Spectral Signature of Memorization under Label Noise

    Jul 14, 2026Satwik Bathula, Anand A. JoshiNeural Network MemorizationNoisy-Label Learning

  17. Spectral Perturbation of the Empirical Fisher Information Matrix under Weight Quantization

    Jun 26, 2026Rahid Zahid Alekberli, Hikmat KarimovInformation GeometryWeight-Only Quantization

  18. Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers

    Jun 15, 2026Sourya Sengupta. Mark A. AnastasioNeural Network InterpretabilityMedical Image Classification

  19. Fisher-Guided Progressive Parameter Selection for Adaptive Fine-Tuning

    Jun 8, 2026Ghodsiyeh Rostami, Po-Han Chen, Mahdi S. HosseiniFine-TuningVision Foundation Model Adaptation

  20. Measuring Model Robustness via Fisher Information: Spectral Bounds, Theoretical Guarantees, and Practical Algorithms

    Jun 3, 2026Chong Zhang, Xiang Li, Jia Wang +3Neural Network RobustnessAdversarial Robustness

  21. Complexity of Non-Log-Concave Sampling in Fisher Information

    May 15, 2026Sinho Chewi, Andre WibisonoOracle ComplexityProximal Sampling

  22. Beyond Activation Alignment: The Geometry of Neural Sensitivity

    May 4, 2026Amirhossein Yavari, Farnaz Zamani EsfahlaniNeural Representation GeometryNeural Decoding

  23. Elastic Weight Consolidation Done Right for Continual Learning

    Mar 19, 2026Xuan Liu, Xiaobin ChangRegularization-Based Continual LearningContinual Learning

  24. Personalized Federated Learning with Residual Fisher Information for Medical Image Segmentation

    Mar 16, 2026Meilu Zhu, Yuxing Li, Zhiwei Wang +1Federated LearningHeterogeneous Federated Learning