Entropy

Ask about this topic

Momentum

6 papers in the last four weeks, up 20% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 96

All topics
CardsList

  1. Auditing Routing Entropy as an Uncertainty Signal in Attention-Residual Transformers

    Oct 1, 2026Wenhao Liang, Lin Yue, Wei Emma Zhang +3Transformer Residual StreamsModel Auditing

    Adelaide University, Adelaide, Australia

  2. No Model Required: Text Entropy Rate Filtering Mitigates Iterative Fine-Tuning Collapse

    Oct 1, 2026Lewis MitchellCollapseToken-Level Entropy

    Adelaide Data Science Centre School of Mathematical Sciences Adelaide University Adelaide SA 5005, Australia

  3. Scaling and Distilling Text Embeddings for Better Diffusibility

    Oct 1, 2026Zekai Zhang, Yunjie Tian, Yanjin He +4Diffusion Language ModelsText Embeddings

    University of Michigan

  4. Kinematic signatures of impairment: Detecting alcohol intoxication in e-scooter riders using sensor data and machine learning

    Sep 29, 2026Rahul Rajendra Pai, Marco Dozza, Alexander Rasch +2Bivariate Bicycle CodesAccelerometer Data

    Chalmers University of Technology, Division of Vehicle Safety, Department of Mechanical Engineering, Gothenburg, Sweden · Voi Technology AB, Stockholm, Sweden

  5. Massively Parallel Reinforcement Learning with a Chaotic Reconfigurable Clockless Chip

    Sep 28, 2026Eric Oliveira-Gomes, Damien RontaniChip DesignChaos

    CentraleSup´elec and Universit´e de Lorraine, LMOPS UR4423 Laboratory, Metz F-57070, France

  6. Entropy-aware logistic regression for fusion of large-scale speaker recognition systems

    Sep 20, 2026Pierre-Michel Bousquet, Mickael RouvierSpeakerEntropy

    LIA, Avignon University, France

  7. Route, Don't Fix: Regime-Dependent Decoding Correction and a Trajectory-Gated Router for Reliable Clinical LLM Answer Selection

    Sep 13, 2026Zeyu Dong, Benjamin Wang, Joyee W. JinLarge Language Model ResponsesCorrection

    St. Theresa of Lisieux Catholic High School Toronto, Canada · Department of Computer Science University of Toronto Toronto, Canada

  8. Phases in a class of associative memories via hidden neurons

    Sep 11, 2026Toshihiro Ota, Masato TakiHopfield NetworksNeurons

    CyberAgent AI Lab, Shibuya, Tokyo 150–0002, Japan · RIKEN iTHEMS, Wako, Saitama 351–0198, Japan · Graduate School of Artificial Intelligence and Science, Rikkyo University, Toshima, Tokyo 171–8501, Japan

  9. Tensor network representations of discrete maximum entropy distributions via mean polytopes

    Sep 7, 2026Alex Goessmann, Martin EigelTensor NetworksPolytopes

    Weierstrass Institute of Applied Analysis and Stochastics Anton-Wilhelm-Amo-Straße 39 Berlin, 10117, Germany

  10. Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM Teachers

    Sep 1, 2026Giovanni Bonetta, Matteo Merler, Davide Zago +2Recent Vision-Language ModelsEntropy

    Department of Computer Science, University of Torino, Torino, Italy · Natural Language Processing Unit, Fondazione Bruno Kessler, Trento, Italy

  11. ConCA: Concentration-Aware Channel Attention for Fine-Grained Visual Recognition

    Aug 31, 2026Yu-Sheng Liu, Yu-Chen TungConvolutional Block Attention ModuleFine-Grained Perception

    Department of Physics, National Kaohsiung Normal University, Kaohsiung, 824, Taiwan

  12. ERR+: Sequential Entropy Resolution for Efficient and Decisive LLM Reasoning

    Aug 28, 2026Xin Jiang, Minhao Wang, Wen Wu +4LLM Reasoning StrategiesLarge Reasoning Models

    School of Computer Science and Technology, East China Normal University, Shanghai 200241, China · State Key Laboratory of Estuarine and Coastal Research, School of Computer Science and Technology, East China Normal University, Shanghai 200241, China

  13. Basins of Attraction to Multiple Fixed Points in Discrete-time Hysteresis Neural Networks

    Aug 24, 2026Yuta Arai, Seigo Nakamura, Ryoga Nakamura +2BasinFixed-Point Iteration

    Hosei University, Koganei, Tokyo, Japan

  14. Wasserstein Policy Gradient for Entropy-Regularized Linear-Quadratic Control

    Aug 7, 2026Zhaoyu Zhu, Rui Gao, Shuang LiEntropy Regularized Reinforcement LearningLinear Quadratic Regulator

    University of Illinois Urbana-Champaign · The University of Texas at Austin · The Chinese University of Hong Kong, Shenzhen

  15. An entropic explanation of insistence on sameness in autism

    Aug 5, 2026Przemysław ŚliwińskiAutism Spectrum DisorderEntropy

    Faculty of Information and Communication Technology, Wrocław University of Science and Technology, Wrocław, Poland.

  16. Learning Compression Rules for Network Traffic

    Aug 5, 2026Quentin Lampin, Éloi Sainte-Beuve, Louis-Adrien Dufrène +2Network TrafficData Compression Methods

    Orange Research · 1Orange Research · Université Grenoble Alpes +1

  17. Why Formal Monitors Fail: Attack Distribution Entropy as a Coverage Bound for LTL-Based LLM Agent Safety

    Aug 2, 2026Ruiyang ZhangLarge Language Model SafetyRuntime Safety Filtering

    Ryonix Labs Inc. Flock.io

  18. EntropyMoE: Entropy-Aware Sparse Expert Routing for Tokenizer-Free LLMs

    Jul 31, 2026Bo Liu, Muxuab Yu, Yu Zhang +2ExpertsEntropy

    University of Bristol · School of Automation Science and Electrical Engineering,Beihang University, Beijing, China · University of Manchester

  19. Explore Beyond the Boundary Using Entropic Information

    Jul 31, 2026Bumgeun Park, Donghwan LeeExplorationEntropy

    Korea Advanced Institute of Science and Technology, Daejeon 34051, Korea

  20. NMINE: Normalized Mutual Information Neural Estimation

    Jul 30, 2026Petra Eerikinharju, Marko Tuononen, Ville HautamäkiMutual InformationEntropy

    University of Eastern Finland

  21. Anti-Backdoor Coreset Selection via Cumulative Entropy

    Jul 28, 2026Qi Zhao, Christian WressneggerModel-Agnostic DefenseGeometry-Aware Uncertainty Coresets

    KASTEL Security Research Labs, Karlsruhe Institute of Technology (KIT)

  22. Codebook Capacity Governs Perceptual Quality Across Resolutions in Hierarchical Discrete Video Compression

    Jul 25, 2026Manikanta Kotthapalli, Banafsheh RekabdarVideo CompressionCodebooks

    Department of Computer Science Portland State University Portland, OR 97201

  23. The Curvature Shadow: An Apparent Failure of Maximum-Entropy Equilibrium Selection is a Removable Artifact

    Jul 20, 2026Luis LealNash EquilibriumEntropy

  24. Calibrated Alzheimer's Conversion Risk in Mild Cognitive Impairment: Persistent Homology of Clinical Trajectories with Conformal Guarantees

    Jul 20, 2026Navin BondadeMild Cognitive ImpairmentAlzheimer

    Institute of Health Informatics, University College London

  25. How Much Human Label Variation Does Formal Semantic Structure Explain?: Group-Level Effects and Item-Level Ceilings in NLI

    Jul 17, 2026Haram ChoiNatural Language InferenceInterpretation

    University of Bremen

  26. Subgrid-Scale Parameterization in Burgers' Equation Using Structure-Preserving Neural Networks and Entropy Variables

    Jul 16, 2026Aijaz Nazir, Ilya TimofeyevNeural NetworkReduced-Order Models

    Dept. of Mathematics, University of Houston, Houston, TX 77204

  27. Information-Theoretic Adaptive Cooling for Deterministic MPPI via Entropy Feedback

    Jul 15, 2026Shuqi Wang, Wenrong Sun, Tao Han +2Model Predictive Path IntegralOptimal Control

    School of Automation & Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China · Department of Physics, The Hong Kong University of Science and Technology, Hong Kong S.A.R., China

  28. Watermark Forensics for Generative Models: An Information-Theoretic Perspective

    Jul 14, 2026Xiaoyu Li, Zheng Gao, Xiaoyan Feng +3WatermarksMulti-Bit Watermarking

    University of New South Wales · 2Griffith University

  29. Code-MUE: Measuring Code LLMs' Uncertainty through Execution-based Semantic Interaction Graphs

    Jul 14, 2026Xiaoning Ren, Yinxing Xue, Lei Ma +1Large Language Model UncertaintyInput Uncertainties

    Xi’an Jiaotong University, China · Institute of AI for Industries, Chinese Academy of Sciences, China · The University of Tokyo, Japan +1

  30. Entropy in Semantic Memory Navigation in Blind and Sighted Individuals: The Effect of Visual Experience

    Jul 13, 2026Felipe D. Toro-Hernández, Rodrigo Lagos, Sergio E. ChaigneauSpatial BlindnessSensorimotor Experience

    Graduate Program in Neuroscience and Cognition, Federal University of ABC (UFABC) · Center for Social and Cognitive Neuroscience, Universidad Adolfo Ibáñez, Santiago, Chile

  31. Requential Coding: Pushing the Limits of Model Compression with Self-Generated Training Data

    Jul 13, 2026Shikai Qiu, Marc Finzi, Yujia Zheng +2Data Compression MethodsCodebooks

    New York University · Carnegie Mellon University

  32. Evaluating Nonuniform Dependability Across Response Conditions: A Conditional Generalizability Framework Illustrated in Automated Essay Scoring

    Jul 13, 2026Yi GuiAutomated Essay ScoringScoring

    Measurement Incorporated

  33. Mirror Horizon: Viable Path Entropy as a Measure of Bounded Reflection

    Jul 11, 2026Tiantian ZhangReflectionsReasoning Paths

    Crystal · Department of Computer Science, Columbia University

  34. Eigenvalue Calibration for Semantic Embeddings of Large Language Models

    Jul 9, 2026Sebastian G. Gruber, Nassim Walha, Francis Bach +1Large Language Model UncertaintyUncertainty Quantification

    1ESAT-PSI, KU Leuven, Belgium · 2German Cancer Research Center (DKFZ), Heidelberg, Germany · 3German Cancer Consortium (DKTK), Germany +3

  35. EntroPath: Maximum Entropy Path Ensemble Embedding for Manifold Learning

    Jul 7, 2026Przemysław RolaGeodesicEntropy

    Department of Mathematics, Krakow University of Economics

  36. Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropy

    Jul 6, 2026Jingyun Zhang, Hao Peng, Jianxin Li +2Graph Representation LearningContrastive Learning

    Beihang University Beijing, China · Hangzhou Innovation Institute, Beihang University Hangzhou, China · University of Illinois at Chicago Chicago, USA

  37. Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios

    Jun 28, 2026Wongi Park, Jiyeon Lim, Minjae Lee +6Neural Mask EstimationDynamic 3D Gaussian Splatting

    1Ajou Univerity · 2Samsung Electronics · 3Georgia Institute of Technology +5

  38. Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy

    Jun 28, 2026Ramakrishna Appicharla, Baban Gain, Santanu Pal +1Machine Translation QualityTranslation Quality

    Department of Computer Science and Engineering, Indian Institute of Technology Patna, India · 2Wipro AI Lab45, Bengaluru, India

  39. SEAD: Competence-Aware On-Policy Distillation via Entropy-Guided Supervision

    Jun 26, 2026Chia-Hsuan Lee, Zelei Cheng, Yu Wang +4CurriculumEntropy

    Capital One

  40. GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

    Jun 24, 2026Chaoxiang Cai, Minghe Weng, Jie Li +4Mixture-Of-Experts Large Language ModelsLarge Language Model Routing

    School of Software Technology, Zhejiang University · College of Computer Science and Technology, Zhejiang University

  41. Sample complexity of unbalanced entropic OT

    Jun 23, 2026Francisco Andrade, Gabriel Peyré, Clarice PoonOptimal Transport ApproachOptimal Sample Complexity

    INRIA (PreMeDICaL & HeKA) · INRIA · CNRS and ENS, PSL Universit´e +1

  42. DART: Draft-Agreement Routing for Training-Free Adaptive Thinking Budgets in Hybrid Reasoning Models

    Jun 22, 2026Jungseob Lee, Seongtae Hong, Seungjun Lee +7Large Reasoning ModelsAgreement

    Korea University · 242dot · Konkuk University +3

  43. Learning Graphs through Continuous Information Entropy Fields

    Jun 22, 2026Hui Cong, Bo Sun, Ziheng Jiao +1Graph Representation LearningGraph Neural Networks

    School of Information Engineering, Chang’an University, Shaanxi, Xi’an, China · AUTHORERR: Missing \icmlaffiliation.

  44. Entropy Objectives in Markov Decision Processes

    Jun 19, 2026S. Akshay, Raghav Goyal, Aditya Neeraje +1Markov Decision ProcessesEntropy

    Indian Institute of Technology Bombay, Mumbai, India. · Tata Institute of Fundamental Research, Mumbai, India.

  45. Geometric Entropy: When Trajectory Diversity Helps and Hurts in Imitation Learning

    Jun 18, 2026Qian Luo, Ruizhe Liu, Pei Zhou +2Imitation LearningEntropy

    InfoBodied AI Lab, The University of Hong Kong. · Transcengram.

  46. On the Entropy Formula for Real, Complex, and Quaternionic Deep Linear Networks

    Jun 15, 2026Luis Contreras, Marco Nahas, Tejas KotwalDeep NetworkEntropy

  47. No Accidental Software Agent First Canonical Code for Human Code Entropy Reduction and 30 to 500 times Lower Frontier Model Requirements

    Jun 12, 2026Jepson TaylorCoding AgentsFrontier Models

    NeverHuman Research

  48. Advancing the State-of-the-Art in Empirical Privacy Auditing

    Jun 9, 2026Nicole Mitchell, Galen Andrew, Arun Ganesh +2PrivacyModel Auditing

    Google Research San Francisco, CA · Google Research Seattle, WA

  49. PAEC: Position-Aware Entropy Calibration for LLM Reasoning in RLVR

    Jun 7, 2026Shumeng Yang, Yisu Liu, Jiayi Zheng +2Reinforcement Learning With Verifiable RewardToken-Level Entropy

    Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · School of Artificial Intelligence, Beijing University of Posts and Telecommunications +2

  50. Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development

    Jun 5, 2026Zixi Li, Youzhen LiDiffusion ModelsEntropy

    Sun Yat-sen University · Datawhale

  51. Learning Multi-Agent Communication Protocol: Study on Information Entropy Efficiency in MARL

    Jun 5, 2026Xinren Zhang, Zixin Zhong, Jiadong YuMulti-Agent Reinforcement LearningEntropy

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China

  52. αα-PFN: Fast Entropy Search via In-Context Learning

    Jun 5, 2026Herilalaina Rakotoarison, Steven Adriaensen, Tom Viering +4Bayesian OptimizationSearch Algorithms

    University of Helsinki · University of Freiburg · Delft University of Technology +2

  53. Hybrid Adversarial Defence for Natural Language Understanding Tasks

    Jun 3, 2026Manar Abouzaid, Yang Wang, Chenghua Lin +1Attacker Large Language ModelLLM Defense Mechanisms

    School of Electronics and Computer Science, University of Southampton, UK · Department of Computer Science, University of Manchester, UK

  54. Integrating Local and Global Entropy for Uncertainty Quantification in LLMs

    Jun 2, 2026Johanne Medina, Tianyi Zhou, Keivin Isufaj +2Large Language Model UncertaintyUncertainty Quantification

    Qatar Computing Research Institute, HBKU Doha, Qatar · KTH Royal Institute of Technology Stockholm, Sweden

  55. Entropy Is Not Enough: Unlocking Effective Reinforcement Learning for Visual Reasoning via Vision-Anchored Token Selection

    Jun 2, 2026Senjie Jin, Peixin Wang, Boyang Liu +8Visual ReasoningOffline Reinforcement Learning

    College of Computer Science and Artificial Intelligence, Fudan University

  56. Torus Graphs for Large Scale Neural Phase Analysis

    May 30, 2026Jack Goffinet, Casey Hanks, David E. CarlsonOscillatory DynamicsEntropy

    Department of Computer Science, Duke University, Durham NC, USA · Departments of Civil and Environmental Engineering; Biostatistics and Bioinformatics; and Electrical and Computer Engineering, Duke University, Durham NC, USA

  57. On Revisiting Entropy for Identifying Mislabeled Images

    May 29, 2026Chunlei Li, Zixuan Zheng, Yilei Shi +5Medical Imaging DatasetsDeep Network

    MedAI Technology (Wuxi) Co. Ltd., Wuxi, China · Sichuan University, Chengdu, China · University of Basel, Allschwil, Switzerland +1

  58. Functional Entropy: Predicting Functional Correctness in LLM-Generated Code with Uncertainty Quantification

    May 27, 2026Dylan Bouchard, Mohit Singh Chauhan, Zeya Ahmad +1Code GenerationLarge Language Model Generation

    CVS Health®, Wellesley, MA, USA

  59. Entropy Distribution as a Fingerprint for Hallucinations in Generative Models

    May 27, 2026Mattia J. Villani, Pranav Deshpande, Akshay Seshadri +2Large Language Model HallucinationHallucination Detection

    Global Technology Applied Research, JPMorganChase, New York, NY 10001, USA

  60. Cyclical Entropy Eruption: Entropy Dynamics in Agent Reinforcement Learning

    May 27, 2026Wendi Li, Shawn Im, Sharon LiAgentic Reinforcement LearningOffline Reinforcement Learning

    Department of Computer Sciences, University of Wisconsin–Madison