Inductive Bias

Follow this topic Ask about this topic

Momentum

20 papers in the last four weeks, up 186% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 158

All topics

Phylogenetic Tree Inference with Tropical Axial Attention
May 12, 2026Chris Teska, Kurt Pasque, Ruriko Yoshida +1Phylogenetic Inference Inductive Bias
In this work, we introduce a Tropical Axial Attention neural reasoning architecture...
A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapse
May 11, 2026Atul Ganju, Travis McVoy, Shaddin Dughmi +1Deadlines Inductive Bias
University of Southern California
PhysEDA: Physics-Aware Learning Framework for Efficient EDA With Manhattan Distance Decay
May 11, 2026Zetao YangElectronic Design Automation Physics-Aware Models
School of Mathematics and Statistics Beijing Institute of Technology Beijing, China
Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice
May 11, 2026Jinwoo Lee, Jiwoo Kim, Woojae Shin +2Point Clouds Robust Geometric Model Estimation
Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea · Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu, Republic of Korea
SSDA: Bridging Spectral and Structural Gaps via Dual Adaptation for Vision-Based Time Series Forecasting
May 10, 2026Mingrui Zhang, Hanchen Yang, Wengen Li +4Time Series Forecasting Spatial Encoding
Continuity Laws for Sequential Models
May 8, 2026Annan Yu, Dongwei Lyu, N. Benjamin ErichsonSequence Modeling Replay-Based Continual Learning
Center for Applied Mathematics, Cornell University · University of California, Berkeley · Lawrence Berkeley National Laboratory +1
Have Graph -- Will Lift? The Case for Higher-Order Benchmarks
May 8, 2026Bastian RieckHigher-Order Structures Multi-Turn Benchmark
AIDOS Lab, University of Fribourg, Switzerland · Institute of AI for Health, Helmholtz Munich, Germany
No Triangulation Without Representation: Generalization in Topological Deep Learning
May 7, 2026Johannes S. Schmidt, Martin Carrasco, Ernst Röell +3Triangulations Data Manifold
Dept. of Math. & Statistics University of Montréal Montréal, Canada · Dept. of Informatics University of Fribourg Fribourg, Switzerland
Geometric Kolmogorov--Arnold Network (GeoKAN)
May 7, 2026Abhijit Sen, Bikram Keshari Parida, Giridas Maiti +2Kolmogorov-Arnold Networks Geometry-Aware
Department of Physics and Engineering Physics, Tulane University, New Orleans, Louisiana 70118, USA. · Institute of Applied Geosciences, Karlsruhe Institute of Technology, Karlsruhe 76131, Germany.
In-Context Black-Box Optimization with Unreliable Feedback
May 7, 2026Nicolas Samuel Blumer, Julien Martinelli, Samuel KaskiBlack-Box Optimization Bayesian Optimization
ELLIS Institute Finland · Aalto University · University of Manchester
BoostLLM: Boosting-inspired LLM Fine-tuning for Few-shot Tabular Classification
May 7, 2026Yi-Siang Wang, Kuan-Yu Chen, Yu-Chen Den +1Large Language Model Fine-Tuning Gradient Boosted Decision Tree
SinoPac Holdings
Understanding diffusion models requires rethinking (again) generalization
May 7, 2026Pierre Marion, Yu-Han WuOverfitting Diffusion Models
Inria, École Normale Supérieure, PSL Research University · LPSM, Sorbonne University & Google DeepMind
Multi-Level Bidirectional Biomimetic Learning for EEG-Based Visual Decoding
May 6, 2026Jingtao Liu, Peiliang Gong, Chuhang Zheng +2Human Visual Cortex Inductive Bias
Department of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, Nanjing, China · Department of Electrical and Information Engineering, Tianjin University, Tianjin, China
Intervention Complexity as a Canonical Reward and a Measure of Intelligence
May 4, 2026Brendan McCaneGeneral Intelligence Intelligence
School of Computing University of Otago Dunedin, New Zealand
Structured Diffusion Bridges: Inductive Bias for Denoising Diffusion Bridges
May 3, 2026Eitan Kosman, Gabriele Serussi, Chaim BaskinDiffusion Bridges Cross-Modal
Ben-Gurion University of the Negev, Israel.
Graph World Models: Concepts, Taxonomy, and Future Directions
Apr 30, 2026Jiawei Liu, Senqiao Yang, Mingjun Wang +2World Models Inductive Bias
The Chinese University of Hong Kong, Hong Kong, China · Tsinghua University, Beijing, China
Decoupling the Benefits of Subword Tokenization for Language Model Training via Byte-level Simulation
Apr 29, 2026Théo Gigant, Bowen Peng, Jeffrey QuesnelleSubword Tokenization Large Language Model Pretraining
Nous Research
What Kind of Language is Easy to Language-Model Under Curriculum Learning?
Apr 29, 2026Nadine El-Naggar, Tatsuki Kuribayashi, Ted BriscoeLanguage Acquisition Typology
Mohamed bin Zayed University of Artificial Intelligence
Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective
Apr 25, 2026Bishwamittra Ghosh, Soumi Das, Till Speicher +5Large Language Model Fine-Tuning In-Context Learning
Max Planck Institute for Software Systems, Germany · Boston University, USA
Insect-inspired modular architectures as inductive biases for reinforcement learning
Apr 23, 2026Anne E. StaplesBio-Inspired Framework Predator-Prey Models
Department of Mechanical Engineering, Virginia Tech, Blacksburg, Virginia 24061, USA
Directional Confusions Reveal Divergent Inductive Biases Through Rate-Distortion Geometry in Human and Machine Vision
Apr 23, 2026Leyla Roksan Caglar, Pedro A. M. Mediano, Baihan LinInductive Bias Visual Perception
Windreich Department of AI and Human Health Icahn School of Medicine at Mount Sinai New York, NY, USA · Department of Computing Imperial College London London, UK · Windreich Department of AI and Human Health Department of Psychiatry Icahn School of Medicine at Mount Sinai New York, NY, USA
Locating acts of mechanistic reasoning in student team conversations with mechanistic machine learning
Apr 23, 2026Kaitlin Gili, Mainak Nistala, Kristen Wendell +1Mechanistic Interpretability Large Reasoning Models
Department of Computer Science, Tufts University, Medford, MA, U.S.A. · Departments of Mechanical Engineering and Education, Tufts University, Medford, MA, U.S.A.
SpatiO: Adaptive Test-Time Orchestration of Vision-Language Agents for Spatial Reasoning
Apr 23, 2026Chan Yeong Hwang, Miso Choi, Sunghyun On +2Spatial Reasoning Multi-Agent Reasoning
Korea University · Handong Global University · Kakao Mobility Corp.
Decentralized Machine Learning with Centralized Performance Guarantees via Gibbs Algorithms
Apr 22, 2026Yaiza Bermudez, Samir M. Perlaza, Iñaki EsnaolaDecentralized Learning Gibbs
Centre Inria d'Université Côte d'Azur, INRIA, Sophia Antipolis, France. · Laboratoire GAATI, Université de la Polynésie française, Fa'a'ā, French Polynesia. · ECE Dept. Princeton University, Princeton, 08544 NJ, USA. +1
LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction
Apr 22, 2026Enshuai Zhou, Yifan Hao, Chao Wang +7Key-Value Cache Compression Large Language Model Compression
University of Science and Technology of China, Hefei, China · State Key Lab of Processors, Institute of Computing Technology, CAS, Beijing, China · University of Chinese Academy of Sciences, Beijing, China
DSAINet: An Efficient Dual-Scale Attentive Interaction Network for General EEG Decoding
Apr 20, 2026Zhiyuan Ma, Zeyuan Li, Zihao Qiu +6Electroencephalography Neuroscience
School of Biomedical Engineering, Tsinghua Laboratory of Brain and Intelligence, and IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, China · School of Basic Medical Sciences and Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China · Department of Psychological and Cognitive Sciences, Tsinghua University, Beijing 100084, China +1
Diverse Dictionary Learning
Apr 19, 2026Yujia Zheng, Zijian Li, Shunxing Fan +2Unsupervised Dictionary Learning Identifiability
CMU · MBZUAI · NYU
Anomaly detection in time-series via inductive biases in the latent space of conditional normalizing flows
Mar 12, 2026David Baumgartner, Eliezer de Souza da Silva, Iñigo UrteagaTime-Series Anomaly Detection Multivariate Time-Series
Department of Computer Science, Norwegian University of Science and Technology, Norway · BCAM — Basque Center for Applied Mathematics, Spain · Department of Informatics Engineering, University of Coimbra, Portugal +2
Distributional Regression with Tabular Foundation Models: Evaluating Probabilistic Predictions via Proper Scoring Rules
Mar 9, 2026Jonas Landsgesell, Pascal Knoll, Tizian WenzelTabular Foundation Models Distributional Information
University of Stuttgart (Stuttgart, Germany) · Ludwig Maximilian University of Munich (Munich, Germany) · Munich Center for Machine Learning (Munich, Germany)
A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
Feb 23, 2026Nicolas Anguita, Francesco Locatello, Andrew M. Saxe +4Model Fine-Tuning Feature Learning
Department of Engineering, University of Cambridge · Institute of Science and Technology, Austria (ISTA) · Gatsby Computational Neuroscience Unit and Sainsbury Wellcome Centre, UCL +1
MedFeat: Model-Aware and Explainability-Driven Feature Engineering with LLMs for Tabular Prediction
Feb 10, 2026Zizheng Zhang, Yiming Li, Justin Xu +6Feature Engineering Tabular Learning
Microsoft Research · University of Oxford
Categorize Early, Integrate Late: Divergent Processing Strategies in Automatic Speech Recognition
Jan 11, 2026Nathan Roll, Pranav Bhalerao, Martijn Bartelds +7Automatic Speech Recognition Inductive Bias
Stanford University
MauBERT: Universal Phonetic Inductive Biases for Few-Shot Acoustic Units Discovery
Dec 22, 2025Angelo Ortiz Tandazo, Manel Khentout, Youssef Benchekroun +2Self-Supervised Speech Models Articulatory
ENS, PSL Research University, EHESS, CNRS, Paris, France · Meta AI Research, France · Univ. Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, Grenoble, France
Soft Geometric Inductive Bias for Object Centric Dynamics
Dec 17, 2025Hampus Linander, Conor Heins, Alexander Tschantz +2Rigid-Body Dynamics Equivariance
VERSES AI · University of Sussex, Department of Informatics
Aligning Inductive Bias for Data-Efficient Generalization in State Space Models
Sep 25, 2025Qiyu Chen, Guozhang ChenState Space Models Inductive Bias
School of Computer Science, National Key Laboratory for Multimedia Information Processing, Peking University, China · School of Physics, Peking University, China
A Theoretical Analysis of Provable Compositional Generalization in Neural Networks: A Necessary and Sufficient Condition
May 5, 2025Yuanpeng LiCompositional Generalization Neural Network
KTO: Model Alignment as Prospect Theoretic Optimization
Feb 2, 2024Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff +2Reinforcement Learning From Human Feedback Cross-Entropy Losses
Stanford University · Contextual AI
Self-Supervised Cardiac Phase Detection via Single-Parameter Latent Orbits
Date pendingJohn Bonnici, Matthew Baugh, Aleksandra Kulbaka +3Echocardiography Cardiac
Departament of Computing, Imperial College London, UK · Friedrich–Alexander University Erlangen–Nürnberg, DE · Ultromics Ltd, Oxford, UK

May 12, 2026, q-bio.PEJ/K move · Enter open · S save

Phylogenetic Tree Inference with Tropical Axial Attention

Chris Teska, Kurt Pasque, Ruriko Yoshida, Baran Hashemi

In this work, we introduce a Tropical Axial Attention neural reasoning architecture...

Phylogenetic Inference Inductive Bias Distance

Open paper AskPDF arXiv

In this work, we introduce a Tropical Axial Attention neural reasoning architecture that replaces vanilla softmax dot-product attention with max-plus operators, inducing a piecewise-linear structure aligned with dynamic programming formulations. From multi-species sequence alignments, our model learns all possible pairwise distances and is trained using a combination of

\ell_1

and tropical symmetric distance metric losses with an ultrametric violation penalty. We leverage the well known isomorphic relationship between the space of all phylogenetic trees with

n

species and tropical Grassmannian to show that tropical attention provides a natural geometric framework for phylogenetic inference. On empirical

DS1-DS11

alignments, where true trees are unknown, the tropical model produces distance matrices that are substantially closer to their BME-induced tree metrics than the baseline models. These results suggest that tropical attention is a useful geometric inductive bias for neural phylogenetic inference, especially under distribution shift and when tree-metric consistency is important.

Momentum

Related topics

Latest papers 158