Inductive Bias

Ask about this topic

Momentum

20 papers in the last four weeks, up 186% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 158

All topics
CardsList

  1. Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

    Oct 1, 2026Nafiseh Ghoroghchian, Haipeng Zhang, Shuyi Han +2Time Series Foundation ModelsZero-Shot Forecasting

    Layer6 AI

  2. Typological Alignment of Stack-Based Language Models on Mildly Context-Sensitive Artificial Languages

    Oct 1, 2026Nadine El-Naggar, Tatsuki Kuribayashi, Ted BriscoeTypologySyntactic Structure

    Mohamed bin Zayed University of Artificial Intelligence · Tohoku University

  3. Iterative Policy Refinement through Semantic Rollout Analysis

    Oct 1, 2026Feiyu Gavin Zhu, Qi Xu, Zhifei Deng +4ImitationRollout

    Carnegie Mellon University · Meta

  4. Prototype-Rule Neurosymbolic Regularization for Rank-Constrained Tensor Neural Networks under Label Scarcity

    Sep 30, 2026Eftychios Protopapadakis, Konstantinos Makantasis, Konstantinos M. GiannoutakisRegularizationNeural Network

    Department of Applied Informatics, University of Macedonia, 156 Egnatia Street, 54636 Thessaloniki, Greece · Department of Artificial Intelligence, Faculty of Information & Communication Technology, University of Malta, Msida, Malta

  5. Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior

    Sep 30, 2026Atsuki Yamaguchi, Tatsuro Inaba, Joel Niklaus +3Large Language Model PretrainingGrammaticality

    University of Sheffield, UK · Mohamed bin Zayed University of Artificial Intelligence, UAE · Hugging Face +3

  6. Attention Function as an Intrinsic Inductive Bias: How Models' Behavior Diverges in Novel Contexts

    Sep 30, 2026Dong Gyun Kang, Megha Thukral, Kwangsoo KimTransformer AttentionDynamic Attention

    College of Computing, Georgia Institute of Technology · Department of Transdisciplinary Medicine, Seoul National University Hospital

  7. Synchronous Multi-view Neural Diffusion

    Sep 30, 2026Yongquan Shi, Weijun Huang, Yueyang Pi +3Multimodal Diffusion ModelsGlobal-Local Fusion Framework

  8. RBF-GNN: Rational Basis Functions for Pseudo-Coordinate based Graph Convolutions

    Sep 29, 2026Paweł Batorski, Abtin Pourhadi, Paul SwobodaBasis FunctionsGraph Neural Networks

    Heinrich Heine University Düsseldorf

  9. Deep kernel hedging

    Sep 28, 2026Jean-Loup Dupret, Donatien Hainaut, Edouard MotteHessianEmpirical Risk Minimization

    University of Amsterdam, Amsterdam School of Economics · ETH Zurich, Department of Mathematics, RiskLab · Université Catholique de Louvain, LIDAM–ISBA

  10. Understanding Generalization Requires Universal Induction

    Sep 28, 2026Aram Ebtekar, Marcus Hutter, Danica J. SutherlandInductive BiasInduction

    AIXI Labs · Google DeepMind & ANU · UBC & Amii

  11. ConvCue: Complementary Visual Inductive Biases for Vision-Language Models

    Sep 28, 2026Zixuan Lan, Shichu SunRecent Vision-Language ModelsVision Encoders

    The University of Chicago · University of Chinese Academy of Sciences

  12. Taming the Greeks: Option Portfolios with Inductive Biases

    Sep 27, 2026Wee Ling Tan, Stephen Roberts, Stefan ZohrenPortfolio OptimizationPortfolio Construction

    Department of Engineering Science Oxford-Man Institute of Quantitative Finance University of Oxford

  13. Geometric Inductive Biases for Semi-Supervised Equalization: The Constellation-Aware Transformer

    Sep 27, 2026Avi CaciularuChannel EstimationMultiple-Input Multiple-Output

    Google Research

  14. Benign Overfitting for General Norms and Distributions

    Sep 27, 2026Daniel Barzilai, Ohad ShamirOverfittingSpectral Norm

    Weizmann Institute of Science · University of Toronto & Vector Institute

  15. Diverse Geometries, Frozen Weights: Robust Heterogeneous Treatment-Effect Estimation via Causal Expert Ensembles

    Sep 24, 2026Ali Haghpanah Jahromi, Mohammad TaheriHeterogeneous Treatment EffectsGeometric Constraints

    Department of Electrical and Computer Engineering, University of Shiraz, Shiraz, Iran

  16. Exactness at Inference: A Representational Criterion for Out-of-Distribution Generalization

    Sep 21, 2026Filipe Marinho Rocha, Inês Dutra, Vítor Santos Costa +1Out-Of-DistributionImproved Generalization

    Faculdade de Ciências da Universidade do Porto, Porto, Portugal · INESC TEC, Campus da FEUP, Porto, Portugal · Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, Porto, Portugal +1

  17. Action-Slot: Structured Action-Centric Representation Learning for Multi-Agent Atomic Activity Understanding

    Sep 21, 2026Yu-Ho Chang, Chi-Hsi Kung, Yi-Hsuan Tsai +1Object-Centric RepresentationsFine-Grained Video Understanding

    National Yang Ming Chiao Tung University · Atmanity Inc.

  18. Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates

    Sep 12, 2026Shirong Yang, Bo Yang, Ying CaoLayoutsGenerative Processes

    School of Information Science and Technology, ShanghaiTech University, 393 Middle Huaxia Road, Pudong New Area, Shanghai, China

  19. Inductive Biases in Field-Level Cosmological Inference from Galaxy Catalogs

    Sep 8, 2026James O. Baldwin, Shy Genel, Francisco Villaescusa-NavarroCosmologyAstronomical Images

    City University of New York Graduate Center, 365 5th Ave, New York, NY 10016 · Center for Computational Astrophysics, Flatiron Institute, 162 5th Avenue, New York, NY 10010, USA · Columbia Astrophysics Laboratory, Columbia University, 550 West 120th Street, New York, NY 10027, USA +1

  20. Neither Adversarial Training Nor Purification: Emergent Adversarial Robustness from Oscillatory Predictive Learning

    Sep 8, 2026Mohammed-Yassine Habibi, Klea Ziu, Martin Takáč +1Adversarial TrainingComputer Vision

    Ecole polytechnique, IPP, France · Ecole Nationale des Ponts et Chaussées, IPP, France · Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE +1

  21. Learning Task-Specific Antibody Representations via Function-Aware Masking

    Sep 1, 2026Ayan Goel, Thomas A. Walton, Amirali AghazadehAntibodyInductive Bias

    School of Computer Science, Georgia Institute of Technology · School of Electrical and Computer Engineering, Georgia Institute of Technology

  22. Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions

    Aug 31, 2026James Crowley, Faez Ahmed, Anton van BeekPartial Differential EquationsHypothesis Class

    School of Mechanical and Material Engineering University College Dublin · Department of Mechanical Engineering Massachusets Institute of Technology

  23. TPR-Attention for Combinatorial Generalization

    Aug 31, 2026Melisa Civelekoğlu, Isabeau Prémont-SchwarzDeep Learning ArchitecturesInductive Bias

    Universit´e Laval · Institut intelligence et donn´ees · Mila – Qu´ebec Artificial Intelligence Institute

  24. M-Net: Integrating Spectral Features and Physical Field Operators into Deep Learning for Medical Image Segmentation

    Aug 12, 2026Jing Zhu, Ye Wang, Fumin WangSemi-Supervised Medical Image SegmentationU-Net

    School of Physics, Xi’an Jiaotong University, Xi’an 710049, China · University of Sydney, Sydney, NSW 2006, Australia

  25. Grid-Preserving Knowledge Distillation: Transferring Convolutional Inductive Bias to Vision Transformers under Data Scarcity

    Aug 11, 2026Junyong Choi, Cheolhyeon Park, Jaehoon ChoVision TransformerKnowledge Distillation

    Hyundai Motor Company · School of Electronics and Avionics Engineering, Korea Aerospace University

  26. Rethinking Data Efficiency in Industrial Dense Prediction: Pretraining Coherence, Not Inductive Bias, Determines ViTs Low-Data Advantage

    Aug 11, 2026Haoran Sui, Yaoyuan JiaVision TransformerFrozen Backbone

    ZTE Corporation, Shenzhen, Guangdong Province, P.R. China · The University of Hong Kong, Hong Kong SAR, P.R. China

  27. Marrying Optimal Transport and ODEs for Unified Continuous-Time 4D Reconstruction and Tracking

    Aug 10, 2026Liying Yang, Hao Mo, Jialun Liu +74D Reconstruction3D Tracking

    SCSE, Macau University of Science and Technology · The University of Queensland · Great Bay University +3

  28. Agentic Anomaly Detection with ORCA-Style Dynamic Inductive Bias Adaptation in Multimodal Wearable Time Series Data

    Aug 9, 2026Anushka Roy, Jyotirmoy Singh, Shreea Bose +1Time-Series Anomaly DetectionWearable Devices

    Department of Electrical and Electronics Engineering BITS Pilani, Hyderabad Campus · Department of Computer Science & Information Systems BITS Pilani, Hyderabad Campus · Department of Computer Science & Information Systems2026 BITS Pilani, Hyderabad Campus

  29. DoGMA: A Central-Dogma-Guided Foundation Model for Multi-Omics Alignment and Multi-Task Learning in Oncology

    Aug 8, 2026Junfei Ling, Bangzheng Pu, Bingsen Xue +3Multi-Omic IntegrationMultidisciplinary Tumor Boards

    Institute of Medical Robotics, Shanghai Jiao Tong University · Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China · Institute of Data Science, The University of Hong Kong +1

  30. Graph Machine: Exploring Edge Mechanisms as an Inductive Bias

    Aug 7, 2026Lintai HouMultiplex Graph TransformersGraph Representations

    Iter Labs

  31. Mask-Based Priors Are More Persistent than Query-Key Initializations

    Aug 1, 2026Mingze Ma, Hemanth Saratchandran, Cameron Gordon +1Transformer ArchitecturesMask2Former

    Australian Institute for Machine Learning · Adelaide University

  32. Conservation laws determine what physical learning remembers

    Jul 30, 2026Bijaya DangolUncoupled LearningInductive Bias

    1Independent researcher

  33. TopoFormer: Topology Meets Attention for Graph Learning

    Jul 30, 2026Md Joshem Uddin, Astrit Tola, Cuneyt Gurcan Akcora +1Graph Representation LearningTopology

    Department of Mathematical Science The University of Texas at Dallas Richardson, TX 75080, USA · Department of Mathematics Florida State University Tallahassee, FL 32306, USA · AI Initiative University of Central Florida Orlando, FL 32816, USA

  34. Inverse Learning of Latent Risk-Neutral Densities from Irregular Option Quotes

    Jul 29, 2026Lennon J. Shikhman, Michael Galarnyk, Aadi Dash +1Mathematical FinanceInductive Bias

    School of Computer Science Georgia Institute of Technology USA

  35. Journey Operators for Structured Multi-Axis Composition

    Jul 29, 2026Mahesh GodavartiRotary Position EmbeddingRelative Position

    A Carrot, Inc

  36. Shape-Based Inductive Bias for Glioma Grading from Tumor Contours

    Jul 27, 2026Puneet Velidi, Michelle F. Miranda, Farouk Nathoo +2GliomaMultiple Instance Learning

    Department of Mathematics and Statistics University of Victoria · Department of Computer Science University of Victoria · D´epartement de math´ematiques Universit´e du Qu´ebec `a Montr´eal

  37. Grounding latent algorithm routing in transformer reasoning

    Jul 27, 2026Xiangbo Zhang, Xiaoxu MaTransformer ArchitecturesLarge Language Model Routing

    Georgia Institute of Technology

  38. 3D-Aware VLMs with Implicit and Explicit Geometries

    Jul 23, 2026Wenhao Li, Xueying Jiang, Quanhao Qian +43D Spatial Reasoning3D Object Detection

    1Nanyang Technological University · 2DAMO Academy, Alibaba Group · 3HuPan Lab +1

  39. GLAM-SLAM: Real-time Gaussian Large-scale Mapping via Flow Densification and Spatial Decomposition

    Jul 23, 2026Panagiotis Mermigkas, Argyris Manetas, Petros MaragosGaussian Splatting Simultaneous Localization And Mapping SystemsSimultaneous Localization And Mapping

    HERON - Hellenic Robotics Center of Excellence, Athena Research Center, Greece. · Institute of Robotics, Athena Research Center, Marousi, Greece. · Electrical and Computer Engineering, National Technical University of Athens, 15780 Zografou, Athens, Greece.

  40. Convolution for Large Language Models

    Jul 20, 2026Yuchuan Tian, Yingte Shu, Wei He +7Linear AttentionConvolutional

    1Peking University · 2Huawei Technologies · 3Tsinghua University

  41. Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks

    Jul 20, 2026Damien Teney, Liangze Jiang, Hemanth Saratchandran +1Transformer ArchitecturesInductive Bias

    Idiap Research Institute · Adelaide University · EPFL

  42. The Information Shadow: Measuring Structural Limits on What Language Models Can Learn

    Jul 17, 2026Priyansh Srivastava, Romit ChatterjeeFundamental LimitsLanguage Modeling

    Sirena Ai · Independent Researcher

  43. XCT-SAM: Sequential Parameter-Efficient Domain Adaptation of SAM for Industrial XCT Defect Segmentation

    Jul 15, 2026Md Mahedi Hasan, Md Mushfiqur Rahaman, Alan Pachkovskiy +3Defect DetectionDomain Adaptation

    Lane Department of Computer Science & Electrical Engineering West Virginia University, Morgantown, WV · Department of Industrial and Management Engineering West Virginia University, Morgantown, WV · School of Mathematical and Data Sciences West Virginia University, Morgantown, WV

  44. Implementations of Quantum and Classical Topology-Aligned Architectures for Molecular Property Prediction

    Jul 15, 2026James T. Pegg, Hubert Okadome Valencia, Ronin WuQuantum Machine LearningQuantum Chemistry

    QunaSys Europe Copenhagen, Denmark · QunaSys Inc. Tokyo, Japan

  45. Function-Aware Fill-in-the-Middle as Mid-Training for Coding Agent Foundation Models

    Jul 14, 2026Yubo Wang, Jiarong Liang, Yuxuan Zhang +5Coding AgentsPost-Training

    University of Waterloo · 5Vector Institute · University of British Columbia +2

  46. MESH: Scaling Up Retrieval with Heterogeneous Content Unification

    Jul 14, 2026Jiaxing Qu, Yilin Chen, Junpeng Hou +4Real-World Content Recommendation ProblemSequential Recommendation

    Pinterest Inc. San Francisco, CA, USA

  47. The RG-Flow Transformer: Encoding Scale-Free Dynamics in Scarce EEG

    Jul 11, 2026Dibakar SigdelElectroencephalographySleep

    Mindverse Computing LLC, Lynnwood, WA 98087 · 1Mindverse Computing LLC, Lynnwood, WA 98087

  48. Language Re-generation: An investigation into information locality effects on reconstruction

    Jul 11, 2026Amirhossein Mohammadi, Laurence E. Frank, Albert Gatt +1Language ModelingInductive Bias

    Utrecht University

  49. Are We Ready for AI-Driven Discovery? AI Verification Before the Next Fundamental Physics Breakthrough

    Jul 10, 2026Gaia Grosso, Vinicius Mikuni, Lukas HeinrichScientific DiscoveryInductive Bias

    NSF AI Institute for Artificial Intelligence and Fundamental Interactions, Cambridge, MA · MIT Laboratory for Nuclear Science, Cambridge, MA · School of Engineering and Applied Sciences, Harvard University, Cambridge, MA +3

  50. RhyMix: A Lightweight Adaptive Multi-Rhythm Network for Long-Term Time Series Forecasting

    Jul 9, 2026Sumit Satishrao Shevtekar, Chandresh Kumar MauryaShort-Horizon ForecastingTemporal Convolutional Networks

  51. Drift Happens: An Empirical Study of Neural Architecture Robustness to Temporal Distribution Shift

    Jul 7, 2026Robin Holzinger, Riccardo CollettiInductive BiasConvolutional Neural Networks

    Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA

  52. Input Pathways Shape Few-Shot, Not Zero-Shot, Binding in Tiny Transformers: A Fully-Enumerable Study

    Jul 6, 2026Yoshiyuki OotaniTransformer ArchitecturesFew-Shot Learning

    Independent Researcher

  53. PIEFS: Physics-Informed Eigenfunction Features with Learnable Scaling

    Jul 4, 2026Varvara Nazarenko, Timur Lidzhiev, Alexander TarakanovSpectral Representation MethodPhysics-Informed Learning

    Faculty of Computer Science, HSE University, Moscow, Russia · AI VK, Moscow, Russia

  54. Active Spatial Guidance: Eliminating Injected Positional Mechanisms in Vision Transformers

    Jul 1, 2026Cong Liu, Xiaofang Li, Simon X. YangVision TransformerVision Encoders

    School of Engineering, Yancheng Institute of Technology, No. 1 Xiwang Middle Avenue, Yancheng, 224051, Jiangsu, PR China · School of Computer Information Engineering, Changzhou Institute of Technology, No. 666 Liaohe Road, Xinbei District, Changzhou, 213032, Jiangsu, PR China · Advanced Robotics and Intelligent Systems Laboratory, School of Engineering, University of Guelph, 50 Stone Road East, Guelph, N1G 2W1, Ontario, Canada

  55. A Multi-Resolution Finite-Volume Inspired Deep Learning Framework for Spatiotemporal Dynamics Prediction

    Jul 1, 2026Xin-Yang Liu, Xiantao Fan, Jian-Xun WangSpatiotemporal PredictionReynolds-Averaged Navier-Stokes

    Department of Aerospace and Mechanical Engineering, University of Notre Dame, Notre Dame, IN, USA · Sibley School of Mechanical and Aerospace Engineering, Cornell University, Ithaca, NY, USA

  56. The FIL Hypothesis: Inductive Biases Help with Kernel Engineering

    Jun 29, 2026Nikolai Rozanov, Subhabrata Dutta, Preslav Nakov +1Inductive BiasFeedback Loop

    1NLP Department, MBZUAI, Abu Dhabi, UAE · Department of Computing, Imperial College London, London, UK · 2Ubiquitous Knowledge Processing, TU Darmstadt, Darmstadt, Germany

  57. RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering

    Jun 29, 2026Huangsheng Du, Haoran Zhu, Youcheng Cai +2Neural RenderingVisual Geometry Grounded Transformer

    University of Science and Technology of China, China

  58. Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning

    Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +6Multimodal ReasoningCross-View

    HKUST (GZ) · HKUST · UIC +1

  59. Are Humans Evolved Instruction Followers? An Underlying Inductive Bias Enables Rapid Instructed Task Learning

    Jun 29, 2026Anjishnu KumarInstructionCognitive Science

    Amazon Alexa AI Seattle, USA

  60. Adaptive Oscillatory Inductive Bias for Modeling Sharp Prosodic Dynamics in Diffusion-Based TTS

    Jun 24, 2026Sandipan Dhar, Nirmesh J. Shah, Ashishkumar P. Gudmalwar +1ProsodyInductive Bias

    Media Analysis, Sony Research India