Extrapolation

Ask about this topic

Momentum

9 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 72

All topics
CardsList

  1. Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers

    Sep 30, 2026Yilun Liu, Yi Zhang, Ganyu Wu +5ChaosAutoregressive Transformers

    Ludwig Maximilian University of Munich · Munich Center for Machine Learning · Technical University of Munich

  2. HiTS-CL: A Continual Learning Framework for Long-Horizon Temporal Knowledge Graph Extrapolation

    Sep 29, 2026Yansong Liu, Rui Liu, Yuan Zuo +6Temporal Knowledge GraphsReplay-Based Continual Learning

    Beihang University Beijing, China · Beijing University of Posts and Telecommunications Beijing, China · Hubei Engineering University Xiaogan, Hubei, China

  3. Rethinking Token Reweighting for SFT: Suppress, Reverse, and Extrapolate Learned Features

    Sep 27, 2026Cunchun Li, Haonan He, Yifan Gao +4Supervised FinetuningReweighting

    Shanghai AI Laboratory · University of Science and Technology of China · Fudan University +2

  4. Exactness at Inference: A Representational Criterion for Out-of-Distribution Generalization

    Sep 21, 2026Filipe Marinho Rocha, Inês Dutra, Vítor Santos Costa +1Out-Of-DistributionImproved Generalization

    Faculdade de Ciências da Universidade do Porto, Porto, Portugal · INESC TEC, Campus da FEUP, Porto, Portugal · Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias, Porto, Portugal +1

  5. Recursive Reasoning or Statistical Extrapolation? In-Context Learning in Multi-Agent Interdependent Decision-Making

    Sep 16, 2026Yu Liu, Wenwen Li, Yifan Dou +1Multi-Agent ReasoningContextual Reasoning

    Fudan University

  6. What Fixed-Rollout pass@k Evaluations Can Identify

    Sep 10, 2026Pranav Singh, Prashant SinghPass-Rate EvaluationExtrapolation

    Department of Mathematics Indian Institute of Technology Ropar Ropar, Punjab 140001, India

  7. Field-level prediction of mid-plane stress tensor fields in concrete target penetration: a cross-velocity graph neural operator surrogate

    Sep 9, 2026Wenpu Du, Peng Zhou, Yunlong Xia +5Extrapolation

    School of Environment and Safety Engineering, North University of China, Taiyuan, 030051, China

  8. Development and Validation of a Physics-Guided Machine Learning Extrapolation Framework Using a Classical Transient Diffusion Benchmark

    Sep 9, 2026Ashutosh Yadav, Alok Dubey, Prodyut Ranjan Chakraborty +1ExtrapolationPhysics-Guided Machine Learning

    Department of Mechanical Engineering, Indian Institute of Technology Jodhpur, Jodhpur 342030, India · Department of Aerospace Engineering, Indian Institute of Technology Jodhpur, Jodhpur 342030, India

  9. HOPE: Heterophily-Aware Open-Set Node Classification with Pseudo-Extrapolation

    Sep 8, 2026Yumeng Dai, Yue Tan, Yixin Liu +3Graph Neural NetworksExtrapolation

    Xi’an Jiaotong University, Xi’an, China · Griffith University, Brisbane, Australia

  10. Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction

    Sep 3, 2026Chin-Yang Lin, Yang-Che Sun, Cheng Sun +53D ReconstructionExtrapolation

    Department of Computer Science, National Yang Ming Chiao Tung University · NVIDIA

  11. BRACE: Taming Sharp Irregularities via Barycentric Rational Forecasting for Fast Diffusion Transformers Inference

    Aug 4, 2026Jinlong Yang, Jinke Wu, Lizilin +1Diffusion TransformersExtrapolation

    Sichuan University Chengdu, China · School of Artificial Intelligence, Sichuan University Chengdu, China

  12. Mask-Based Priors Are More Persistent than Query-Key Initializations

    Aug 1, 2026Mingze Ma, Hemanth Saratchandran, Cameron Gordon +1Transformer ArchitecturesMask2Former

    Australian Institute for Machine Learning · Adelaide University

  13. Self Gradient Forcing: Native Long Video Extrapolation

    Jul 22, 2026Junhao Zhuang, Shiyi Zhang, Yuxuan Bian +11Autoregressive Video Diffusion ModelsExtrapolation

    Joy Future Academy, JD

  14. Relative Positions Generalize, Absolute Positions Memorize: An Implicit-Bias Account of Length Generalization in Attention

    Jul 21, 2026Subham Singh, Ashutosh Mishra, Subha RautPositional EncodingRelative Position

    Department of Mathematics and Statistics, Mississippi State University · Independent Researcher

  15. GAttNHP: Group Attention Neural Hawkes Process for Extrapolation Reasoning in Temporal Knowledge Graphs

    Jul 16, 2026Xiangni Tian, Kaixian Yu, Runpeng Dai +2Temporal Knowledge GraphsLong-Range Temporal Dependencies

    Yunnan Key Laboratory of Statistical Modeling and Data Analysis, Yunnan University, Kunming, China · Insilicom LLC, Peabody, MA, USA · University of North Carolina at Chapel Hill, North Carolina, USA

  16. ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting

    Jul 14, 2026Cheng-Tai Hsieh, Jiwei Shan, Han Fang +6Novel View SynthesisColonoscopy

    School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, and the Shanghai Key Laboratory of Navigation and Location-Based Services, Shanghai, China · Department of Mechanical and Automation Engineering and the T Stone Robotics Institute, The Chinese University of Hong Kong, Hong Kong · Global College, Shanghai Jiao Tong University, Shanghai, China +1

  17. Efficient Temporal Point Processes via Monotone Alternating Splines

    Jul 2, 2026Cheng Wan, Quyu Kong, Feng ZhouDeterminantal Point ProcessSplines

    Hong Kong University of Science and Technology, Hong Kong · Alibaba Cloud, Hangzhou, China · Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing, China

  18. Mind the Gap: Standard 3DGS Evaluation Primarily Measures Near-Trajectory Interpolation

    Jul 2, 2026Gaoxiang Jia, Vikram AppiaDynamic 3D Gaussian SplattingExtrapolation

    Advanced Micro Devices, Inc.

  19. Extrapolating from Regularised Solutions for Solving Ill-Conditioned Linear Systems in Machine Learning

    Jun 29, 2026Disha Hegde, Jon Cockayne, Chris. J. OatesSolver IterationsRegularization

    University of Southampton, UK · Newcastle University, UK · The Alan Turing Institute, UK

  20. Stabilizing Extrapolation in Looped Transformers via Learned Stochastic Stopping

    Jun 29, 2026Hsun-Yu Kuo, El Mahdi Chayti, Patrik Reizinger +2StochasticMulti-Stage Training

    EPFL, Lausanne, Switzerland · Max Planck Institute for Intelligent Systems & ELLIS Institute, Tübingen, Germany

  21. On the Nonlinearity of Learning Rate Scaling for LLM Training

    Jun 28, 2026Zaiwen Yang, Huaqing Zhang, Jing Xu +1BatchLarge Language Model Training

    Tsinghua University · Tsinghua University, Shanghai Qi Zhi Institute

  22. Depth-Staggered Fibonacci Spacing for Sparse Attention: Static Schedules Beat Learned Dilation and Extrapolate Where Dense Attention Fails

    Jun 26, 2026Chad A. CappsDynamic Sparse AttentionLinear Attention

    Independent Researcher

  23. InvestPhilBench: A Multi-Layer Benchmark for Evaluating Large Language Model Procedural Reasoning in Expert Investment Philosophy

    Jun 24, 2026Mingguang Chen, Bo QuFinancial Strategy ResearchFinance Benchmarks

    University of California, Riverside (UCR). · 2Illinois Institute of Technology (IIT).

  24. Why Do Accumulated Transformations Extrapolate?

    Jun 23, 2026Mahesh GodavartiRotary Position EmbeddingLinear Attention

    A Carrot, Inc.

  25. A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matching

    Jun 23, 2026Feiyang Fu, Hehe FanAccelerated SamplingConditional Flow Matching

    College of Artificial Intelligence, Zhejiang University, Hangzhou, China.

  26. Topological Out-of-Domain Generalization in Dynamical Systems Reconstruction

    Jun 22, 2026Georg Trede, Charlotte Ricarda Doll, Elias Weber +1Dynamical SystemsExtrapolation

    Dept. of Theoretical Neuroscience, Central Institute of Mental Health, Mannheim, Germany · Faculty of Physics and Astronomy, Heidelberg University, Germany · Interdisciplinary Center for Scientific Computing (IWR), Heidelberg University, Germany

  27. Fine-Tuning Large Language Models for Quantum Reasoning

    Jun 20, 2026Katherine Ip, Casey R. Myers, Udaya Parampalli +2Large Language Model QuantizationQuantum Machine Learning

    School of Computing and Information Systems, The University of Melbourne, Melbourne, Australia · School of Physics, Mathematics and Computing, The University of Western Australia, 35 Stirling Hwy, Crawley WA, 6009, Australia · Pawsey Supercomputing Centre, 1 Bryce Avenue, Kensington WA, 6151, Australia +1

  28. VFILC: Accurate Frequency Extrapolations in Imitation Learning via Sampling Frequency ILC

    Jun 18, 2026Nozomu Masuya, Toshiaki Tsuji, Sho SakainoTemporally Coherent Imitation LearningImitation Learning

    Grad. School of Science and Technology University of Tsukuba Tsukuba, Japan · Grad. School of Science and Engineering Saitama University Saitama, Japan · Systems and Information Engineering University of Tsukuba Tsukuba, Japan

  29. Concept Modulation Models: A Unified Framework for Identifiability and Extrapolation

    Jun 16, 2026Soheun Yi, Yizhou Lu, Chandler Squires +1IdentifiabilityLatent Variable

    Department of Statistics and Data Science, Carnegie Mellon University · Machine Learning Department, Carnegie Mellon University

  30. Least-Action-Guided Diffusion for Physical Extrapolation

    Jun 9, 2026Zhongxin Yang, Yuanwei Bin, Xiang I. A. Yang +1ExtrapolationAerodynamics

    College of Engineering, Peking University, Beijing 100871, China · Ningbo Institute for Digital Twin, Eastern Institute of Technology, Ningbo 315200, Zhejiang, China · Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo 315200, Zhejiang, China +2

  31. ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modeling

    Jun 8, 2026Zhuoyan Tao, Jiatong Shi, Hye-jin Shim +1SpeakerAutoregressive Model

    University of Southern California, USA · Carnegie Mellon University, USA

  32. When Do Local Score Models Extrapolate Across Size? A Diagnostic Theory and Benchmark

    Jun 8, 2026Wenjie XiModel SizeExtrapolation

    Department of Physics and HK Institute of Quantum Science & Technology The University of Hong Kong, Pokfulam Road, Hong Kong, China

  33. Assessing Sample Quality in Conditional Generation under Compositional Shift

    Jun 8, 2026Berker Demirel, Valentino Maiorca, Marco Fumero +2High-Fidelity Conditional GenerationText-Conditioned Diffusion Model

    Institute of Science and Technology Austria (ISTA) · Pyramidal Inc, San Francisco, CA, USA · Achira Inc, San Francisco, CA, USA

  34. ExDet: Open-Domain Open-Vocabulary Detection with Cross-modal Extrapolation and Rectification

    Jun 8, 2026Yupeng Zhang, Yuzhong Feng, Ruize Han +3Open-Vocabulary Object DetectionOpen-Vocabulary

  35. Accelerated Decentralized Stochastic Gradient Descent for Strongly Convex Optimization

    Jun 5, 2026Ming Sun, Kun YuanDecentralized OptimizationStochastic Gradient Descent

    Center for Machine Learning Research Peking University

  36. SCALE: Scalable Cross-Attention Learning with Extrapolation for Agentic Workflow Scheduling

    Jun 5, 2026Zhifei Xu, Jierui Lan, Zixuan Liang +2BatchCross-Attention

    Faculty of Arts and Sciences, Beijing Normal University, Zhuhai 519087, China

  37. Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence

    May 31, 2026Payel Mukhopadhyay, Stefan S. Nixon, Romain Watteaux +20Turbulent FlowsWireless Foundation Models

    University of Cambridge, UK · Polymathic AI · CEA, DAM/DIF, 91297 Arpajon Cedex, France +6

  38. Out-of-Distribution generalization of quantile regression with heavy tailed inputs: an SVM approach

    May 29, 2026Baptiste Leroux, Clément Dombry, Anne SabourinMulti-Quantile RegressionQuantile Regression

    Université Paris Cité, CNRS, MAP5, F-75006 Paris, France · Université Marie et Louis Pasteur, CNRS, LmB (UMR 6623), F-25000 Besançon, France · Université Paris Cité, Université Paris Saclay, ENS Paris Saclay, CNRS, SSA, INSERM, Centre Borelli, F-75006, Paris, France

  39. Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation

    May 29, 2026Zekai Li, Ji Liu, Yiqing Huang +3Diffusion Language ModelsConstrained Decoding

    Advanced Micro Devices, Inc. (AMD)

  40. Unveiling the Visual Counting Bottleneck in Vision-Language Models

    May 28, 2026Xingzhou Pang, Yifan Hou, Junling Wang +1Recent Vision-Language ModelsExtrapolation

    Department of Computer Science, ETH Zürich

  41. Learning to Extrapolate to New Tasks: A Relational Approach to Task Extrapolation

    May 28, 2026Adam Ousherovitch, Yixin WangExtrapolationEfficient Task Adaptation

    Department of Statistics, University of Michigan, Ann Arbor.

  42. Extrapolative Weight Averaging Reveals Correctness-Efficiency Frontiers in Code RL

    May 27, 2026Kunhao Zheng, Pierre Chambon, Juliette Decugis +4Intermediate CheckpointsOffline Reinforcement Learning

    Meta Superintelligence Labs - FAIR · Université Paris-Dauphine PSL

  43. Unified Neural Scaling Laws

    May 25, 2026Ethan Caballero, Priyank Jaini, David Krueger +1Scaling LawsExtrapolation

    Mila, University of Montreal · Google DeepMind

  44. Conformalised imprecise inference for robust extrapolation under limited data

    May 25, 2026Yu Chen, Scott FersonConformal InferenceUncertainty Quantification

    Institute for Risk and Uncertainty · University of Liverpool · Liverpool

  45. SEGA: Spectral-Energy Guided Attention for Resolution Extrapolation in Diffusion Transformers

    May 21, 2026Javad Rajabi, Kimia Shaban, Koorosh Roohi +2Diffusion TransformersRotary Position Embedding

    University of Toronto · Vector Institute

  46. Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate

    May 20, 2026Dayal Singh Kalra, Maissam BarkeshliHyperparameterLarge Language Model Training

    Department of Computer Science, University of Maryland, College Park · Department of Physics, University of Maryland, College Park · Joint Quantum Institute, University of Maryland, College Park +1

  47. FLUXtrapolation: A benchmark on extrapolating ecosystem fluxes

    May 19, 2026Anya Fries, Jacob A Nelson, Martin Jung +2ExtrapolationEcosystems

    Seminar for Statistics, ETH Zürich Zürich, Switzerland · Max Planck Institute for Biogeochemistry Jena, Germany

  48. Increasing Missingness to Reduce Bias: Richardson-SGD with Missing Data

    May 19, 2026Ferdinand Genans, Erwan ScornetMissing DataStochastic Gradient Descent

    SU, LPSM · Sorbonne Université and Université Paris Cité, CNRS, Laboratoire de Probabilités, Statistique et Modélisation, LPSM, F-75005 Paris, France

  49. Beyond Extrapolation: Knowledge Utilization Paradigm with Bidirectional Inspiration for Time Series Forecasting

    May 19, 2026Liu Chong, Yingjie Zhou, Hao Li +3Forecasting BackboneExtrapolation

    College of Computer Science, Sichuan University · Computer and Information Science, University of Macau · Squirrel Ai +1

  50. MagBridge-Battery: A Synthetic Bridge Dataset for Li-ion Magnetometry and State-of-Health Diagnostics

    May 17, 2026Sakthi Prabhu Gunasekar, Prasanna Kumar RangarajanLithium-Ion BatteriesMagnetic Tunnel Junction

    Dept. of Computer Science & Engineering Amrita School of Computing Amrita Vishwa Vidyapeetham, India

  51. HL-OutPaint: Coarse-to-Fine Video Outpainting for High-Resolution Long-Range Videos

    May 17, 2026Jeongeun Park, Janghyeok Han, Geonung Kim +4InpaintingHigh-Resolution

    POSTECH, Republic of Korea · Visual Display Business, Samsung Electronics, Republic of Korea

  52. Discovering Physical Directions in Weight Space: Composing Neural PDE Experts

    May 14, 2026Pengkai Wang, Pengwei Liu, Yuanyi Wang +7Neural Partial Differential Equation SolversPartial Differential Equations

    1The Hong Kong Polytechnic University · 2Zhejiang University · 3Tsinghua University +1

  53. Learning Perturbations to Extrapolate Your LLM

    May 13, 2026Zetai Cen, Chenfei Gu, Jin Zhu +3Extrapolation

    School of Mathematics, University of Bristol · School of Statistics and Data Science, Shanghai University of Finance and Economics · School of Mathematics, University of Birmingham +1

  54. Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning

    May 13, 2026Siyuan Liu, Tinghong Chen, Xinghan Li +2Large Language Model Fine-TuningModel Fine-Tuning

    IIIS, Tsinghua University · College of AI, Tsinghua University · Shanghai Qi Zhi Institute +1

  55. AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive

    May 12, 2026Taicheng Guo, Nitesh V. Chawla, Olaf Wiest +1Extrapolation

    University of Notre Dame

  56. ExtraVAR: Stage-Aware RoPE Remapping for Resolution Extrapolation in Visual Autoregressive Models

    May 11, 2026Feihong Yan, Shaoyu Liu, Haixuan Wang +4Visual Autoregressive ModelsExtrapolation

    Beijing Institute of Technology · Xidian University · Northeastern University at Qinhuangdao +3

  57. Controlling Transient Amplification Improves Long-horizon Rollouts

    May 9, 2026Adeel Pervez, Francesco LocatelloAutoregressive RolloutLong-Horizon Forecasting

    Institute of Science and Technology Austria Klosterneuburg, Austria

  58. The Extrapolation Cliff in On-Policy Distillation of Near-Deterministic Structured Outputs

    May 9, 2026Xin Li, Hao Jiang, Annan Wang +2TeacherGradient Clipping

    Nanyang Technological University, Singapore

  59. Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints

    May 8, 2026Tsuyoshi OkitaExtrapolationTarget Domain

    Kyushu Institute of Technology

  60. Does Your Neural Network Extrapolate? Feature Engineering as Identifiability Bias for OOD Generalization

    May 8, 2026Leonel Aguilar, Jan Nagler, Christoph Hoelscher +1Out-Of-DistributionExtrapolation

    Chair of Cognitive Science, ETH Zürich · Centre for Human and Machine Intelligence, Frankfurt School · Aisot Technologies AG +1