Numerical Reasoning in Language Models

Follow this topic Ask about this topic

Momentum

21 papers in the last four weeks, up 250% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 73

All topics

From Numbers to Judgment: Specialist LLM Agents and Reinforcement Learning for European Listed Real Estate
Aug 11, 2026Pardis Taghavi, Santosh BhavaniNumerical Reasoning in Language Models Multi-Agent LLM Systems
Santosh Bhavani∗
V-FiLLM: Verified Financial LLM Reasoning Benchmark
Aug 11, 2026Alicia Larsen, Victoire Laurent, Aulia Kharis Rakhamsari +2Numerical Reasoning in Language Models Synthetic Data Generation
ETH Zürich, Zürich · Aisot Technologies Ltd
ThinkRetrieve: Retrieval-Augmented Reasoning Traces for Test-Time Scaling
Aug 11, 2026Vaibhav Singh, Soumya Suvra Ghosal, Sarvesh Gharat +3Numerical Reasoning in Language Models Test-Time Scaling
IIT Bombay · University of Maryland, College Park · Adobe Research
MedCalc-R1: Knowledge-Guided Reward Framework for Medical Mathematical Reasoning
Aug 9, 2026Haotian Wang, Lian Yan, Xingzhi Yao +4Numerical Reasoning in Language Models Reinforcement Learning with Verifiable Rewards
Harbin Institute of Technology
RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer
Aug 6, 2026Xinye Wang, Junxiao Liu, Shujian HuangNumerical Reasoning in Language Models Multilingual Language Models
National Key Laboratory for Novel Software Technology, Nanjing University
On-Policy Delta Distillation for Multilingual Math Reasoning
Aug 6, 2026Byeongho Heo, Jaehui Hwang, Sangdoo Yun +1Numerical Reasoning in Language Models Multilingual Language Models
NAVER AI Lab
Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning
Aug 6, 2026Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer +4Numerical Reasoning in Language Models LLM Self-Correction
University of Oklahoma · Stanford University · Universitat Pompeu Fabra +1
Analysis of Numerical Localisation in LLM Translations
Aug 5, 2026Patrizia KayeNumerical Reasoning in Language Models Machine Translation
University of Bath
CVPO: Enhancing LLM Reinforcement Learning Reasoning via Value-Variance Adaptation and Dynamic Curriculum Learning
Aug 4, 2026Ziqi Jia, Yalu Ouyang, Bo Pang +5Numerical Reasoning in Language Models RL for Language Model Reasoning
AI Cloud Group, Baidu · Tsinghua University · University of California, San Diego
A Graph Signal Processing Perspective on Numerical Sequence Representations in LLM In-Context Learning
Aug 4, 2026Jiajun Bao, Zihao Qi, Toni J. B. Liu +4Numerical Reasoning in Language Models In-Context Learning
1Cornell University · 2Goodfire AI · 3Imperial College London
Latent Thought Credit: Multi-Answer Credit Assignment for Latent Reasoning
Aug 3, 2026Xuyang Zhao, Liting Zhang, Zichen Xu +4Numerical Reasoning in Language Models RL for Language Model Reasoning
TMCC, College of Computer Science, Nankai University, Tianjin, China · Lingxi (Beijing) Technology Co., Ltd.
Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages
Aug 1, 2026Sean Gip Lim, William Chandra Tjhi, Hai Leong ChieuNumerical Reasoning in Language Models Multilingual Language Models
1Nanyang Technological University · 2AI Singapore · 3DSO National Laboratories
A foundation model of numerical intelligence with cross-disciplinary generalization
Jul 30, 2026Chenghan Wu, Zongmin Yu, Liu YangNumerical Reasoning in Language Models Domain Generalization
Department of Mathematics, National University of Singapore, Singapore, Singapore.
LEEPS: Latent-Guided Explore-Exploit Prompt Sampling for Efficient RLVR in Large Language Models
Jul 30, 2026Shuang Liang, Haoyang Zhou, Yifan Gong +2Numerical Reasoning in Language Models Reinforcement Learning with Verifiable Rewards
Renmin University of China · AntGroup
Credit Cards, Confusion, Computation, and Consequences: What Can We Uncover About Language Model Reasoning?
Jul 29, 2026Arnav Hiray, Agam Shah, Caleb Lu +3Numerical Reasoning in Language Models Financial Services
College of Computing & Scheller College of Business Georgia Institute of Technology, Atlanta, GA
Mergeable Model-Side Aggregation States for Long-Context Language Models
Jul 29, 2026Dachuan Song, Junyu Yin, Zechen Hu +1Numerical Reasoning in Language Models Long-Context Language Modeling
Department of Electrical and Computer Engineering, George Mason University, Fairfax, VA, USA · Department of Computer Science, George Mason University, Fairfax, VA, USA
Probing the Origins of Reasoning Performance: Representational Quality for Mathematical Problem-Solving in RL vs. SFT Fine-Tuned Models
Jul 28, 2026Antyabha Rahman, Akshaj Gurugubelli, Omar Ankit +2Numerical Reasoning in Language Models LLM Interpretability
University of New South Wales · Algoverse AI Research · University of Waterloo +1
DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification
Jul 27, 2026Sagnik Sinha, Shreyas ShresthaNumerical Reasoning in Language Models Reward Modeling
Georgia Institute of Technology, North Ave, Atlanta, GA 30332, United States
INS-ActBench: A Comprehensive Benchmark for Assessing Professional Actuarial Capability of Large Language Models
Jul 27, 2026Changyu Chen, Chenwei Lin, Xian XuNumerical Reasoning in Language Models LLM Evaluation
Fudan University
Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
Jul 22, 2026Xinke Tong, Xuanming Zhang, Tianyi Tang +10Numerical Reasoning in Language Models LLM Evaluation
Qwen Team, Alibaba Group · Tsinghua University · Alibaba Group
Nigeria Machinery: A Low-Resource Industrial Dataset with a Domain-Grounded Reasoning Layer
Jul 8, 2026Gospel Bassey, Vincent FakiyesiNumerical Reasoning in Language Models LLM Grounding
Independent Researcher · Engineering Education Transformations Institute, College of Engineering, University of Georgia.
Enhancing Numerical Prediction in LLMs via Smooth MMD Alignment
Jun 26, 2026Zhuo Zuo, Li Yue, Wenhao Zheng +2Numerical Reasoning in Language Models Maximum Mean Discrepancy
College of Computer Science, Sichuan University, Chengdu, China · Dongfang Electric (Chengdu) Academy of Science and Technology Co., Ltd., Chengdu, China · Institute of Medical Information & Library, CAMS & PUMC, Beijing, China
Riazi-8B: An Urdu Large Language Model for Mathematical Reasoning
Jun 24, 2026Azher Ali, Ibtsam Haider, Raja Khurram Shahzad +2Numerical Reasoning in Language Models LLM Fine-Tuning
School of Electrical Engineering and Computer Science (SEECS), National University of Sciences and Technology (NUST), Islamabad, Pakistan · Department of Communication, Quality Management and Information Systems, Mid Sweden University, Ostersund, Sweden
Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning
Jun 24, 2026Jaeyong Ko, Jinu Lee, Pilsung Kang +1Numerical Reasoning in Language Models LLM Reliability
Seoul National University · Boston University
Nothing from Something: Can a Language Model Discover 0?
Jun 15, 2026Phoebe Zeng, Thomas L. Griffiths, Brenden M. LakeNumerical Reasoning in Language Models Language Model Pretraining
Department of Computer Science, Princeton University
Localizing Anchoring Pathways in Language Models
Jun 11, 2026Hillary N. Owusu, Sarah Wiegreffe, Naomi H. FeldmanNumerical Reasoning in Language Models LLM Interpretability
University of Maryland, College Park
Arithmetic Pedagogy for Language Models
Jun 3, 2026Andhika Bernard Lumbantobing, Hokky SitungkirNumerical Reasoning in Language Models Language Model Pretraining
Bandung Fe Institute & Adjunct Science Fellow in InaAI · Adjunct Science Fellow in InaAI · AI Research Center IT Del +1
Language Models Compare Quantities Using Number-specific and Unit-specific Heuristics
Jun 2, 2026Mutsumi Sasaki, Go kamoda, Ryosuke Takahashi +4Numerical Reasoning in Language Models LLM Evaluation
Tohoku University · SOKENDAI · NINJAL +2
PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models
Jun 2, 2026Zetian Ouyang, Linlin Wang, Gerard de Melo +1Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks
East China Normal University · Hasso Plattner Institute, University of Potsdam
Testing LLM Arithmetic Reasoning Generalization with Automatic Numeric-Remapping Attacks
Jun 2, 2026Malia Barker, Bishal Lakha, Edoardo Serra +1Numerical Reasoning in Language Models Mathematical Reasoning Benchmarks
Department of Computer Science, Boise State University, Boise, ID, USA · University of L'Aquila, L'Aquila, Italy

Aug 11, 2026, cs.AIJ/K move · Enter open · S save

From Numbers to Judgment: Specialist LLM Agents and Reinforcement Learning for European Listed Real Estate

Pardis Taghavi, Santosh Bhavani

Santosh Bhavani∗

Numerical Reasoning in Language Models Multi-Agent LLM Systems LLM Agent Training Finance RL for LLM Agents

Open paper AskPDF arXiv

We study whether the localized numerical operations and integrative judgments of financial analysis benefit from the same form of LLM specialization. Larix maps a 16-lens European listed-real-estate analysis framework to eight lens-aligned specialists; we compare a frontier LLM under monolithic versus specialist-decomposed prompting while holding the model, source evidence, task instructions, output schema, and scoring fixed. Across 19 firms spanning seven regulatory wrappers, decomposition improves the numerical-task aggregate by 15.8 percentage points but does not reliably improve, and can reduce, performance on judgment tasks, a pattern stable across four frozen-template dispatches; a single-agent control given the complete framework does not reproduce the numerical gain. Post-training Qwen3.5-9B with GRPO using task-aligned structured rewards then raises the development-split score by 12.0 points and the judgment aggregate by 14.2 points, with gains on all four sub-ceiling tasks; the gains transfer to unseen firms (+15.2 points overall; +40.4 on covenant stress) and to unseen regulatory wrappers (+4.3), with positive transfer on all three anti-memorization splits. Prompt-level decomposition thus improves modular numerical execution, whereas targeted parameter adaptation improves integrative financial judgment.

Momentum

Related topics

Latest papers 73