Financial Reasoning in Language Models

Follow this topic Ask about this topic

Latest papers

25 papers7 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

AgenticFinBench: Benchmarking Financial Agents on Diverse Tasks from Real-World Requests
Nov 3, 2026Shu Zhou, Ziyang He, Yuxin Rao +5LLM Agent Evaluation Financial Reasoning in Language Models
NashNova Research
Thinking Fast, Trading Late: System One Decision Models vs the Market
Nov 2, 2026Amir Dehkordi, Alireza Kargarzadeh, Nariman Khaledian +3Financial Reasoning in Language Models Look-Ahead Bias in Language Models
Independent Researcher · TailState Intelligence Ltd · Zanista AI Ltd +1
Honest Small Decision Models for Finance: Scale, Specialization Collapse, and Mixed-Corpus Remediation
Nov 2, 2026Ajitabh KumarTyped Decision Models Financial Reasoning in Language Models
IntelCast Mumbai, India
TrackMem: Tracking Evolving Beliefs in Long-Horizon Financial Dialogue
Nov 1, 2026Austin M. Y. Cheung, Harsh Vardhan Gupta, Go Nam Lui +3Long-Term Conversational Memory Graph-Based Agent Memory
The Hong Kong University of Science and Technology · FinCatch Ltd · City University of Hong Kong +1
Beyond LLM Wrappers: Context Engineering and the Three-Engine Architecture for Reliable Financial AI
Oct 29, 2026Pradeep Kumar GS, Ravi TanniruContext Engineering LLM Context Management
Finteract AI
Right Numbers, Wrong Questions: Evaluating LLMs on Underspecified Financial Queries
Oct 28, 2026Radha Yadav, Prasanna Devadiga, Peeyush Mishra +1Financial Language Model Evaluation Financial Reasoning in Language Models
TIFIN, India
How Much Does the Hint Matter? Scope Conditions for Hindsight Self-Distillation in Financial Reasoning
Oct 26, 2026Johnny Yu, Cyril GorllaSelf-Distillation Knowledge Distillation
University of California, Berkeley Berkeley, California, USA · CTGT San Francisco, California, USA
When News Gets Old: Portfolio Allocation with Reinforcement Learning and Large Language Models
Oct 22, 2026Bolin Song, Surui XiangFinance Portfolio Optimization
Cornell University · United Nations
Staged Continual Adaptation of Multimodal Foundation Models for Japanese Financial Documents
Oct 20, 2026Genshin Kakimoto, Atsushi YanagisawaMultimodal Foundation Models Catastrophic Forgetting
Kyoto University, Kyoto, Japan.
TxnQA: Benchmarking Analytical Reasoning and Evidence Grounding over Transaction Event Sequences
Oct 19, 2026Rabimba Karanjai, Yiming Bian, Yun-Shiuan Chuang +9Financial Language Model Evaluation Financial Reasoning in Language Models
PayPal AI · University of Pennsylvania
Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning
Sep 9, 2026Zhirayr Hayrapetyan, Andrei Kalmykov, Denis Kokosinskii +2Financial Reasoning in Language Models RL for Language Model Reasoning
Evaluating Investment Logic in Large Language Models: A Real-World Benchmark Towards Personalzied Financial Agents
Aug 6, 2026Yuanhong Jiang, Jingjie Zou, Zhenghong Lin +4Financial Decision-Making Financial Reasoning in Language Models
Language-Routed RAG and Direct Option Scoring for Multilingual Financial QA: DS@GT at FinMMEval
Jul 24, 2026Justice Ayela, Kabir SahniFinance Multilingual Language Model Evaluation
Georgia Institute of Technology, North Ave NW, Atlanta, GA 30332
Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
Jul 22, 2026Xinke Tong, Xuanming Zhang, Tianyi Tang +10Numerical Reasoning in Language Models LLM Evaluation
Qwen Team, Alibaba Group · Tsinghua University · Alibaba Group
SAHM: A Benchmark for Arabic Financial and Shari'ah-Compliant Reasoning
Apr 21, 2026Rania Elbadry, Sarfraz Ahmad, Ahmed Heakl +12Finance Financial Services
1MBZUAI · 2INSAIT, Sofia University ”St. Kliment Ohridski” · 3The University of Manchester +1
Learning to Trade Like an Expert: Cognitive Fine-Tuning for Stable Financial Reasoning in Language Models
Apr 18, 2026Yuchen Pan, Soung Chang LiewLLM Evaluation Financial Reasoning in Language Models
Department of Information Engineering, The Chinese University of Hong Kong
SenseAI: A Human-in-the-Loop Dataset for RLHF-Aligned Financial Sentiment Reasoning
Apr 6, 2026Berny KabalisaFinancial Reasoning in Language Models Financial Sentiment Analysis
RizqSpark | SenseAI
FinTradeBench: A Financial Reasoning Benchmark for LLMs
Mar 19, 2026Yogesh Agrawal, Aniruddha Dutta, Md Mahadi Hasan +2Financial Reasoning in Language Models Financial Reasoning Benchmarks
University of Central Florida
FinRule-Bench: A Benchmark for Joint Reasoning over Financial Tables and Principles
Mar 11, 2026Arun Vignesh Malarkkan, Manan Roy Choudhury, Guangwei Zhang +4Financial Reasoning in Language Models Benchmark Auditing
Arizona State University Tempe, Arizona, USA · Pine AI Singapore, Singapore · The College of William & Mary Williamsburg, Virginia, USA +1
Evaluating Financial Intelligence in Large Language Models: Benchmarking SuperInvesting AI with LLM Engines
Mar 9, 2026Akshay Gulati, Kanha Singhania, Tushar Banga +8Financial Reasoning in Language Models Financial Reasoning Benchmarks
The Future University
Neuro-Symbolic Financial Reasoning via Deterministic Fact Ledgers and Adversarial Low-Latency Hallucination Detector
Mar 4, 2026Pedram AgandFinancial Reasoning in Language Models Neuro-Symbolic Reasoning
FactAI Lab, Vancouver, BC, Canada.
Constructing Synthetic Instruction Datasets for Improving Reasoning in Domain-Specific LLMs: A Case Study in the Japanese Financial Domain
Mar 2, 2026Yuma Okochi, Fabio Milentiansen Sim, Tomoyasu OkadaFinancial Language Model Evaluation Financial Reasoning in Language Models
Nomura Research Institute, Ltd. · NRI Indonesia
FinReasoning: A Hierarchical Benchmark for Reliable Financial Research Reporting
Feb 25, 2026Yiyun Zhu, Yidong Jiang, Ziwen Xu +4Financial Reasoning in Language Models Financial Reasoning Benchmarks
School of Computer Science and Technology, Tongji University, Shanghai, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China
LLM-Generated Counterfactual Stress Scenarios for Portfolio Risk Simulation via Hybrid Prompt-RAG Pipeline
Nov 26, 2025Masoud SoleimaniLLM Reliability Quantitative Finance
Department of Information Engineering, University of Pisa, Pisa, Italy
FinMultiHopQA: A KG-Grounded Multi-Hop Financial QA Benchmark for Evidence-Driven Reasoning
Oct 3, 2025Abhinav Arun, Reetu Raj Harsh, Bhaskarjit Sarmah +1Financial QA Multi-Hop QA
Domyn New York, US · Domyn India · Domyn Gurgaon, India

Nov 3, 2026J/K move · Enter open · S save

AgenticFinBench: Benchmarking Financial Agents on Diverse Tasks from Real-World Requests

Shu Zhou, Ziyang He, Yuxin Rao, Yudong Fang+4

NashNova Research

LLM Agent Evaluation Financial Reasoning in Language Models AI Agent Auditing

Open paper AskPDF arXiv

Financial agents are becoming an important class of real-world AI systems. Financial tasks vary widely in type and difficulty, and many are open-ended with no ground-truth answers. However, existing benchmarks neither capture this breadth and open-endedness nor separate grounding from correctness. To bridge this gap, we introduce

\textbf{AgenticFinBench}

, a benchmark of 230 real-world financial tasks spanning 8 categories, 2 languages, and 4 complexity levels. We also propose a reference-free evaluation framework that combines question-specific rubrics with a two-stage claim audit that detects hallucinations, defined as claims absent from the agent's trace and refuted by external evidence. This framework better matches how financial work is assessed in practice. Experiments across 18 agent configurations reveal three key findings: (1) Ignoring hallucinations can overstate agent performance: hallucination auditing lowers the baseline leader's score by 7.58 points and moves it to fourth place. (2) Harness differences explain more variation in evidence grounding than model differences (28.6% vs 8.8%). (3) Quality scores fall from 89.44 on direct retrieval to 79.18 on the most complex tasks. Case studies show that agents struggle to explain how events affect company profits or stock prices, compare financial data on a consistent basis, and justify their conclusions. By releasing AgenticFinBench, we aim to advance financial reasoning, factual verification, and agent design for more reliable responses to diverse real-world financial requests.