Financial restatements correct errors in previously published financial reports. Could managers' language in earnings calls warn of them in advance? Comparing 109 calls that precede restatements with 218 matched control calls, we find that the text predicts restatements but adds no detectable ranking gain beyond public firm information. A text classifier beats chance, largely because of restatements tied to special-purpose acquisition companies, but a model using only public information scores slightly higher. With refitting, the 95% interval for the gain from adding text (-0.05 to 0.11 AUROC) still leaves room for a meaningful benefit. A large language model scores higher, but we show that it names the exact ticker in 66% of masked transcripts, and it was released after the restatements occurred. Our results suggest that finding new warning signs in call text requires a public-information baseline and a check of what a language model already knows.
Figures & tables
Figure 1: Within-set AUROC on 109 matched sets with 95% confidence intervals. The dashed line marks chance, and the dotted line marks the 0.60 threshold. The name-only bar gives the 27B model only the firm’s name and the call date. † The 27B model names the exact ticker in most masked transcripts (see the language-model results).
Setting (sets)
Baseline
Text
Δ [95% CI]
Main (109)
0.651
0.628
0.000 [ − .06, .06]
± 3-yr controls (109)
0.683
0.665
+0.005 [ − .05, .06]
No SPAC-related (80)
0.625
0.562
−0.025 [ − .08, .03]
Out-of-time (69)
0.594
0.572
+0.014 [ − .03, .06]
Table 1: Within-set AUROC of the baseline and the text model, and the change Δ when text is added to the baseline. Intervals hold the models fixed. ± 3-yr: controls with no Item 4.02 observed within three years of the call. No SPAC-related: models retrained without SPAC-related cases. Out-of-time: trained on the 40 sets filed by 2019 and tested on the later sets. Definitions are in Appendix A .
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
Cases
Controls
Calls
109
218
Distinct firms
106
218
Motley Fool corpus
61
122
S&P 500 corpus
48
96
Calls in 2005–2014
28
56
Median words
8,308
8,682
Appendix
Table 2: Dataset summary. Each control matches its case’s corpus and quarter.
Figure 2: Text-model performance by time between the call and the restatement filing. Within each window, scores are averaged over each firm’s calls. A matched set is included when the case and at least one control have a call in that window (77, 93, 66, and 36 sets). Calls are scored by models that did not train on the firm.
Financial forecasting uses market, company, and economic data to predict prices, returns, volatility, and business outcomes for decisions and risk management.
Corporate financial disclosures often unfold over time, with announcements, prepared remarks, and discussion spanning multiple high-frequency return intervals. Financial NLP benchmarks can therefore suffer from a within-event timing mismatch when the prediction target begins before the textual or audio input used by a model could be complete. Chronological train--test splits do not prevent this mismatch, because it occurs inside individual events rather than across samples. We introduce an Availability Contract, which requires a benchmark to state the input boundary, evidence for input availability, the outcome start, and the claims supported by that evidence. We apply this framework to 552 earnings calls from 24 firms. For each call, we hold the return endpoint fixed and compare the previous close, a documentary call-start proxy, and a completion proxy based on reconstructed audio end plus a stipulated processing allowance. At this baseline, moving from the call-start proxy to the completion proxy flips return signs for 9.4% of calls. Holding completion-clock cutpoints fixed, 28.3% change quintile. In an independent release-session analysis of a public earnings-call volatility benchmark, shifting before-market target windows forward by one trading session raises three-day mean squared error by 18.1-21.4% across four frozen prediction streams, while their point rankings remain unchanged. Together, the results show that labels and losses can depend materially on the declared outcome clock even when model rankings appear stable. The Availability Contract makes this assumption explicit and ties post-input claims to the available timing evidence.
Xiaoyu Ma, Kelvin J. L. Koa, Yuncong Liu +1
National University of Singapore Asian Institute of Digital Finance Singapore
Earnings calls are a key source of financial information about public companies. However, extracting information from these calls is difficult. Unlike the templatic filings required by the U.S. Securities and Exchange Commission (SEC) to report a company's financial situation, earnings conference calls have no built-in labels, are unstructured, and feature conversational language. We explore this challenging domain by assessing the information captured by models trained on SEC filings and in-context learning methods. To establish a baseline, we first evaluate the generalization capabilities of SEC-trained models across established SEC datasets. To support our investigation, we introduce three novel benchmarks: (1) SEC Filings Benchmark (SECB), (2) Earnings Calls Benchmark (ECB), and ECB-A, a subset with 2,460 expert annotation groups to support our qualitative analysis. We find that encoder-based models struggle with the domain shift. Finally, we propose a system utilizing LLMs to perform open-ended extraction from unstructured call transcripts, verified by human evaluation (79.7% precision), providing a baseline for this valuable domain through the consistent tracking of emergent KPIs.
Rasmus T. Aavang, Rasmus Tjalk-Bøggild, Alexandre Iolov +3
Department of Computer Science, Aalborg University, Denmark · ALIPES ApS, Denmark · University of Copenhagen
Earnings conference calls are a primary channel through which managers disclose information under analyst scrutiny. Prior work has linked vocal and lexical cues to future adverse outcomes, but often pools features over an entire call and underuses the interactive structure of Q&A. We propose a two-branch late-fusion framework for detecting managerial evasiveness as a predictor of extrinsic SEC events (primarily late filings): (i) an LLM-as-a-judge that maps Q&A text to an interpretable call-level vector X_text via a structured binary rubric, and (ii) a frozen conversational encoder whose temporal hidden states are read by a DeepVoice-style sequential reader to produce an audio representation h. Late fusion of (X_text, h) yields a call-level risk score p. On n=1,039 calls (212 late filings) with firm-grouped 5-fold CV, fusion reaches AUROC approx. 0.89, versus 0.55 for the text judge and 0.71 for duration alone. These results show that conversational audio dynamics encode managerial evasiveness beyond lexical content and call length, yielding a stronger early-warning signal of adverse SEC outcomes.
Huizhong Chen, Huan Zhang
Beijing Normal-Hong Kong Baptist University · Individual researcher