cs.LGDec 15, 2025

Comparative Evaluation of Embedding Representations for Financial News Sentiment Analysis

Authors: Joyjit Roy, Samaresh Kumar Singh

Organizations: Austin, Texas, USA · Leander, Texas, USA

Abstract

Financial sentiment analysis enhances market understanding. However, standard Natural Language Processing (NLP) approaches encounter significant challenges when applied to small datasets. This study presents a comparative evaluation of embedding-based techniques for financial news sentiment classification in resource-constrained environments. Word2Vec, GloVe, and sentence transformer representations are evaluated in combination with gradient boosting on a manually labeled dataset of 349 financial news headlines. Experimental results identify a substantial gap between validation and test performance. Despite strong validation metrics, models underperform relative to trivial baselines. The analysis indicates that pretrained embeddings yield diminishing returns below a critical data sufficiency threshold. Small validation sets contribute to overfitting during model selection. Practical application is illustrated through weekly sentiment aggregation and narrative summarization for market monitoring. Overall, the findings indicate that embedding quality alone cannot address fundamental data scarcity in sentiment classification. Practitioners with limited labeled data should consider alternative strategies, including few-shot learning, data augmentation, or lexicon-enhanced hybrid methods.

Figures & tables

Explore similar work

CardsList
  1. RA-FinBERT: Rule-aware LoRA adaptation for low-resource financial sentiment classification

    Aug 10, 2026Fan Zhang, Jiaming LiSentiment AnalysisFinancial Sentiment Analysis

  2. FinMoji: A Framework for Emoji-driven Sentiment Analysis in Financial Social Media

    May 10, 2026Ahmed Mahrous, Roberto Di PietroSocial Media AnalysisSentiment Analysis