Objective Mispricing Detection for Shortlisting Undervalued Football Players via Market Dynamics and News Signals
Organizations: School of Computing and Mathematics, Manchester Metropolitan University, Manchester, United Kingdom · Typewind Ltd., London, United Kingdom
Abstract
We present a practical, reproducible framework for identifying undervalued football players grounded in objective mispricing. Instead of relying on subjective expert labels, we estimate an expected market value from structured data (historical market dynamics, biographical and contract features, transfer history) and compare it to the observed valuation to define mispricing. We then assess whether news-derived Natural Language Processing (NLP) features (i.e., sentiment statistics and semantic embeddings from football articles) complement market signals for shortlisting undervalued players. Using a chronological (leakage-aware) evaluation, gradient-boosted regression explains a large share of the variance in log-transformed market value. For undervaluation shortlisting, ROC-AUC-based ablations show that market dynamics are the primary signal, while NLP features provide consistent, secondary gains that improve robustness and interpretability. SHAP analyses suggest the dominance of market trends and age, with news-derived volatility cues amplifying signals in high-uncertainty regimes. The proposed pipeline is designed for decision support in scouting workflows, emphasizing ranking/shortlisting over hard classification thresholds, and includes a concise reproducibility and ethics statement.
Figures & tables
| Item | Value | Description |
|---|---|---|
| Unique Players | 19,982 | Structured player records from Transfermarkt |
| News Articles | 70,627 | Multi-source football news mentioning players |
| Market Value Records | 280,334 | Weekly time-stamped valuations |
| Avg. Articles/Player | 44.20 | Mean article count per player |
| Temporal Range | 2015–2024 | Shared coverage period |
| Model | RMSE | MAE | R 2 |
|---|---|---|---|
| XGBoost | 0.453 | 0.337 | 0.935 |
| TabNet | 0.920 | 0.695 | 0.732 |
| Linear Regression | 1.109 | 0.863 | 0.611 |
| XGBoost | TabNet | Random Forest (RF) | ||||
|---|---|---|---|---|---|---|
| Variant | ROC AUC | F1 | ROC AUC | F1 | ROC AUC | F1 |
| Full Model | 0.677 | 0.263 | 0.614 | 0.206 | 0.471 | 0.137 |
| No Text | 0.604 | 0.250 | 0.560 | 0.247 | 0.553 | 0.208 |
| Text Only | 0.514 | 0.264 | 0.508 | 0.295 | 0.488 | 0.050 |