DLT-Corpus: A Large-Scale Text Collection for the Distributed Ledger Technology Domain
Organizations: Centre for Blockchain Technologies, University College London · Exponential Science Foundation · School of Informatics, University of Edinburgh
Abstract
We introduce DLT-Corpus, the largest domain-specific text collection for Distributed Ledger Technology (DLT) research to date: 2.98 billion tokens from 22.12 million documents spanning scientific literature (37,440 publications), United States Patent and Trademark Office (USPTO) patents (49,023 filings), and social media (22 million posts). Existing Natural Language Processing (NLP) resources for DLT focus narrowly on cryptocurrency price prediction and smart contracts, leaving domain-specific language underexplored despite the sector's ~$3 trillion market capitalization and rapid technological evolution. We demonstrate DLT-Corpus' utility by analyzing patterns of technology emergence and market-innovation correlations. Findings reveal that technologies first appear in our scientific literature subset before reaching patents and social media, following traditional technology transfer patterns. While social media sentiment remains overwhelmingly bullish even during crypto winters, scientific and patent activity grows less tied to short-term sentiment, tracking overall market expansion in a virtuous cycle in which research precedes and enables economic growth that, in turn, funds further innovation. We release the DLT-Corpus and companion artifacts: LedgerBERT (+23% over BERT-base on DLT-specific Named Entity Recognition (NER) task), a sentiment analysis dataset of 23,301 crypto news headlines and descriptions, tools, and code.
Figures & tables
| Corpus | Type | Density | Doc. Cov. | JS Div. |
|---|---|---|---|---|
| Social Media | Domain | 86.92 | 96.3% | 0.44 |
| Patents | Domain | 25.27 | 99.8% | 0.45 |
| Scientific Lit. | Domain | 19.68 | 100.0% | 0.39 |
| DLT-Corpus avg. | Domain | 43.96 | 98.7% | 0.43 |
| RefinedWeb | General | 4.96 | 55.6% | 0.10 |
| C4 | General | 5.14 | 51.9% | 0.10 |
| Model | Parameters | NER F1 |
|---|---|---|
| General Baselines | ||
| BERT-base ( Devlin et al., 2019 ) | 110M | 0.243 |
| MosaicBERT-base ( Portes et al., 2023 ) | 109M | 0.076 |
| ModernBERT-base ( Warner et al., 2025 ) | 149M | 0.209 |
| Domain-Adapted Baselines | ||
| SciBERT ( Beltagy et al., 2019 ) | 110M | 0.289 |
| Model | Market | Content | Engagement |
|---|---|---|---|
| Direction | Characteristics | Quality | |
| BERT-base | 0.577 | 0.514 | 0.539 |
| DistilBERT-base | 0.570 | 0.508 | 0.544 |
| SciBERT | 0.591 | 0.514 | 0.532 |
| LedgerBERT | 0.590 | 0.502 | 0.537 |
| vs. SciBERT | -0.2% | -2.3% | +0.9% |
| Field | Description |
|---|---|
| paperId | Semantic Scholar identifier |
| title | Publication title |
| abstract | Publication abstract |
| text | Full text in Markdown format |
| url | URL to the source document |
| year | Publication year |
| Field | Description |
|---|---|
| Patent Number | USPTO patent number (e.g., US10123456B2) |
| Document ID | Unique document identifier |
| Title | Patent title |
| text | Full patent text |
| Date Published | Publication date |
| Filing Date | Application filing date |
| Field | Description |
|---|---|
| tweet | Tweet text |
| timestamp | Post creation time |
| year | Post year |
| language | Detected language |
| sentiment_class | Sentiment category |
| sentiment_label | Sentiment label |
| Document Type | Period | Spearman’s | -value |
|---|---|---|---|
| Scientific literature | 2013-2024 | 0.76 | 0.004 |
| Patents | 2013-2024 | 0.96 | 0.001 |
| Social media | 2013-2023 | 0.98 | 0.001 |
| Lag (years) | Scientific | Social Media | Patents |
|---|---|---|---|
| Document volumes lead market | |||
| 0.86** | 0.77 | 0.86** | |
| 0.90** | 0.82* | 0.90** | |
| 0.93*** | 0.95*** | 0.93*** | |
| 0.95*** | 0.88** | 0.95*** | |
| 0.94*** | 0.90*** | 0.95*** | |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Field | Description |
|---|---|
| title | Article headline |
| description | Article summary |
| text | Combined title and description |
| timestamp | Publication time |
| url | Original article link |
| source_url | CryptoPanic news link |