BenCoDiC: A Large-Scale Contextual Cyberbullying Corpus for Bengali Political News Discourse FULL VERSION
Organizations: Big Data, Information and Knowledge Engineering Lab, Department of Computer Science and Engineering, University of Chittagong, Chattogram-4331, Bangladesh · Department of Computer Science and Engineering, Gopalganj Science and Technology University, Gopalganj-8105, Bangladesh · Department of Computer Science and Engineering, Bangladesh University, Dhaka-1207, Bangladesh
Abstract
Cyberbullying is a growing concern in online communities, yet existing Bengali corpora remain limited in contextual information, annotation transparency, scale, accessibility, and support for multidimensional analysis, thereby hindering robust detection and comprehensive study of harasser behaviors and networks. To address these gaps, we introduce the Bengali Contextual and Diverse Cyberbullying (BenCoDiC) corpus, a publicly available contextual cyberbullying resource for Bengali political news discourse comprising 50,250 textual instances collected from 100 YouTube videos and their associated discussions. The corpus preserves caption--comment--reply relationships and is organized through a nine-dimensional star schema covering users, videos, textual content, context, time, engagement, political parties, target identities, and language categories. Five AI chatbots were initially evaluated for annotation but did not meet the predefined reliability criterion. Consequently, a two-tier human annotation process with expert verification was adopted, achieving Fleiss' and Krippendorff's . Statistical analyses characterize the corpus, while transformer-based experiments show that incorporating conversational context yields modest but consistent improvements over isolated-text classification. BenCoDiC supports context-aware cyberbullying detection and perpetrator-oriented behavioral and network analysis. The corpus is available at https://github.com/bencodic/BenCoDiC-Corpus.
Figures & tables
| Reference | Task | Source | Ln | Cls | RG1 | RG2 | RG3 | |||||
| CHP | CnM | CAE | AG | AP | ARM | Size | PA | |||||
| Romim et al. [ 13 ] | Hate speech | Facebook, YouTube | Bn | BC | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | 30000 | ✓ |
| Islam et al. [ 20 ] | Abusive | Facebook, YouTube | Bn | BC | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | 12028 | ✗ |
| Jahan et al. [ 22 ] | Abusive | Bn, BnEn, RBn | BC | ✗ | ✗ | ✗ | ✗ | ✓ | ✗ | 2000 | ✗ | |
| Chakraborty and Seddiqui [ 23 ] | Threat, abusive | Bn | BC | ✗ | ✗ | ✗ | ✗ | ✗ | ✗ | 5644 | ✗ | |
| Bhattacharya et al. [ 27 ] | Aggression, Misogyny | YouTube | Bn, Hn, En | BC, MC | ✗ | ✗ | ✗ | ✓ | ✓ | ✓ | 25,000 | ✓ |
| Fact and | Attribute/ | Description |
| Dimension | Column | |
| userId | Persistent anonymized identifier of the author’s YouTube channel | |
| handler | Anonymized handler of the author’s YouTube channel | |
| title | Anonymized title of the author’s YouTube channel | |
| User | subscriberCount | Total number of channel subscribers |
| videoCount | Total number of videos uploaded by the channel |
| AI | Accuracy (%) | Mean | 95% CI (%) | ||||
|---|---|---|---|---|---|---|---|
| Chatbot | E-1 | E-2 | E-3 | E-4 | (%) | LB | UB |
| ChatGPT | 71.00 | 71.40 | 69.80 | 76.60 | 72.20 | 67.41 | 76.99 |
| Grok 3 | 80.2 | 75.8 | 82.0 | 81.0 | 79.75 | 75.40 | 84.10 |
| DeepSeek | 76.0 | 75.6 | 78.0 | 74.4 | 76.00 | 73.62 | 78.38 |
| Gemini | 71.4 | 70.4 | 69.6 | 71.2 | 70.65 | 69.34 | 71.96 |
| Perplexity | 70.6 | 69.6 | 68.0 | 66.0 | 68.55 | 65.35 | 71.75 |
| Measure | Level-1 | Level-2 |
|---|---|---|
| Fleiss’ | 0.81 | 0.86 |
| Krippendorff’s | 0.81 | 0.86 |
| Unanimous decisions (3–0), (%) | 43,286 (86.14) | 45,158 (89.87) |
| Majority decisions (2–1), (%) | 6,964 (13.86) | 5,092 (10.13) |
| Text | Class |
|---|---|
| (You were also a sycophant) | Bully |
| (I want proper justice) | Not Bully |
| (That bloody cheat!) | Bully |
| (Thanks to the student community) | Not Bully |
| Class | min | max | avg | total | total |
|---|---|---|---|---|---|
| Word | Word | Word | Word | Sample | |
| Bully | 1 | 620 | 12.52 | 376,655 | 30,083 |
| Not Bully | 1 | 629 | 9.41 | 189,780 | 20,167 |
| Bully+Not Bully | 1 | 629 | 11.27 | 566,435 | 50,250 |
| Measure | Bully | Not Bully |
| Median words per sample | 8 | 5 |
| Vocabulary size | 44,980 | 26,157 |
| Shared vocabulary | 13,709 | |
| Combined unique vocabulary | 57,428 | |
| Jaccard vocabulary overlap | 23.87% | |
| Top five associated unigrams | ||
| Bully | Not Bully | |||||
|---|---|---|---|---|---|---|
| Engagement Measure | Mean | Median (IQR) | Mean | Median (IQR) | Spearman’s | |
| Likes | 1.62 | 0 (0–0) | 3.35 | 0 (0–1) | ||
| Replies | 0.10 | 0 (0–0) | 0.18 | 0 (0–0) | ||
| Month | Samples | Bully | Not Bully | Bully (%) |
|---|---|---|---|---|
| Jul. 2024 | 2,831 | 1,519 | 1,312 | 53.66 |
| Aug. 2024 | 15,432 | 9,696 | 5,736 | 62.83 |
| Sep. 2024 | 13,785 | 7,737 | 6,048 | 56.13 |
| Oct. 2024 | 12,849 | 7,347 | 5,502 | 57.18 |
| Nov. 2024 | 5,063 | 3,646 | 1,417 | 72.01 |
| Dec. 2024 | 116 | 59 | 57 | 50.86 |
| News | Number | Number of Samples | ||
|---|---|---|---|---|
| Channel | of Videos | Bully | Not Bully | Total |
| Jamuna TV | 12 | 4692 | 2967 | 7659 |
| SOMOY TV | 13 | 3373 | 2780 | 6153 |
| Channel 24 | 13 | 3541 | 2612 | 6153 |
| Ekattor TV | 13 | 4208 | 1954 | 6162 |
| Independent Television | 13 | 4403 | 1956 | 6359 |
| Political | Number | Number of Samples | Bully | ||
|---|---|---|---|---|---|
| Party | of Videos | Bully | Not Bully | Total | (%) |
| AL | 16 | 5142 | 2826 | 7968 | 64.53 |
| BNP | 16 | 4573 | 3377 | 7950 | 57.52 |
| JaPa | 16 | 6404 | 1838 | 8242 | 77.70 |
| Jamaat | 16 | 3474 | 4432 | 7906 | 43.94 |
| NCP | 16 | 4977 | 3087 | 8064 | 61.72 |
| Bengali | Romanized Bengali | Code-Mix | English | Emoji-Only | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Target Identity | Bully | Not Bully | Bully | Not Bully | Bully | Not Bully | Bully | Not Bully | Bully | Not Bully |
| Male | 9,291 | 5,303 | 2,005 | 721 | 203 | 131 | 356 | 683 | 45 | 1,331 |
| Female | 1,865 | 655 | 343 | 98 | 64 | 23 | 72 | 88 | 3 | 117 |
| Individual | 172 | 139 | 56 | 45 | 5 | 4 | 5 | 26 | 0 | 36 |
| People Group | 4,018 | 2,000 | 579 | 232 | 101 | 56 | 80 | 86 | 0 | 40 |
| Organization | 8,815 | 4,449 | 1,122 | 403 | 280 | 205 | 229 | 445 | 10 | 302 |
| Split Seed | Partition | Samples | Videos | Captions | Comments | Replies | Bully | Not Bully | Bully (%) |
|---|---|---|---|---|---|---|---|---|---|
| Train | 30,104 | 60 | 60 | 26,568 | 3,476 | 18,024 | 12,080 | 59.87 | |
| 0 | Validation | 10,180 | 20 | 20 | 8,888 | 1,272 | 6,133 | 4,047 | 60.25 |
| Test | 9,966 | 20 | 20 | 8,912 | 1,034 | 5,926 | 4,040 | 59.46 | |
| Train | 30,201 | 60 | 60 | 26,617 | 3,524 | 17,879 | 12,322 | 59.20 | |
| 42 | Validation | 9,952 | 20 | 20 | 8,775 | 1,157 | 6,042 | 3,910 | 60.71 |
| Test | 10,097 | 20 | 20 | 8,976 | 1,101 | 6,162 | 3,935 | 61.03 |
| Model | Setting | Macro Precision | Macro Recall | Macro F1 | Weighted F1 | Accuracy |
|---|---|---|---|---|---|---|
| BanglaBERT | Context-free | |||||
| Flat context | ||||||
| Bangla-Bert-Base | Context-free | |||||
| Flat context | ||||||
| BanglishBERT | Context-free | |||||
| Flat context |
| Model | Mean F1 | 95% CI | Significant |
|---|---|---|---|
| BanglaBERT | 0.0076 | Yes | |
| Bangla-Bert-Base | 0.0048 | Yes | |
| BanglishBERT | 0.0067 | Yes | |
| IndicBERT v2 | 0.0070 | Yes | |
| mBERT | 0.0084 | Yes | |
| XLM-R-base | 0.0061 | Yes |
| Configuration | Caption | Parent Comment | Macro F1 | Weighted F1 | Accuracy |
|---|---|---|---|---|---|
| A0 | No | No | |||
| A1 | Yes | No | |||
| A2 | No | Yes | |||
| A3 | Yes | Yes |