Constructing a Regional Slang Lexicon for Electricity Demands via Soft-Label Bidirectional Anchoring and Active Learning
Authors: Rong Chang, Lijing Shi, Zhaoxiang Zang
Organizations: Yuxi Power Supply Bureau, Yunnan Power Grid Co., Ltd., Yuxi, 653100, China. · Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, 650504, China. · Key Laboratory of Artificial Intelligence in Yunnan Province, Kunming University of Science and Technology, Kunming, 650504, China.
Power-grid customer service increasingly relies on community social media, where customers describe outages, billing, and equipment faults in informal regional dialect. Such messages exhibit non-standard morphology, semantic drift, and out-of-vocabulary expressions that make manual lexicon construction costly and degrade conventional NLP tools. We propose a weak-supervision framework constructing a regional slang lexicon from curated dialect anchors and power-domain seed terms. Candidates are generated via Pointwise Mutual Information with soft-label bidirectional anchoring, retaining dialect-anchored terms while recording power-domain relevance as separate metadata, and are scored by combining Sentence-BERT semantic similarity with a jieba-based wordhood measure. Uncertainty-aware active learning with rule-based and retrieval-augmented LLM oracles is applied under three query strategies, and the resulting lexicon is evaluated by a higher-capability LLM calibrated against human expert annotations via Cohen's κ. On 11,177 real WeChat messages from Yuxi (Yunnan, China), the framework achieves an evaluator-estimated dialect precision of DP~=~1.0 with zero false positives. An ablation shows that soft-label layering retains 751% more candidates than strict power-gating at identical precision, expanding the candidate pool from 41 to 349 terms. Human calibration (n=46) yields κdialect=1.0 and κpower=0.85. The resulting 25--33-term lexicon, 4--5 of which are power-relevant, provides a preliminary resource for dialect-aware power-grid service NLP.
Figures & tables
Chinese term (pinyin)
Literal meaning
Power-grid meaning
Translated example
扎实 (zhashi)
Sturdy, solid, firm
Severe, very, intense
“雷打得扎实, 变压器都跳了” (The thunder was intense; the transformer tripped).
鬼火 (guihuo)
Phosphorescence, will-o’-the-wisp
Anger, frustration, annoyance
“三天两头停电, 哪个不鬼火?” (Outages every few days; who would not be frustrated?).
给有 (gei you)
To give, to have
Is there? Does it exist? (question marker)
“供电局呢领导, 给有电了嘛?” (Power bureau leaders, is there electricity yet?).
着炸 (zhao zha)
Affected + to explode
Damaged by electrical surge, shorted
“表箱着炸掉了, 快点来看哈” (The meter box was damaged by a surge; please come and check it).
老火 (laohuo)
Old fire
Severe, terrible, critical (intensifier)
“线路老火, 快派人来修” (The line fault is severe; please send someone to repair it).
Table 1: Semantic drift in Yuxi dialect terms within power-grid service contexts. Pinyin is provided for Chinese terms, and each example includes an English translation.
Figure 1: Overview of the four-stage pipeline.
Figure 2: Candidate generation pipeline: from raw corpus to filtered candidate pool.
Figure 3: Bidirectional anchoring: hard-gate versus soft-label comparison.
Figure 4: Active learning loop: iterative query–verify–update cycle with three query strategies and twin oracles.
Parameter
Value
Description
τhigh
0.78
Auto-accept threshold
τlow
0.45
Rejection threshold
τbound
0.60
Decision boundary
α / β
0.6 / 0.4
SBERT / wordhood weights
K
5
Candidates per AL round
Rmax
3
Maximum AL iterations
Table 2: Hyperparameter configuration for all experiments.
Model
DP
PDP
∣Ld∣
∣Lpd∣
Lexicon
Queries
Margin + Rule (Soft-Label)
1.0
0.160
25
4
25
15
TD-CAL + Rule
1.0
0.148
27
4
27
15
Margin + LLM
1.0
0.125
32
4
32
15
Proposed (TD-CAL + LLM)
1.0
0.125
32
4
32
15
Random + LLM
1.0
0.121
33
4
33
15
Margin + Rule (Hard Gate)
1.0
0.625
8
5
8
5
Table 3: Main experimental results for all six configurations. DP and PDP are computed by the independent LLM evaluator calibrated against n=46 human annotations. ∣Ld∣ and ∣Lpd∣ denote the sizes of the dialect and power-dialect lexicon subsets, respectively.
Figure 5: (a) Power-Dialect Precision (PDP) and (b) lexicon size across the five experiment configurations. Rule-oracle configurations (left two bars) achieve higher PDP on smaller lexicons; LLM-oracle configurations (right three bars) produce larger lexicons with lower PDP. See Table 3 for exact values.
Pipeline Stage
Hard Gate
Soft Label
Δ
Candidates extracted
41
349
+751%
After fragment filter
9
58
+544%
Uncertain pool ∣U∣
5
39
+680%
Final lexicon ∣L∣
8
25
+213%
DP
1.0
1.0
—
Table 4: Soft-label versus strict power-gate ablation: pipeline throughput at each stage. Hard Gate applies the power-related check as a binary filter across all extraction paths (bigram, unigram, and anchor injection); Soft Label retains all dialect-anchored candidates. Both configurations use margin sampling with rule-based oracle at three AL rounds. Δ = percentage increase of Soft Label over Hard Gate.
Figure 6: Soft-label vs. hard gate ablation: pipeline throughput at each stage. The soft-label approach (blue) consistently retains more candidates, with the largest gain at the extraction stage (+751%).
Dimension
κ
95% CI
Verdict
has_dialect_features
1.0
—
Degenerate (all True)
power_domain_relevance
0.85
[0.64, 1.0]
Strong agreement
Table 5: Cohen’s κ between LLM evaluator (DeepSeek V4 Pro) and human expert annotations ( n=46 ).
Configuration
DP
PDP
Lexicon
Candidates
Unigram Noise
NPMI, no bidirectional anchoring
0.17–0.28
0.01–0.05
101–148
347–496
72–75%
PMI, strict power gate
1.0
0.63
8
41
0%
PMI, soft-label layering
1.0
0.12–0.16
25–33
349
0%
Table 6: Pipeline performance across three design iterations.
Figure 7: (a) Oracle acceptance rates. (b) Stacked bar view: colored segments show accepted candidates where both oracles accept regardless of query strategy; gray segments show rejected candidates where strategies can differentiate (11% for LLM vs. 53% for Rule).
Slang is a central component of everyday language, reflecting linguistic creativity, social identity, and cultural change, yet its dy- namic and non-standard nature makes it difficult to model computationally. We present the first large-scale computational study of slang.gr, a crowdsourced lexicon of Greek non-standard language, combining lexical content, user-generated tags, and interaction data. To enable the systematic analysis, we map noisy folksonomic tags to a structured multi-layer taxonomy capturing both semantic categories and sociolinguistic metadata. Using this representation, we analyze the linguistic structure of Greek slang and the behavior of its contributor community. We find that slang is strongly centered on person-related and evaluative language, exhibits high morphological creativity, and is shaped by highly skewed participation with short user lifespans and overlapping communities. Building on these signals, we introduce a community-based confidence score for definitions that integrates user roles, interaction patterns, and moderation signals. Our results show that taxonomy-based representations improve interpretability while retaining meaningful aspects of behavioral structure, enabling a more structured and interpretable analysis of confidence signals. Overall, this work establishes slang.gr as a computational resource for non-standard Greek and provides a foundation for sociolinguistic NLP, bias analysis, and the study of informal language in LLMs.
We propose an unsupervised method of resolving slang, unique entities, and folklore from online communities by isolating words in the lexicon that have the highest magnitude of semantic shift. Semantic shift is defined as the evolution of a word's encoded representation as a result of fine-tuning a pretrained Large Language Model (LLM) on a community-specific text corpus. This value is inversely proportional to the cosine similarity between the base model's encoded representation of a word, and a fine-tuned model's encoded representation. We fine-tune the DistilRoBERTa model on text corpora collected from 3 Reddit subreddits (r/Technology, r/Gaming, r/WorldofWarcraft), model a distribution of cosine similarity over the lexicon, and show that one can successfully resolve words that have unique significance to the community by pulling data in the bottom 10-percentile. In contrast, we show that data in the top 10-percentile consist of words that carry relatively universal semantics.
Julia Kruk, Sanchita Porwal, Amitrajit Bhattacharjee +1
Georgia Institute of Technology College of Computing Atlanta, GA, USA
Automatic induction of high-quality dictionaries is essential for building lexical resources, yet low-resource languages and dialects pose several challenges: limited access to annotators, high degree of spelling variations, and poor performance of large language models (LLMs). We empirically show that statistical models (random forests) trained on string similarity features are surprisingly effective for inducing German dialect lexicons. They outperform LLMs, enable cross-dialect transfer, and offer a lightweight data-driven alternative. We evaluate our models intrinsically on bilingual lexicon induction (BLI) and extrinsically on dialect information retrieval (IR). On BLI, random forests outperform Mistral-123b while being more resource-lean. On dialect IR with BM25, using our dialect dictionaries for query expansion yields relative improvements of up to 28.9% in nDCG@10 and 50.7% in Recall@100. Motivated by the resource scarcity in dialects, we further investigate the extent to which models transfer across different German dialects, and their performance under varying amounts of training data.
Robert Litschko, Barbara Plank, Diego Frassinelli
MaiNLP, Center for Information and Language Processing, LMU Munich, Germany · Munich Center for Machine Learning (MCML), Munich, Germany