Beyond Cosine Similarity: Zero-Initialized Residual Complex Projection for Aspect-Based Sentiment Analysis
Organizations: School of Economics and Management, Xidian University, Xi’an, China
Abstract
Aspect-Based Sentiment Analysis (ABSA) faces critical challenges due to representation entanglement and false-negative collisions in real-valued embedding spaces. In this paper, we propose a novel framework featuring a Zero-Initialized Residual Complex Projection (ZRCP) and an Anti-collision Masked Angle Loss. Our approach projects textual features into a complex semantic space, utilizing the phase to isolate sentiment polarities while regularizing the amplitude to ensure structural consistency within aspect categories. To mitigate this, we introduce an anti-collision mask that preserves intra-polarity aspect cohesion while significantly expanding the discriminative margin between opposing polarities. Experimental results on the ASAP dataset demonstrate that our framework achieves a state-of-the-art Macro-F1 score of 0.8923, outperforming robust baselines.
Figures & tables
| Aspect | Zero-shot | RoB-pair | LCFS | DualGCN | SimCSE | AnglE (Form C) | Ours (AnglE+ZRCP) | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | |
| Transportation | 0.5359 | 0.6950 | 0.6559 | 0.8571 | 0.6834 | 0.8861 | 0.7950 | 0.9323 | 0.9039 | 0.9710 | 0.8622 | 0.9592 | 0.9022 | 0.9721 |
| Downtown | 0.4706 | 0.7217 | 0.5700 | 0.9245 | 0.6084 | 0.9363 | 0.7454 | 0.9658 | 0.7961 | 0.9682 | 0.8434 | 0.9776 | 0.7858 | 0.9717 |
| Easy to find | 0.5998 | 0.6601 | 0.7150 | 0.7696 | 0.7534 | 0.8076 | 0.9004 | 0.9297 | 0.9191 | 0.9424 | 0.9149 | 0.9401 | 0.9265 | 0.9482 |
| Queue | 0.6830 | 0.6851 | 0.7502 | 0.7511 | 0.7649 | 0.7660 | 0.7802 | 0.7809 | 0.8401 | 0.8404 | 0.8573 | 0.8574 | 0.8743 | 0.8745 |
| Hospitality | 0.7932 | 0.8526 | 0.8678 | 0.9039 | 0.8793 | 0.9138 | 0.9281 | 0.9497 | 0.9505 | 0.9660 | 0.9479 | 0.9642 | 0.9582 | 0.9714 |
| Model Variations | Macro-F1 | Acc |
|---|---|---|
| Ours (Full Framework) | 0.8923 | 0.9418 |
| Ablation on Network & Objective | ||
| ZRCP (Hard Chunking) | 0.8739 | 0.9319 |
| Anti-collision Mask | 0.8809 | 0.9336 |
| Angle Loss ( ) | 0.8843 | 0.9389 |
| Ablation on Data Strategy | ||
| Model | SemEval-2016 | MAMS-ACSA | ||
|---|---|---|---|---|
| Macro-F1 | Acc | Macro-F1 | Acc | |
| RoB-pair | 0.8180 | 0.8869 | 0.6383 | 0.7193 |
| DualGCN | 0.8289 | 0.9135 | 62.643 | 66.548 |
| SimCSE | 0.8457 | 0.8962 | 0.6038 | 0.7217 |
| AnglE (Format C) | 0.8632 | 0.9134 | – | – |
| AnglE (Format A) | 0.8784 | 0.9078 | 0.6532 | 0.7526 |
| Aspect Category | w/o AmpLoss | with AmpLoss | |
|---|---|---|---|
| Objective / Fact-based Aspects | |||
| Transportation | 0.8916 | 0.9022 | +1.06% |
| Downtown | 0.7489 | 0.7858 | +3.69% |
| Subjective / Descriptive Aspects | |||
| Decoration | 0.8556 | 0.8627 | +0.71% |
| Taste | 0.9265 | 0.9247 | -0.18% |
| Aspect | RoB-pair | DualGCN | SimCSE | AnglE (Format C) | AnglE (Format A) | Ours (ZRCP+Mask) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | |
| Restaurant General | 0.9549 | 0.9701 | 0.8923 | 0.9220 | 0.9780 | 0.9851 | 0.9780 | 0.9851 | 1.0000 | 1.0000 | 0.9780 | 0.9851 |
| Service | 1.0000 | 1.0000 | 0.9122 | 0.9122 | 0.9787 | 0.9825 | 0.9581 | 0.9649 | 0.9787 | 0.9825 | 0.9566 | 0.9649 |
| Food Quality | 0.9424 | 0.9737 | 0.8493 | 0.9433 | 0.8848 | 0.9474 | 0.9699 | 0.9868 | 0.9699 | 0.9868 | 0.9171 | 0.9605 |
| Food Style/Options | 0.7013 | 0.7826 | 0.8627 | 0.8913 | 0.7319 | 0.7826 | 0.7745 | 0.8261 | 0.7745 | 0.8261 | 0.7319 | 0.7826 |
| Food Prices | 0.8611 | 0.8667 | 0.8400 | 0.8500 | 0.9321 | 0.9333 | 0.9321 | 0.9333 | 1.0000 | 1.0000 | 0.9321 | 0.9333 |
| Aspect | RoB-pair | DualGCN | SimCSE | AnglE | Ours (AnglE+ZRCP) | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | F1 | Acc | |
| Food | 0.7298 | 0.7526 | 0.5237 | 0.5464 | 0.6008 | 0.6564 | 0.6920 | 0.7354 | 0.7224 | 0.7698 |
| Service | 0.7702 | 0.8077 | 0.5771 | 0.7308 | 0.6737 | 0.7308 | 0.7676 | 0.8205 | 0.8384 | 0.8590 |
| Staff | 0.6108 | 0.7870 | 0.5925 | 0.8284 | 0.6166 | 0.8047 | 0.5995 | 0.8047 | 0.6199 | 0.8047 |
| Price | 0.7540 | 0.7368 | 0.6735 | 0.6579 | 0.6647 | 0.6579 | 0.7868 | 0.7895 | 0.7210 | 0.7105 |
| Ambience | 0.5302 | 0.7188 | 0.5494 | 0.8125 | 0.5703 | 0.8438 | 0.5297 | 0.7188 | 0.5523 | 0.7500 |
Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA) identifies what people express opinions about and the sentiment or emotion attached to each aspect.
See all 52 papers