From Two Passes to One: Compact and Efficient Target-Stance Extraction
Organizations: University of Florida, Gainesville, FL, USA
Abstract
Target-Stance Extraction (TSE) is the task of predicting both the target (or topic) of an author's writing and the author's stance toward it. Existing approaches to TSE use a sequential pipeline of two separate neural models: one to identify the target and another to determine the stance. We present a one-pass, joint architecture that predicts both in a single forward pass, reducing trainable parameters by nearly 50% with only a 4-7 F1 point tradeoff in performance. We further demonstrate that standard target-scrubbing practices artificially suppress target prediction accuracy. Retaining explicit target mentions, as in real-world deployments, improves F1 by at least 6 points across both target classification and target generation settings. These improvements allow for significantly easier integration of TSE in downstream applications such as public opinion tracking.
Figures & tables
| Subset | #Train / #Val / #Test | Unique Targets |
|---|---|---|
| SE | 2160/359/1080 | Atheism, Feminist Movement, Hillary Clinton, Abortion |
| AM | 18341/2042/5109 | Abortion, Cloning, Death Penalty, Gun Control, Marijuana Legalization, Minimum Wage, Nuclear Energy, School Uniforms |
| C19 | 4533/800/800 | Face Masks, Fauci, Stay at Home Orders, School Closures |
| PS | 17224/2193/2157 | Joe Biden, Bernie Sanders, Donald Trump |
| Unrelated | 8800/1120/1880 | Unrelated |
| Algorithm | Two-Pass | One-Pass |
|---|---|---|
| TC Li et al. (2023) | 75.59 | - |
| TC (Ours) | 76.19 | 76.23 |
| +No Hashtag | 74.51 | 74.58 |
| +No Scrub | 84.67 | 83.95 |
| +No Hashtag + No Scrub | 83.79 | 82.27 |
| TG Li et al. (2023) | 48.31 | - |
| Algorithm | Two-Pass | One-Pass |
|---|---|---|
| TC Li et al. (2023) | 53.30 | - |
| TC (Ours) | 54.00 | 50.67 |
| +No Hashtag | 52.94 | 49.39 |
| +No Scrub | 60.89 | 59.41 |
| +No Hashtag + No Scrub | 60.73 | 58.41 |
| TG Li et al. (2023) | 38.92 | - |
| Algorithm | Two-Pass | One-Pass |
|---|---|---|
| TC Li et al. (2023) | 75.28 | - |
| TC (Ours) | 75.91 | 69.74 |
| +No Hashtag | 75.91 | 69.48 |
| +No Scrub | 75.27 | 72.96 |
| +No Hashtag + No Scrub | 75.27 | 75.27 |
| TG Li et al. (2023) | 79.49 | - |
| Scenario | Relative | Absolute |
|---|---|---|
| TC | 49.89% | 135,505,171 |
| TG | 48.32% | 133,142,803 |
| Target | |||
|---|---|---|---|
| Corpus | Document | Generated | GT |
| SE | @DesireeAaron @ Hillary Clinton Sheets Clinton Ya got to love it # Hillary onCNN # Hillary Clinton #SemST | donald trump | Hillary Clinton |
| AM | Proponents of a higher minimum wage state that the current federal minimum wage of $ 7.25 per hour is too low for anyone to live on ; that a higher minimum wage will help create jobs and grow the economy ; that the declining value of the minimum wage is one of the primary causes of wage inequality between low - and middle-income workers ; and that a majority of Americans , including a slim majority of self-described conservatives , support increasing the minimum wage . | income inequality | minimum wage |
| C19 | @Morning_ Joe Well, you Morning joe , idiots President Trump was correct on using #hydroxychloriquine for #coronavirus and # Trump did not need #Dr Fauci to tell him to use it or not. #mikabrzezinski is a Dope, who is 2nd fiddle to Joe . So get behind your Man? and stay there Mika. | bronzirus | fauci |
| PS | Former Vice President Joe Biden holds a community event in Muscatine, Iowa. # Joe Biden # Biden #IowaCaucus @Team Joe @ Joe Biden # Biden s #Iowa #muscatine @jules1327 @JennyUwishuknew @jmill_30 @morenoandreak @BlueTxBlue Live Link | primaries and caucuses | Joe Biden |
| Unrelated | Lovin’ that jazz. https://t.co/AAf5cBucla | jazz | Unrelated |
| Target | Stance | |||||
|---|---|---|---|---|---|---|
| Corpus | Document | Generated | Mapped | GT | Predicted | GT |
| SE | My Jesus, I wish to do nothing but Thy most holy will. #Saint Philip Neri #Catholic #SemST | religion and churches | Feminist Movement | Atheism | Against | Against |
| AM | Abortions cause psychological damage . | mental health | abortion | abortion | Against | Against |
| C19 | My wife and I were not allowed to work as they say we now have to wear a mask. When told we are exempt they said we need letter from doctor to prove it. Rang doctor’s and they say they will not give us a letter or refer us privately for one. #KBF | mask | face masks | face masks | Neutral | Against |
| PS | How about @BetoORourke & @KamalaHarris ticket? Not sure if @JoeBiden has been around too long??? | rourke & amp kamala harris | Joe Biden | Joe Biden | Against | Against |
| Unrelated | @HellNaw4Life @iamDOAS Hispanics & Latinos are already white | hispanic americans | Donald Trump | Unrelated | Neutral | Neutral |
Stance Detection
Stance detection identifies whether people support, oppose, or remain neutral toward a target, claim, or position in text and conversation.
See all 36 papers