PTCG: Persona-guided Tree-based Counterargument Generation
Organizations: Sungkyunkwan University · Seoul National University · University of Richmond · NAVER Cloud
Abstract
The ability to generate counterarguments is important for critical thinking and balanced discourse, yet existing approaches typically produce only a single counterargument, failing to capture the diversity and persuasiveness required in real-world debates. To address this limitation, we propose Persona-guided Tree-based Counterargument Generation (PTCG), a framework that combines Tree-of-Thoughts-inspired step-wise generation and pruning with speaker persona selection. By estimating the author's persona from the original argument and incorporating speaker personas representing distinct perspectives, PTCG operationalizes perspective-taking and enables the generation of diverse counterarguments. Results from LLM-as-a-Judge, classifier-based assessment, and human evaluations indicate that PTCG shows consistent improvements in both the diversity and persuasiveness of counterarguments compared to baseline methods.
Figures & tables
| Backbone | Method | Persuasiveness | Perspective | |
| General | Targeted | Diversity | ||
| LLaMA3.1-8B | Vanilla | |||
| CoT | ||||
| Argument Undermining | ||||
| Joint One-seq | ||||
| PTCG (Ours) | ||||
| Backbone | Method | Avg. | Max |
| LLaMA3.1-8B | Vanilla | 0.84 | 0.88 |
| CoT | 0.82 | 0.87 | |
| Argument Undermining | 0.64 | 0.83 | |
| Joint One-seq | 0.42 | 0.78 | |
| PTCG (Ours) | 0.81 | 0.90 | |
| LLaMA3.2-1B | Vanilla | 0.80 | 0.86 |
| Configuration | Persuasiveness | Perspective | |
| General | Targeted | Diversity | |
| LLaMA3.1-8B | |||
| + Persona | |||
| + CoT-based Gen. ( =1; linear chain) | |||
| + Tree-based Gen. ( =3; tree search) | |||
| + Persona + Tree-based Gen. (PTCG) | |||
Appendix figures & tables23 assets
Supplementary material from the paper’s appendix.
Appendix
| Backbone | Method | App. | Cla. | Gra. | Rel. |
| LLaMA3.1-8B | Vanilla | 4.40 | 4.27 | 4.74 | 4.70 |
| AU | 2.46 | 2.36 | 2.37 | 2.80 | |
| Joint One-seq | 3.02 | 3.06 | 3.22 | 3.22 | |
| PTCG (Ours) | 4.55 | 4.34 | 4.87 | 4.75 | |
| LLaMA3.2-1B | Vanilla | 3.95 | 3.90 | 4.32 | 4.18 |
| AU | 2.55 | 2.46 | 2.61 | 2.59 |
| Method / Configuration | Persuasiveness | Perspective | |
| General | Targeted | Diversity | |
| Vanilla | 7.79 0.0031 | 7.59 0.0023 | 3.78 0.0021 |
| Persona_All_Same | 8.32 0.0038 | 7.93 0.0042 | 4.25 0.0064 |
| Persona_All_Nearest | 8.39 0.0030 | 7.98 0.0007 | 4.27 0.0071 |
| Persona_All_Furthest | 8.25 0.0034 | 7.86 0.0022 | 4.17 0.0068 |
| Method (Ours) | 8.32 0.0025 | 7.93 0.0032 | 4.28 0.0024 |
| Configuration | App. | Cla. | Gra. | Rel. |
| LLaMA3.1-8B | 4.40 | 4.27 | 4.74 | 4.70 |
| + Persona | 3.82 | 3.81 | 4.38 | 3.99 |
| + CoT-based Gen. ( =1; linear chain) | 4.69 | 4.43 | 4.93 | 4.82 |
| + Tree-based Gen. ( =3; tree search) | 4.70 | 4.44 | 4.93 | 4.83 |
| + Persona + Tree-based Gen. (PTCG) | 4.55 | 4.34 | 4.87 | 4.75 |
| Model | Avg end-to-end latency/OP (s) | Per response (s) | Percentage (%) |
| LLaMA3.1-8B (n=1) | 100.00 | ||
| LLaMA3.1-8B (n=3) | 34.49 | ||
| LLaMA3.1-8B + PTCG (n=1) | 156.33 | ||
| LLaMA3.1-8B + PTCG (n=3) | 82.59 | ||
| LLaMA3.1-8B + PTCG (n=5) | 111.71 |
| Model | Throughput (tokens/s) | Total Time (s) |
| LLaMA3.1-8B (n=1) | ||
| LLaMA3.1-8B (n=3) | ||
| LLaMA3.1-8B + PTCG (n=1) | ||
| LLaMA3.1-8B + PTCG (n=3) | ||
| LLaMA3.1-8B + PTCG (n=5) |
| Ablation | Avg end-to-end latency/OP (s) | Per response (s) | Percentage (%) |
| LLaMA3.1-8B | 100 | ||
| + Persona | 111.93 | ||
| + Tree-based Gen. | 211.01 | ||
| + Persona + Tree-based Gen. | 239.45 |
| Ablation | Throughput (tokens/s) | Total Time (s) |
| LLaMA3.1-8B | ||
| + Persona | ||
| + Tree-based Gen. | ||
| + Persona + Tree-based Gen. |
| Model | Precision | Recall | F1-score | Accuracy |
| RoBERTa | 0.52 | 0.94 | 0.67 | 0.54 |
| DeBERTa | 0.62 | 0.67 | 0.65 | 0.64 |
| Longformer | 0.63 | 0.78 | 0.70 | 0.66 |
| Title (claim): Organ donation should be mandatory. |
| Estimated Persona: A likely individual from a Western country with a high level of education, possibly a university student or recent graduate, who is familiar with utilitarian philosophy and holds liberal or progressive views. |
| LLaMA3.1-8B-Instruct (Vanilla) |
| Counterargument 1: Mandatory organ donation could be considered an infringement on personal autonomy and bodily integrity . The argument that someone would want their organs donated if they were in a similar situation is based on a flawed assumption that people’s desires in hypothetical situations can be accurately predicted. … |
| Counterargument 2: The argument for mandatory organ donation relies heavily on a utilitarian perspective , which prioritizes the greatest good for the greatest number of people. However, this approach can overlook the individual experiences and needs of those who may be affected by mandatory organ donation. For example, certain communities or individuals may have strong cultural or personal objections to organ donation that cannot be ignored. … |
| Counterargument 3: The assumption that all people’s organs should be made available for donation after death is based on a flawed understanding of the complexities surrounding organ donation and transplantation. In many cases, organs may be unsuitable for donation due to various medical conditions, such as cancer or HIV. … |
| LLaMA3.1-8B-Instruct (PTCG) |
| Title (claim): Scientists should be allowed to patent their theories. |
| Estimated Persona: A layperson with a passion for science and intellectual property, possibly a student or enthusiast who has been exposed to basic concepts of physics and patent law. |
| LLaMA3.1-8B-Instruct (Vanilla) |
| Counterargument 1: Allowing scientists to patent their theories could stifle the advancement of knowledge by creating a barrier to entry for future researchers. Patenting theories would essentially turn scientific discovery into a competitive marketplace, where the primary goal is to secure intellectual property rights rather than to advance understanding. This could lead to a situation where groundbreaking research is delayed or even abandoned due to concerns about potential patent infringement. … |
| Counterargument 2: … patenting theories would also create a new class of intellectual property owners who would have a vested interest in suppressing alternative explanations or discoveries that might challenge their patents. This would lead to a situation where scientific progress is hindered by the need to navigate complex patent portfolios and negotiate licensing agreements. … |
| Counterargument 3: Patenting scientific theories would create a situation where individual scientists are rewarded for their contributions, while the broader scientific community is left to pick up the pieces. Moreover, the fact that scientists are often motivated by a desire to make a discovery or advance our understanding of the world suggests that financial rewards are not the primary driver of scientific progress. In fact, many of the most groundbreaking discoveries in history were made by scientists who were driven by curiosity and a passion for knowledge, rather than a desire for financial gain. … |
| LLaMA3.1-8B-Instruct (PTCG) |
| Title (claim): Kids should not be allowed in a movie theater after a certain time. |
| Estimated Persona: A likely adult film-goer, possibly a young adult or someone with a family of their own, who values a quiet and immersive cinematic experience. |
| LLaMA3.1-8B-Instruct (Vanilla) |
| Counterargument 1: … Implementing an age-based restriction on movie theater entry times may not be an effective solution. Such a rule would be difficult to enforce in a large theater. Rather than implementing a blanket restriction, theaters could consider alternative measures such as offering designated showtimes for families, which would allow for greater flexibility without relying on an overly simplistic solution. … |
| Counterargument 2: … The argument overlooks the fact that many children are capable of behaving respectfully to other patrons. Rather than viewing children as a nuisance, theaters should focus on creating a more welcoming and child-friendly environment. By embracing children as part of the audience, theaters can build a loyal customer base and promote a love of cinema that will last a lifetime. … |
| Counterargument 3: … Restricting access raises questions about the impact on families who enjoy going to the movies together. This policy would not address the root cause of the problem, which is a lack of social behavior in public spaces. Rather than restricting access to the movie theater, it would be more effective to focus on general community programs that support families, creating a more positive and welcoming environment for everyone. … |
| LLaMA3.1-8B-Instruct (PTCG) |
| Min Cluster Size | # of Clusters | Silhouette Score | Calinski–Harabasz Index |
| 25 | 280 | 0.6255 | 16008.35 |
| 50 | 147 | 0.6416 | 22752.07 |
| 100 | 58 | 0.6251 | 17977.72 |
| 200 | 39 | 0.6513 | 24054.99 |
| 300 | 27 | 0.6081 | 26879.54 |
Computational Argumentation
Computational argumentation studies how to represent, analyze, and apply arguments and their relationships using formal and computational methods.
See all 99 papers