LOLGORITHM: Funny Comment Generation Agent For Short Videos
Authors: Xuan Ouyang, Bouzhou Wang, Senan Wang, Siyuan Xiahou, Jinrong Zhou, Yuekang Li
Organizations: University of New South Wales Sydney, Australia · University of Sydney Sydney, Australia · The University of Hong Kong Hong Kong, China · University of Southern California Los Angeles, USA
Short-form video platforms have become central to multimedia information dissemination, where comments play a critical role in driving engagement, propagation, and algorithmic feedback. However, existing approaches -- including video summarization and live-streaming danmaku generation -- fail to produce authentic comments that conform to platform-specific cultural and linguistic norms. In this paper, we present LOLGORITHM, a novel modular multi-agent framework for stylized short-form video comment generation. LOLGORITHM supports six controllable comment styles and comprises three core modules: video content summarization, video classification, and comment generation with semantic retrieval and hot meme augmentation. We further construct a bilingual dataset of 3,267 videos and 16,335 comments spanning five high-engagement categories across YouTube and Douyin. Evaluation combining automatic scoring and large-scale human preference analysis demonstrates that LOLGORITHM consistently outperforms baseline methods, achieving human preference selection rates of 80.46% on YouTube and 84.29% on Douyin across 107 respondents. Ablation studies confirm that these gains are attributable to the framework architecture rather than the choice of backbone LLM, underscoring the robustness and generalizability of our approach.
Figures & tables
Figure 1. Workflow of the LOLGORITHM framework …
Figure 2. A Single Composite Image Example …
Platform
TS
HC
FA
DLJ
CS
Other
YouTube
3
3
3
4
3
4
Douyin
3
4
2
4
3
4
Table 1. Details of the videos used for benchmarking. TS: Talk Show; HC: Humorous Commentary; FA: Funny Animal; DLJ: Daily Life Jokes; CS: Comedy Skits.
Model
Orig.
Rel.
Style
Total
V2Xum-LLM
1.38
8.24
1.10
3.57
LiveChat
1.21
7.49
5.44
4.71
Qwen3.5-9b (Direct)
1.75
7.66
2.42
3.94
LOLGORITHM
1.75
7.98
6.59
5.44
Table 2. Scoring results on Douyin dataset.
Model
Orig.
Rel.
Style
Total
V2Xum-LLM
2.73
8.03
1.75
4.17
LiveChat
2.37
5.14
6.77
4.76
Qwen3.5-9b (Direct)
2.21
5.40
4.09
3.90
LOLGORITHM
3.26
7.70
4.76
4.90
Table 3. Scoring results on YouTube dataset.
Model
Orig.
Rel.
Style
Total
Qwen3.5-9b (Direct)
1.75
7.66
2.42
3.94
DeepSeek-R1
1.22
8.33
4.37
4.64
LLaMa4
1.29
8.26
5.43
4.99
LOLGORITHM (Qwen3.5-9b)
1.75
7.98
6.59
5.44
GPT-5.4
1.43
8.25
7.45
5.71
Table 4. Impact of backbone LLM on Douyin dataset.
Model
Orig.
Rel.
Style
Total
Qwen3.5-9b (Direct)
2.21
5.40
4.09
3.90
LOLGORITHM (Qwen3.5-9b)
2.25
7.70
4.76
4.90
GPT-5.4
2.27
7.78
4.73
4.93
LLaMa4
2.09
7.73
5.49
5.11
DeepSeek-R1
2.32
8.04
5.10
5.15
Table 5. Impact of backbone LLM on YouTube dataset.
Figure 3. Human evaluation results for comment generation.
Figure 4. Example comments generated by different techniques.