cs.CLJan 8, 2026

Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding

Authors: Sungmok JungYeonkyoung SoJoonhak LeeSangho KimYelim AhnJaejin Lee

Organizations: Graduate School of Data Science, Seoul National University · Dept. of Computer Science and Engineering, Seoul National University

Abstract

Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding-especially in Korean-are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance degrades under negation. We then introduce Thunder-KoNUBench, a sentence-level negation understanding benchmark that reflects the empirical distribution of Korean negation phenomena. Evaluating 47 LLMs on Thunder-KoNUBench, we analyze the effects of model size and instruction tuning, and perform error analysis to better understand model behavior. We further show that fine-tuning on Thunder-KoNUBench improves negation understanding and broader contextual comprehension in Korean.

Explore similar work

CardsList
  1. How Language Models Process Negation

    May 4, 2026Zhejian Zhou, Tianyi Zhou, Robin Jia +1NegationLarge Language Model Performance