Critic's Eye: Review-Grounded Graph Reasoning for Long-Form Motif Discovery
Organizations: College of Computer Science and Artificial Intelligence, Fudan University · Shanghai Key Laboratory of Intelligent Information Processing
Abstract
Deep narrative understanding requires distinguishing what happens from how it is presented, moving beyond the chronological fabula to decode the sjuzet, the discursive organization through which themes are staged. We study this through the recurrence of literary motifs (blood in Macbeth, for instance), where symbolic significance emerges not from local cues, but through repetition-with-variation across the whole work. We operationalize this setting as Computational Motif Discovery, a transductive task that predicts missing line-motif links using the full narrative structure of a play. We propose Critic's Eye, which models the work as a heterogeneous Narrative Topology Graph and performs discriminative inference over global structural evidence. Critic's Eye achieves 84.8% Hit@5 on our benchmark, nearly quadrupling state-of-the-art proprietary foundation models (Gemini-3-pro-preview, ~22.6%). Our analysis reveals that despite massive scaling, sequence-based models hit a "semantic ceiling", struggling to resolve dispersed dependencies. These findings suggest that explicit structural priors are a far more effective inductive bias than parameter scaling for decoding the complex architecture of long-form literature.
Figures & tables
| Node Type | Count | Edge Type | Count |
| Act / Scene | 5 / 28 | Hierarchical ( ) | 3,397 |
| Speech Section | 865 | Sequential ( ) | 2,602 |
| Atomic Line | 2,456 | Metadata ( ) | 1,058 |
| Character | 44 | Total Explicit | 7,057 |
| Latent Motif | 281 | Thematic Link | 923 |
| Stratum (Type) | Focus & Role in Narrative Graph |
| 1. Humanist | Focus: Character agency, ethical conflicts, and tragedy. |
| (12 Monographs | Role : High-Density Supervision. Comprising foundational book-length studies and major critical volumes. |
| & Volumes) | Key Sources: Bradley (1904) , Bloom (1987) , Fletcher (1844) , Hazlitt (1903) , Weiss (1876) . |
| 2. Socio-Cultural | Focus: Folklore, politics, history, and theatre practice. |
| (8 Mixed Sources) | Role : Contextual Anchoring. Captures world-building motifs (e.g., Witchcraft , Kingship ) missed by pure text analysis. |
| (Books/Essays) | Key Sources: Thiselton-Dyer (1884) (Folklore), Adams (1917) (Theatre), Tolstoy (1906) (Counter-criticism), Moschovakis (2008) . |
| Method | Hit | nDCG | MRR | ||||||
| @1 | @3 | @5 ∗ | @10 | @1 | @3 | @5 | @10 | ||
| Embedding SOTA (Best of dense retrievers) | |||||||||
| Sentence-BERT | 0.042 | 0.074 | 0.106 | 0.106 | 0.041 | 0.053 | 0.064 | 0.074 | 0.081 |
| Open-Source LLMs (Highlighting Inverse Scaling) | |||||||||
| GPT-OSS-20B (+RAG) | 0.042 | 0.088 | 0.117 | 0.120 | 0.042 | 0.070 | 0.081 | 0.082 | 0.070 |
| GPT-OSS-120B (+RAG) † | 0.032 | 0.064 | 0.085 | 0.085 | 0.032 | 0.049 | 0.058 | 0.058 | 0.050 |
| Model Configuration | Hit | nDCG | MRR | ||||||
| @1 | @3 | @5 | @10 | @1 | @3 | @5 | @10 | ||
| w/o pre-training (frozen random) | 0.1237 | 0.2544 | 0.3145 | 0.3746 | 0.1237 | 0.1710 | 0.1944 | 0.2134 | 0.2189 |
| Critic’s Eye ( Hetero-only ) | 0.2792 | 0.4947 | 0.5901 | 0.7208 | 0.2792 | 0.3742 | 0.4165 | 0.4657 | 0.4245 |
| Critic’s Eye ( Seq-only ) | 0.4876 | 0.6608 | 0.7562 | 0.8198 | 0.4876 | 0.5543 | 0.5960 | 0.6223 | 0.6019 |
| Critic’s Eye ( Full Topology ) | 0.5654 | 0.7809 | 0.8481 | 0.9293 | 0.5654 | 0.6618 | 0.6979 | 0.7321 | 0.6942 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Author / Source | Title |
| Johnson (1765) | Preface to Shakespeare |
| Fletcher (1844) | Macbeth:—Shakespearian Criticism and Acting |
| Weiss (1876) | Wit, Humor, and Shakspeare: Twelve Essays |
| Thiselton-Dyer (1884) | Folk-lore of Shakespeare |
| Hazlitt (1903) | Characters of Shakespeare’s Plays |
| Bradley (1904) | Shakespearean Tragedy: Lectures on Hamlet, Othello, King Lear, Macbeth |
| Method | Hit | nDCG | MRR | ||||||
| @1 | @3 | @5 | @10 | @1 | @3 | @5 | @10 | ||
| Embedding Baselines | |||||||||
| Random Guess | 0.0035 | 0.0106 | 0.0177 | 0.0353 | 0.0035 | 0.0075 | 0.0104 | 0.0161 | 0.0220 |
| Sentence-BERT | 0.0424 | 0.0742 | 0.1060 | 0.1060 | 0.0406 | 0.0531 | 0.0637 | 0.0736 | 0.0812 |
| BGE-Large-v1.5 | 0.0389 | 0.0707 | 0.0813 | 0.1307 | 0.0371 | 0.0488 | 0.0521 | 0.0665 | 0.0748 |
| Open-Source LLMs | |||||||||
Computational Literary Studies
Computational Literary Studies uses data analysis and language technologies to examine literary style, themes, narratives, influence, and change.
See all 49 papers