We test whether authors have characteristic "fingerprints" in the information-theoretic novelty curves of their published works. Working with two corpora -- Books3 (52,796 books, 759 qualifying authors) and PG-19 (28,439 books, 1,821 qualifying authors) -- we find that authorial voice leaves measurable traces in how novelty unfolds across a text. The signal is multi-scale: at book level, scalar dynamics (mean novelty, speed, volume, circuitousness) identify 43% of authors significantly above chance; at chapter level, SAX motif patterns in sliding windows achieve 30x-above-chance attribution, far exceeding the scalar features that dominate at book level. These signals are complementary, not redundant. We show that the fingerprint is partly confounded with genre but persists within-genre for approximately one-quarter of authors. Classical authors (Twain, Austen, Kipling) show fingerprints comparable in strength to modern authors, suggesting the phenomenon is not an artifact of contemporary publishing conventions.
Figures & tables
Figure 1: Distribution of author fingerprint effect sizes (Books3, baseline SAX). Red bars indicate statistically significant authors ( p<0.05 ). The distribution is right-skewed, with a long tail of strongly fingerprinted authors.
Table 2: Fingerprint detection vs. SAX resolution (Books3).
Figure 2: Resolution scaling (Experiment 2). Left: significance rate and mean effect size increase monotonically with PAA segments. Right: at PAA =64 , increasing k -gram length trades consistency-test power for attribution accuracy.
Features
% Sig.
Top-1
× Chance
SAX motifs only
14.0%
0.9%
7 ×
Scalar dynamics only
43.3%
3.8%
29 ×
PAA vectors only
35.4%
2.9%
22 ×
All combined
18.3%
2.3%
18 ×
Table 3: Feature comparison for author fingerprints (Books3).
Figure 3: Fisher Discriminant Ratios for scalar features vs. SAX motifs. The four scalar features (FDR 6.97–9.05) are 6–8 × more discriminative than SAX motifs (avg. 1.13) at book level, explaining the dominance of scalars in Experiment 3.
Window
% Sig.
Top-1
× Chance
Scalar Top-1
W=20
11.3%
4.1%
30.5 ×
0.7%
W=40
14.5%
3.6%
27.1 ×
0.8%
W=80
18.0%
2.7%
20.0 ×
0.8%
Table 4: Sliding-window SAX motif fingerprints (Books3, 752 authors, 6,317 books with ≥80 paragraphs to support window sizes up to W=80 ).
Figure 4: Multi-scale comparison of attribution performance ( × above chance). At book level (blue band), scalar dynamics dominate at 29 × . At window level (green band), SAX motifs dominate at 30.5 × . The scale inversion is the paper’s central finding.
Figure 5: Genre disentangling: within-cluster fingerprint rates. The overall 13.6% rate drops to 7.6% in formulaic clusters but rises to 25% in literary clusters, confirming that a substantial fraction of fingerprints survive genre control.
Figure 6: The James–Dickens Paradox. Dickens is weak at book level (effect =0.45 ) but strong at window level ( =4.04 ). James shows a strong anti-fingerprint at book level ( −4.9 ). Multi-scale analysis reveals fingerprints invisible to single-scale methods.
I introduce semantic novelty--cosine distance between each paragraph's sentence embedding and the running centroid of all preceding paragraphs--as an information-theoretic measure of narrative structure at corpus scale. Applying it to 28,606 books in PG19 (pre-1920 English literature), I compute paragraph-level novelty curves using 768-dimensional SBERT embeddings, then reduce each to a 16-segment Piecewise Aggregate Approximation (PAA). Ward-linkage clustering on PAA vectors reveals eight canonical narrative shape archetypes, from Steep Descent (rapid convergence) to Steep Ascent (escalating unpredictability). Volume--variance of the novelty trajectory--is the strongest length-independent predictor of readership (partial rho = 0.32), followed by speed (rho = 0.19) and Terminal/Initial ratio (rho = 0.19). Circuitousness shows strong raw correlation (rho = 0.41) but is 93 percent correlated with length; after control, partial rho drops to 0.11--demonstrating that naive correlations in corpus studies can be dominated by length confounds. Genre strongly constrains narrative shape (chi squared = 2121.6, p < 10 to the power negative 242), with fiction maintaining plateau profiles while nonfiction front-loads information. Historical analysis shows books became progressively more predictable between 1840 and 1910 (T/I ratio trend r = negative 0.74, p = 0.037). SAX analysis reveals 85 percent signature uniqueness, suggesting each book traces a nearly unique path through semantic space. These findings demonstrate that information-density dynamics, distinct from sentiment or topic, constitute a fundamental dimension of narrative structure with measurable consequences for reader engagement. Dataset: https://huggingface.co/datasets/wfzimmerman/pg19-semantic-novelty
I apply Schmidhuber's compression progress theory of interestingness at corpus scale, analyzing semantic novelty trajectories in more than 80,000 books spanning two centuries of English-language publishing. Using sentence-transformer paragraph embeddings and a running-centroid novelty measure, I compare 28,730 pre-1920 Project Gutenberg books (PG19) against 52,796 modern English books (Books3, approximately 1990-2010). The principal findings are fourfold. First, mean paragraph-level novelty is roughly 10% higher in modern books (0.503 vs. 0.459). Second, trajectory circuitousness -- the ratio of cumulative path length to net displacement in embedding space -- nearly doubles in the modern corpus (+67%). Third, convergent narrative curves, in which novelty declines toward a settled semantic register, are 2.3x more common in pre-1920 literature. Fourth, novelty is orthogonal to reader quality ratings (r = -0.002), suggesting that interestingness in Schmidhuber's sense is structurally independent of perceived literary merit. Clustering paragraph-level trajectories via PAA-16 representations reveals eight distinct narrative-shape archetypes whose distribution shifts substantially between eras. All analysis code and an interactive exploration toolkit are publicly available at https://bigfivekiller.online/novelty_hub.
This article introduces two new measures for authorship attribution - Rank-Turbulence Delta and Jensen-Shannon Delta - which generalise Burrows's classical Delta by applying distance functions designed for probabilistic distributions. We first set out the theoretical basis of the measures, contrasting centred and uncentred z-scoring of word-frequency vectors and re-casting the uncentred vectors as probability distributions. Building on this representation, we develop a token-level decomposition that renders every Delta distance numerically interpretable, thereby facilitating close reading and the validation of results. The effectiveness of the methods is assessed on four literary corpora in English, German, French and Russian. The English, German and French datasets are compiled from Project Gutenberg, whereas the Russian benchmark is the SOCIOLIT corpus containing 639 works by 89 authors spanning the eighteenth to the twenty-first centuries. Rank-Turbulence Delta attains attribution accuracy comparable with Cosine Delta; Jensen-Shannon Delta consistently matches or exceeds the performance of canonical Burrows's Delta. Finally, several established attribution algorithms are re-evaluated on the extended SOCIOLIT corpus, providing a realistic estimate of their robustness under pronounced temporal and stylistic variation.