AI Historian: Helping historians organize and verify person-centred temporal clues from dispersed historical narratives
Organizations: Westlake University · Peking University
Abstract
History is not preserved in complete, continuous form. Accounts of a person's activities, relationships and historical contexts are scattered across texts, chapters and narrative perspectives; historians must retrieve, identify and compare these materials to reconstruct temporal sequences and verify them against sources. Here we present AI Historian (AIH), an AI agent system that helps historians organize person-time evidence from dispersed biographical narratives. It takes source sentences as evidence units, identifies people and temporal cues, verifies candidate cross-text associations and infers comparable temporal ranges while preserving traceable source-text evidence. We evaluated AIH on six Shiji cases concerning Liu Bang, Xiang Yu and Xiao He. AIH Agent achieved a temporal-localization MicroIoU of 86.2%, compared with 81.3% for human-only annotation and 17.1% for direct large-language-model prompting; it required about 14 min, versus 1 h 32 min for human-only annotation. We further applied AIH to the Twenty-Four Histories and other ancient Chinese histories, ancient Japanese and Korean histories, and modern and contemporary historical materials, and released the results through Westlake Historian. These results indicate that AIH can reduce the cost of organizing historical materials at scale while turning connections obscured by chapter-based narration into traceable, revisable research questions for collaborative testing.
Figures & tables
| Evaluation | Conditions | Evaluation set | Primary metric | Aggregation and timing |
|---|---|---|---|---|
| Experiment 1: temporal reconstruction | Direct large-language-model prompting; human-only; AIH Agent | Six case packets; 244 eligible sentence-level temporal ranges | Month-level MicroIoU between predicted and reference ranges | Case-size-weighted mean; six human participants; AIH Agent row-level consensus across three runs; cumulative elapsed time |
| Experiment 2: diagnostic reasoning | Human; direct large-language-model prompting; structured large-language-model prompting | 96 human responses across six forms; 48 unique questions per model condition | Strict row accuracy; all required fields must match | Majority vote across three model runs; total elapsed time by condition |
| Participant | Stage 1 | Stage 2 |
|---|---|---|
| P1 | C1 | T1 |
| P2 | C2 | T2 |
| P3 | C3 | T3 |
| P4 | C4 | T1 |
| P5 | C5 | T2 |
| P6 | C6 | T3 |
| Agent | Level | Principal function | Main output |
|---|---|---|---|
| A1 | Sentence | Person recognition and construction of cross-text traceable referent sets. | Person fields |
| A2 | Sentence | Extraction of source temporal expressions. | Source temporal expression |
| A3 | Sentence | Text-function classification and identification of descriptive or preparatory material for sinking. | Sinking flag |
| A4 | Sentence | Detection of retrospective passages and temporal displacement from the surrounding narrative sequence. | Retrospective-passage flag |
| A5 | TimeBlock | Conversion of abbreviated or relative expressions into comparable temporal markers. | Temporal marker |
| A6 | TimeBlock | Temporal ordering of TimeBlocks on a shared timeline. | Ordered sequence |
| Field | Meaning |
|---|---|
| sentence_id | Stable sentence identifier in the form book_uuid.chapter_id.paragraph_id.sentence_id . |
| text | Sentence text. |
| character_flags | Boolean fields for candidate people such as liu_bang , xiang_yu and xiao_he . |
| has_time_expression | Whether the sentence contains an extractable source temporal expression. |
| time_expression | Extracted source wording, such as “秦二世元年七月” or “这时”. |
| is_sinking | Whether the sentence is assigned to the background layer of the principal temporal-reasoning chain. |
| Field | Meaning |
|---|---|
| ID | Unique TimeBlock identifier, usually derived from the first sentence in the block. |
| timeblock_range | Sentence span covered by the TimeBlock. |
| Interlude | Whether the TimeBlock contains a retrospective passage. |
| Conversioninformation | Temporal-marker conversion record, including source wording, conversion requirement, evidence and rationale. |
| Granularity | Temporal granularity, with values 0 – 3 . |
| TM | Normalized temporal marker. |
| Case | Sentence | Chapter | Passage | Internal reference range |
|---|---|---|---|---|
| C5 | 8.16.1 | Gaozu | In the third year of Qin Er Shi, King Huai of Chu saw that Xiang Liang’s army had been defeated, moved his capital to Pengcheng and combined the armies of Lü Chen and Xiang Yu. | -0207-10to-0206-11 |
| C5 | 7.10.1 | Xiang Yu | After the Chu army was defeated at Dingtao, King Huai moved to Pengcheng, combined the armies of Xiang Yu and Lü Chen and assumed command. | -0207-10to-0206-11 |
| C5 | 8.23.3 | Gaozu | In the eleventh month of the first Han year, Xiang Yu led the armies of the feudal lords westward to enter the passes, but the gate was closed. | -0206-11to-0206-12 |
| C5 | 7.17.3 | Xiang Yu | Xiang Yu heard that Pei Gong had taken Xianyang, became enraged and sent Lord Dangyang and others to attack the pass. | -0206-11to-0206-12 |
| C6 | 53.4.1 | Xiao He | After Liu Bang rose and became Pei Gong, Xiao He frequently assisted him in administering affairs. | -0209-10to-0208-10 |
| C6 | 53.4.2 | Xiao He | When Pei Gong entered Xianyang, Xiao He first secured the Qin laws, maps and household registers. | -0208-10to-0205-01 |
| Sentence | Passage | Internal reference range |
|---|---|---|
| 53.4.1 | After Liu Bang rose and became Pei Gong, Xiao He repeatedly assisted him in administering affairs. | -0209-10to-0208-10 |
| 53.4.2 | When Pei Gong entered Xianyang, Xiao He first secured the laws, maps and household registers. | -0208-10to-0205-01 |
| 53.4.3 | When Pei Gong became King of Han, he appointed Xiao He as chancellor. | -0205-01to-0205-10 |
| 53.5.1 | When the King of Han led his army east and pacified the Three Qin, Xiao He remained as chancellor to govern Ba and Shu. | -0205-10to+infinity |
| Corpus collection | Texts | Sentences | TimeBlocks | Temporal anchors | Normalized ranges | Cross-text relations |
|---|---|---|---|---|---|---|
| Samguk Sagi | 3 | 73 | 23 | 20 | 23 | 19 |
| Sanguozhi | 3 | 345 | 57 | 19 | 57 | 10 |
| History of Yuan | 3 | 7,187 | 3,405 | 950 | 3,405 | 36 |
| History of the Northern Dynasties | 3 | 930 | 174 | 66 | 174 | 26 |
| Book of Northern Qi | 3 | 639 | 216 | 122 | 216 | 57 |
| History of the Southern Dynasties | 3 | 433 | 30 | 1 | 30 | 14 |
| Chapter | TimeBlocks | Non-empty ISO | Cross-text update records | Summaries |
|---|---|---|---|---|
| Basic Annals of Xiang Yu | 88 | 77 | 57 | 88 |
| Basic Annals of Gaozu | 166 | 139 | 85 | 166 |
| Hereditary House of Chancellor Xiao | 30 | 23 | 12 | 30 |
| Total | 284 | 239 | 154 | 284 |
| Chapter | ID | Normalized time | summary |
|---|---|---|---|
| Xiang Yu | 7.3.1 | -0209-07-01 | In the seventh month of the first year of Qin Er Shi, Chen She and others launched the uprising at Daze Village, beginning the late-Qin rebellions. |
| Xiang Yu | 7.5.14 | -0209-09-01 | Pei Gong raised troops at Pei and led an attack on Xue. |
| Gaozu | 8.23.3 | -0206-11to-0206-12 | In the eleventh month of the first Han year, Xiang Yu led the armies of the feudal lords west and was blocked at Hangu Pass. |
| Gaozu | 8.26.2 | -0205-01to-0205-04 | Xiang Yu made Pei Gong King of Han, ruling Ba, Shu and Hanzhong from Nanzheng. |
| Xiao He | 53.4.1 | -0209-10to-0208-10 | After Liu Bang rose as Pei Gong, Xiao He repeatedly assisted him in administration and became a principal aide. |
| Xiao He | 53.4.2 | -0208-10to-0205-01 | When Pei Gong entered Xianyang, Xiao He first preserved the laws, maps, registers and archival materials. |
| Chinese term | English usage | Definition in this study |
|---|---|---|
| 人物编年(年谱) | biographical chronology | Chronological organization of a person’s life, activities and relationships; nianpu is the traditional Chinese form discussed here. |
| 传统人物年谱 | traditional biographical chronology | Concise chronology centred on the principal events of a person’s life. |
| 年谱长编 | extended biographical chronology | Evidence-rich chronology incorporating source excerpts, quotations and editorial notes. |
| 多人物合谱 | multi-person chronology | Combined chronology representing interactions among several historical people. |
| 编年 | chronology | Events arranged by time; here, a method or temporal structure. |
| 编年体 | annalistic format | Historiographical format organized primarily by chronological sequence. |
| Chinese title | English usage | Scope and note |
|---|---|---|
| 史记 | Shiji ( Records of the Grand Historian ) | Historical text used in all method demonstrations; Shiji is used after first definition. |
| 项羽本纪 | Basic Annals of Xiang Yu | Shiji , chapter 7; Xiang Yu’s biographical perspective. |
| 高祖本纪 | Basic Annals of Gaozu | Shiji , chapter 8; Liu Bang’s biographical perspective. |
| 萧相国世家 | Hereditary House of Chancellor Xiao | Shiji , chapter 53; Xiao He’s biographical perspective. |
| 二十四史 | Twenty-Four Histories | Canonical collection of Chinese official histories in the annals-biographies format. |
| 三国史记 | Samguk Sagi | Korean history written in the annals-biographies format. |
| Person | Chinese form | English usage | Relation and note |
|---|---|---|---|
| Liu Bang | 刘邦 | Liu Bang | Personal name and default manuscript usage. |
| 高祖 | Gaozu | Temple name; Emperor Gaozu of Han when imperial status is foregrounded. | |
| 汉王 | King of Han | Royal title before the establishment of the Han empire. | |
| 沛公 | Pei Gong | Early title in the uprising narrative; also translated as Duke or Lord of Pei. | |
| 刘季 | Liu Ji | Early name. | |
| Xiang Yu | 项羽 | Xiang Yu | Conventional name and default manuscript usage. |
Historical Document Processing
Historical document processing uses AI to transcribe, structure, restore, and analyze manuscripts, books, newspapers, and archival records.
See all 76 papers