Beyond Similarity: Grounded Agentic Extraction and Expert-Adjudicated Evaluation of Intertextuality in Classical Chinese Histories
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Computational approaches to intertextuality have advanced from string matching to neural retrieval, yet their outputs, similarity scores and parallel-passage lists, identify where texts reuse one another without characterizing how or why. We recast fine-grained intertextuality extraction as an agentic task in which a large language model (LLM) reads two text units in full and, through a constrained tool interface, must ground each proposed reuse in exact character spans on both sides and label it under a five-dimension typology of reuse (form, aspect, source-marking, function, stance). We validate the approach on an exhaustive comparison of the Analects with the Book of Han, where three domain experts adjudicate a pooled multi-model candidate set into a benchmark of 2,533 intertextual pairs. Against this standard we study twelve LLMs, reporting precision (56%-93%), a 51× cost spread at comparable quality, and how well their confidence is calibrated. Expert agreement traces a reliability gradient: dimensions legible on the textual surface are annotated consistently, while those requiring inference of intent are contested, delimiting the claims such annotation supports. Scaling the validated extractor to the full Twenty-Four Histories (65,380 comparisons, 5,766 pairs) recovers corpus-level structure a similarity score cannot express. The interpretive composition of citation shows no systematic change across eighteen centuries, yet the same passage is quoted less and less literally. Stability in the aggregate with drift in the individual case is what a cultural-attraction account expects. We release the extraction protocol and the expert-adjudicated benchmark.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 35 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
9 of 35 references.
Closest ancestors · 1
Same direction, newest first
Other references · 8
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 812
- 2019On the Feasibility of Automated Detection of Allusive Text Reusecited by 8
- 2016Identification of Parallel Passages Across a Large Hebrew/Aramaic Corpuscited by 6
- 2023Graecia capta ferum victorem cepit. Detecting Latin Allusions to Ancient Greek Literaturecited by 4
- 2026Loci Similes: A Benchmark for Extracting Intertextualities in Latin Literaturecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Worlds Within Words: Translating Culture in Ancient Chinese Texts with Multi-Agent Coordination
- 2026Neo-Classic: A Benchmark for Evaluating Linguistic-Aesthetic Reasoning in Classical Chinese Poetry
- 2026SAGE: From Direct Answering to Evidence-Grounded Inference for Chinese Ancient Document Understanding
- 2025Liaozhai through the Looking-Glass: On Paratextual Explicitation of Culture-Bound Terms in Machine Translation
- 2026Internal Knowledge Without External Expression: Probing the Generalization Boundary of a Classical Chinese Language Model
- 2026When Do Agents Help? Embedding, LLM and Agentic Alignment of Classical Texts and Their Translations
- 2024Shared Heritage, Distinct Writing: Rethinking Resource Selection for East Asian Historical Documents
- 2026How China-Origin Vision-Language Models Move from Refusal to Reframing in State Alignment