How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations
Not on the map. Why?
Abstract (arXiv)
How does research evolve, and can we trace it at the level of individual claims? Scientific progress is not simply a uniform accumulation of facts. Existing citation graphs usually collapse these roles into a single homogeneous edge type, limiting how we can analyze scientific progress. We introduce SciTraj, a typed citation corpus for tracing research evolution across natural language processing, machine learning, and computer vision. SciTraj includes 32,559 papers published between 2015 and 2024 and 573,126 directed edges spanning six research-relation types. Unlike traditional citation graphs, each edge is paired with the claim sentence that motivates its label. Claim-driven relations are verified by natural language inference against their local in-paper context. The corpus further organizes these relations into multi-step typed trajectories that trace how ideas develop across papers and over time. We evaluate the corpus along three dimensions. First, a three-annotator pilot achieves Fleiss' kappa=0.74 and 79.9% majority-vote precision for relation labels, indicating substantial agreement and reliable labeling. Second, corpus-level analyses reveal clear disciplinary siloing in the directional flow of research relations. Topic analysis further identifies rapidly growing clusters dominated by vision and LLM-related research and declining clusters associated with several classical machine-learning topics. We further evaluate SciTraj using a temporally split link-prediction benchmark and a year-shuffle falsifiability test that distinguishes genuine temporal signal from year-correlated content. Under this setting, textscSciTraj-Pair performs strongly, but its AUC drops by 0.288 when publication years are shuffled, showing that its predictions depend not only on content but also on the temporal order in which research develops.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 29 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
16 of 29 references.
References · 16
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 124
- 2022Towards Better Evaluation for Dynamic Link Predictioncited by 120
- 2018Content-Based Citation Recommendationcited by 43
- 2021MultiCite: Modeling realistic citations requires moving beyond the single-sentence single-label settingcited by 30
- 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
- 2021SemEval-2021 Task 11: NLPContributionGraph -- Structuring Scholarly NLP Contributions for a Research Knowledge Graphcited by 16
4 more
- 2023A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?cited by 14
- 2022Spatial-Temporal Recurrent Graph Neural Networks for Fault Diagnostics in Power Distribution Systemscited by 7
- 2024Citation Amnesia: On The Recency Bias of NLP and Other Academic Fieldscited by 5
- 2024CiteFusion: An Ensemble Framework for Citation Intent Classification Harnessing Dual-Model Binary Couples and SHAP Analysescited by 2
Built on by
Not cited yet.