mlsanityData to 14 Oct 2026

In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis

arXiv 2505.14838 ↗First posted 20 May 2025cs.DL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Understanding the impact of scientific publications is crucial for identifying breakthroughs and guiding future research. Traditional metrics based on citation counts often miss the nuanced ways a paper contributes to its field. In this work, we propose a new task: generating nuanced, expressive, and time-aware impact summaries that capture both praise (confirmation citations) and critique (correction citations) through the evolution of fine-grained citation intents. We introduce an evaluation framework tailored to this task, showing moderate to strong human correlation on subjective metrics such as insightfulness. Expert feedback from professors reveals a strong interest in these summaries and suggests future improvements. Data and code are made available.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 73 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

39 of 73 references.

References · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  6. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  7. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  8. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  9. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  11. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  12. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
27 more
  1. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  2. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  3. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  4. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  5. 2016Coupled Generative Adversarial Networkscited by 216
  6. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  7. 2020Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networkscited by 153
  8. 2024Evaluation of Retrieval-Augmented Generation: A Surveycited by 146
  9. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 130
  10. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  11. 2020Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articlescited by 97
  12. 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMscited by 72
  13. 2021Studying the Usage of Text-To-Text Transfer Transformer to Support Code-Related Taskscited by 70
  14. 2024FABLES: Evaluating faithfulness and content selection in book-length summarizationcited by 65
  15. 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
  16. 2019TreeGen: A Tree-Based Transformer Architecture for Code Generationcited by 58
  17. 2018Neural Open Information Extractioncited by 50
  18. 2021MultiCite: Modeling realistic citations requires moving beyond the single-sentence single-label settingcited by 30
  19. 2024Forecasting high-impact research topics via machine learning on evolving knowledge graphscited by 22
  20. 2023We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fieldscited by 20
  21. 2023SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generationcited by 17
  22. 2015Measuring academic influence: Not all citations are equalcited by 11
  23. 2021Towards Generating Citation Sentences for Multiple References with Intent Controlcited by 9
  24. 2024Systematic Task Exploration with LLMs: A Study in Citation Text Generationcited by 8
  25. 2024PST-Bench: Tracing and Benchmarking the Source of Publicationscited by 7
  26. 2024Beyond Relevant Documents: A Knowledge-Intensive Approach for Query-Focused Summarization using Large Language Modelscited by 4
  27. 2020Citation Cascade and the Evolution of Topic Relevancecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectivescited by 2
  2. 2026Crystal: Characterizing Relative Impact of Scholarly Publicationscited by 0