mlsanityData to 14 Oct 2026

Semantically Orthogonal Framework for Citation Classification: Disentangling Intent and Content

arXiv 2601.05103 ↗First posted 8 Jan 2026cs.DL cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding the role of citations is essential for research assessment and citation-aware digital libraries. However, existing citation classification frameworks often conflate citation intent (why a work is cited) with cited content type (what part is cited), limiting their effectiveness in auto classification due to a dilemma between fine-grained type distinctions and practical classification reliability. We introduce SOFT, a Semantically Orthogonal Framework with Two dimensions that explicitly separates citation intent from cited content type, drawing inspiration from semantic role theory. We systematically re-annotate the ACL-ARC dataset using SOFT and release a cross-disciplinary test set sampled from ACT2. Evaluation with both zero-shot and fine-tuned Large Language Models demonstrates that SOFT enables higher agreement between human annotators and LLMs, and supports stronger classification performance and robust cross-domain generalization compared to ACL-ARC and SciCite annotation frameworks. These results confirm SOFT's value as a clear, reusable annotation standard, improving clarity, consistency, and generalizability for digital libraries and scholarly communication infrastructures. All code and data are publicly available on GitHub https://github.com/zhiyintan/SOFT.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 63 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

25 of 63 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  7. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  8. 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
  9. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
  10. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
  11. 2023Data-centric Artificial Intelligence: A Surveycited by 203
  12. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 130
13 more
  1. 2020MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Modelscited by 23
  2. 2024Benchmarking Object Detectors with COCO: A New Path Forwardcited by 23
  3. 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 21
  4. 2024A Survey on Evaluation of Out-of-Distribution Generalizationcited by 21
  5. 2020CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systemscited by 17
  6. 2023CitePrompt: Using Prompts to Identify Citation Intent in Scientific Paperscited by 12
  7. 2023ObjectLab: Automated Diagnosis of Mislabeled Images in Object Detection Datacited by 11
  8. 2023CleanCoNLL: A Nearly Noise-Free Named Entity Recognition Datasetcited by 11
  9. 2023Benchmarking a Benchmark: How Reliable is MS-COCO?cited by 6
  10. 2022Academic information retrieval using citation clusters: In-depth evaluation based on systematic reviewscited by 3
  11. 2024Beyond Dataset Creation: Critical View of Annotation Variation and Bias Probing of a Dataset for Online Radical Content Detectioncited by 3
  12. 2025Can LLMs Predict Citation Intent? An Experimental Analysis of In-context Learning and Fine-tuning on Open LLMscited by 2
  13. 2023Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variablescited by 1

Built on by

Not cited yet.