mlsanityData to 7 Oct 2026

On the Use of ArXiv as a Dataset

arXiv 1905.00075 ↗First posted 30 Apr 2019cs.IR cs.LG cs.SIcited by 101

Not on the map. Why?

Abstract (arXiv)

The arXiv has collected 1.5 million pre-print articles over 28 years, hosting literature from scientific fields including Physics, Mathematics, and Computer Science. Each pre-print features text, figures, authors, citations, categories, and other metadata. These rich, multi-modal features, combined with the natural graph structure---created by citation, affiliation, and co-authorship---makes the arXiv an exciting candidate for benchmarking next-generation models. Here we take the first necessary steps toward this goal, by providing a pipeline which standardizes and simplifies access to the arXiv's publicly available data. We use this pipeline to extract and analyze a 6.7 million edge citation graph, with an 11 billion word corpus of full-text research articles. We present some baseline classification results, and motivate application of more exciting generative graph models.

Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 11; 2022: 5; 2023: 17; 2024: 30; 2025: 27; 2026: 11.

101 papers.

Sort:

By area:

  1. 2023Can AI-Generated Text be Reliably Detected?cited by 372
  2. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 230
  3. 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
  4. 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
  5. 2024EuroLLM: Multilingual Language Models for Europecited by 103
  6. 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
  7. 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 85
  8. 2021SciCap: Generating Captions for Scientific Figurescited by 76
  9. 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 66
  10. 2023User Inference Attacks on Large Language Modelscited by 36
  11. 2022OCR-VQGAN: Taming Text-within-Image Generationcited by 31
  12. 2023Can LLMs Effectively Leverage Graph Structural Information through Prompts, and Why?cited by 31
38 more
  1. 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
  2. 2021RetGen: A Joint framework for Retrieval and Grounded Text Generation Modelingcited by 22
  3. 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
  4. 2024Predicting vs. Acting: A Trade-off Between World Modeling & Agent Modelingcited by 20
  5. 2023Towards Better Evaluation of Instruction-Following: A Case-Study in Summarizationcited by 18
  6. 2024Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Designcited by 18
  7. 2025Mid-Training of Large Language Models: A Surveycited by 18
  8. 2024MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluationcited by 17
  9. 2024BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Modelscited by 15
  10. 2024Waterfall: Framework for Robust and Scalable Text Watermarking and Provenance for LLMscited by 14
  11. 2025Large Language Models Encode Semantics and Alignment in Linearly Separable Representationscited by 14
  12. 2023Online Label Shift: Optimal Dynamic Regret meets Practical Algorithmscited by 11
  13. 2023Source Attribution for Large Language Model-Generated Datacited by 11
  14. 2026Text summarization via global structure awarenesscited by 11
  15. 2021Adaptive Neural Message Passing for Inductive Learning on Hypergraphscited by 10
  16. 2023SIGMA: An Efficient Heterophilous Graph Neural Network with Fast Global Aggregationcited by 10
  17. 2021Studying word order through iterative shufflingcited by 9
  18. 2024KV Prediction for Improved Time to First Tokencited by 9
  19. 2025LongAttn: Selecting Long-context Training Data via Token-level Attentioncited by 9
  20. 2023Weakly-Supervised Scientific Document Classification via Retrieval-Augmented Multi-Stage Trainingcited by 8
  21. 2025Enabling Autoregressive Models to Fill In Masked Tokenscited by 7
  22. 2026EuroLLM-22B: Technical Reportcited by 7
  23. 2022Cracking Double-Blind Review: Authorship Attribution with Deep Learningcited by 6
  24. 2023ANTM: An Aligned Neural Topic Model for Exploring Evolving Topicscited by 6
  25. 2024INDUS: Effective and Efficient Language Models for Scientific Applicationscited by 6
  26. 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Originationcited by 6
  27. 2025Variance reduction in output from generative AIcited by 6
  28. 2026MoE Lens -- An Expert Is All You Needcited by 6
  29. 2025DCAD-2000: A Multilingual Dataset across 2000+ Languages with Data Cleaning as Anomaly Detectioncited by 5
  30. 2025Exploiting Leaderboards for Large-Scale Distribution of Malicious Modelscited by 5
  31. 2024Enhancing Robustness of LLM-Synthetic Text Detectors for Academic Writing: A Comprehensive Analysiscited by 4
  32. 2024AI on AI: Exploring the Utility of GPT as an Expert Annotator of AI Publicationscited by 4
  33. 2024MathBridge: A Large Corpus Dataset for Translating Spoken Mathematical Expressions into LaTeX Formulas for Improved Readabilitycited by 4
  34. 2024LM-PUB-QUIZ: A Comprehensive Framework for Zero-Shot Evaluation of Relational Knowledge in Language Modelscited by 4
  35. 2025SkipPipe: Partial and Reordered Pipelining Framework for Training LLMs in Heterogeneous Networkscited by 4
  36. 2025Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniquescited by 4
  37. 2025Geometric Metrics and LLMs: What They Measure and When They Workcited by 4
  38. 2025iSeal: Encrypted Fingerprinting for Reliable LLM Ownership Verificationcited by 4

50 most cited of 101 All 101 (JSON)