mlsanityData to 7 Oct 2026

Distributed Representations of Sentences and Documents

arXiv 1405.4053 ↗First posted 16 May 2014cs.CL cs.AI cs.LGcited by 677

Not on the map. Why?

Abstract (arXiv)

Many machine learning algorithms require the input to be represented as a fixed-length feature vector. When it comes to texts, one of the most common fixed-length features is bag-of-words. Despite their popularity, bag-of-words features have two major weaknesses: they lose the ordering of the words and they also ignore semantics of the words. For example, "powerful," "strong" and "Paris" are equally distant. In this paper, we propose Paragraph Vector, an unsupervised algorithm that learns fixed-length feature representations from variable-length pieces of texts, such as sentences, paragraphs, and documents. Our algorithm represents each document by a dense vector which is trained to predict words in the document. Its construction gives our algorithm the potential to overcome the weaknesses of bag-of-words models. Empirical results show that Paragraph Vectors outperform bag-of-words models as well as other techniques for text representations. Finally, we achieve new state-of-the-art results on several text classification and sentiment analysis tasks.

Key facts. Cited by 677 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 May 2014.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 207; 2022: 145; 2023: 121; 2024: 109; 2025: 62; 2026: 33.

677 papers.

Sort:

By area:

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  3. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  4. 2021Generating Datasets with Pretrained Language Modelscited by 192
  5. 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
  6. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  7. 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
  8. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 124
  9. 2022Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?cited by 100
  10. 2025Gemini Embedding: Generalizable Embeddings from Geminicited by 93
  11. 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 89
  12. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
38 more
  1. 2024Gecko: Versatile Text Embeddings Distilled from Large Language Modelscited by 81
  2. 2021ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanationcited by 78
  3. 2022PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understandingcited by 77
  4. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
  5. 2021ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embeddingcited by 73
  6. 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
  7. 2024Repetition Improves Language Model Embeddingscited by 70
  8. 2022MDFEND: Multi-domain Fake News Detectioncited by 68
  9. 2024Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysiscited by 65
  10. 2022Twin Contrastive Learning for Online Clusteringcited by 60
  11. 2021Log-based Anomaly Detection Without Log Parsingcited by 59
  12. 2023The Wall Street Neophyte: A Zero-Shot Analysis of ChatGPT Over MultiModal Stock Movement Prediction Challengescited by 59
  13. 2022Debiased Contrastive Learning of Unsupervised Sentence Representationscited by 56
  14. 2023Gloss Attention for Gloss-free Sign Language Translationcited by 50
  15. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  16. 2021A Survey on Ensemble Learning under the Era of Deep Learningcited by 47
  17. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  18. 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
  19. 2023Transformers in Speech Processing: A Surveycited by 38
  20. 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
  21. 2021Provably Secure Generative Linguistic Steganographycited by 34
  22. 2022Jointly Contrastive Representation Learning on Road Network and Trajectorycited by 34
  23. 2021Vision-Language Navigation: A Survey and Taxonomycited by 33
  24. 2021Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information Networkscited by 32
  25. 2021Survey on reinforcement learning for language processingcited by 31
  26. 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
  27. 2024Diversity Measurement and Subset Selection for Instruction Tuning Datasetscited by 28
  28. 2021The Surprising Performance of Simple Baselines for Misinformation Detectioncited by 27
  29. 2022Domain Adaptive Fake News Detection via Reinforcement Learningcited by 27
  30. 2025Cramming 1568 Tokens into a Single Vector and Back Again: Exploring the Limits of Embedding Space Capacitycited by 27
  31. 2021Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalancited by 26
  32. 2022InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddingscited by 25
  33. 2024TELEClass: Taxonomy Enrichment and LLM-Enhanced Hierarchical Text Classification with Minimal Supervisioncited by 25
  34. 2022A Survey on Dynamic Neural Networks for Natural Language Processingcited by 24
  35. 2023Is ChatGPT a Good Personality Recognizer? A Preliminary Studycited by 24
  36. 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trialscited by 24
  37. 2021Spatio-Temporal Joint Graph Convolutional Networks for Traffic Forecastingcited by 23
  38. 2023RankCSE: Unsupervised Sentence Representations Learning via Learning to Rankcited by 23

50 most cited of 677 All 677 (JSON)