An Empirical Evaluation of doc2vec with Practical Insights into Document Embedding Generation
Not on the map. Why?
Abstract (arXiv)
Recently, Le and Mikolov (2014) proposed doc2vec as an extension to word2vec (Mikolov et al., 2013a) to learn document-level embeddings. Despite promising results in the original paper, others have struggled to reproduce those results. This paper presents a rigorous empirical evaluation of doc2vec over two tasks. We compare doc2vec to two baselines and two state-of-the-art document embedding methodologies. We found that doc2vec performs robustly when using models trained on large external corpora, and can be further improved by using pre-trained word embeddings. We also provide recommendations on hyper-parameter settings for general purpose applications, and release source code to induce document embeddings using our trained doc2vec models.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 6; 2023: 9; 2024: 7; 2025: 6; 2026: 1.
48 papers.
Sort:
By area:
- 2021MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extractioncited by 20
- 2021Identifying Machine-Paraphrased Plagiarismcited by 16
- 2024Diversified Batch Selection for Training Accelerationcited by 14
- 2021Learning Models for Suicide Prediction from Social Media Postscited by 10
- 2023CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answeringcited by 10
- 2021Unsupervised Deep Keyphrase Generationcited by 7
- 2021A News-based Machine Learning Model for Adaptive Asset Pricingcited by 7
- 2021We've had this conversation before: A Novel Approach to Measuring Dialog Similaritycited by 7
- 2021Data Augmentation for Mental Health Classification on Social Mediacited by 7
- 2022Lbl2Vec: An Embedding-Based Approach for Unsupervised Document Retrieval on Predefined Topicscited by 7
- 2023Computational thematics: Comparing algorithms for clustering the genres of literary fictioncited by 5
- 2024SlideSpawn: An Automatic Slides Generation System for Research Publicationscited by 5
36 more
- 2021quantum Case-Based Reasoning (qCBR)cited by 4
- 2021Evaluating Document Representations for Content-based Legal Literature Recommendationscited by 4
- 2021Neural Embeddings of Urban Big Data Reveal Emergent Structures in Citiescited by 2
- 2024EUREKHA: Enhancing User Representation for Key Hackers Identification in Underground Forumscited by 2
- 2025Deep Reversible Consistency Learning for Cross-modal Retrievalcited by 2
- 2021Contextual Text Embeddings for Twicited by 1
- 2022Stock2Vec: An Embedding to Improve Predictive Models for Companiescited by 1
- 2023Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings?cited by 1
- 2024Probabilistic Topic Modelling with Transformer Representationscited by 1
- 2024Manufacturing Service Capability Prediction with Graph Neural Networkscited by 1
- 2024Implementing NLPs in industrial process modeling: Addressing Categorical Variablescited by 1
- 2025A Method for Handling Negative Similarities in Explainable Graph Spectral Clustering of Text Documents -- Extended Versioncited by 1
- 2025Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrievalcited by 1
- 2021Advances in Electron Microscopy with Deep Learningcited by 0
- 2021Modelling the Impact of Scandals: the case of the 2017 French Presidential Electioncited by 0
- 2021Back Translation Survey for Improving Text Augmentationcited by 0
- 2021Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis managementcited by 0
- 2021On Representation Learning for Scientific News Articles Using Heterogeneous Knowledge Graphscited by 0
- 2021MOOCRep: A Unified Pre-trained Embedding of MOOC Entitiescited by 0
- 2021We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semanticscited by 0
- 2021A Deep Learning Approach for Ontology Enrichment from Unstructured Textcited by 0
- 2022Suggesting Relevant Questions for a Query Using Statistical Natural Language Processing Techniquecited by 0
- 2022Using Full-Text Content to Characterize and Identify Best Seller Bookscited by 0
- 2022Keywords for Biascited by 0
- 2022Submission-Aware Reviewer Profiling for Reviewer Recommender Systemcited by 0
- 2023A Benchmark Study by using various Machine Learning Models for Predicting Covid-19 trendscited by 0
- 2023XAI in Computational Linguistics: Understanding Political Leanings in the Slovenian Parliamentcited by 0
- 2023Detection of depression on social networks using transformers and ensemblescited by 0
- 2023Semi-automated extraction of research topics and trends from NCI funding in radiological sciences from 2000-2020cited by 0
- 2023Vulgar Remarks Detection in Chittagonian Dialect of Banglacited by 0
- 2023Refining GPT-3 Embeddings with a Siamese Structure for Technical Post Duplicate Detectioncited by 0
- 2024A Unified Optimal Transport Framework for Cross-Modal Retrieval with Noisy Labelscited by 0
- 2025Explainable Graph Spectral Clustering For GloVe-like Text Embeddingscited by 0
- 2025Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswanacited by 0
- 2025Neighbor-aware Instance Refining with Noisy Labels for Cross-Modal Retrievalcited by 0
- 2026PRecG: Legal Precedent Retrieval with Graph Neural Networks and Rhetorical Role Segmentationcited by 0
- 2026PRecG: Legal Precedent Retrieval with Graph Neural Networks and Rhetorical Role Segmentation10 Jul 2026
- 2025Neighbor-aware Instance Refining with Noisy Labels for Cross-Modal Retrieval30 Dec 2025
- 2025Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswana25 Nov 2025
- 2025Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrieval11 Nov 2025
- 2025Explainable Graph Spectral Clustering For GloVe-like Text Embeddings12 Aug 2025
- 2025A Method for Handling Negative Similarities in Explainable Graph Spectral Clustering of Text Documents -- Extended Version16 Apr 2025
- 2025Deep Reversible Consistency Learning for Cross-modal Retrieval10 Jan 2025
- 2024SlideSpawn: An Automatic Slides Generation System for Research Publications20 Nov 2024
- 2024EUREKHA: Enhancing User Representation for Key Hackers Identification in Underground Forums8 Nov 2024
- 2024Implementing NLPs in industrial process modeling: Addressing Categorical Variables27 Sep 2024
- 2024Diversified Batch Selection for Training Acceleration7 Jun 2024
- 2024Manufacturing Service Capability Prediction with Graph Neural Networks25 Mar 2024
36 more
- 2024A Unified Optimal Transport Framework for Cross-Modal Retrieval with Noisy Labels20 Mar 2024
- 2024Probabilistic Topic Modelling with Transformer Representations6 Mar 2024
- 2023Refining GPT-3 Embeddings with a Siamese Structure for Technical Post Duplicate Detection22 Dec 2023
- 2023CarExpert: Leveraging Large Language Models for In-Car Conversational Question Answering14 Oct 2023
- 2023Vulgar Remarks Detection in Chittagonian Dialect of Bangla29 Aug 2023
- 2023Semi-automated extraction of research topics and trends from NCI funding in radiological sciences from 2000-202022 Jun 2023
- 2023Computational thematics: Comparing algorithms for clustering the genres of literary fiction18 May 2023
- 2023Detection of depression on social networks using transformers and ensembles9 May 2023
- 2023XAI in Computational Linguistics: Understanding Political Leanings in the Slovenian Parliament8 May 2023
- 2023Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings?28 Apr 2023
- 2023A Benchmark Study by using various Machine Learning Models for Predicting Covid-19 trends26 Jan 2023
- 2022Submission-Aware Reviewer Profiling for Reviewer Recommender System8 Nov 2022
- 2022Keywords for Bias31 Oct 2022
- 2022Lbl2Vec: An Embedding-Based Approach for Unsupervised Document Retrieval on Predefined Topics12 Oct 2022
- 2022Using Full-Text Content to Characterize and Identify Best Seller Books5 Oct 2022
- 2022Suggesting Relevant Questions for a Query Using Statistical Natural Language Processing Technique26 Apr 2022
- 2022Stock2Vec: An Embedding to Improve Predictive Models for Companies27 Jan 2022
- 2021Data Augmentation for Mental Health Classification on Social Media19 Dec 2021
- 2021A Deep Learning Approach for Ontology Enrichment from Unstructured Text16 Dec 2021
- 2021Neural Embeddings of Urban Big Data Reveal Emergent Structures in Cities24 Oct 2021
- 2021MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction13 Oct 2021
- 2021We've had this conversation before: A Novel Approach to Measuring Dialog Similarity12 Oct 2021
- 2021We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semantics10 Sep 2021
- 2021MOOCRep: A Unified Pre-trained Embedding of MOOC Entities12 Jul 2021
- 2021A News-based Machine Learning Model for Adaptive Asset Pricing13 Jun 2021
- 2021Learning Models for Suicide Prediction from Social Media Posts29 Apr 2021
- 2021Evaluating Document Representations for Content-based Legal Literature Recommendations28 Apr 2021
- 2021Unsupervised Deep Keyphrase Generation18 Apr 2021
- 2021On Representation Learning for Scientific News Articles Using Heterogeneous Knowledge Graphs12 Apr 2021
- 2021quantum Case-Based Reasoning (qCBR)1 Apr 2021
- 2021Contextual Text Embeddings for Twi29 Mar 2021
- 2021Identifying Machine-Paraphrased Plagiarism22 Mar 2021
- 2021Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis management22 Mar 2021
- 2021Back Translation Survey for Improving Text Augmentation19 Feb 2021
- 2021Modelling the Impact of Scandals: the case of the 2017 French Presidential Election27 Jan 2021
- 2021Advances in Electron Microscopy with Deep Learning4 Jan 2021
- 2021MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extractioncited by 20
- 2021Identifying Machine-Paraphrased Plagiarismcited by 16
- 2024Diversified Batch Selection for Training Accelerationcited by 14
- 2021Learning Models for Suicide Prediction from Social Media Postscited by 10
- 2021Unsupervised Deep Keyphrase Generationcited by 7
- 2021A News-based Machine Learning Model for Adaptive Asset Pricingcited by 7
- 2021We've had this conversation before: A Novel Approach to Measuring Dialog Similaritycited by 7
- 2021Data Augmentation for Mental Health Classification on Social Mediacited by 7
- 2022Lbl2Vec: An Embedding-Based Approach for Unsupervised Document Retrieval on Predefined Topicscited by 7
- 2023Computational thematics: Comparing algorithms for clustering the genres of literary fictioncited by 5
- 2024SlideSpawn: An Automatic Slides Generation System for Research Publicationscited by 5
- 2021quantum Case-Based Reasoning (qCBR)cited by 4
12 most cited of 47 All 47 (JSON)
- 2026PRecG: Legal Precedent Retrieval with Graph Neural Networks and Rhetorical Role Segmentation10 Jul 2026
- 2025Neighbor-aware Instance Refining with Noisy Labels for Cross-Modal Retrieval30 Dec 2025
- 2025Language-Independent Sentiment Labelling with Distant Supervision: A Case Study for English, Sepedi and Setswana25 Nov 2025
- 2025Semantic-Consistent Bidirectional Contrastive Hashing for Noisy Multi-Label Cross-Modal Retrieval11 Nov 2025
- 2025Explainable Graph Spectral Clustering For GloVe-like Text Embeddings12 Aug 2025
- 2025A Method for Handling Negative Similarities in Explainable Graph Spectral Clustering of Text Documents -- Extended Version16 Apr 2025
- 2025Deep Reversible Consistency Learning for Cross-modal Retrieval10 Jan 2025
- 2024SlideSpawn: An Automatic Slides Generation System for Research Publications20 Nov 2024
- 2024EUREKHA: Enhancing User Representation for Key Hackers Identification in Underground Forums8 Nov 2024
- 2024Implementing NLPs in industrial process modeling: Addressing Categorical Variables27 Sep 2024
- 2024Diversified Batch Selection for Training Acceleration7 Jun 2024
- 2024Manufacturing Service Capability Prediction with Graph Neural Networks25 Mar 2024
12 newest of 47 All 47 (JSON)