# Using Deep Learning for Title-Based Semantic Subject Indexing to Reach Competitive Performance to Full-Text

arXiv: https://arxiv.org/abs/1801.06717 · HTML: https://mlsanity.com/paper/1801.06717/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Jan 2018.

## Built on by (most cited first, 10 of 10)

- [Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP](https://mlsanity.com/paper/2109.03777/) (2021)
- [The CSO Classifier: Ontology-Driven Detection of Research Topics in Scholarly Articles](https://mlsanity.com/paper/2104.00948/) (2021)
- [Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets](https://mlsanity.com/paper/2211.16878/) (2022)
- [A Comparison of Deep-Learning Methods for Analysing and Predicting Business Processes](https://mlsanity.com/paper/2102.07838/) (2021)
- [Lifelong Learning on Evolving Graphs Under the Constraints of Imbalanced Classes and New Classes](https://mlsanity.com/paper/2112.10558/) (2021)
- [A Survey on Knowledge Organization Systems of Research Fields: Resources and Challenges](https://mlsanity.com/paper/2409.04432/) (2024)
- [Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method?](https://mlsanity.com/paper/2101.08114/) (2021)
- [Improving Editorial Workflow and Metadata Quality at Springer Nature](https://mlsanity.com/paper/2103.13527/) (2021)
- [Are We Really Making Much Progress in Text Classification? A Comparative Review](https://mlsanity.com/paper/2204.03954/) (2022)
- [Beyond original Research Articles Categorization via NLP](https://mlsanity.com/paper/2309.07020/) (2023)

## Abstract (arXiv)

For (semi-)automated subject indexing systems in digital libraries, it is often more practical to use metadata such as the title of a publication instead of the full-text or the abstract. Therefore, it is desirable to have good text mining and text classification algorithms that operate well already on the title of a publication. So far, the classification performance on titles is not competitive with the performance on the full-texts if the same number of training samples is used for training. However, it is much easier to obtain title data in large quantities and to use it for training than full-text data. In this paper, we investigate the question how models obtained from training on increasing amounts of title training data compare to models from training on a constant number of full-texts. We evaluate this question on a large-scale dataset from the medical domain (PubMed) and from economics (EconBiz). In these datasets, the titles and annotations of millions of publications are available, and they outnumber the available full-texts by a factor of 20 and 15, respectively. To exploit these large amounts of data to their full potential, we develop three strong deep learning classifiers and evaluate their performance on the two datasets. The results are promising. On the EconBiz dataset, all three classifiers outperform their full-text counterparts by a large margin. The best title-based classifier outperforms the best full-text method by 9.4%. On the PubMed dataset, the best title-based method almost reaches the performance of the best full-text classifier, with a difference of only 2.9%.