mlsanityData to 14 Oct 2026

Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge

arXiv 2305.09877 ↗First posted 17 May 2023cs.CL cs.AI cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

Initiated by the University Consortium of Geographic Information Science (UCGIS), GIS&T Body of Knowledge (BoK) is a community-driven endeavor to define, develop, and document geospatial topics related to geographic information science and technologies (GIS&T). In recent years, GIS&T BoK has undergone rigorous development in terms of its topic re-organization and content updating, resulting in a new digital version of the project. While the BoK topics provide useful materials for researchers and students to learn about GIS, the semantic relationships among the topics, such as semantic similarity, should also be identified so that a better and automated topic navigation can be achieved. Currently, the related topics are either defined manually by editors or authors, which may result in an incomplete assessment of topic relationship. To address this challenge, our research evaluates the effectiveness of multiple natural language processing (NLP) techniques in extracting semantics from text, including both deep neural networks and traditional machine learning approaches. Besides, a novel text summarization - KACERS (Keyword-Aware Cross-Encoder-Ranking Summarizer) - is proposed to generate a semantic summary of scientific publications. By identifying the semantic linkages among key topics, this work provides guidance for future development and content organization of the GIS&T BoK project. It also offers a new perspective on the use of machine learning techniques for analyzing scientific publications, and demonstrate the potential of KACERS summarizer in semantic understanding of long text documents.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 89 references that are in the map. First posted on arXiv 17 May 2023.

Builds on

23 of 89 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  8. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  9. 2014Distributed Representations of Sentences and Documentscited by 678
  10. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
  11. 2018Universal Sentence Encodercited by 489
  12. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
11 more
  1. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  2. 2018SentEval: An Evaluation Toolkit for Universal Sentence Representationscited by 294
  3. 2020Pretrained Transformers for Text Ranking: BERT and Beyondcited by 267
  4. 2019On Extractive and Abstractive Neural Document Summarization with Transformer Language Modelscited by 83
  5. 2020Evolution of Semantic Similarity -- A Surveycited by 83
  6. 2017DeepER -- Deep Entity Resolutioncited by 54
  7. 2019Topic-Guided Variational Autoencoders for Text Generationcited by 44
  8. 2018Neural Abstractive Text Summarization with Sequence-to-Sequence Modelscited by 39
  9. 2019A Summarization System for Scientific Documentscited by 17
  10. 2018Abstractive Text Summarization by Incorporating Reader Commentscited by 15
  11. 2019Document Similarity for Texts of Varying Lengths via Hidden Topicscited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.