Learning Semantic Text Similarity to rank Hypernyms of Financial Terms
Not on the map. Why?
Abstract (arXiv)
Over the years, there has been a paradigm shift in how users access financial services. With the advancement of digitalization more users have been preferring the online mode of performing financial activities. This has led to the generation of a huge volume of financial content. Most investors prefer to go through these contents before making decisions. Every industry has terms that are specific to the domain it operates in. Banking and Financial Services are not an exception to this. In order to fully comprehend these contents, one needs to have a thorough understanding of the financial terms. Getting a basic idea about a term becomes easy when it is explained with the help of the broad category to which it belongs. This broad category is referred to as hypernym. For example, "bond" is a hypernym of the financial term "alternative debenture". In this paper, we propose a system capable of extracting and ranking hypernyms for a given financial term. The system has been trained with financial text corpora obtained from various sources like DBpedia [4], Investopedia, Financial Industry Business Ontology (FIBO), prospectus and so on. Embeddings of these terms have been extracted using FinBERT [3], FinISH [1] and fine-tuned using SentenceBERT [54]. A novel approach has been used to augment the training set with negative samples. It uses the hierarchy present in FIBO. Finally, we benchmark the system performance with that of the existing ones. We establish that it performs better than the existing ones and is also scalable.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 84 references that are in the map. First posted on arXiv 20 Mar 2023.
Builds on
24 of 84 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2018Universal Sentence Encodercited by 485
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
- 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 101
- 2021EDGAR-CORPUS: Billions of Tokens Make The World Go Roundcited by 32
- 2016Improving Hypernymy Detection with an Integrated Path-based and Distributional Methodcited by 26
- 2018Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corporacited by 26
12 more
- 2017Taxonomy Induction using Hypernym Subsequencescited by 4
- 2020IITK at the FinSim Task: Hypernym Detection in Financial Domain via Context-Free and Contextualized Word Embeddingscited by 4
- 2015INRIASAC: Simple Hypernym Extraction Methodscited by 3
- 2021FinEAS: Financial Embedding Analysis of Sentimentcited by 3
- 2020From syntactic structure to semantic relationship: hypernym extraction from definitions by recurrent neural networks using the part of speech informationcited by 2
- 2021FinMatcher at FinSim-2: Hypernym Detection in the Financial Services Domain using Knowledge Graphscited by 2
- 2021JSI at the FinSim-2 task: Ontology-Augmented Financial Concept Classificationcited by 2
- 2021Yseop at FinSim-3 Shared Task 2021: Specializing Financial Domain Learning with Phrase Representationscited by 2
- 2017MIT at SemEval-2017 Task 10: Relation Extraction with Convolutional Neural Networkscited by 1
- 2021Exploiting Network Structures to Improve Semantic Representation for the Financial Domaincited by 1
- 2021Term Expansion and FinBERT fine-tuning for Hypernym and Synonym Ranking of Financial Termscited by 1
- 2021DICoE@FinSim-3: Financial Hypernym Detection using Augmented Terms and Distance-based Featurescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.