mlsanityData to 7 Oct 2026

PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similarity

arXiv 2305.07893 ↗First posted 13 May 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

One of the components of natural language processing that has received a lot of investigation recently is semantic textual similarity. In computational linguistics and natural language processing, assessing the semantic similarity of words, phrases, paragraphs, and texts is crucial. Calculating the degree of semantic resemblance between two textual pieces, paragraphs, or phrases provided in both monolingual and cross-lingual versions is known as semantic similarity. Cross lingual semantic similarity requires corpora in which there are sentence pairs in both the source and target languages with a degree of semantic similarity between them. Many existing cross lingual semantic similarity models use a machine translation due to the unavailability of cross lingual semantic similarity dataset, which the propagation of the machine translation error reduces the accuracy of the model. On the other hand, when we want to use semantic similarity features for machine translation the same machine translations should not be used for semantic similarity. For Persian, which is one of the low resource languages, no effort has been made in this regard and the need for a model that can understand the context of two languages is felt more than ever. In this article, the corpus of semantic textual similarity between sentences in Persian and English languages has been produced for the first time by using linguistic experts. We named this dataset PESTS (Persian English Semantic Textual Similarity). This corpus contains 5375 sentence pairs. Also, different models based on transformers have been fine-tuned using this dataset. The results show that using the PESTS dataset, the Pearson correlation of the XLM ROBERTa model increases from 85.87% to 95.62%.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 57 references that are in the map. First posted on arXiv 13 May 2023.

Builds on

17 of 57 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2019Cross-lingual Language Model Pretrainingcited by 1,088
  6. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  7. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  8. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  9. 2013Exploiting Similarities among Languages for Machine Translationcited by 187
  10. 2021XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyondcited by 114
  11. 2018Learning Cross-Lingual Sentence Representations via a Multi-task Dual-Encoder Modelcited by 46
  12. 2016Massively Multilingual Word Embeddingscited by 26
5 more
  1. 2014BilBOWA: Fast Bilingual Distributed Representations without Word Alignmentscited by 16
  2. 2018MIZAN: A Large Persian-English Parallel Corpuscited by 13
  3. 2018Improving Multilingual Semantic Textual Similarity with Shared Sentence Encoder for Low-resource Languagescited by 5
  4. 2018Linear Transformations for Cross-lingual Semantic Textual Similaritycited by 3
  5. 2020Intrinsic analysis for dual word embedding space modelscited by 2

Built on by

Not cited yet.