CrossNews-UA: A Cross-lingual News Semantic Similarity Benchmark for Ukrainian, Polish, Russian, and English
Not on the map. Why?
Abstract (arXiv)
In the era of social networks and rapid misinformation spread, news analysis remains a critical task. Detecting fake news across multiple languages, particularly beyond English, poses significant challenges. Cross-lingual news comparison offers a promising approach to verify information by leveraging external sources in different languages (Chen and Shu, 2024). However, existing datasets for cross-lingual news analysis (Chen et al., 2022a) were manually curated by journalists and experts, limiting their scalability and adaptability to new languages. In this work, we address this gap by introducing a scalable, explainable crowdsourcing pipeline for cross-lingual news similarity assessment. Using this pipeline, we collected a novel dataset CrossNews-UA of news pairs in Ukrainian as a central language with linguistically and contextually relevant languages-Polish, Russian, and English. Each news pair is annotated for semantic similarity with detailed justifications based on the 4W criteria (Who, What, Where, When). We further tested a range of models, from traditional bag-of-words, Transformer-based architectures to large language models (LLMs). Our results highlight the challenges in multilingual news analysis and offer insights into models performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
12 of 27 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
- 2017Automatic Detection of Fake Newscited by 145
- 2024Aya 23: Open Weight Releases to Further Multilingual Progresscited by 121
- 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
- 2023Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similaritycited by 11
- 2024Cross-lingual Text Classification Transfer: The Case of Ukrainiancited by 5
- 2024A Multilingual Similarity Dataset for News Article Framecited by 2
- 2020Scalable Cross-lingual Document Similarity through Language-specific Concept Hierarchiescited by 1
Built on by
Not cited yet.