mlsanityData to 14 Oct 2026

Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysis

arXiv 2409.20054 ↗First posted 30 Sep 2024cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We investigate zero-shot cross-lingual news sentiment detection, aiming to develop robust sentiment classifiers that can be deployed across multiple languages without target-language training data. We introduce novel evaluation datasets in several less-resourced languages, and experiment with a range of approaches including the use of machine translation; in-context learning with large language models; and various intermediate training regimes including a novel task objective, POA, that leverages paragraph-level information. Our results demonstrate significant improvements over the state of the art, with in-context learning generally giving the best performance, but with the novel POA approach giving a competitive alternative with much lower computational overhead. We also show that language similarity is not in itself sufficient for predicting the success of cross-lingual transfer, but that similarity in semantic content and structure can be equally important.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 58 references that are in the map. First posted on arXiv 30 Sep 2024.

Builds on

26 of 58 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2017Decoupled Weight Decay Regularizationcited by 1,831
  6. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  7. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  8. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  9. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
  10. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 242
  11. 2020Geometric Dataset Distances via Optimal Transportcited by 158
  12. 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languagescited by 97
14 more
  1. 2024On Limitations of the Transformer Architecturecited by 63
  2. 2019Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsingcited by 46
  3. 2018Multinomial Adversarial Networks for Multi-Domain Text Classificationcited by 40
  4. 2020SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semanticscited by 31
  5. 2019Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translationcited by 27
  6. 2013Sentiment Analysis in the Newscited by 20
  7. 2019Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Modelcited by 18
  8. 2022Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structurecited by 17
  9. 2019Explicit Cross-lingual Pre-training for Unsupervised Machine Translationcited by 13
  10. 2018Zero-shot Sequence Labeling: Transferring Knowledge from Sentences to Tokenscited by 12
  11. 2023T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classificationcited by 8
  12. 2017Cross-Lingual Sentiment Analysis Without (Good) Translationcited by 7
  13. 2022Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?cited by 7
  14. 2023AHAM: Adapt, Help, Ask, Model -- Harvesting LLMs for literature miningcited by 5

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.