mlsanityData to 14 Oct 2026

Sentiment-based Candidate Selection for NMT

arXiv 2104.04840 ↗First posted 10 Apr 2021cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The explosion of user-generated content (UGC)--e.g. social media posts, comments, and reviews--has motivated the development of NLP applications tailored to these types of informal texts. Prevalent among these applications have been sentiment analysis and machine translation (MT). Grounded in the observation that UGC features highly idiomatic, sentiment-charged language, we propose a decoder-side approach that incorporates automatic sentiment scoring into the MT candidate selection process. We train separate English and Spanish sentiment classifiers, then, using n-best candidates generated by a baseline MT model with beam search, select the candidate that minimizes the absolute difference between the sentiment score of the source sentence and that of the translation, and perform a human evaluation to assess the produced translations. Unlike previous work, we select this minimally divergent translation by considering the sentiment scores of the source sentence and translation on a continuous interval, rather than using e.g. binary classification, allowing for more fine-grained selection of translation candidates. The results of human evaluations show that, in comparison to the open-source MT baseline model on top of which our sentiment-based pipeline is built, our pipeline produces more accurate translations of colloquial, sentiment-heavy source texts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 43 references that are in the map. First posted on arXiv 10 Apr 2021.

Builds on

14 of 43 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  5. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 798
  6. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  7. 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 222
  8. 2018Marian: Fast Neural Machine Translation in C++cited by 203
  9. 2017Unsupervised Neural Machine Translationcited by 149
  10. 2018MTNT: A Testbed for Machine Translation of Noisy Textcited by 54
  11. 2018Examining the Tip of the Iceberg: A Data Set for Idiom Translationcited by 34
  12. 2018Multilingual Sentiment Analysis: An RNN-Based Framework for Limited Datacited by 19
2 more
  1. 2018Classifying Idiomatic and Literal Expressions Using Topic Models and Intensity of Emotionscited by 13
  2. 2016User Reviews and Language: How Language Influences Ratingscited by 1

Built on by

Not cited yet.