ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
Not on the map. Why?
Abstract (arXiv)
Neural Machine Translation (NMT) has improved translation by using Transformer-based models, but it still struggles with word ambiguity and context. This problem is especially important in domain-specific applications, which often have problems with unclear sentences or poor data quality. Our research explores how adding information to models can improve translations in the context of e-commerce data. To this end we create ConECT -- a new Czech-to-Polish e-commerce product translation dataset coupled with images and product metadata consisting of 11,400 sentence pairs. We then investigate and compare different methods that are applicable to context-aware translation. We test a vision-language model (VLM), finding that visual context aids translation quality. Additionally, we explore the incorporation of contextual information into text-to-text models, such as the product's category path or image descriptions. The results of our study demonstrate that the incorporation of contextual information leads to an improvement in the quality of machine translation. We make the new dataset publicly available.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 41 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
25 of 41 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
- 2018Marian: Fast Neural Machine Translation in C++cited by 203
- 2017Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Descriptioncited by 76
13 more
- 2020A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translationcited by 51
- 2017Doubly-Attentive Decoder for Multi-modal Neural Machine Translationcited by 46
- 2017Incorporating Global Visual Features into Attention-Based Neural Machine Translationcited by 39
- 2020Visual Grounding in Video for Unsupervised Word Translationcited by 27
- 2022Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluationcited by 26
- 2021Gumbel-Attention for Multi-modal Machine Translationcited by 20
- 2016Multimodal Attention for Neural Machine Translationcited by 19
- 2018Unsupervised Multi-modal Neural Machine Translationcited by 15
- 2020Efficient Object-Level Visual Context Modeling for Multimodal Machine Translation: Masking Irrelevant Objects Helps Groundingcited by 13
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingcited by 10
- 2019Visual Agreement Regularized Training for Multi-Modal Machine Translationcited by 9
- 2019From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivotscited by 6
- 2024Towards Zero-Shot Multimodal Machine Translationcited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Vectra: A New Metric, Dataset, and Model for Visual Quality Assessment in E-Commerce In-Image Machine Translation
- 2026Adapting Vision-Language Models for E-commerce Understanding at Scale
- 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
- 2024Enhancing E-commerce Product Title Translation with Retrieval-Augmented Generation and Large Language Models
- 2026TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation
- 2025CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation
- 2023PUMGPT: A Large Vision-Language Model for Product Understanding
- 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understanding