Attention Strategies for Multi-Source Sequence-to-Sequence Learning
Not on the map. Why?
Abstract (arXiv)
Modeling attention in neural multi-source sequence-to-sequence learning remains a relatively unexplored area, despite its usefulness in tasks that incorporate multiple source languages or modalities. We propose two novel approaches to combine the outputs of attention mechanisms over each source sequence, flat and hierarchical. We compare the proposed methods with existing techniques and present results of systematic evaluation of those methods on the WMT16 Multimodal Translation and Automatic Post-editing tasks. We show that the proposed methods achieve competitive results on both tasks.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 7; 2023: 6; 2024: 4; 2025: 2; 2026: 1.
32 papers.
Sort:
By area:
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 58
- 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
- 2021Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarizationcited by 32
- 2022On Vision Features in Multimodal Machine Translationcited by 31
- 2022Neural Machine Translation with Phrase-Level Universal Visual Representationscited by 26
- 2023Exploring Better Text Image Translation with Multimodal Codebookcited by 23
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
- 2021Cross-lingual Visual Pre-training for Multimodal Machine Translationcited by 19
- 2021See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarizationcited by 18
- 2022Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translationcited by 11
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languagescited by 11
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingcited by 10
20 more
- 2021Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Informationcited by 9
- 2021Attention-based Multi-hypothesis Fusion for Speech Summarizationcited by 9
- 2024On Measuring Context Utilization in Document-Level MT Systemscited by 9
- 2024AnyTrans: Translate AnyText in the Image with Large Scale Modelscited by 8
- 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translationcited by 7
- 2021Text is no more Enough! A Benchmark for Profile-based Spoken Language Understandingcited by 7
- 2022Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translationcited by 7
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contentscited by 7
- 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challengescited by 6
- 2022Low-resource Neural Machine Translation with Cross-modal Alignmentcited by 5
- 2023BASS: Block-wise Adaptation for Speech Summarizationcited by 4
- 2021ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpuscited by 3
- 2023Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairscited by 3
- 2021Visual Cues and Error Correction for Translation Robustnesscited by 2
- 2022Supervised Visual Attention for Simultaneous Multimodal Machine Translationcited by 2
- 2021ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarizationcited by 1
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?cited by 1
- 2023CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarizationcited by 0
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decodingcited by 0
- 2026Multimodal Abstractive Summarization of Instructional Videos with Vision-Language Modelscited by 0
- 2026Multimodal Abstractive Summarization of Instructional Videos with Vision-Language Models12 May 2026
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decoding8 Oct 2025
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languages10 Jan 2025
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?19 Jun 2024
- 2024AnyTrans: Translate AnyText in the Image with Large Scale Models17 Jun 2024
- 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges21 May 2024
- 2024On Measuring Context Utilization in Document-Level MT Systems2 Feb 2024
- 2023Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs26 Oct 2023
- 2023BASS: Block-wise Adaptation for Speech Summarization17 Jul 2023
- 2023CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarization6 Jul 2023
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contents24 Jun 2023
- 2023Exploring Better Text Image Translation with Multimodal Codebook27 May 2023
20 more
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM3 Mar 2023
- 2022Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation20 Dec 2022
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation19 Oct 2022
- 2022Low-resource Neural Machine Translation with Cross-modal Alignment13 Oct 2022
- 2022Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation5 Apr 2022
- 2022Neural Machine Translation with Phrase-Level Universal Visual Representations19 Mar 2022
- 2022On Vision Features in Multimodal Machine Translation17 Mar 2022
- 2022Supervised Visual Attention for Simultaneous Multimodal Machine Translation23 Jan 2022
- 2021Text is no more Enough! A Benchmark for Profile-based Spoken Language Understanding22 Dec 2021
- 2021Attention-based Multi-hypothesis Fusion for Speech Summarization16 Nov 2021
- 2021Contrastive Learning for Context-aware Neural Machine TranslationUsing Coreference Information13 Sep 2021
- 2021Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization6 Sep 2021
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training25 Aug 2021
- 2021ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization11 Aug 2021
- 2021ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus14 Jul 2021
- 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation30 May 2021
- 2021See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization20 May 2021
- 2021Visual Cues and Error Correction for Translation Robustness12 Mar 2021
- 2021Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation22 Feb 2021
- 2021Cross-lingual Visual Pre-training for Multimodal Machine Translation25 Jan 2021
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 58
- 2021Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translationcited by 44
- 2021Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarizationcited by 32
- 2022On Vision Features in Multimodal Machine Translationcited by 31
- 2022Neural Machine Translation with Phrase-Level Universal Visual Representationscited by 26
- 2023Exploring Better Text Image Translation with Multimodal Codebookcited by 23
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
- 2021Cross-lingual Visual Pre-training for Multimodal Machine Translationcited by 19
- 2021See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarizationcited by 18
- 2022Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translationcited by 11
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languagescited by 11
- 2021Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-trainingcited by 10
12 most cited of 30 All 30 (JSON)
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decoding8 Oct 2025
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languages10 Jan 2025
- 2024How effective is Multi-source pivoting for Translation of Low Resource Indian Languages?19 Jun 2024
- 2024A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges21 May 2024
- 2024On Measuring Context Utilization in Document-Level MT Systems2 Feb 2024
- 2023Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs26 Oct 2023
- 2023BASS: Block-wise Adaptation for Speech Summarization17 Jul 2023
- 2023CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarization6 Jul 2023
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contents24 Jun 2023
- 2023Exploring Better Text Image Translation with Multimodal Codebook27 May 2023
- 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM3 Mar 2023
- 2022Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation20 Dec 2022
12 newest of 30 All 30 (JSON)