mlsanityData to 7 Oct 2026

Counter-Interference Adapter for Multilingual Machine Translation

arXiv 2104.08154 ↗First posted 16 Apr 2021cs.CL cs.AIcited by 39

Not on the map. Why?

Abstract (arXiv)

Developing a unified multilingual model has long been a pursuit for machine translation. However, existing approaches suffer from performance degradation -- a single multilingual model is inferior to separately trained bilingual ones on rich-resource languages. We conjecture that such a phenomenon is due to interference caused by joint training with multiple languages. To accommodate the issue, we propose CIAT, an adapted Transformer model with a small parameter overhead for multilingual machine translation. We evaluate CIAT on multiple benchmark datasets, including IWSLT, OPUS-100, and WMT. Experiments show that CIAT consistently outperforms strong multilingual baselines on 64 of total 66 language directions, 42 of which see above 0.5 BLEU improvement. Our code is available at urlhttps://github.com/Yaoming95/CIAT~.

Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 24 of its 37 references that are in the map. First posted on arXiv 16 Apr 2021.

Builds on

24 of 37 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Layer Normalizationcited by 5,579
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  6. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  7. 2017Learning multiple visual domains with residual adapterscited by 553
  8. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  9. 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
  10. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
  11. 2019Massively Multilingual Neural Machine Translationcited by 246
  12. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 239
12 more
  1. 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
  2. 2019Multilingual Neural Machine Translation with Knowledge Distillationcited by 95
  3. 2017Adversarial Multi-task Learning for Text Classificationcited by 91
  4. 2018Tensor2Tensor for Neural Machine Translationcited by 85
  5. 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66
  6. 2020Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Informationcited by 64
  7. 2016Fully Character-Level Neural Machine Translation without Explicit Segmentationcited by 55
  8. 2019Generalized Data Augmentation for Low-Resource Translationcited by 53
  9. 2020Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translationcited by 51
  10. 2018From Word to Sense Embeddings: A Survey on Vector Representations of Meaningcited by 49
  11. 2019Multilingual Neural Machine Translation with Language Clusteringcited by 47
  12. 2020On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatmentcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 9; 2023: 9; 2024: 11; 2025: 8; 2026: 1.

39 papers.

Sort:

By area:

  1. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  2. 2023Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessmentcited by 227
  3. 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 171
  4. 2024Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysiscited by 52
  5. 2022Continual Prompt Tuning for Dialog State Trackingcited by 44
  6. 2024Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologiescited by 44
  7. 2023OWL: A Large Language Model for IT Operationscited by 43
  8. 2024DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distributioncited by 41
  9. 2022Exploring Efficient-tuning Methods in Self-supervised Speech Modelscited by 26
  10. 2021Learning Kernel-Smoothed Machine Translation with Retrieved Examplescited by 25
  11. 2024Hyperbolic Fine-Tuning for Large Language Modelscited by 24
  12. 2022Causes and Cures for Interference in Multilingual Translationcited by 23
27 more
  1. 2025AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mappingcited by 22
  2. 2022Lego-MT: Learning Detachable Models for Massively Multilingual Machine Translationcited by 21
  3. 2024Spectral Adapter: Fine-Tuning in Spectral Spacecited by 21
  4. 2022Multilingual Machine Translation with Hyper-Adapterscited by 15
  5. 2024Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Visioncited by 13
  6. 2022Structured Pruning Adapterscited by 12
  7. 2024Learning Attentional Mixture of LoRAs for Language Model Continual Learningcited by 10
  8. 2023Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuningcited by 8
  9. 2022On The Cross-Modal Transfer from Natural Language to Code through Adapter Modulescited by 6
  10. 2024Combo: Co-speech holistic 3D human motion generation and efficient customizable adaptation in harmonycited by 6
  11. 2025An Efficient Adaptive Compression Method for Human Perception and Machine Vision Taskscited by 5
  12. 2025Memory-Efficient Fine-Tuning of Transformers via Token Selectioncited by 4
  13. 2025On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentationcited by 4
  14. 2023Towards a Deep Understanding of Multilingual End-to-End Speech Translationcited by 3
  15. 2023PPEA-Depth: Progressive Parameter-Efficient Adaptation for Self-Supervised Monocular Depth Estimationcited by 3
  16. 2024Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing Imagescited by 3
  17. 2022Unifying the Convergences in Multilingual Neural Machine Translationcited by 2
  18. 2024Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Modelscited by 2
  19. 2025Prada: Black-Box LLM Adaptation with Private Data on Resource-Constrained Devicescited by 2
  20. 2025LLaVA-CMoE: Towards Continual Mixture of Experts for Large Vision-Language Modelscited by 2
  21. 2025qa-FLoRA: Data-free query-adaptive Fusion of LoRAs for LLMscited by 2
  22. 2022Informative Language Representation Learning for Massively Multilingual Neural Machine Translationcited by 1
  23. 2026Memory-Efficient Transfer Learning with Fading Side Networks via Masked Dual Path Distillationcited by 1
  24. 2023Label-Free Multi-Domain Machine Translation with Stage-wise Trainingcited by 0
  25. 2023Exploring Representational Disparities Between Multilingual and Bilingual Translation Modelscited by 0
  26. 2023Efficient Online Processing with Deep Neural Networkscited by 0
  27. 2025FuxiMT: Sparsifying Large Language Models for Chinese-Centric Multilingual Machine Translationcited by 0