mlsanityData to 14 Oct 2026

BinaryAlign: Word Alignment as Binary Sequence Labeling

arXiv 2407.12881 ↗First posted 16 Jul 2024cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Real world deployments of word alignment are almost certain to cover both high and low resource languages. However, the state-of-the-art for this task recommends a different model class depending on the availability of gold alignment training data for a particular language pair. We propose BinaryAlign, a novel word alignment technique based on binary sequence labeling that outperforms existing approaches in both scenarios, offering a unifying approach to the task. Additionally, we vary the specific choice of multilingual foundation model, perform stratified error analysis over alignment error type, and explore the performance of BinaryAlign on non-English language pairs. We make our source code publicly available.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

24 of 41 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  5. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  6. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  7. 2020Language-agnostic BERT Sentence Embeddingcited by 627
  8. 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
  9. 2021Word Alignment by Fine-tuning Embeddings on Parallel Corporacited by 186
  10. 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
  11. 2018Identifying and Controlling Important Neurons in Neural Machine Translationcited by 111
  12. 2019Jointly Learning to Align and Translate with Transformer Modelscited by 75
12 more
  1. 2019compare-mt: A Tool for Holistic Comparison of Language Generation Systemscited by 43
  2. 2021Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignmentcited by 41
  3. 2020Accurate Word Alignment Induction from Neural Machine Translationcited by 32
  4. 2021Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitutioncited by 31
  5. 2020End-to-End Neural Word Alignment Outperforms GIZA++cited by 28
  6. 2020A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERTcited by 27
  7. 2020Mask-Align: Self-Supervised Neural Word Alignmentcited by 20
  8. 2023WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Predictioncited by 10
  9. 2023Multilingual Sentence Transformer as A Multilingual Word Alignercited by 8
  10. 2021Graph Algorithms for Multiparallel Word Alignmentcited by 4
  11. 2023Meeting the Needs of Low-Resource Languages: The Value of Automatic Alignments via Pretrained Modelscited by 4
  12. 2022Word Alignment in the Era of Deep Learning: A Tutorialcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026NeoAMT: Neologism-Aware Agentic Machine Translation with Reinforcement Learningcited by 3
  2. 2026OmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignmentcited by 1
  3. 2026Scaling Unsupervised Word Alignment to Documents via Structural Constraintscited by 1