Songs Across Borders: Singable and Controllable Neural Lyric Translation
Not on the map. Why?
Abstract (arXiv)
The development of general-domain neural machine translation (NMT) methods has advanced significantly in recent years, but the lack of naturalness and musical constraints in the outputs makes them unable to produce singable lyric translations. This paper bridges the singability quality gap by formalizing lyric translation into a constrained translation problem, converting theoretical guidance and practical techniques from translatology literature to prompt-driven NMT approaches, exploring better adaptation methods, and instantiating them to an English-Chinese lyric translation system. Our model achieves 99.85%, 99.00%, and 95.52% on length accuracy, rhyme accuracy, and word boundary recall. In our subjective evaluation, our model shows a 75% relative enhancement on overall quality, compared against naive fine-tuning (Code available at https://github.com/Sonata165/ControllableLyricTranslation).
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 26 May 2023.
Builds on
20 of 41 references.
References · 20
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
- 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 182
- 2017Unsupervised Neural Machine Translationcited by 149
- 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
- 2020Lexically Constrained Neural Machine Translation with Levenshtein Transformercited by 45
- 2019Controlling the Output Length of Neural Machine Translationcited by 36
8 more
- 2020SongNet: Rigid Formats Controlled Text Generationcited by 26
- 2021DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modelingcited by 25
- 2022PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generationcited by 22
- 2020Iterative Domain-Repaired Back-Translationcited by 13
- 2020On the Generation of Medical Dialogues for COVID-19cited by 12
- 2022Automatic Song Translation for Tonal Languagescited by 12
- 2022Integrating Vectorized Lexical Constraints for Neural Machine Translationcited by 9
- 2021Input Augmentation Improves Constrained Beam Search for Neural Machine Translation: NTT at WAT 2021cited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 4; 2026: 1.
11 papers.
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2025SwiLTra-Bench: The Swiss Legal Translation Benchmarkcited by 11
- 2023A Computational Evaluation Framework for Singable Lyric Translationcited by 4
- 2023K-pop Lyric Translation: Dataset, Analysis, and Neural-Modellingcited by 4
- 2025Isolating Culture Neurons in Multilingual Large Language Modelscited by 4
- 2024REFFLY: Melody-Constrained Lyrics Editing Modelcited by 2
- 2024Sing it, Narrate it: Quality Musical Lyrics Translationcited by 2
- 2023Joint Learning of Wording and Formatting for Singable Melody-to-Lyric Generationcited by 1
- 2025LyriCAR: A Difficulty-Aware Curriculum Reinforcement Learning Framework For Controllable Lyric Translationcited by 1
- 2026HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learningcited by 1
- 2025MAVL: A Multilingual Audio-Video Lyrics Dataset for Animated Song Translationcited by 0
- 2026HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learning15 Jan 2026
- 2025LyriCAR: A Difficulty-Aware Curriculum Reinforcement Learning Framework For Controllable Lyric Translation22 Oct 2025
- 2025Isolating Culture Neurons in Multilingual Large Language Models4 Aug 2025
- 2025MAVL: A Multilingual Audio-Video Lyrics Dataset for Animated Song Translation24 May 2025
- 2025SwiLTra-Bench: The Swiss Legal Translation Benchmark3 Mar 2025
- 2024Sing it, Narrate it: Quality Musical Lyrics Translation29 Oct 2024
- 2024REFFLY: Melody-Constrained Lyrics Editing Model30 Aug 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2023K-pop Lyric Translation: Dataset, Analysis, and Neural-Modelling20 Sep 2023
- 2023A Computational Evaluation Framework for Singable Lyric Translation26 Aug 2023
- 2023Joint Learning of Wording and Formatting for Singable Melody-to-Lyric Generation5 Jul 2023