mlsanityData to 14 Oct 2026

RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation

arXiv 2305.17131 ↗First posted 26 May 2023cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Attribute-controlled translation (ACT) is a subtask of machine translation that involves controlling stylistic or linguistic attributes (like formality and gender) of translation outputs. While ACT has garnered attention in recent years due to its usefulness in real-world applications, progress in the task is currently limited by dataset availability, since most prior approaches rely on supervised methods. To address this limitation, we propose Retrieval and Attribute-Marking enhanced Prompting (RAMP), which leverages large multilingual language models to perform ACT in few-shot and zero-shot settings. RAMP improves generation accuracy over the standard prompting approach by (1) incorporating a semantic similarity retrieval component for selecting similar in-context examples, and (2) marking in-context examples with attribute annotations. Our comprehensive experiments show that RAMP is a viable approach in both zero-shot and few-shot settings.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 41 of its 58 references that are in the map. First posted on arXiv 26 May 2023.

Builds on

41 of 58 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  7. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  8. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  10. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  11. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  12. 2019How Can We Know What Language Models Know?cited by 959
29 more
  1. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  2. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
  3. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  4. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  5. 2022In-context Examples Selection for Machine Translationcited by 172
  6. 2020Deep Learning for Text Style Transfer: A Surveycited by 162
  7. 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 145
  8. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  9. 2019Getting Gender Right in Neural Machine Translationcited by 98
  10. 2020Reducing Gender Bias in Neural Machine Translation as a Domain Adaptation Problemcited by 86
  11. 2023Inseq: An Interpretability Toolkit for Sequence Generation Modelscited by 78
  12. 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
  13. 2021Discrete and Soft Prompting for Multilingual Modelscited by 49
  14. 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
  15. 2016Personalized Machine Translation: Preserving Original Author Traitscited by 47
  16. 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
  17. 2019Controlling the Output Length of Neural Machine Translationcited by 36
  18. 2018Extreme Adaptation for Personalized Neural Machine Translationcited by 27
  19. 2021The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Resultscited by 27
  20. 2022Using natural language prompts for machine translationcited by 27
  21. 2022Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Promptcited by 25
  22. 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
  23. 2021Translation Error Detection as Rationale Extractioncited by 22
  24. 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 21
  25. 2019Controlling Neural Machine Translation Formality with Synthetic Supervisioncited by 18
  26. 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
  27. 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfercited by 12
  28. 2021Towards Universality in Multilingual Text Rewritingcited by 7
  29. 2022Controlling Styles in Neural Machine Translation with Activation Promptcited by 7

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 5; 2025: 3.

9 papers.

  1. 2024Multi-property Steering of Large Language Models with Dynamic Activation Compositioncited by 39
  2. 2024Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?cited by 17
  3. 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Studycited by 15
  4. 2024A Prompt Response to the Demand for Automatic Gender-Neutral Translationcited by 12
  5. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 7
  6. 2025Steering Large Language Models for Machine Translation Personalizationcited by 3
  7. 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?cited by 2
  8. 2025CIE: Controlling Language Model Text Generations Using Continuous Signalscited by 1
  9. 2024Fine-grained Gender Control in Machine Translation with Large Language Modelscited by 0