mlsanityData to 7 Oct 2026

Text Fact Transfer

arXiv 2310.14486 ↗First posted 23 Oct 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Text style transfer is a prominent task that aims to control the style of text without inherently changing its factual content. To cover more text modification applications, such as adapting past news for current events and repurposing educational materials, we propose the task of text fact transfer, which seeks to transfer the factual content of a source text between topics without modifying its style. We find that existing language models struggle with text fact transfer, due to their inability to preserve the specificity and phrasing of the source text, and tendency to hallucinate errors. To address these issues, we design ModQGA, a framework that minimally modifies a source text with a novel combination of end-to-end question generation and specificity-aware question answering. Through experiments on four existing datasets adapted for text fact transfer, we show that ModQGA can accurately transfer factual content without sacrificing the style of the source text.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

45 of 65 references.

References · 45

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  8. 2020Longformer: The Long-Document Transformercited by 3,362
  9. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  10. 2019Language Models as Knowledge Bases?cited by 1,922
  11. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  12. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
33 more
  1. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  2. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
  3. 2020Evaluation of Text Generation: A Surveycited by 275
  4. 2017Toward Controlled Generation of Textcited by 271
  5. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
  6. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
  7. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  8. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
  9. 2020Deep Learning for Text Style Transfer: A Surveycited by 161
  10. 2017Style Transfer in Text: Exploration and Evaluationcited by 145
  11. 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
  12. 2018Style Transfer Through Back-Translationcited by 124
  13. 2014Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)cited by 109
  14. 2019Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfercited by 81
  15. 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
  16. 2018Unsupervised Text Style Transfer using Language Models as Discriminatorscited by 70
  17. 2022Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Datacited by 61
  18. 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
  19. 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
  20. 2020Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymencited by 45
  21. 2019Controllable Paraphrase Generation with a Syntactic Exemplarcited by 44
  22. 2020Parallel Data Augmentation for Formality Style Transfercited by 39
  23. 2019Retrieve and Refine: Exemplar-based Neural Comment Generationcited by 36
  24. 2022E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoningcited by 28
  25. 2022Analogy Generation by Prompting Large Language Models: A Case Study of InstructGPTcited by 27
  26. 2020Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained Generationcited by 26
  27. 2021Data Augmentation in Natural Language Processing: A Novel Text Generation Approach for Long and Short Text Classifierscited by 24
  28. 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
  29. 2019Formality Style Transfer with Hybrid Textual Annotationscited by 16
  30. 2022Can Language Models Be Specific? How?cited by 8
  31. 2023Expository Text Generation: Imitate, Retrieve, Paraphrasecited by 8
  32. 2021A Template-guided Hybrid Pointer Network for Knowledge-basedTask-oriented Dialogue Systemscited by 5
  33. 2023Audience-Centric Natural Language Generation via Style Infusioncited by 5

Built on by

Not cited yet.