mlsanityData to 7 Oct 2026

Biomedical Data-to-Text Generation via Fine-Tuning Transformers

arXiv 2109.01518 ↗First posted 3 Sep 2021cs.LG cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Data-to-text (D2T) generation in the biomedical domain is a promising - yet mostly unexplored - field of research. Here, we apply neural models for D2T generation to a real-world dataset consisting of package leaflets of European medicines. We show that fine-tuned transformers are able to generate realistic, multisentence text from data in the biomedical domain, yet have important limitations. We also release a new dataset (BioLeaflets) for benchmarking D2T generation models in the biomedical domain.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 3 Sep 2021.

Builds on

18 of 27 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  7. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  8. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
  9. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  10. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  11. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 267
  12. 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
6 more
  1. 2017Why We Need New Evaluation Metrics for NLGcited by 232
  2. 2017Challenges in Data-to-Document Generationcited by 226
  3. 2018Data-to-Text Generation with Content Selection and Planningcited by 106
  4. 2020Text-to-Text Pre-Training for Data-to-Text Taskscited by 104
  5. 2020A Human Evaluation of AMR-to-English Generation Systemscited by 13
  6. 2019Comprehend Medical: a Named Entity Recognition and Relationship Extraction Web Servicecited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 4; 2025: 0; 2026: 1.

9 papers.

  1. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  2. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
  3. 2023Generating Medical Prescriptions with Conditional Transformercited by 3
  4. 2024VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Modelscited by 3
  5. 2024An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generationcited by 2
  6. 2023AITA Generating Moral Judgements of the Crowd with Reasoningcited by 1
  7. 2024Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigationcited by 1
  8. 2022Cloning Ideology and Style using Deep Learningcited by 0
  9. 2026Exploring Post-Training Alignment of Small Language Models for Biomedical Data-to-Text Generation: A Case Study of Medication Leafletcited by 0