mlsanityData to 14 Oct 2026

DFKI-NLP at SemEval-2024 Task 2: Towards Robust LLMs Using Data Perturbations and MinMax Training

arXiv 2405.00321 ↗First posted 1 May 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The NLI4CT task at SemEval-2024 emphasizes the development of robust models for Natural Language Inference on Clinical Trial Reports (CTRs) using large language models (LLMs). This edition introduces interventions specifically targeting the numerical, vocabulary, and semantic aspects of CTRs. Our proposed system harnesses the capabilities of the state-of-the-art Mistral model, complemented by an auxiliary model, to focus on the intricate input space of the NLI4CT dataset. Through the incorporation of numerical and acronym-based perturbations to the data, we train a robust system capable of handling both semantic-altering and numerical contradiction interventions. Our analysis on the dataset sheds light on the challenging sections of the CTRs for reasoning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 1 May 2024.

Builds on

24 of 32 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  7. 2020Longformer: The Long-Document Transformercited by 3,413
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  9. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  10. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  11. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  12. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
12 more
  1. 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 425
  2. 2023Llemma: An Open Language Model For Mathematicscited by 388
  3. 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 364
  4. 2018Hypothesis Only Baselines in Natural Language Inferencecited by 295
  5. 2018Stress Test Evaluation for Natural Language Inferencecited by 213
  6. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  7. 2023Solving Math Word Problems by Combining Language Models With Symbolic Solverscited by 124
  8. 2018Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual Entailmentcited by 59
  9. 2024SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trialscited by 20
  10. 2023NLI4CT: Multi-Evidence Natural Language Inference for Clinical Trial Reportscited by 18
  11. 2019Deep Contextualized Biomedical Abbreviation Expansioncited by 14
  12. 2023Solving Math Word Problem with Problem Type Classificationcited by 6

Built on by

Not cited yet.