mlsanityData to 7 Oct 2026

Generating Prototypes for Contradiction Detection Using Large Language Models and Linguistic Rules

arXiv 2310.14732 ↗First posted 23 Oct 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce a novel data generation method for contradiction detection, which leverages the generative power of large language models as well as linguistic rules. Our vision is to provide a condensed corpus of prototypical contradictions, allowing for in-depth linguistic analysis as well as efficient language model fine-tuning. To this end, we instruct the generative models to create contradicting statements with respect to descriptions of specific contradiction types. In addition, the model is also instructed to come up with completely new contradiction typologies. As an auxiliary approach, we use linguistic rules to construct simple contradictions such as those arising from negation, antonymy and numeric mismatch. We find that our methods yield promising results in terms of coherence and variety of the data. Further studies, as well as manual refinement are necessary to make use of this data in a machine learning setup.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 18 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

8 of 18 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  5. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  6. 2022Informed Pre-Training on Prior Knowledgecited by 5
  7. 2022A Linguistic Investigation of Machine Learning based Contradiction Detection Models: An Empirical Analysis and Future Perspectivescited by 1
  8. 2022Towards Linguistically Informed Multi-Objective Pre-Training for Natural Language Inferencecited by 1

Built on by

Not cited yet.