mlsanityData to 14 Oct 2026

FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domain

arXiv 2406.10040 ↗First posted 14 Jun 2024cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper describes the inference system of FZI-WIM at the SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials. Our system utilizes the chain of thought (CoT) paradigm to tackle this complex reasoning problem and further improves the CoT performance with self-consistency. Instead of greedy decoding, we sample multiple reasoning chains with the same prompt and make the final verification with majority voting. The self-consistent CoT system achieves a baseline F1 score of 0.80 (1st), faithfulness score of 0.90 (3rd), and consistency score of 0.73 (12th). We release the code and data publicly https://github.com/jens5588/FZI-WIM-NLI4CT.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

17 of 21 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  9. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  10. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  11. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  12. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
5 more
  1. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  2. 2020AdapterHub: A Framework for Adapting Transformerscited by 444
  3. 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 370
  4. 2022ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoningcited by 177
  5. 2024SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trialscited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Knowledge Graph-Enhanced Zero-Shot Topic Classification: A Multi-Strategy Comparative Studycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024IITK at SemEval-2024 Task 2: Exploring the Capabilities of LLMs for Safe Biomedical Natural Language Inference for Clinical Trials
  2. 2024SEME at SemEval-2024 Task 2: Comparing Masked and Generative Language Models on Natural Language Inference for Clinical Trials
  3. 2026To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering
  4. 2023Faithful Chain-of-Thought Reasoning
  5. 2024Faithful Logical Reasoning via Symbolic Chain-of-Thought
  6. 2024SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning
  7. 2024Lisbon Computational Linguists at SemEval-2024 Task 2: Using A Mistral 7B Model and Data Augmentation
  8. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation