A Novel Cartography-Based Curriculum Learning Method Applied on RoNLI: The First Romanian Natural Language Inference Corpus
Not on the map. Why?
Abstract (arXiv)
Natural language inference (NLI), the task of recognizing the entailment relationship in sentence pairs, is an actively studied topic serving as a proxy for natural language understanding. Despite the relevance of the task in building conversational agents and improving text classification, machine translation and other NLP tasks, to the best of our knowledge, there is no publicly available NLI corpus for the Romanian language. To this end, we introduce the first Romanian NLI corpus (RoNLI) comprising 58K training sentence pairs, which are obtained via distant supervision, and 6K validation and test sentence pairs, which are manually annotated with the correct labels. We conduct experiments with multiple machine learning methods based on distant learning, ranging from shallow models based on word embeddings to transformer-based neural networks, to establish a set of competitive baselines. Furthermore, we improve on the best model by employing a new curriculum learning strategy based on data cartography. Our dataset and code to reproduce the baselines are available at https://github.com/Eduard6421/RONLI.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 27 of its 57 references that are in the map. First posted on arXiv 20 May 2024.
Builds on
27 of 57 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2018Annotation Artifacts in Natural Language Inference Datacited by 671
15 more
- 2020Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamicscited by 425
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2018Lessons from Natural Language Inference in the Clinical Domaincited by 151
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 148
- 2020OCNLI: Original Chinese Natural Language Inferencecited by 86
- 2020The birth of Romanian BERTcited by 44
- 2022SciNLI: A Corpus for Natural Language Inference on Scientific Textcited by 27
- 2021Figurative Language in Recognizing Textual Entailmentcited by 26
- 2021NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoningcited by 25
- 2021IndoNLI: A Natural Language Inference Dataset for Indonesiancited by 24
- 2022JamPatoisNLI: A Jamaican Patois Natural Language Inference Datasetcited by 11
- 2022Entailment Semantics Can Be Extracted from an Ideal Language Modelcited by 10
- 2023RoDia: A New Dataset for Romanian Dialect Identification from Speechcited by 4
- 2022InferES : A Natural Language Inference Corpus for Spanish Featuring Negation-Based Contrastive and Adversarial Examplescited by 3
- 2022Effective Cross-Task Transfer Learning for Explainable Natural Language Inference with T5cited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 2.
8 papers.
- 2025mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Taskscited by 7
- 2024Soft Language Prompts for Language Transfercited by 5
- 2024SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipecited by 3
- 2025Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Textcited by 3
- 2025DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognitioncited by 2
- 2025LLM-Guided Co-Training for Text Classificationcited by 1
- 2026CLewR: Curriculum Learning with Restarts for Machine Translation Preference Learningcited by 1
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomycited by 0
- 2026Disentangling Curriculum Learning in NLP: Towards a Unifying Taxonomy21 Jul 2026
- 2026CLewR: Curriculum Learning with Restarts for Machine Translation Preference Learning9 Jan 2026
- 2025LLM-Guided Co-Training for Text Classification20 Sep 2025
- 2025mSTEB: Massively Multilingual Evaluation of LLMs on Speech and Text Tasks10 Jun 2025
- 2025DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition6 Apr 2025
- 2025Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text18 Feb 2025
- 2024SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe7 Oct 2024
- 2024Soft Language Prompts for Language Transfer2 Jul 2024