jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models
Not on the map. Why?
Abstract (arXiv)
We introduce jiant, an open source toolkit for conducting multitask and transfer learning experiments on English NLU tasks. jiant enables modular and configuration-driven experimentation with state-of-the-art models and implements a broad set of tasks for probing, transfer learning, and multitask training experiments. jiant implements over 50 NLU tasks, including all GLUE and SuperGLUE benchmark tasks. We demonstrate that jiant reproduces published performance on a variety of tasks and models, including BERT and RoBERTa. jiant is available at https://jiant.info.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 12; 2023: 5; 2024: 5.
39 papers.
Sort:
- 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 140
- 2022minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Modelscited by 58
- 2021Comparing Test Sets with Item Response Theorycited by 55
- 2023Language acquisition: do children and language models follow similar learning stages?cited by 40
- 2022An Analysis of Negation in Natural Language Understanding Corporacited by 39
- 2021Curriculum learning for language modelingcited by 32
- 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
- 2021Does Putting a Linguist in the Loop Improve NLU Data Collection?cited by 29
- 2021Fine-Tuned Transformers Show Clusters of Similar Representations Across Layerscited by 29
- 2022Investigating Reasons for Disagreement in Natural Language Inferencecited by 29
- 2024BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Modelscited by 27
- 2021IndoNLI: A Natural Language Inference Dataset for Indonesiancited by 24
27 more
- 2021The Case for Translation-Invariant Self-Attention in Transformer-Based Language Modelscited by 23
- 2021LMdiff: A Visual Diff Tool to Compare Language Modelscited by 17
- 2021Mediators in Determining what Processing BERT Performs Firstcited by 14
- 2022Machine Reading, Fast and Slow: When Do Models "Understand" Language?cited by 13
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmaticscited by 12
- 2021Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Faircited by 12
- 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speechcited by 10
- 2022Sequence to sequence pretraining for a less-resourced Slovenian languagecited by 9
- 2021The Rediscovery Hypothesis: Language Models Need to Meet Linguisticscited by 7
- 2021Effect of Post-processing on Contextualized Word Representationscited by 7
- 2022Slovene SuperGLUE Benchmark: Translation and Evaluationcited by 7
- 2024Paraphrasing in Affirmative Terms Improves Negation Understandingcited by 7
- 2021Probing Linguistic Information For Logical Inference In Pre-trained Language Modelscited by 6
- 2021Evaluation of contextual embeddings on less-resourced languagescited by 4
- 2022ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Modelscited by 4
- 2022Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understandingcited by 3
- 2021Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models?cited by 2
- 2022Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP modelscited by 2
- 2022Rethinking Fano's Inequality in Ensemble Learningcited by 2
- 2021Learning Bill Similarity with Annotated and Augmented Corpora of Billscited by 1
- 2023A Stability Analysis of Fine-Tuning a Pre-Trained Modelcited by 1
- 2023Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Modelscited by 1
- 2024Consistency Matters: Explore LLMs Consistency From a Black-Box Perspectivecited by 1
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claimscited by 1
- 2021MOROCCO: Model Resource Comparison Frameworkcited by 0
- 2023Transferring Fairness using Multi-Task Learning with Limited Demographic Informationcited by 0
- 2024Aligned at the Start: Conceptual Groupings in LLM Embeddingscited by 0
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2024Paraphrasing in Affirmative Terms Improves Negation Understanding11 Jun 2024
- 2024Aligned at the Start: Conceptual Groupings in LLM Embeddings8 Jun 2024
- 2024BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models3 Apr 2024
- 2024Consistency Matters: Explore LLMs Consistency From a Black-Box Perspective27 Feb 2024
- 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speech8 Dec 2023
- 2023Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Models14 Nov 2023
- 2023Language acquisition: do children and language models follow similar learning stages?6 Jun 2023
- 2023Transferring Fairness using Multi-Task Learning with Limited Demographic Information22 May 2023
- 2023A Stability Analysis of Fine-Tuning a Pre-Trained Model24 Jan 2023
- 2022On the Effectiveness of Parameter-Efficient Fine-Tuning28 Nov 2022
- 2022Machine Reading, Fast and Slow: When Do Models "Understand" Language?15 Sep 2022
27 more
- 2022Investigating Reasons for Disagreement in Natural Language Inference7 Sep 2022
- 2022Sequence to sequence pretraining for a less-resourced Slovenian language28 Jul 2022
- 2022Hate Speech and Counter Speech Detection: Conversational Context Does Matter13 Jun 2022
- 2022Rethinking Fano's Inequality in Ensemble Learning25 May 2022
- 2022ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models3 May 2022
- 2022Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding13 Apr 2022
- 2022minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models24 Mar 2022
- 2022An Analysis of Negation in Natural Language Understanding Corpora16 Mar 2022
- 2022Russian SuperGLUE 1.1: Revising the Lessons not Learned by Russian NLP models15 Feb 2022
- 2022Slovene SuperGLUE Benchmark: Translation and Evaluation10 Feb 2022
- 2021Probing Linguistic Information For Logical Inference In Pre-trained Language Models3 Dec 2021
- 2021Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair16 Nov 2021
- 2021LMdiff: A Visual Diff Tool to Compare Language Models2 Nov 2021
- 2021IndoNLI: A Natural Language Inference Dataset for Indonesian27 Oct 2021
- 2021Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers17 Sep 2021
- 2021Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models?15 Sep 2021
- 2021Learning Bill Similarity with Annotated and Augmented Corpora of Bills14 Sep 2021
- 2021Curriculum learning for language modeling4 Aug 2021
- 2021Evaluation of contextual embeddings on less-resourced languages22 Jul 2021
- 2021He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics2 Jul 2021
- 2021The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models3 Jun 2021
- 2021Comparing Test Sets with Item Response Theory1 Jun 2021
- 2021MOROCCO: Model Resource Comparison Framework29 Apr 2021
- 2021Effect of Post-processing on Contextualized Word Representations15 Apr 2021
- 2021Does Putting a Linguist in the Loop Improve NLU Data Collection?15 Apr 2021
- 2021Mediators in Determining what Processing BERT Performs First13 Apr 2021
- 2021The Rediscovery Hypothesis: Language Models Need to Meet Linguistics2 Mar 2021
- 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 140
- 2022minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Modelscited by 58
- 2021Comparing Test Sets with Item Response Theorycited by 55
- 2023Language acquisition: do children and language models follow similar learning stages?cited by 40
- 2022An Analysis of Negation in Natural Language Understanding Corporacited by 39
- 2021Curriculum learning for language modelingcited by 32
- 2022Hate Speech and Counter Speech Detection: Conversational Context Does Mattercited by 32
- 2021Does Putting a Linguist in the Loop Improve NLU Data Collection?cited by 29
- 2021Fine-Tuned Transformers Show Clusters of Similar Representations Across Layerscited by 29
- 2022Investigating Reasons for Disagreement in Natural Language Inferencecited by 29
- 2024BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Modelscited by 27
- 2021IndoNLI: A Natural Language Inference Dataset for Indonesiancited by 24
12 most cited of 39 All 39 (JSON)
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2024Paraphrasing in Affirmative Terms Improves Negation Understanding11 Jun 2024
- 2024Aligned at the Start: Conceptual Groupings in LLM Embeddings8 Jun 2024
- 2024BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models3 Apr 2024
- 2024Consistency Matters: Explore LLMs Consistency From a Black-Box Perspective27 Feb 2024
- 2023Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speech8 Dec 2023
- 2023Selecting Shots for Demographic Fairness in Few-Shot Learning with Large Language Models14 Nov 2023
- 2023Language acquisition: do children and language models follow similar learning stages?6 Jun 2023
- 2023Transferring Fairness using Multi-Task Learning with Limited Demographic Information22 May 2023
- 2023A Stability Analysis of Fine-Tuning a Pre-Trained Model24 Jan 2023
- 2022On the Effectiveness of Parameter-Efficient Fine-Tuning28 Nov 2022
- 2022Machine Reading, Fast and Slow: When Do Models "Understand" Language?15 Sep 2022
12 newest of 39 All 39 (JSON)