AdapterHub Playground: Simple and Flexible Few-Shot Learning with Adapters
Not on the map. Why?
Abstract (arXiv)
The open-access dissemination of pretrained language models through online repositories has led to a democratization of state-of-the-art natural language processing (NLP) research. This also allows people outside of NLP to use such models and adapt them to specific use-cases. However, a certain amount of technical proficiency is still required which is an entry barrier for users who want to apply these models to a certain task but lack the necessary knowledge or resources. In this work, we aim to overcome this gap by providing a tool which allows researchers to leverage pretrained models without writing a single line of code. Built upon the parameter-efficient adapter modules for transfer learning, our AdapterHub Playground provides an intuitive interface, allowing the usage of adapters for prediction, training and analysis of textual data for a variety of NLP tasks. We present the tool's architecture and demonstrate its advantages with prototypical use-cases, where we show that predictive performance can easily be increased in a few-shot learning scenario. Finally, we evaluate its usability in a user study. We provide the code and a live interface at https://adapter-hub.github.io/playground.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 32 of its 58 references that are in the map. First posted on arXiv 18 Aug 2021.
Builds on
32 of 58 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2017Learning multiple visual domains with residual adapterscited by 553
- 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
- 2020AdapterHub: A Framework for Adapting Transformerscited by 441
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
20 more
- 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 239
- 2020AdapterDrop: On the Efficiency of Adapters in Transformerscited by 223
- 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 214
- 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 209
- 2021On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptationcited by 147
- 2020Neural Unsupervised Domain Adaptation in NLP---A Surveycited by 142
- 2020An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Modelscited by 133
- 2020Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?cited by 127
- 2020UNKs Everywhere: Adapting Multilingual Language Models to New Scriptscited by 113
- 2020UDapter: Language Adaptation for Truly Universal Dependency Parsingcited by 77
- 2021What to Pre-Train on? Efficient Intermediate Task Selectioncited by 62
- 2020Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformerscited by 57
- 2021Structural Adapters in Pretrained Language Models for AMR-to-text Generationcited by 48
- 2021Robust Transfer Learning with Pretrained Language Models through Adapterscited by 35
- 2020Stance Detection Benchmark: How Robust Is Your Stance Detection?cited by 33
- 2015Semi-supervised Question Retrieval with Gated Convolutionscited by 28
- 2020Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfercited by 23
- 2020MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scalecited by 20
- 2018Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustnesscited by 17
- 2021Investigating label suggestions for opinion mining in German Covid-19 social mediacited by 15
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 3; 2024: 3; 2025: 1.
8 papers.
- 2024Towards Modular LLMs by Building and Reusing a Library of LoRAscited by 72
- 2024A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learningcited by 52
- 2024Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMscited by 31
- 2023Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modelingcited by 19
- 2021LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learnerscited by 9
- 2023IFAN: An Explainability-Focused Interaction Framework for Humans and NLP Modelscited by 8
- 2023Parameter-Efficient Sparse Retrievers and Rerankers using Adapterscited by 3
- 2025Position: Pause Recycling LoRAs and Prioritize Mechanisms to Uncover Limits and Effectivenesscited by 0
- 2025Position: Pause Recycling LoRAs and Prioritize Mechanisms to Uncover Limits and Effectiveness16 Jun 2025
- 2024A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning13 Aug 2024
- 2024Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs24 Jun 2024
- 2024Towards Modular LLMs by Building and Reusing a Library of LoRAs18 May 2024
- 2023Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling18 Oct 2023
- 2023Parameter-Efficient Sparse Retrievers and Rerankers using Adapters23 Mar 2023
- 2023IFAN: An Explainability-Focused Interaction Framework for Humans and NLP Models6 Mar 2023
- 2021LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learners12 Oct 2021