mlsanityData to 7 Oct 2026

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP

arXiv 2005.14672 ↗First posted 29 May 2020cs.CLcited by 50

Not on the map. Why?

Abstract (arXiv)

Transfer learning, particularly approaches that combine multi-task learning with pre-trained contextualized embeddings and fine-tuning, have advanced the field of Natural Language Processing tremendously in recent years. In this paper we present MaChAmp, a toolkit for easy fine-tuning of contextualized embeddings in multi-task settings. The benefits of MaChAmp are its flexible configuration options, and the support of a variety of natural language processing tasks in a uniform toolkit, from text classification and sequence labeling to dependency parsing, masked language modeling, and text generation.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 May 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 12; 2023: 7; 2024: 11; 2025: 10; 2026: 2.

50 papers.

Sort:

  1. 2021From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understandingcited by 43
  2. 2022SkillSpan: Hard and Soft Skill Extraction from English Job Postingscited by 41
  3. 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
  4. 2021DaN+: Danish Nested Named Entities and Lexical Normalizationcited by 19
  5. 2021On Language Models for Creolescited by 17
  6. 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
  7. 2023SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)cited by 17
  8. 2023ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domaincited by 14
  9. 2023Findings of the VarDial Evaluation Campaign 2023cited by 14
  10. 2022Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learningcited by 13
  11. 2022Skill Extraction from Job Postings using Weak Supervisioncited by 13
  12. 2021De-identification of Privacy-related Entities in Job Postingscited by 12
38 more
  1. 2022Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Modelscited by 10
  2. 2022Experimental Standards for Deep Learning in Natural Language Processing Researchcited by 9
  3. 2021Genre as Weak Supervision for Cross-lingual Dependency Parsingcited by 8
  4. 2022Probing for Labeled Dependency Treescited by 8
  5. 20234 and 7-bit Labeling for Projective and Non-Projective Dependency Treescited by 8
  6. 2024Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Datacited by 8
  7. 2021Sequence-to-Sequence Lexical Normalization with Multilingual Transformerscited by 7
  8. 2021'UFAL at MultiLexNorm 2021: Improving Multilingual Lexical Normalization by Fine-tuning ByT5cited by 7
  9. 2022Ancestor-to-Creole Transfer is Not a Walk in the Parkcited by 7
  10. 2024MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebankcited by 7
  11. 2025Fine-grained Fallacy Detection with Human Label Variationcited by 6
  12. 2022Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learningcited by 5
  13. 2024Exploring the Robustness of Task-oriented Dialogue Systems for Colloquial German Varietiescited by 4
  14. 2024data2lang2vec: Data Driven Typological Features Completioncited by 4
  15. 2022Data-driven Parsing Evaluation for Child-Parent Interactionscited by 3
  16. 2024Beyond Dataset Creation: Critical View of Annotation Variation and Bias Probing of a Dataset for Online Radical Content Detectioncited by 3
  17. 2025Improving Dialectal Slot and Intent Detection with Auxiliary Tasks: A Multi-Dialectal Bavarian Case Studycited by 3
  18. 2025IYKYK: Using language models to decode extremist cryptolectscited by 3
  19. 2022Sort by Structure: Language Model Ranking as Dependency Probingcited by 2
  20. 2023Silver Syntax Pre-training for Cross-Domain Relation Extractioncited by 2
  21. 2024Can Humans Identify Domains?cited by 2
  22. 2024'UFAL LatinPipe at EvaLatin 2024: Morphosyntactic Analysis of Latincited by 2
  23. 2024Modeling Orthographic Variation in Occitan's Dialectscited by 2
  24. 2025Add Noise, Tasks, or Layers? MaiNLP at the VarDial 2025 Shared Task on Norwegian Dialectal Slot and Intent Detectioncited by 2
  25. 2025CorPipe at CRAC 2025: Evaluating Multilingual Encoders for Multilingual Coreference Resolutioncited by 2
  26. 2021Parsing with Pretrained Language Models, Multiple Datasets, and Dataset Embeddingscited by 1
  27. 2024EEVEE: An Easy Annotation Tool for Natural Language Processingcited by 1
  28. 2024Recipe for Zero-shot POS Tagging: Is It Useful in Realistic Scenarios?cited by 1
  29. 2025NameTag 3: A Tool and a Service for Multilingual/Multitagset NERcited by 1
  30. 2026MultiLexNorm++: A Unified Benchmark and a Generative Model for Lexical Normalization for Asian Languagescited by 1
  31. 2026CAIT: A Syntactic Parsing Toolkit for Child-Adult InTeractionscited by 1
  32. 2023EventNet-ITA: Italian Frame Parsing for Eventscited by 0
  33. 2023LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classificationcited by 0
  34. 2024A multitask learning framework for leveraging subjectivity of annotators to identify misogynycited by 0
  35. 2025The Language of Attachment: Modeling Attachment Dynamics in Psychotherapycited by 0
  36. 2025Nested Named Entity Recognition as Single-Pass Sequence Labelingcited by 0
  37. 2025NLPnorth @ TalentCLEF 2025: Comparing Discriminative, Contrastive, and Prompt-Based Methods for Job Title and Skill Matchingcited by 0
  38. 2025Flexing in 73 Languages: A Single Small Model for Multilingual Inflectioncited by 0