mlsanityData to 14 Oct 2026

Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop

arXiv 2301.09908 ↗First posted 24 Jan 2023cs.HC cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents our project proposal for extracting biomedical information from German clinical narratives with limited amounts of annotations. We first describe the applied strategies in transfer learning and active learning for solving our problem. After that, we discuss the design of the user interface for both supplying model inspection and obtaining user annotations in the interactive environment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 82 references that are in the map. First posted on arXiv 24 Jan 2023.

Builds on

37 of 82 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  4. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  5. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  6. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  7. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  8. 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 742
  9. 2019How multilingual is Multilingual BERT?cited by 645
  10. 2020A Survey of Deep Active Learningcited by 554
  11. 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
  12. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
25 more
  1. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  2. 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
  3. 2019Cross-Lingual Ability of Multilingual BERT: An Empirical Studycited by 182
  4. 2020A Diagnostic Study of Explainability Techniques for Text Classificationcited by 159
  5. 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
  6. 2019Multilingual is not enough: BERT for Finnishcited by 119
  7. 2017Deep Active Learning for Named Entity Recognitioncited by 108
  8. 2019Deep Active Learning: Unified and Principled Method for Query and Trainingcited by 93
  9. 2018Deep Bayesian Active Learning for Natural Language Processing: Results of a Large-Scale Empirical Studycited by 90
  10. 2021Explanation-Based Human Debugging of NLP Models: A Surveycited by 53
  11. 2020SeqMix: Augmenting Active Sequence Labeling via Sequence Mixupcited by 52
  12. 2020A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matterscited by 45
  13. 2018Neural Cross-Lingual Named Entity Recognition with Minimal Resourcescited by 44
  14. 2021Putting Humans in the Natural Language Processing Loop: A Surveycited by 40
  15. 2020From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformerscited by 35
  16. 2020TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognitioncited by 30
  17. 2020Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learningcited by 25
  18. 2017YEDDA: A Lightweight Collaborative Text Span Annotation Toolcited by 13
  19. 2019Interactive Refinement of Cross-Lingual Word Embeddingscited by 13
  20. 2020LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanationcited by 11
  21. 2020LTP: A New Active Learning Strategy for CRF-Based Named Entity Recognitioncited by 10
  22. 2019A Little Annotation does a Lot of Good: A Study in Bootstrapping Low-resource Named Entity Recognizerscited by 9
  23. 2020Neural Cross-Lingual Transfer and Limited Annotated Data for Named Entity Recognition in Danishcited by 5
  24. 2018An architecture of open-source tools to combine textual information extraction, faceted search and information visualisationcited by 2
  25. 2020Learning the grammar of drug prescription: recurrent neural network grammars for medication information extraction in clinical textscited by 2

Built on by

Not cited yet.