mlsanityData to 14 Oct 2026

An analysis of full-size Russian complexly NER labelled corpus of Internet user reviews on the drugs based on deep learning and language neural nets

arXiv 2105.00059 ↗First posted 30 Apr 2021cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present the full-size Russian complexly NER-labeled corpus of Internet user reviews, along with an evaluation of accuracy levels reached on this corpus by a set of advanced deep learning neural networks to extract the pharmacologically meaningful entities from Russian texts. The corpus annotation includes mentions of the following entities: Medication (33005 mentions), Adverse Drug Reaction (1778), Disease (17403), and Note (4490). Two of them - Medication and Disease - comprise a set of attributes. A part of the corpus has the coreference annotation with 1560 coreference chains in 300 documents. Special multi-label model based on a language model and the set of features is developed, appropriate for presented corpus labeling. The influence of the choice of different modifications of the models: word vector representations, types of language models pre-trained for Russian, text normalization styles, and other preliminary processing are analyzed. The sufficient size of our corpus allows to study the effects of particularities of corpus labeling and balancing entities in the corpus. As a result, the state of the art for the pharmacological entity extraction problem for Russian is established on a full-size labeled corpus. In case of the adverse drug reaction (ADR) recognition, it is 61.1 by the F1-exact metric that, as our analysis shows, is on par with the accuracy level for other language corpora with similar characteristics and the ADR representativnes. The evaluated baseline precision of coreference relation extraction on the corpus is 71, that is higher the results reached on other Russian corpora.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 59 references that are in the map. First posted on arXiv 30 Apr 2021.

Builds on

20 of 59 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2018Deep contextualized word representationscited by 2,290
  6. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  7. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  8. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  9. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  10. 2017End-to-end Neural Coreference Resolutioncited by 241
  11. 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
  12. 2016A guide to convolution arithmetic for deep learningcited by 185
8 more
  1. 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
  2. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  3. 2019BERT for Coreference Resolution: Baselines and Analysiscited by 125
  4. 2020Revealing the Myth of Higher-Order Inference in Coreference Resolutioncited by 49
  5. 2020Learning to Ignore: Long Document Coreference with Bounded Memory Neural Networkscited by 29
  6. 2020The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviewscited by 11
  7. 2018Co-training for Extraction of Adverse Drug Reaction Mentions from Tweetscited by 2
  8. 2018Multi-Task Learning for Extraction of Adverse Drug Reaction Mentions from Tweetscited by 1

Built on by

Not cited yet.