mlsanityData to 14 Oct 2026

Detecting Entities in the Astrophysics Literature: A Comparison of Word-based and Span-based Entity Recognition Methods

arXiv 2211.13819 ↗First posted 24 Nov 2022cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Information Extraction from scientific literature can be challenging due to the highly specialised nature of such text. We describe our entity recognition methods developed as part of the DEAL (Detecting Entities in the Astrophysics Literature) shared task. The aim of the task is to build a system that can identify Named Entities in a dataset composed by scholarly articles from astrophysics literature. We planned our participation such that it enables us to conduct an empirical comparison between word-based tagging and span-based classification methods. When evaluated on two hidden test sets provided by the organizer, our best-performing submission achieved F1 scores of 0.8307 (validation phase) and 0.7990 (testing phase).

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 24 Nov 2022.

Builds on

17 of 29 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  6. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
  7. 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 255
  8. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
  9. 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 102
  10. 2020COMETA: A Corpus for Medical Entity Linking in the Social Mediacited by 50
  11. 2022FiNER: Financial Numeric Entity Recognition for XBRL Taggingcited by 50
  12. 2022Revisiting Transformer-based Models for Long Document Classificationcited by 49
5 more
  1. 2020The SOFC-Exp Corpus and Neural Approaches to Information Extraction in the Materials Science Domaincited by 32
  2. 2019NNE: A Dataset for Nested Named Entity Recognition in English Newswirecited by 25
  3. 2021Building astroBERT, a language model for Astronomy & Astrophysicscited by 19
  4. 2019Using Similarity Measures to Select Pretraining Data for NERcited by 15
  5. 2021Recognising Biomedical Names: Challenges and Solutionscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.