SoMeSci- A 5 Star Open Data Gold Standard Knowledge Graph of Software Mentions in Scientific Articles
Not on the map. Why?
Abstract (arXiv)
Knowledge about software used in scientific investigations is important for several reasons, for instance, to enable an understanding of provenance and methods involved in data handling. However, software is usually not formally cited, but rather mentioned informally within the scholarly description of the investigation, raising the need for automatic information extraction and disambiguation. Given the lack of reliable ground truth data, we present SoMeSci (Software Mentions in Science) a gold standard knowledge graph of software mentions in scientific articles. It contains high quality annotations (IRR: kappa=.82) of 3756 software mentions in 1367 PubMed Central articles. Besides the plain mention of the software, we also provide relation labels for additional information, such as the version, the developer, a URL or citations. Moreover, we distinguish between different types, such as application, plugin or programming environment, as well as different types of mentions, such as usage or creation. To the best of our knowledge, SoMeSci is the most comprehensive corpus about software mentions in scientific articles, providing training samples for Named Entity Recognition, Relation Extraction, Entity Disambiguation, and Entity Linking. Finally, we sketch potential use cases and provide baseline results.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 5 of its 36 references that are in the map. First posted on arXiv 20 Aug 2021.
Builds on
5 of 36 references.
References · 5
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Investigating Software Usage in the Social Sciences: A Knowledge Graph Approachcited by 7
- 2017Understanding Software in Research: Initial Results from Examining Nature and a Call for Collaborationcited by 2
- 2018Schroedinger's code: A preliminary study on research source code availability and link persistence in astrophysicscited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 5.
11 papers.
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
- 2023Into the Single Cell Multiverse: an End-to-End Dataset for Procedural Knowledge Extraction in Biomedical Textscited by 1
- 2024Enhancing Software-Related Information Extraction via Single-Choice Question Answering with Large Language Modelscited by 0
- 2024Software Mention Recognition with a Three-Stage Framework Based on BERTology Models at SOMD 2024cited by 0
- 2024Falcon 7b for Software Mention Detection in Scholarly Documentscited by 0
- 2025NFDI4DS Shared Tasks for Scholarly Document Processingcited by 0
- 2026NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositoriescited by 0
- 2026Supporting Workflow Reproducibility by Linking Bioinformatics Tools across Papers and Executable Codecited by 0
- 2026Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolutioncited by 0
- 2026Do Lexical and Contextual Coreference Resolution Systems Degrade Differently under Mention Noise? An Empirical Study on Scientific Software Mentionscited by 0
- 2026From Code Archival to Knowledge Graph: Bridging Software Heritage, COAR Notify and Wikidatacited by 0
- 2026From Code Archival to Knowledge Graph: Bridging Software Heritage, COAR Notify and Wikidata18 Sep 2026
- 2026Do Lexical and Contextual Coreference Resolution Systems Degrade Differently under Mention Noise? An Empirical Study on Scientific Software Mentions2 Apr 2026
- 2026Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolution25 Mar 2026
- 2026Supporting Workflow Reproducibility by Linking Bioinformatics Tools across Papers and Executable Code9 Mar 2026
- 2026NERdME: a Named Entity Recognition Dataset for Indexing Research Artifacts in Code Repositories5 Mar 2026
- 2025NFDI4DS Shared Tasks for Scholarly Document Processing26 Sep 2025
- 2024Falcon 7b for Software Mention Detection in Scholarly Documents14 May 2024
- 2024Software Mention Recognition with a Three-Stage Framework Based on BERTology Models at SOMD 202423 Apr 2024
- 2024Enhancing Software-Related Information Extraction via Single-Choice Question Answering with Large Language Models8 Apr 2024
- 2023Into the Single Cell Multiverse: an End-to-End Dataset for Procedural Knowledge Extraction in Biomedical Texts4 Sep 2023
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition7 Aug 2023