NLP for Knowledge Discovery and Information Extraction from Energetics Corpora
Not on the map. Why?
Abstract (arXiv)
We present a demonstration of the utility of NLP for aiding research into energetic materials and associated systems. The NLP method enables machine understanding of textual data, offering an automated route to knowledge discovery and information extraction from energetics text. We apply three established unsupervised NLP models: Latent Dirichlet Allocation, Word2Vec, and the Transformer to a large curated dataset of energetics-related scientific articles. We demonstrate that each NLP algorithm is capable of identifying energetic topics and concepts, generating a language model which aligns with Subject Matter Expert knowledge. Furthermore, we present a document classification pipeline for energetics text. Our classification pipeline achieves 59-76% accuracy depending on the NLP model used, with the highest performing Transformer model rivaling inter-annotator agreement metrics. The NLP approaches studied in this work can identify concepts germane to energetics and therefore hold promise as a tool for accelerating energetics research efforts and energetics material development.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 50 references that are in the map. First posted on arXiv 10 Feb 2024.
Builds on
24 of 50 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
12 more
- 2019Learning Deep Transformer Models for Machine Translationcited by 309
- 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 82
- 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
- 2019Language Models with Transformerscited by 36
- 2023ChatGPT for Programming Numerical Methodscited by 26
- 2022A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processingcited by 22
- 2020Deep learning for synthetic microstructure generation in a materials-by-design framework for heterogeneous energetic materialscited by 18
- 2021Looking Through Glass: Knowledge Discovery from Materials Science Literature using Natural Language Processingcited by 16
- 2019Using natural language processing techniques to extract information on the properties and functionalities of energetic materials from large text corporacited by 3
- 2018Independent Vector Analysis for Data Fusion Prior to Molecular Property Prediction with Machine Learningcited by 1
- 2022Assessing the trade-off between prediction accuracy and interpretability for topic modeling on energetic materials corporacited by 1
Built on by
Not cited yet.