SciEv: Finding Scientific Evidence Papers for Scientific News
Not on the map. Why?
Abstract (arXiv)
In the past decade, many scientific news media that report scientific breakthroughs and discoveries emerged, bringing science and technology closer to the general public. However, not all scientific news article cites proper sources, such as original scientific papers. A portion of scientific news articles contain misinterpreted, exaggerated, or distorted information that deviates from facts asserted in the original papers. Manually identifying proper citations is laborious and costly. Therefore, it is necessary to automatically search for pertinent scientific papers that could be used as evidence for a given piece of scientific news. We propose a system called SciEv that searches for scientific evidence papers given a scientific news article. The system employs a 2-stage query paradigm with the first stage retrieving candidate papers and the second stage reranking them. The key feature of SciEv is it uses domain knowledge entities (DKEs) to find candidates in the first stage, which proved to be more effective than regular keyphrases. In the reranking stage, we explore different document representations for news articles and candidate papers. To evaluate our system, we compiled a pilot dataset consisting of 100 manually curated (news,paper) pairs from ScienceAlert and similar websites. To our best knowledge, this is the first dataset of this kind. Our experiments indicate that the transformer model performs the best for DKE extraction. The system achieves a P@1=50%, P@5=71%, and P@10=74% when it uses a TFIDF-based text representation. The transformer-based re-ranker achieves a comparable performance but costs twice as much time. We will collect more data and test the system for user experience.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 30 Apr 2022.
Builds on
24 of 46 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Deep contextualized word representationscited by 2,290
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2014Distributed Representations of Sentences and Documentscited by 678
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2015Highway Networkscited by 260
- 2018DKN: Deep Knowledge-Aware Network for News Recommendationcited by 137
12 more
- 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 102
- 2020BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervisioncited by 91
- 2014Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencescited by 64
- 2020Citation Recommendation: Approaches and Datasetscited by 36
- 2019Hierarchical Contextualized Representation for Named Entity Recognitioncited by 32
- 2020Covidex: Neural Ranking Models and Keyword Search Infrastructure for the COVID-19 Open Research Datasetcited by 15
- 2018Text Similarity in Vector Space Models: A Comparative Studycited by 13
- 2020Domain-independent Extraction of Scientific Concepts from Research Articlescited by 11
- 2015Boosting Named Entity Recognition with Neural Character Embeddingscited by 10
- 2017Character-Word LSTM Language Modelscited by 5
- 2021Determining the Credibility of Science Communicationcited by 4
- 2019Recommending research articles to consumers of online vaccination informationcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.