mlsanityData to 7 Oct 2026

Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications

arXiv 2209.09062 ↗First posted 19 Sep 2022cs.CL cs.IRcited by 3

Not on the map. Why?

Abstract (arXiv)

In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 32 references that are in the map. First posted on arXiv 19 Sep 2022.

Builds on

10 of 32 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  4. 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
  5. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  6. 2020SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrievalcited by 50
  7. 2018MedSTS: A Resource for Clinical Semantic Textual Similaritycited by 39
  8. 2022SsciBERT: A Pre-trained Language Model for Social Science Textscited by 12
  9. 2020CORD19STS: COVID-19 Semantic Textual Similarity Datasetcited by 7
  10. 2022Towards Automated Survey Variable Search and Summarization in Social Science Publicationscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 1.

3 papers.

  1. 2023Evaluating end-to-end entity linking on domain-specific knowledge bases: Learning about ancient technologies from museum collectionscited by 3
  2. 2023VADIS -- a VAriable Detection, Interlinking and Summarization systemcited by 1
  3. 2024Enriching Social Science Research via Survey Item Linkingcited by 0