# The X Types -- Mapping the Semantics of the Twitter Sphere

arXiv: https://arxiv.org/abs/2409.14584 · HTML: https://mlsanity.com/paper/2409.14584/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 42 references that are in the map.
- First posted on arXiv 22 Sep 2024.

## Builds on (most cited first, 15 of 15)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [Efficient Estimation of Word Representations in Vector Space](https://mlsanity.com/paper/1301.3781/) (2013)
- [E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT](https://mlsanity.com/paper/1911.03681/) (2019)
- [Ultra-Fine Entity Typing](https://mlsanity.com/paper/1807.04905/) (2018)
- [TWEETQA: A Social Media Focused Question Answering Dataset](https://mlsanity.com/paper/1907.06292/) (2019)
- [Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation](https://mlsanity.com/paper/1601.01343/) (2016)
- [A Study of the Quality of Wikidata](https://mlsanity.com/paper/2107.00156/) (2021)
- [Context-Dependent Fine-Grained Entity Type Tagging](https://mlsanity.com/paper/1412.1820/) (2014)
- [Learning Distributed Representations of Texts and Entities from Knowledge Base](https://mlsanity.com/paper/1705.02494/) (2017)
- [Graph-Embedding Empowered Entity Retrieval](https://mlsanity.com/paper/2005.02843/) (2020)
- [Corpus-level Fine-grained Entity Typing](https://mlsanity.com/paper/1708.02275/) (2017)
- [Which Knowledge Graph Is Best for Me?](https://mlsanity.com/paper/1809.11099/) (2018)
- [Entity Type Prediction Leveraging Graph Walks and Entity Descriptions](https://mlsanity.com/paper/2207.14094/) (2022)
- [Inferring Missing Entity Type Instances for Knowledge Base Completion: New Dataset and Methods](https://mlsanity.com/paper/1504.06658/) (2015)

## Built on by (most cited first, 1 of 1)

- [Social Knowledge for Cross-Domain User Preference Modeling](https://mlsanity.com/paper/2603.10148/) (2026)

## Abstract (arXiv)

Social networks form a valuable source of world knowledge, where influential entities correspond to popular accounts. Unlike factual knowledge bases (KBs), which maintain a semantic ontology, structured semantic information is not available on social media. In this work, we consider a social KB of roughly 200K popular Twitter accounts, which denotes entities of interest. We elicit semantic information about those entities. In particular, we associate them with a fine-grained set of 136 semantic types, e.g., determine whether a given entity account belongs to a politician, or a musical artist. In the lack of explicit type information in Twitter, we obtain semantic labels for a subset of the accounts via alignment with the KBs of DBpedia and Wikidata. Given the labeled dataset, we finetune a transformer-based text encoder to generate semantic embeddings of the entities based on the contents of their accounts. We then exploit this evidence alongside network-based embeddings to predict the entities semantic types. In our experiments, we show high type prediction performance on the labeled dataset. Consequently, we apply our type classification model to all of the entity accounts in the social KB. Our analysis of the results offers insights about the global semantics of the Twitter sphere. We discuss downstream applications that should benefit from semantic type information and the semantic embeddings of social entities generated in this work. In particular, we demonstrate enhanced performance on the key task of entity similarity assessment using this information.
