mlsanityData to 14 Oct 2026

A Semantic Approach to the Academic Publishing Network: Document Vector Representations and Hybrid Structural-Semantic Fusion over OpenAlex Data

arXiv 2609.26218 ↗First posted 11 Aug 2026cs.IR cs.CL cs.DLcited by 0

Not on the map. Why?

Abstract (arXiv)

Structural graph analysis of the academic publishing network captures the topological relationships between entities but does not see the content of works. Building on our structural approach, this work complements it with a semantic layer and a parameterized structural-semantic fusion. We represent scientific documents by citation-informed vector embeddings (SPECTER2) and store them in an embedded vector database keyed by the stable OpenAlex ID, so that they connect directly to the graph layer. We define a modular late-fusion function that combines semantic similarity (cosine of embeddings) and structural similarity (bibliographic coupling) with a tunable weight alpha whose value is chosen according to the specific task. On the corpus of VSB - Technical University of Ostrava we show two things: citation-informed embeddings agree with the expert OpenAlex topical taxonomy better than a TF-IDF baseline, and in a recommendation use case the structural, semantic, and combined signals carry information in different regimes depending on the available data. Hybrid fusion here is not a universally better method but an explicit mechanism for steering complementary signals according to the task. We release the whole approach as an open-source extension of the apnet library with a reproducible workflow.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

24 of 38 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  6. 2017Billion-scale similarity search with GPUscited by 2,497
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  8. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  9. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  11. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  12. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
12 more
  1. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  2. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  3. 2023C-Pack: Packed Resources For General Chinese Embeddingscited by 578
  4. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
  5. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  6. 2024The Faiss librarycited by 376
  7. 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
  8. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 214
  9. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  10. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
  11. 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
  12. 2020Scientific Paper Recommendation: A Surveycited by 20

Built on by

Not cited yet.