Predicting Scientific Impact Through Diffusion, Conformity, and Contribution Disentanglement
Not on the map. Why?
Abstract (arXiv)
The scientific impact of academic papers is influenced by intricate factors such as dynamic popularity and inherent contribution. Existing models typically rely on static graphs for citation count estimation, failing to differentiate among its sources. In contrast, we propose distinguishing effects derived from various factors and predicting citation increments as estimated potential impacts within the dynamic context. In this research, we introduce a novel model, DPPDCC, which Disentangles the Potential impacts of Papers into Diffusion, Conformity, and Contribution values. It encodes temporal and structural features within dynamic heterogeneous graphs derived from the citation networks and applies various auxiliary tasks for disentanglement. By emphasizing comparative and co-cited/citing information and aggregating snapshots evolutionarily, DPPDCC captures knowledge flow within the citation network. Afterwards, popularity is outlined by contrasting augmented graphs to extract the essence of citation diffusion and predicting citation accumulation bins for quantitative conformity modeling. Orthogonal constraints ensure distinct modeling of each perspective, preserving the contribution value. To gauge generalization across publication times and replicate the realistic dynamic context, we partition data based on specific time points and retain all samples without strict filtering. Extensive experiments on three datasets validate DPPDCC's superiority over baselines for papers published previously, freshly, and immediately, with further analyses confirming its robustness. Our codes and supplementary materials can be found at https://github.com/ECNU-Text-Computing/DPPDCC.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 79 references that are in the map. First posted on arXiv 15 Nov 2023.
Builds on
34 of 79 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2020Heterogeneous Graph Transformercited by 581
- 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
22 more
- 2016Incorporating Copying Mechanism in Sequence-to-Sequence Learningcited by 217
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
- 2018Disentangled Representation Learning for Non-Parallel Text Style Transfercited by 127
- 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
- 2019Learning Disentangled Representations for Recommendationcited by 110
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
- 2017Dynamic Graph Convolutional Networkscited by 83
- 2022Debiasing Graph Neural Networks via Learning Disentangled Causal Substructurecited by 83
- 2020Factorizable Graph Convolutional Networkscited by 79
- 2020Learning Disentangled Semantic Representation for Domain Adaptationcited by 54
- 2016DeepCas: an End-to-end Predictor of Information Cascadescited by 48
- 2019Independence Promoted Graph Disentangled Networkscited by 38
- 2013Quantifying Long-Term Scientific Impactcited by 28
- 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
- 2020A Survey of Information Cascade Analysis: Models, Predictions, and Recent Advancescited by 26
- 2018Predicting citation counts based on deep neural network learning techniquescited by 21
- 2022DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graphcited by 21
- 2021CCGL: Contrastive Cascade Graph Learningcited by 9
- 2023Modeling Dynamic Heterogeneous Graph and Node Importance for Future Citation Predictioncited by 7
- 2014Will This Paper Increase Your h-index? Scientific Impact Predictioncited by 6
- 2023H2CGL: Modeling Dynamics of Citation Network for Impact Predictioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.