ForeSeer: Product Aspect Forecasting Using Temporal Graph Embedding
Not on the map. Why?
Abstract (arXiv)
Developing text mining approaches to mine aspects from customer reviews has been well-studied due to its importance in understanding customer needs and product attributes. In contrast, it remains unclear how to predict the future emerging aspects of a new product that currently has little review information. This task, which we named product aspect forecasting, is critical for recommending new products, but also challenging because of the missing reviews. Here, we propose ForeSeer, a novel textual mining and product embedding approach progressively trained on temporal product graphs for this novel product aspect forecasting task. ForeSeer transfers reviews from similar products on a large product graph and exploits these reviews to predict aspects that might emerge in future reviews. A key novelty of our method is to jointly provide review, product, and aspect embeddings that are both time-sensitive and less affected by extremely imbalanced aspect frequencies. We evaluated ForeSeer on a real-world product review system containing 11,536,382 reviews and 11,000 products over 3 years. We observe that ForeSeer substantially outperformed existing approaches with at least 49.1% AUPRC improvement under the real setting where aspect associations are not given. ForeSeer further improves future link prediction on the product graph and the review aspect association prediction. Collectively, Foreseer offers a novel framework for review forecasting by effectively integrating review text, product network, and temporal information, opening up new avenues for online shopping recommendation and e-commerce applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 95 references that are in the map. First posted on arXiv 7 Oct 2023.
Builds on
43 of 95 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
- 2020Inductive Representation Learning on Temporal Graphscited by 454
- 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
- 2019Predicting Dynamic Embedding Trajectory in Temporal Interaction Networkscited by 443
- 2019Time2Vec: Learning a Vector Representation of Timecited by 208
- 2017Know-Evolve: Deep Temporal Reasoning for Dynamic Knowledge Graphscited by 149
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 137
31 more
- 2022ROLAND: Graph Learning Framework for Dynamic Graphscited by 131
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2018DynGEM: Deep Embedding Method for Dynamic Graphscited by 100
- 2018Streaming Graph Neural Networkscited by 91
- 2018dyngraph2vec: Capturing Network Dynamics using Dynamic Graph Representation Learningcited by 88
- 2020Discovering New Intents with Deep Aligned Clusteringcited by 68
- 2020Structural Temporal Graph Neural Networks for Anomaly Detection in Dynamic Graphscited by 55
- 2021MAVE: A Product Dataset for Multi-source Attribute Value Extractioncited by 53
- 2019Temporal Network Embedding with Micro- and Macro-dynamicscited by 51
- 2019Node Embedding over Temporal Graphscited by 45
- 2021Dynamic Network Embedding Surveycited by 44
- 2017Attributed Network Embedding for Learning in a Dynamic Environmentcited by 39
- 2018Dynamic Graph Representation Learning via Self-Attention Networkscited by 39
- 2020Multimodal Joint Attribute Prediction and Value Extraction for E-commerce Productcited by 39
- 2016Deep Coevolutionary Network: Embedding User and Item Features for Recommendationcited by 33
- 2018dynnode2vec: Scalable Dynamic Network Embeddingcited by 32
- 2021AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decodingcited by 32
- 2022A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learningcited by 24
- 2020Modeling Dynamic Heterogeneous Network for Link Prediction using Hierarchical Attention with Temporal RNNcited by 23
- 2014Scalable Link Prediction in Dynamic Networks via Non-Negative Matrix Factorizationcited by 21
- 2022OA-Mine: Open-World Attribute Mining for E-Commerce Products with Weak Supervisioncited by 20
- 2019Zero-Shot Cross-Lingual Opinion Target Extractioncited by 11
- 2018DyLink2Vec: Effective Feature Representation for Link Prediction in Dynamic Networkscited by 9
- 2021DynG2G: An Efficient Stochastic Graph Embedding Method for Temporal Graphscited by 8
- 2022Zero-Shot Aspect-Based Sentiment Analysiscited by 5
- 2022Continuous Temporal Graph Networks for Event-Based Graph Datacited by 4
- 2021CoarSAS2hvec: Heterogeneous Information Network Embedding with Balanced Network Samplingcited by 3
- 2017Continuous-Time Relationship Prediction in Dynamic Heterogeneous Information Networkscited by 2
- 2014Mining of product reviews at aspect levelcited by 1
- 2022Aspect Based Sentiment Analysis Using Spectral Temporal Graph Neural Networkcited by 1
- 2022Zero-shot Aspect-level Sentiment Classification via Explicit Utilization of Aspect-to-Document Sentiment Compositioncited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.