mlsanityData to 7 Oct 2026

ONSEP: A Novel Online Neural-Symbolic Framework for Event Prediction Based on Large Language Model

arXiv 2408.07840 ↗First posted 14 Aug 2024cs.CL cs.AI cs.SCcited by 4

Not on the map. Why?

Abstract (arXiv)

In the realm of event prediction, temporal knowledge graph forecasting (TKGF) stands as a pivotal technique. Previous approaches face the challenges of not utilizing experience during testing and relying on a single short-term history, which limits adaptation to evolving data. In this paper, we introduce the Online Neural-Symbolic Event Prediction (ONSEP) framework, which innovates by integrating dynamic causal rule mining (DCRM) and dual history augmented generation (DHAG). DCRM dynamically constructs causal rules from real-time data, allowing for swift adaptation to new causal relationships. In parallel, DHAG merges short-term and long-term historical contexts, leveraging a bi-branch approach to enrich event prediction. Our framework demonstrates notable performance enhancements across diverse datasets, with significant Hit@k (k=1,3,10) improvements, showcasing its ability to augment large language models (LLMs) for event prediction without necessitating extensive retraining. The ONSEP framework not only advances the field of TKGF but also underscores the potential of neural-symbolic approaches in adapting to dynamic data environments.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 14 Aug 2024.

Builds on

22 of 36 references.

References · 22

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  6. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
  7. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  8. 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
  9. 2021Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learningcited by 106
  10. 2020Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networkscited by 84
  11. 2023Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-Incited by 71
  12. 2021TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph Forecastingcited by 67
10 more
  1. 2023Large Language Models can Learn Rulescited by 66
  2. 2021TLogic: Temporal Logical Rules for Explainable Link Forecasting on Temporal Knowledge Graphscited by 59
  3. 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
  4. 2023MoT: Memory-of-Thought Enables ChatGPT to Self-Improvecited by 37
  5. 2023Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learningcited by 36
  6. 2023GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Modelscited by 30
  7. 2020xERTE: Explainable Reasoning on Temporal Knowledge Graphs for Forecasting Future Linkscited by 13
  8. 2021Time-aware Path Reasoning on Knowledge Graph for Recommendationcited by 11
  9. 2022ForecastTKGQuestions: A Benchmark for Temporal Question Answering and Forecasting over Temporal Knowledge Graphscited by 9
  10. 2023A Survey on Event Prediction Methods from a Systems Perspective: Bringing Together Disparate Research Areascited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.