# Hyper Hawkes Processes: Interpretable Models of Marked Temporal Point Processes

arXiv: https://arxiv.org/abs/2511.01096 · HTML: https://mlsanity.com/paper/2511.01096/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 29 of its 49 references that are in the map.
- First posted on arXiv 2 Nov 2025.

## Builds on (most cited first, 29 of 29)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://mlsanity.com/paper/2312.00752/) (2023)
- [Efficiently Modeling Long Sequences with Structured State Spaces](https://mlsanity.com/paper/2111.00396/) (2021)
- [HyperNetworks](https://mlsanity.com/paper/1609.09106/) (2016)
- [Simplified State Space Layers for Sequence Modeling](https://mlsanity.com/paper/2208.04933/) (2022)
- [Transformer Interpretability Beyond Attention Visualization](https://mlsanity.com/paper/2012.09838/) (2020)
- [Mechanistic Interpretability for AI Safety -- A Review](https://mlsanity.com/paper/2404.14082/) (2024)
- [Transformer Hawkes Process](https://mlsanity.com/paper/2002.09291/) (2020)
- [The Illusion of State in State-Space Models](https://mlsanity.com/paper/2404.08819/) (2024)
- [Intensity-Free Learning of Temporal Point Processes](https://mlsanity.com/paper/1909.12127/) (2019)
- [Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks](https://mlsanity.com/paper/2207.13243/) (2022)
- [A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models](https://mlsanity.com/paper/2407.02646/) (2024)
- [Transformer Embeddings of Irregularly Spaced Events and Their Participants](https://mlsanity.com/paper/2201.00044/) (2021)
- [SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity](https://mlsanity.com/paper/1506.02594/) (2015)
- [Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs](https://mlsanity.com/paper/1612.05231/) (2016)
- [HYPRO: A Hybridly Normalized Probabilistic Model for Long-Horizon Prediction of Event Sequences](https://mlsanity.com/paper/2210.01753/) (2022)
- [Parallelizing non-linear sequential models over the sequence length](https://mlsanity.com/paper/2309.12252/) (2023)
- [Imputing Missing Events in Continuous-Time Event Streams](https://mlsanity.com/paper/1905.05570/) (2019)
- [Towards Scalable and Stable Parallelization of Nonlinear RNNs](https://mlsanity.com/paper/2407.19115/) (2024)
- [Meta Temporal Point Processes](https://mlsanity.com/paper/2301.12023/) (2023)
- [On the Predictive Accuracy of Neural Temporal Point Process Models for Continuous-time Event Data](https://mlsanity.com/paper/2306.17066/) (2023)
- [How recurrent networks implement contextual processing in sentiment analysis](https://mlsanity.com/paper/2004.08013/) (2020)
- [Interpretable Transformer Hawkes Processes: Unveiling Complex Interactions in Social Networks](https://mlsanity.com/paper/2405.16059/) (2024)
- [Deep Continuous-Time State-Space Models for Marked Event Sequences](https://mlsanity.com/paper/2412.19634/) (2024)
- [Interacting Diffusion Processes for Event Sequence Forecasting](https://mlsanity.com/paper/2310.17800/) (2023)
- [Neuro-Symbolic Temporal Point Processes](https://mlsanity.com/paper/2406.03914/) (2024)
- [Decoupled Marked Temporal Point Process using Neural Ordinary Differential Equations](https://mlsanity.com/paper/2406.06149/) (2024)
- [Mamba Hawkes Process](https://mlsanity.com/paper/2407.05302/) (2024)
- [Validation of point process predictions with proper scoring rules](https://mlsanity.com/paper/2110.11803/) (2021)

## Built on by (most cited first, 1 of 1)

- [Exact Phase-Type Point Processes for Certified Measurement and Prediction of Event Streams](https://mlsanity.com/paper/2610.14948/) (2026)

## Abstract (arXiv)

Foundational marked temporal point process (MTPP) models, such as the Hawkes process, often use inexpressive model families in order to offer interpretable parameterizations of event data. On the other hand, neural MTPPs models forego this interpretability in favor of absolute predictive performance. In this work, we present a new family MTPP models: the hyper Hawkes process (HHP), which aims to be as flexible and performant as neural MTPPs, while retaining interpretable aspects. To achieve this, the HHP extends the classical Hawkes process to increase its expressivity by first expanding the dimension of the process into a latent space, and then introducing a hypernetwork to allow time- and data-dependent dynamics. These extensions define a highly performant MTPP family, achieving state-of-the-art performance across a range of benchmark tasks and metrics. Furthermore, by retaining the linearity of the recurrence, albeit now piecewise and conditionally linear, the HHP also retains much of the structure of the original Hawkes process, which we exploit to create direct probes into how the model creates predictions. HHP models therefore offer both state-of-the-art predictions, while also providing an opportunity to ``open the box'' and inspect how predictions were generated.
