# SigMA: Path Signatures and Multi-head Attention for Learning Parameters in fBm-driven SDEs

arXiv: https://arxiv.org/abs/2512.15088 · HTML: https://mlsanity.com/paper/2512.15088/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 33 references that are in the map.
- First posted on arXiv 17 Dec 2025.

## Builds on (most cited first, 11 of 11)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Universal Approximation with Deep Narrow Networks](https://mlsanity.com/paper/1905.08539/) (2019)
- [Neural Rough Differential Equations for Long Time Series](https://mlsanity.com/paper/2009.08295/) (2020)
- [A Primer on the Signature Method in Machine Learning](https://mlsanity.com/paper/1603.03788/) (2016)
- [Deep Signature Transforms](https://mlsanity.com/paper/1905.08494/) (2019)
- [Signature moments to characterize laws of stochastic processes](https://mlsanity.com/paper/1810.10971/) (2018)
- [SigFormer: Signature Transformers for Deep Hedging](https://mlsanity.com/paper/2310.13369/) (2023)
- [Rough Transformers for Continuous and Efficient Time-Series Modelling](https://mlsanity.com/paper/2403.10288/) (2024)
- [Deep learning the Hurst parameter of linear fractional processes and assessing its reliability](https://mlsanity.com/paper/2401.01789/) (2024)
- [Parameter Estimation of Long Memory Stochastic Processes with Deep Neural Networks](https://mlsanity.com/paper/2410.03776/) (2024)
- [The multivariate fractional Ornstein-Uhlenbeck process](https://mlsanity.com/paper/2408.03051/) (2024)

## Abstract (arXiv)

Stochastic differential equations (SDEs) driven by fractional Brownian motion (fBm) are increasingly used to model systems with rough dynamics and long-range dependence, such as those arising in quantitative finance and reliability engineering. However, these processes are non-Markovian and lack a semimartingale structure, rendering many classical parameter estimation techniques inapplicable or computationally intractable beyond very specific cases. This work investigates two central questions: (i) whether integrating path signatures into deep learning architectures can improve the trade-off between estimation accuracy and model complexity, and (ii) what constitutes an effective architecture for leveraging signatures as feature maps. We introduce SigMA (Signature Multi-head Attention), a neural architecture that integrates path signatures with multi-head self-attention, supported by a convolutional preprocessing layer and a multilayer perceptron for effective feature encoding. SigMA learns model parameters from synthetically generated paths of fBm-driven SDEs, including fractional Brownian motion, fractional Ornstein-Uhlenbeck, and rough Heston models, with a particular focus on estimating the Hurst parameter and on joint multi-parameter inference, and it generalizes robustly to unseen trajectories. Extensive experiments on synthetic data and two real-world datasets (i.e., equity-index realized volatility and Li-ion battery degradation) show that SigMA consistently outperforms CNN, LSTM, vanilla Transformer, and Deep Signature baselines in accuracy, robustness, and model compactness. These results demonstrate that combining signature transforms with attention-based architectures provides an effective and scalable framework for parameter inference in stochastic systems with rough or persistent temporal structure.