# Stiff Circuit System Modeling via Transformer

arXiv: https://arxiv.org/abs/2510.24727 · HTML: https://mlsanity.com/paper/2510.24727/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 41 references that are in the map.
- First posted on arXiv 6 Oct 2025.

## Builds on (most cited first, 5 of 5)

- [Neural Ordinary Differential Equations](https://mlsanity.com/paper/1806.07366/) (2018)
- [On the Properties of Neural Machine Translation: Encoder-Decoder Approaches](https://mlsanity.com/paper/1409.1259/) (2014)
- [Unsupervised Hyperspectral Image Super-Resolution via Self-Supervised Modality Decoupling](https://mlsanity.com/paper/2412.04802/) (2024)
- [TimeExpert: Boosting Long Time Series Forecasting with Temporal Mix of Experts](https://mlsanity.com/paper/2509.23145/) (2025)
- [Fine-Tuned Convex Approximations of Probabilistic Reachable Sets under Data-driven Uncertainties](https://mlsanity.com/paper/2303.01549/) (2023)

## Abstract (arXiv)

Accurate and efficient circuit behavior modeling is a cornerstone of modern electronic design automation. Among different types of circuits, stiff circuits are challenging to model using previous frameworks. In this work, we propose a new approach using Crossformer, which is a current state-of-the-art Transformer model for time-series prediction tasks, combined with Kolmogorov-Arnold Networks (KANs), to model stiff circuit transient behavior. By leveraging the Crossformer's temporal representation capabilities and the enhanced feature extraction of KANs, our method achieves improved fidelity in predicting circuit responses to a wide range of input conditions. Experimental evaluations on datasets generated through SPICE simulations of analog-to-digital converter (ADC) circuits demonstrate the effectiveness of our approach, with significant reductions in training time and error rates.