TradeFM: A Generative Foundation Model for Trade-flow and Market Microstructure
Not on the map. Why?
Abstract (arXiv)
Foundation models have transformed domains from language to genomics by learning general-purpose representations from large-scale, heterogeneous data. We introduce TradeFM, a 524M-parameter generative Transformer that brings this paradigm to market microstructure, learning directly from billions of trade events across >9K equities. To enable cross-asset generalization, we develop scale-invariant features and a universal tokenization scheme that map the heterogeneous, multi-modal event stream of order flow into a unified discrete sequence -- eliminating asset-specific calibration. Integrated with a deterministic market simulator, TradeFM-generated rollouts reproduce key stylized facts of financial returns, including heavy tails, volatility clustering, and absence of return autocorrelation. Quantitatively, TradeFM achieves 2-3x lower distributional error than Compound Hawkes baselines and generalizes zero-shot to geographically out-of-distribution APAC markets with moderate perplexity degradation. Together, these results suggest that scale-invariant trade representations capture transferable structure in market microstructure, opening a path toward synthetic data generation, stress testing, and learning-based trading agents.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
21 of 41 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2022Transformers in Time Series: A Surveycited by 489
- 2023Scaling Data-Constrained Language Modelscited by 391
- 2023TimeGPT-1cited by 149
- 2019Quant GANs: Deep Generation of Financial Time Seriescited by 107
- 2018Universal features of price formation in financial markets: perspectives from Deep Learningcited by 59
- 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 40
- 2023The Impact of Depth on Compositional Generalization in Transformer Language Modelscited by 37
9 more
- 2024MarS: a Financial Market Simulation Engine Powered by Generative Foundation Modelcited by 27
- 2023Synthetic Data Applications in Financecited by 21
- 2023Generative AI for End-to-End Limit Order Book Modelling: A Token-Level Autoregressive Generative Model of Message Flow Using a Deep State Space Networkcited by 19
- 2024ABIDES-Economist: Agent-Based Simulator of Economic Systems with Learning Agentscited by 5
- 2024Scalable Representation Learning for Multimodal Tabular Transactionscited by 5
- 2023Limit Order Book Dynamics and Order Size Modelling Using Compound Hawkes Processcited by 4
- 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Datacited by 4
- 2025TLOB: A Novel Transformer Model with Dual Attention for Price Trend Prediction with Limit Order Book Datacited by 4
- 2024Ensemble Methods for Sequence Classification with Hidden Markov Modelscited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Scaling Laws for Behavioral Foundation Models over User Event Sequencescited by 0
- 2026LOB-ID: Evaluating Synthetic Market Data by Inception Distancescited by 0
- 2026FlowLOB: Efficient and Controllable Limit Order Book Generation with Flow Matchingcited by 0
- 2026M3: A State-Event Generative Foundation Model for Market Microstructure Dynamicscited by 0
- 2026ReLOBGen: Replayable Limit Order Book Message Generationcited by 0
- 2026ReLOBGen: Replayable Limit Order Book Message Generation26 Sep 2026
- 2026FlowLOB: Efficient and Controllable Limit Order Book Generation with Flow Matching13 Aug 2026
- 2026LOB-ID: Evaluating Synthetic Market Data by Inception Distances13 Aug 2026
- 2026M3: A State-Event Generative Foundation Model for Market Microstructure Dynamics29 Jul 2026
- 2026Scaling Laws for Behavioral Foundation Models over User Event Sequences3 Jun 2026