mlsanityData to 7 Oct 2026

TradeFM: A Generative Foundation Model for Trade-flow and Market Microstructure

arXiv 2602.23784 ↗First posted 27 Feb 2026cs.LG cs.AI q-fin.CPcited by 5

Not on the map. Why?

Abstract (arXiv)

Foundation models have transformed domains from language to genomics by learning general-purpose representations from large-scale, heterogeneous data. We introduce TradeFM, a 524M-parameter generative Transformer that brings this paradigm to market microstructure, learning directly from billions of trade events across >9K equities. To enable cross-asset generalization, we develop scale-invariant features and a universal tokenization scheme that map the heterogeneous, multi-modal event stream of order flow into a unified discrete sequence -- eliminating asset-specific calibration. Integrated with a deterministic market simulator, TradeFM-generated rollouts reproduce key stylized facts of financial returns, including heavy tails, volatility clustering, and absence of return autocorrelation. Quantitatively, TradeFM achieves 2-3x lower distributional error than Compound Hawkes baselines and generalizes zero-shot to geographically out-of-distribution APAC markets with moderate perplexity degradation. Together, these results suggest that scale-invariant trade representations capture transferable structure in market microstructure, opening a path toward synthetic data generation, stress testing, and learning-based trading agents.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

21 of 41 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2020Scaling Laws for Neural Language Modelscited by 6,411
  4. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  5. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  6. 2022Transformers in Time Series: A Surveycited by 489
  7. 2023Scaling Data-Constrained Language Modelscited by 391
  8. 2023TimeGPT-1cited by 149
  9. 2019Quant GANs: Deep Generation of Financial Time Seriescited by 107
  10. 2018Universal features of price formation in financial markets: perspectives from Deep Learningcited by 59
  11. 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 40
  12. 2023The Impact of Depth on Compositional Generalization in Transformer Language Modelscited by 37
9 more
  1. 2024MarS: a Financial Market Simulation Engine Powered by Generative Foundation Modelcited by 27
  2. 2023Synthetic Data Applications in Financecited by 21
  3. 2023Generative AI for End-to-End Limit Order Book Modelling: A Token-Level Autoregressive Generative Model of Message Flow Using a Deep State Space Networkcited by 19
  4. 2024ABIDES-Economist: Agent-Based Simulator of Economic Systems with Learning Agentscited by 5
  5. 2024Scalable Representation Learning for Multimodal Tabular Transactionscited by 5
  6. 2023Limit Order Book Dynamics and Order Size Modelling Using Compound Hawkes Processcited by 4
  7. 2025LOB-Bench: Benchmarking Generative AI for Finance -- an Application to Limit Order Book Datacited by 4
  8. 2025TLOB: A Novel Transformer Model with Dual Attention for Price Trend Prediction with Limit Order Book Datacited by 4
  9. 2024Ensemble Methods for Sequence Classification with Hidden Markov Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.