mlsanityData to 14 Oct 2026

Multi-Modal Financial Time-Series Retrieval Through Latent Space Projections

arXiv 2309.16741 ↗First posted 28 Sep 2023cs.LG cs.AI cs.HCcited by 8

Not on the map. Why?

Abstract (arXiv)

Financial firms commonly process and store billions of time-series data, generated continuously and at a high frequency. To support efficient data storage and retrieval, specialized time-series databases and systems have emerged. These databases support indexing and querying of time-series by a constrained Structured Query Language(SQL)-like format to enable queries like "Stocks with monthly price returns greater than 5%", and expressed in rigid formats. However, such queries do not capture the intrinsic complexity of high dimensional time-series data, which can often be better described by images or language (e.g., "A stock in low volatility regime"). Moreover, the required storage, computational time, and retrieval complexity to search in the time-series space are often non-trivial. In this paper, we propose and demonstrate a framework to store multi-modal data for financial time-series in a lower-dimensional latent space using deep encoders, such that the latent space projections capture not only the time series trends but also other desirable information or properties of the financial time-series data (such as price volatility). Moreover, our approach allows user-friendly query interfaces, enabling natural language text or sketches of time-series, for which we have developed intuitive interfaces. We demonstrate the advantages of our method in terms of computational efficiency and accuracy on real historical data as well as synthetic data, and highlight the utility of latent-space projections in the storage and retrieval of financial time-series data with intuitive query modalities.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

18 of 46 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  9. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  10. 2017Billion-scale similarity search with GPUscited by 2,497
  11. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  12. 2023On the Constrained Time-Series Generation Problemcited by 54
6 more
  1. 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 41
  2. 2022Learning to simulate realistic limit order book markets from data as a World Agentcited by 27
  3. 2018DeepStyle: Multimodal Search Engine for Fashion and Interior Designcited by 14
  4. 2019Explaining Agent-Based Financial Market Simulationcited by 10
  5. 2022Performance Study of Time Series Databasescited by 2
  6. 2023Benchmarking Specialized Databases for High-frequency Datacited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 7.

8 papers.