Multi-Modal Financial Time-Series Retrieval Through Latent Space Projections
Not on the map. Why?
Abstract (arXiv)
Financial firms commonly process and store billions of time-series data, generated continuously and at a high frequency. To support efficient data storage and retrieval, specialized time-series databases and systems have emerged. These databases support indexing and querying of time-series by a constrained Structured Query Language(SQL)-like format to enable queries like "Stocks with monthly price returns greater than 5%", and expressed in rigid formats. However, such queries do not capture the intrinsic complexity of high dimensional time-series data, which can often be better described by images or language (e.g., "A stock in low volatility regime"). Moreover, the required storage, computational time, and retrieval complexity to search in the time-series space are often non-trivial. In this paper, we propose and demonstrate a framework to store multi-modal data for financial time-series in a lower-dimensional latent space using deep encoders, such that the latent space projections capture not only the time series trends but also other desirable information or properties of the financial time-series data (such as price volatility). Moreover, our approach allows user-friendly query interfaces, enabling natural language text or sketches of time-series, for which we have developed intuitive interfaces. We demonstrate the advantages of our method in terms of computational efficiency and accuracy on real historical data as well as synthetic data, and highlight the utility of latent-space projections in the storage and retrieval of financial time-series data with intuitive query modalities.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 18 of its 46 references that are in the map. First posted on arXiv 28 Sep 2023.
Builds on
18 of 46 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2023On the Constrained Time-Series Generation Problemcited by 54
6 more
- 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 41
- 2022Learning to simulate realistic limit order book markets from data as a World Agentcited by 27
- 2018DeepStyle: Multimodal Search Engine for Fashion and Interior Designcited by 14
- 2019Explaining Agent-Based Financial Market Simulationcited by 10
- 2022Performance Study of Time Series Databasescited by 2
- 2023Benchmarking Specialized Databases for High-frequency Datacited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 7.
8 papers.
- 2025TimeXL: Explainable Multi-modal Time Series Prediction with LLM-in-the-Loopcited by 39
- 2025Multi-modal Time Series Analysis: A Tutorial and Surveycited by 24
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlookcited by 20
- 2025MoTime: A Dataset Suite for Multimodal Time Series Forecastingcited by 7
- 2025Bridging Language Models and Financial Analysiscited by 4
- 2024Any2Any: Incomplete Multimodal Retrieval with Conformal Predictioncited by 3
- 2025Towards Interpretable Time Series Foundation Modelscited by 3
- 2025Representation Learning of Limit Order Book: A Comprehensive Study and Benchmarkingcited by 2
- 2025Towards Interpretable Time Series Foundation Models10 Jul 2025
- 2025MoTime: A Dataset Suite for Multimodal Time Series Forecasting21 May 2025
- 2025Representation Learning of Limit Order Book: A Comprehensive Study and Benchmarking4 May 2025
- 2025Multi-modal Time Series Analysis: A Tutorial and Survey17 Mar 2025
- 2025Bridging Language Models and Financial Analysis14 Mar 2025
- 2025How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook14 Mar 2025
- 2025TimeXL: Explainable Multi-modal Time Series Prediction with LLM-in-the-Loop2 Mar 2025
- 2024Any2Any: Incomplete Multimodal Retrieval with Conformal Prediction15 Nov 2024