Optimizing Context-Enhanced Relational Joins
Not on the map. Why?
Abstract (arXiv)
Collecting data, extracting value, and combining insights from relational and context-rich multi-modal sources in data processing pipelines presents a challenge for traditional relational DBMS. While relational operators allow declarative and optimizable query specification, they are limited to data transformations unsuitable for capturing or analyzing context. On the other hand, representation learning models can map context-rich data into embeddings, allowing machine-automated context processing but requiring imperative data transformation integration with the analytical query. To bridge this dichotomy, we present a context-enhanced relational join and introduce an embedding operator composable with relational operators. This enables hybrid relational and context-rich vector data processing, with algebraic equivalences compatible with relational algebra and corresponding logical and physical optimizations. We investigate model-operator interaction with vector data processing and study the characteristics of the E-join operator. Using an example of string embeddings, we demonstrate enabling hybrid context-enhanced processing on relational join operators with vector embeddings. The importance of holistic optimization, from logical to physical, is demonstrated in an order of magnitude execution time improvement.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 3 Dec 2023.
Builds on
24 of 64 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
12 more
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2017The Case for Learned Index Structurescited by 188
- 2020Embedding-based Retrieval in Facebook Searchcited by 156
- 2018ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithmscited by 130
- 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 126
- 2018Billion-scale Commodity Embedding for E-commerce Recommendation in Alibabacited by 105
- 2019Misspelling Oblivious Word Embeddingscited by 19
- 2022Zero-Shot Cost Models for Out-of-the-box Learned Cost Predictioncited by 16
- 2022Query Processing on Tensor Computation Runtimescited by 12
- 2017DocTag2Vec: An Embedding Based Multi-label Learning Approach for Document Taggingcited by 5
- 2022Analytical Engines With Context-Rich Processing: Towards Efficient Next-Generation Analyticscited by 4
- 2022The Tensor Data Platform: Towards an AI-centric Database Systemcited by 3
Built on by
Citing papers per year: 2024: 1.
1 paper.