In-RDBMS Hardware Acceleration of Advanced Analytics
Not on the map. Why?
Abstract (arXiv)
The data revolution is fueled by advances in machine learning, databases, and hardware design. Programmable accelerators are making their way into each of these areas independently. As such, there is a void of solutions that enables hardware acceleration at the intersection of these disjoint fields. This paper sets out to be the initial step towards a unifying solution for in-Database Acceleration of Advanced Analytics (DAnA). Deploying specialized hardware, such as FPGAs, for in-database analytics currently requires hand-designing the hardware and manually routing the data. Instead, DAnA automatically maps a high-level specification of advanced analytics queries to an FPGA accelerator. The accelerator implementation is generated for a User Defined Function (UDF), expressed as a part of an SQL query using a Python-embedded Domain-Specific Language (DSL). To realize an efficient in-database integration, DAnA accelerators contain a novel hardware structure, Striders, that directly interface with the buffer pool of the database. Striders extract, cleanse, and process the training data tuples that are consumed by a multi-threaded FPGA engine that executes the analytics algorithm. We integrate DAnA with PostgreSQL to generate hardware accelerators for a range of real-world and synthetic datasets running diverse ML algorithms. Results show that DAnA-enhanced PostgreSQL provides, on average, 8.3x end-to-end speedup for real datasets, with a maximum of 28.2x. Moreover, DAnA-enhanced PostgreSQL is, on average, 4.0x faster than the multi-threaded Apache MADLib running on Greenplum. DAnA provides these benefits while hiding the complexity of hardware design from data scientists and allowing them to express the algorithm in =30-60 lines of Python.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 0; 2024: 2; 2025: 2.
8 papers.
- 2021Accelerating Recommendation System Training by Leveraging Popular Choicescited by 22
- 2025RAGO: Systematic Performance Optimization for Retrieval-Augmented Generation Servingcited by 19
- 2021Distributed Learning Systems with First-order Methodscited by 17
- 2021Towards Demystifying Serverless Machine Learning Trainingcited by 16
- 2022Heterogeneous Acceleration Pipeline for Recommendation System Trainingcited by 13
- 2024Accelerating String-Key Learned Index Structures via Memoization-based Incremental Trainingcited by 4
- 2024Integrated Hardware Architecture and Device Placement Searchcited by 4
- 2025Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Designcited by 1
- 2025Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design9 Apr 2025
- 2025RAGO: Systematic Performance Optimization for Retrieval-Augmented Generation Serving18 Mar 2025
- 2024Integrated Hardware Architecture and Device Placement Search18 Jul 2024
- 2024Accelerating String-Key Learned Index Structures via Memoization-based Incremental Training18 Mar 2024
- 2022Heterogeneous Acceleration Pipeline for Recommendation System Training11 Apr 2022
- 2021Towards Demystifying Serverless Machine Learning Training17 May 2021
- 2021Distributed Learning Systems with First-order Methods12 Apr 2021
- 2021Accelerating Recommendation System Training by Leveraging Popular Choices1 Mar 2021