Sig2Model: A Boosting-Driven Model for Updatable Learned Indexes
Not on the map. Why?
Abstract (arXiv)
Learned Indexes (LIs) represent a paradigm shift from traditional index structures by employing machine learning models to approximate the cumulative distribution function (CDF) of sorted data. While LIs achieve remarkable efficiency for static datasets, their performance degrades under dynamic updates: maintaining the CDF invariant (sum of F(k) equals 1) requires global model retraining, which blocks queries and limits the queries-per-second (QPS) metric. Current approaches fail to address these retraining costs effectively, rendering them unsuitable for real-world workloads with frequent updates. In this paper, we present Sig2Model, an efficient and adaptive learned index that minimizes retraining cost through three key techniques: (1) a sigmoid boosting approximation technique that dynamically adjusts the index model by approximating update-induced shifts in data distribution with localized sigmoid functions while preserving bounded error guarantees and deferring full retraining; (2) proactive update training via Gaussian mixture models (GMMs) that identifies high-update-probability regions for strategic placeholder allocation to speed up updates; and (3) a neural joint optimization framework that continuously refines both the sigmoid ensemble and GMM parameters via gradient-based learning. We evaluate Sig2Model against state-of-the-art updatable learned indexes on real-world and synthetic workloads, and show that Sig2Model reduces retraining cost by up to 20x, achieves up to 3x higher QPS, and uses up to 1000x less memory.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 73 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
37 of 73 references.
References · 37
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2017Measuring Catastrophic Forgetting in Neural Networkscited by 360
- 2015Highway Networkscited by 260
- 2019Search on the Replay Buffer: Bridging Planning and Reinforcement Learningcited by 194
- 2017The Case for Learned Index Structurescited by 188
- 2017Convergence Analysis of Two-layer Neural Networks with ReLU Activationcited by 137
- 2023Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discoverycited by 72
- 2019HoloDetect: Few-Shot Learning for Error Detectioncited by 31
- 2020RadixSpline: A Single-Pass Learned Indexcited by 31
25 more
- 2018FITing-Tree: A Data-aware Index Structurecited by 30
- 2019Learning Multi-dimensional Indexescited by 30
- 2020Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloadscited by 25
- 2019SOSD: A Benchmark for Learned Indexescited by 21
- 2020Qd-tree: Learning Data Layouts for Big Data Analyticscited by 18
- 2024A Method for Evaluating Hyperparameter Sensitivity in Reinforcement Learningcited by 15
- 2021Updatable Learned Index with Precise Positionscited by 13
- 2022Analysis of Stochastic Processes through Replay Bufferscited by 9
- 2021CARMI: A Cache-Aware Learned Index with a Cost-based Construction Algorithmcited by 8
- 2022LIDER: An Efficient High-dimensional Learned Index for Large-scale Dense Passage Retrievalcited by 8
- 2023WISK: A Workload-aware Learned Index for Spatial Keyword Queriescited by 6
- 2023Updatable Learned Indexes Meet Disk-Resident DBMS -- From Evaluations to Design Choicescited by 6
- 2020Approximate Denial Constraintscited by 5
- 2021Shift-Table: A Low-latency Learned Index for Range Queries using Model Correctioncited by 5
- 2021The Case for Learned In-Memory Joinscited by 4
- 2024Accelerating String-Key Learned Index Structures via Memoization-based Incremental Trainingcited by 4
- 2019Approximate Inference in Structured Instances with Noisy Categorical Observationscited by 3
- 2020Record fusion: A learning approachcited by 3
- 2020On sampling from data with duplicate recordscited by 3
- 2023SALI: A Scalable Adaptive Learned Index Framework based on Probability Modelscited by 3
- 2024Algorithmic Complexity Attacks on Dynamic Learned Indexescited by 3
- 2024UpLIF: An Updatable Self-Tuning Learned Index Frameworkcited by 1
- 2025DobLIX: A Dual-Objective Learned Index for Log-Structured Merge Treescited by 1
- 2025Filter-Centric Vector Indexing: Geometric Transformation for Efficient Filtered Vector Searchcited by 1
- 2025FusedANN: Convexified Hybrid ANN via Attribute-Vector Fusioncited by 1
Built on by
Not cited yet.