Dr. Top-k: Delegate-Centric Top-k on GPUs
Not on the map. Why?
Abstract (arXiv)
Recent top-k computation efforts explore the possibility of revising various sorting algorithms to answer top-k queries on GPUs. These endeavors, unfortunately, perform significantly more work than needed. This paper introduces Dr. Top-k, a Delegate-centric top-k system on GPUs that can reduce the top-k workloads significantly. Particularly, it contains three major contributions: First, we introduce a comprehensive design of the delegate-centric concept, including maximum delegate, delegate-based filtering, and β delegate mechanisms to help reduce the workload for top-k up to more than 99%. Second, due to the difficulty and importance of deriving a proper subrange size, we perform a rigorous theoretical analysis, coupled with thorough experimental validations to identify the desirable subrange size. Third, we introduce four key system optimizations to enable fast multi-GPU top-k computation. Taken together, this work constantly outperforms the state-of-the-art.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 3; 2024: 0; 2025: 1; 2026: 2.
6 papers.
- 2023Tango: rethinking quantization for graph neural network training on GPUscited by 4
- 2026LiteTopK: Exploiting the Curse of Dimensionality for a Fused Indexer-TopK Kernel in Long-Context Sparse Attentioncited by 1
- 2023DEFT: Exploiting Gradient Norm Difference between Model Layers for Scalable Gradient Sparsificationcited by 0
- 2023MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Trainingcited by 0
- 2025A Faster Generalized Two-Stage Approximate Top-Kcited by 0
- 2026Prof-K: Probabilistic One-Pass Filtering for Efficient Top-k Selectioncited by 0
- 2026Prof-K: Probabilistic One-Pass Filtering for Efficient Top-k Selection12 Aug 2026
- 2026LiteTopK: Exploiting the Curse of Dimensionality for a Fused Indexer-TopK Kernel in Long-Context Sparse Attention13 Jul 2026
- 2025A Faster Generalized Two-Stage Approximate Top-K4 Jun 2025
- 2023MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training2 Oct 2023
- 2023Tango: rethinking quantization for graph neural network training on GPUs2 Aug 2023
- 2023DEFT: Exploiting Gradient Norm Difference between Model Layers for Scalable Gradient Sparsification7 Jul 2023