Learning to Ask: Decision Transformers for Adaptive Quantitative Group Testing
On the map: Offline RL and imitation learning from data → Offline RL algorithms
Abstract (arXiv)
We consider the problem of quantitative group testing (QGT), where the goal is to recover a sparse binary vector from aggregate subset-sum queries: each query selects a subset of indices and returns the sum of those entries. Information-theoretic results suggest that adaptivity could yield up to a twofold reduction in the total number of required queries, yet no algorithm has surpassed the non-adaptive bound, leaving its practical benefit an open question. In this paper, we reduce the QGT problem to an integer-vector recovery task whose dimension scales with the sparsity of the original problem rather than its full ambient size. We then formulate this reduced recovery task as an offline reinforcement learning problem and employ Decision Transformers to solve it adaptively. By combining these two steps, we obtain an effective end-to-end method for solving the QGT problem. Our experiments show that, for the first time in the literature, our adaptive algorithm reduces the average number of queries below the well-known non-adaptive information-theoretic bound, demonstrating that adaptivity can indeed reduce the number of queries.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Offline RL algorithms, one of 13 directions in Offline RL and imitation learning from data. Builds on 10 of its 28 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
10 of 28 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2022Multi-Game Decision Transformerscited by 214
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
- 2021Support Recovery in Universal One-bit Compressed Sensingcited by 6
- 2014Optimal Nested Test Plan for Combinatorial Quantitative Group Testingcited by 4
- 2023Approximate Message Passing with Rigorous Guarantees for Pooled Data and Quantitative Group Testingcited by 3
- 2022Improved Support Recovery in Universal One-bit Compressed Sensingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Too Correct to Learn: Reinforcement Learning on Saturated Reasoning Data
- 2026Harder Is Better: Boosting Mathematical Reasoning via Difficulty-Aware GRPO and Multi-Aspect Question Reformulation
- 2025Mitigating Think-Answer Mismatch in LLM Reasoning Through Noise-Aware Advantage Reweighting
- 2026Understanding and Mitigating Spurious Signal Amplification in Test-Time Reinforcement Learning for Math Reasoning
- 2026Save Your Saturated Data: Learning Beyond Reward Saturation in Group-Based RL
- 2026Group Distributionally Robust Optimization-Driven Reinforcement Learning for LLM Reasoning
- 2026The Easy, the Hard, and the Learnable: Confidence and Difficulty-Adaptive Policy Optimization for LLM Reasoning
- 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoning