A* Sampling
Not on the map. Why?
Abstract (arXiv)
The problem of drawing samples from a discrete distribution can be converted into a discrete optimization problem. In this work, we show how sampling from a continuous distribution can be converted into an optimization problem over continuous space. Central to the method is a stochastic process recently described in mathematical statistics that we call the Gumbel process. We present a new construction of the Gumbel process and A* sampling, a practical generic sampling algorithm that searches for the maximum of a Gumbel process using A* search. We analyze the correctness and convergence time of A* sampling and demonstrate empirically that it makes more efficient use of bound and likelihood evaluations than the most closely related adaptive rejection sampling-based algorithms.
Key facts. Cited by 150 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 37; 2022: 24; 2023: 23; 2024: 16; 2025: 22; 2026: 27.
150 papers.
Sort:
By area:
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2021Chasing Sparsity in Vision Transformers: An End-to-End Explorationcited by 181
- 2021Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoTcited by 104
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 102
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
- 2022Wavelet Score-Based Generative Modelingcited by 61
- 2024Informed Correctors for Discrete Diffusion Modelscited by 57
- 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 49
- 2021Differentiable Subset Pruning of Transformer Headscited by 46
- 2023Regularized Vector Quantization for Tokenized Image Synthesiscited by 46
- 2023Physically Realizable Natural-Looking Clothing Textures Evade Person Detectors via 3D Modelingcited by 41
38 more
- 2022D&D: Learning Human Dynamics from Dynamic Cameracited by 39
- 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
- 2023Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusioncited by 36
- 2022SIMPLE: A Gradient Estimator for k-Subset Samplingcited by 34
- 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvementcited by 32
- 2021Dynamic Resolution Networkcited by 31
- 2021Algorithms for the Communication of Samplescited by 31
- 2023Bridging Discrete and Backpropagation: Straight-Through and Beyondcited by 31
- 2023Compression with Bayesian Implicit Neural Representationscited by 25
- 2021Meta-Aggregator: Learning to Aggregate for 1-bit Graph Neural Networkscited by 24
- 2021Generalizable Human Pose Triangulationcited by 24
- 2021Influencing Towards Stable Multi-Agent Interactionscited by 24
- 2021Parallel Attention Network with Sequence Matching for Video Groundingcited by 22
- 2023Privacy Amplification via Compression: Achieving the Optimal Privacy-Accuracy-Communication Trade-off in Distributed Mean Estimationcited by 22
- 2023Deep Graph Reprogrammingcited by 22
- 2021Classical Planning in Deep Latent Spacecited by 21
- 2021Multiresolution Equivariant Graph Variational Autoencodercited by 20
- 2021Counterfactual Temporal Point Processescited by 20
- 2024Multimodal Action Quality Assessmentcited by 20
- 2021Linear, or Non-Linear, That is the Question!cited by 19
- 2021Lifelong Teacher-Student Network Learningcited by 18
- 2021A Deep Adversarial Model for Suffix and Remaining Time Prediction of Event Sequencescited by 17
- 2021Learning Generalized Gumbel-max Causal Mechanismscited by 16
- 2023Sparse Backpropagation for MoE Trainingcited by 16
- 2018MEGAN: Mixture of Experts of Generative Adversarial Networks for Multimodal Image Generationcited by 15
- 2023Understanding and Bridging the Modality Gap for Speech Translationcited by 15
- 2023Exponential Smoothing for Off-Policy Learningcited by 15
- 2022Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representationcited by 14
- 2022Counterfactual Inference of Second Opinionscited by 14
- 2021Modular Meta-Learning for Power Control via Random Edge Graph Neural Networkscited by 13
- 2024Gumbel Counterfactual Generation From Language Modelscited by 13
- 2025Adaptive Part Learning for Fine-Grained Generalized Category Discovery: A Plug-and-Play Enhancementcited by 13
- 2021Localization with Sampling-Argmaxcited by 11
- 2022Temporal Multiresolution Graph Neural Networks For Epidemic Predictioncited by 11
- 2024Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learningcited by 11
- 2021Unbiased Gradient Estimation with Balanced Assignments for Mixtures of Expertscited by 10
- 2022A2: Efficient Automated Attacker for Boosting Adversarial Trainingcited by 10
- 2022Is margin all you need? An extensive empirical study of active learning on tabular datacited by 10
50 most cited of 150 All 150 (JSON)
- 2026SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL1 Oct 2026
- 2026Watermarkable Multi-Draft Speculative Sampling via Poisson Processes18 Sep 2026
- 2026Accelerating Diffusion Sampling via Speculative Draft Trees15 Sep 2026
- 2026Break Step: Recursive Training Resonates with Replayed Sampling Noise10 Sep 2026
- 2026PAC-Private Autoregressive Generation: Calibrating Noise to Ensemble Disagreement4 Sep 2026
- 2026VGAS: Variance-Reduced Guidance and Adaptive Selection for Training-Free Reward Alignment in Discrete Diffusion27 Aug 2026
- 2026Faithful, Sufficient and Understandable: Rethinking Graph Counterfactual Explanations via Discrete Diffusion Inversion12 Aug 2026
- 2026Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark31 Jul 2026
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories9 Jul 2026
- 2026Prior-aware and Context-guided Group Sampling for Active Probabilistic Subsampling8 Jul 2026
- 2026Trees from Marginals: Autoregressive drafting with factorized priors7 Jul 2026
- 2026Sample Complexities of Estimating Gumbel--Max Watermark Proportions with and without Reduction to Pivotal Statistics30 Jun 2026
38 more
- 2026Forward-Free Diffusion Language Models with BPTT-Free Looped Refinement6 Jun 2026
- 2026Gumbel Machine: Counterfactual Student Writing Generation via Gumbel Noise Steering26 May 2026
- 2026The Neural Tangent Kernel for Classification17 May 2026
- 2026Lossless Anti-Distillation Sampling12 May 2026
- 2026PREFER: Personalized Review Summarization with Online Preference Learning7 May 2026
- 2026Pliable rejection sampling24 Apr 2026
- 2026Gumbel Distillation for Parallel Text Generation23 Mar 2026
- 2026PLR: Plackett-Luce for Reordering In-Context Learning Examples22 Mar 2026
- 2026FlashSampling: Fast and Memory-Efficient Exact Sampling16 Mar 2026
- 2026How to make the most of your masked language model for protein engineering11 Mar 2026
- 2026Beyond ReinMax: Low-Variance Gradient Estimators for Discrete Latent Variables9 Mar 2026
- 2026Partition Function Estimation under Bounded f-Divergence26 Feb 2026
- 2026Exact Discrete Stochastic Simulation with Deep-Learning-Scale Gradient Optimization23 Feb 2026
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models1 Feb 2026
- 2026Entropy-Aligned Decoding of LMs for Better Writing and Reasoning5 Jan 2026
- 2025Optimized Architectures for Kolmogorov-Arnold Networks13 Dec 2025
- 2025Structural Prognostic Event Modeling for Multimodal Cancer Survival Analysis30 Nov 2025
- 2025Point Cloud Quantization through Multimodal Prompting for 3D Understanding15 Nov 2025
- 2025Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion6 Oct 2025
- 2025On the Empirical Power of Goodness-of-Fit Tests in Watermark Detection4 Oct 2025
- 2025Database Views as Explanations for Relational Deep Learning11 Sep 2025
- 2025Efficient Decoding Methods for Language Models on Encrypted Data10 Sep 2025
- 2025Auditable Early Stopping for Agentic Routing: Ledger-Verified Run-Wise Certificates under Local DP9 Sep 2025
- 2025Advanced Torrential Loss Function for Precipitation Forecasting1 Sep 2025
- 2025Mallows Model with Learned Distance Metrics: Sampling and Maximum Likelihood Estimation10 Jul 2025
- 2025Adaptive Part Learning for Fine-Grained Generalized Category Discovery: A Plug-and-Play Enhancement9 Jul 2025
- 2025Dynamic View Synthesis from Small Camera Motion Videos29 Jun 2025
- 2025Multi-use LLM Watermarking and the False Detection Problem19 Jun 2025
- 2025Tokenization Multiplicity Leads to Arbitrary Price Variation in LLM-as-a-service6 Jun 2025
- 2025Abstract Counterfactuals for Language Model Agents3 Jun 2025
- 2025Scaling Textual Gradients via Sampling-Based Momentum31 May 2025
- 2025Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learning22 Mar 2025
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar 2025
- 2025Efficient Neural Clause-Selection Reinforcement10 Mar 2025
- 2025Waste Not, Want Not; Recycled Gumbel Noise Improves Consistency in Natural Language Generation2 Mar 2025
- 2025DQ-Data2vec: Decoupling Quantization for Multilingual Speech Recognition23 Jan 2025
- 2025No More Sliding Window: Efficient 3D Medical Image Segmentation with Differentiable Top-k Patch Sampling18 Jan 2025
- 2024Discrete Subgraph Sampling for Interpretable Graph based Visual Question Answering11 Dec 2024
50 newest of 150 All 150 (JSON)
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2022Wavelet Score-Based Generative Modelingcited by 61
- 2024Informed Correctors for Discrete Diffusion Modelscited by 57
- 2025Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusioncited by 10
- 2024DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Modelscited by 2
- 2026Accelerating Diffusion Sampling via Speculative Draft Treescited by 2
- 2026Faithful, Sufficient and Understandable: Rethinking Graph Counterfactual Explanations via Discrete Diffusion Inversioncited by 1
- 2026Forward-Free Diffusion Language Models with BPTT-Free Looped Refinementcited by 0
- 2026VGAS: Variance-Reduced Guidance and Adaptive Selection for Training-Free Reward Alignment in Discrete Diffusioncited by 0
- 2026Accelerating Diffusion Sampling via Speculative Draft Trees15 Sep 2026
- 2026VGAS: Variance-Reduced Guidance and Adaptive Selection for Training-Free Reward Alignment in Discrete Diffusion27 Aug 2026
- 2026Faithful, Sufficient and Understandable: Rethinking Graph Counterfactual Explanations via Discrete Diffusion Inversion12 Aug 2026
- 2026Forward-Free Diffusion Language Models with BPTT-Free Looped Refinement6 Jun 2026
- 2025Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion6 Oct 2025
- 2024DICE: Discrete Inversion Enabling Controllable Editing for Multinomial Diffusion and Masked Generative Models10 Oct 2024
- 2024Informed Correctors for Discrete Diffusion Models30 Jul 2024
- 2022Wavelet Score-Based Generative Modeling9 Aug 2022
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions10 Feb 2021
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agentscited by 102
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectoriescited by 3
- 2025Abstract Counterfactuals for Language Model Agentscited by 2
- 2025Auditable Early Stopping for Agentic Routing: Ledger-Verified Run-Wise Certificates under Local DPcited by 0
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories9 Jul 2026
- 2025Auditable Early Stopping for Agentic Routing: Ledger-Verified Run-Wise Certificates under Local DP9 Sep 2025
- 2025Abstract Counterfactuals for Language Model Agents3 Jun 2025
- 2025In Prospect and Retrospect: Reflective Memory Management for Long-term Personalized Dialogue Agents11 Mar 2025
- 2026Trees from Marginals: Autoregressive drafting with factorized priorscited by 2
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Modelscited by 1
- 2026Gumbel Distillation for Parallel Text Generationcited by 1
- 2026Watermarkable Multi-Draft Speculative Sampling via Poisson Processescited by 0
- 2026Watermarkable Multi-Draft Speculative Sampling via Poisson Processes18 Sep 2026
- 2026Trees from Marginals: Autoregressive drafting with factorized priors7 Jul 2026
- 2026Gumbel Distillation for Parallel Text Generation23 Mar 2026
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models1 Feb 2026
- 2023Sparse Backpropagation for MoE Trainingcited by 16
- 2018MEGAN: Mixture of Experts of Generative Adversarial Networks for Multimodal Image Generationcited by 15
- 2021Unbiased Gradient Estimation with Balanced Assignments for Mixtures of Expertscited by 10
- 2023Improved Training of Mixture-of-Experts Language GANscited by 7
- 2023Sparse Backpropagation for MoE Training1 Oct 2023
- 2023Improved Training of Mixture-of-Experts Language GANs23 Feb 2023
- 2021Unbiased Gradient Estimation with Balanced Assignments for Mixtures of Experts24 Sep 2021
- 2018MEGAN: Mixture of Experts of Generative Adversarial Networks for Multimodal Image Generation7 May 2018
- 2025Multi-use LLM Watermarking and the False Detection Problem19 Jun 2025
- 2021Chasing Sparsity in Vision Transformers: An End-to-End Explorationcited by 181
- 2021Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoTcited by 104
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2021Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognitioncited by 68
- 2023LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Versioncited by 49
- 2021Differentiable Subset Pruning of Transformer Headscited by 46
- 2023Regularized Vector Quantization for Tokenized Image Synthesiscited by 46
- 2023Physically Realizable Natural-Looking Clothing Textures Evade Person Detectors via 3D Modelingcited by 41
- 2022D&D: Learning Human Dynamics from Dynamic Cameracited by 39
- 2021Stochastic Batch Acquisition: A Simple Baseline for Deep Active Learningcited by 36
- 2023Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusioncited by 36
- 2022SIMPLE: A Gradient Estimator for k-Subset Samplingcited by 34
12 most cited of 127 All 127 (JSON)
- 2026SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL1 Oct 2026
- 2026Break Step: Recursive Training Resonates with Replayed Sampling Noise10 Sep 2026
- 2026PAC-Private Autoregressive Generation: Calibrating Noise to Ensemble Disagreement4 Sep 2026
- 2026Toward Robust and 3D-Aware RGB-NIR Imaging in the Dark31 Jul 2026
- 2026Prior-aware and Context-guided Group Sampling for Active Probabilistic Subsampling8 Jul 2026
- 2026Sample Complexities of Estimating Gumbel--Max Watermark Proportions with and without Reduction to Pivotal Statistics30 Jun 2026
- 2026Gumbel Machine: Counterfactual Student Writing Generation via Gumbel Noise Steering26 May 2026
- 2026The Neural Tangent Kernel for Classification17 May 2026
- 2026Lossless Anti-Distillation Sampling12 May 2026
- 2026PREFER: Personalized Review Summarization with Online Preference Learning7 May 2026
- 2026Pliable rejection sampling24 Apr 2026
- 2026PLR: Plackett-Luce for Reordering In-Context Learning Examples22 Mar 2026
12 newest of 127 All 127 (JSON)