GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed
On the map: Efficient LLM inference and serving → Fast autoregressive visual generation
Abstract (arXiv)
Autoregressive (AR) grounding models serialize spatial predictions, introducing sequential latency and imposing a causal order on output tokens. We view grounding as visual evidence extraction: objects, locations, and spatial relations are jointly constrained by the image and query, yet their dependencies do not imply an intrinsic left-to-right generation order. This distinction makes bidirectional diffusion a natural fit, allowing spatial hypotheses to emerge in parallel and be jointly refined through iterative denoising. We introduce GroundAnything, a 4B-parameter grounding foundation model that reconciles fast parallel decoding with precise localization through blockwise denoising. Training combines grounding pretraining from public datasets and dedicated data engines, direct AR-to-diffusion conversion with joint AR and diffusion objectives, supervised fine-tuning, and GRPO-based reinforcement post-training. Across 30 grounding benchmarks, our autoregressive variant, GroundAnything-VLM, establishes a new overall state of the art among similarly sized models at 72.42%, remaining competitive with GPT-6 Astra (71.35%). With entropy-guided decoding, GroundAnything also surpasses the prior state of the art at this scale, averaging 61.75% versus 53.32% for the fast MTP-based LocateAnything model. We further explore decoding strategies, showing that an optional self-speculative mode achieves a 4.51× speedup over the AR counterpart with a 0.74 percentage-point drop in COCO F1mIoU. Infrastructure experiments show that progressive inference optimizations translate parallel decoding into practical speedups. These support efficient visual grounding in latency-sensitive real-world systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Fast autoregressive visual generation, one of 12 directions in Efficient LLM inference and serving. First posted on arXiv 30 Sep 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
- 2025Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoning
- 2026Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding
- 2021End-to-End Dense Video Grounding via Parallel Regression
- 2026CoEvolve: Construct-to-Edit Visual Grounding with Bidirectional State Refinement
- 2023Language-Guided Diffusion Model for Visual Grounding
- 2024PD-APE: A Parallel Decoding Framework with Adaptive Position Encoding for 3D Visual Grounding
- 2025Autoregressive Image Generation with Randomized Parallel Decoding