mlsanityData to 7 Oct 2026

Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding

arXiv 2608.03471 ↗First posted 4 Aug 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Generative Vision-Language Models (VLMs) commonly treat bounding-box coordinates as independent output symbols, leaving numerical order and axis semantics implicit. We identify this representation as an important source of error in visual grounding. Hi-Token encodes each coordinate with axis-specific tokens for the hundreds, tens, and ones digits, which adds coarse-to-fine structure and increases token reuse while retaining the existing VLM architecture. Hi-GAR complements this representation with a geometry-based reward for Group Relative Policy Optimization (GRPO), using box overlap and coordinate accuracy at multiple scales. Controlled comparisons under matched training conditions show that Hi-Token improves localization throughout the evaluated IoU range. Hi-GAR further reduces low-overlap predictions and is used only during training. Experiments on three VLM backbones and the RefCOCO family show consistent gains across models and benchmarks. Hi-R1 achieves higher values than strong specialist baselines on most reported metrics. Analyses of token frequency, digit boundaries, object scale, and IoU distributions explain the effects of coordinate representation and reward training. The results show that structured coordinate generation provides an effective approach to generative visual grounding. Project page: https://xyzzzh.github.io/Hi-Token/

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 25 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

18 of 25 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond24 Aug
  2. 2023Kosmos-2: Grounding Multimodal Large Language Models to the World26 Jun

Other references · 16

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  7. 2016Modeling Context in Referring Expressionscited by 1,054
  8. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
  9. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 891
  10. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  11. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  12. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
4 more
  1. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
  2. 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learningcited by 83
  3. 2025Detect Anything via Next Point Predictioncited by 66
  4. 2025Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuningcited by 44

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models
  2. 2026TempoGround: State-Aware Streaming Visual Grounding with Vision-Language Models
  3. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding
  4. 2025Grounding-Aware Token Pruning: Recovering from Drastic Performance Drops in Visual Grounding Caused by Pruning
  5. 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
  6. 2026IVC-Prune: Revealing the Implicit Visual Coordinates in LVLMs for Vision Token Pruning
  7. 2026VEGA: Visual Encoder Grounding Alignment for Spatially-Aware Vision-Language-Action Models
  8. 2025VLM-FO1: Bridging the Gap Between High-Level Reasoning and Fine-Grained Perception in VLMs