mlsanityData to 7 Oct 2026

CrowdCue: Specialist-Cue Conditioning for Vision-Language Crowd Counting

arXiv 2609.23012 ↗First posted 19 Sep 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning also fits: Visual token pruning and efficiency

Abstract (arXiv)

Generative vision-language models (VLMs) offer a counting paradigm in which one model produces both a count and a natural-language account of the scene, yet their raw counting accuracy sits in the range of sub-million-parameter specialist regressors. The open question is whether auxiliary guidance from a pretrained specialist can lift them into useful territory, and through which channel that guidance is best routed. We evaluate Qwen2.5-VL-7B on four widely used crowd counting benchmarks (ShanghaiTech A and B, UCF-QNRF, NWPU-Crowd). Zero-shot prompting rarely produces a parseable count, so LoRA supervised fine-tuning establishes the baseline at overall MAE 81.64. Conditioning on a P2PNet-derived density heatmap as an auxiliary visual signal fails in every encoding we tested, and an adversarial-swap protocol shows the model reads the heatmap but applies it counterproductively. We propose CrowdCue, a family that supplies the same specialist's already-integrated integer count to the VLM as a discrete symbol. The text-channel variant reaches MAE 72.04. The visual-channel variant, which renders the integer as printed digits and supplies it as a second image, reaches MAE 62.65, the strongest result in this paper and well ahead of the cue-supplying specialist alone (84.45 on the same split). In the late-fusion VLM we study, the binding constraint is not the channel but the abstraction level at which the specialist signal is delivered.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 29 references that are in the map. First posted on arXiv 19 Sep 2026.

Builds on

24 of 29 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  2. 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Counting12 May
  3. 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Model9 Apr

Other references · 21

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 352
  4. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  5. 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
  6. 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
  7. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 178
  8. 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
  9. 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
  10. 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
  11. 2018Context-Aware Crowd Countingcited by 150
  12. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 84
9 more
  1. 2023STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learningcited by 41
  2. 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Countingcited by 36
  3. 2023CrowdDiff: Multi-hypothesis Crowd Density Estimation using Diffusion Modelscited by 20
  4. 2025CrowdVLM-R1: Expanding R1 Ability to Vision Language Model for Crowd Counting using Fuzzy Group Relative Policy Rewardcited by 15
  5. 2024CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classificationcited by 12
  6. 2024Multi-modal Crowd Counting via a Broker Modalitycited by 11
  7. 2025ZIP: Scalable Crowd Counting via Zero-Inflated Poisson Modelingcited by 2
  8. 2025RCCFormer: A Robust Crowd Counting Network Based on Transformercited by 1
  9. 2025ProgRoCC: A Progressive Approach to Rough Crowd Countingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Counting Circuits: Mechanistic Interpretability of Visual Reasoning in Large Vision-Language Models
  2. 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventions
  3. 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
  4. 2025Revisiting Data Auditing in Large Vision-Language Models
  5. 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
  6. 2026Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models
  7. 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs
  8. 2026The Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs