BARE: Towards Bias-Aware and Reasoning-Enhanced One-Tower Visual Grounding
Not on the map. Why?
Abstract (arXiv)
Visual Grounding (VG), which aims to locate a specific region referred to by expressions, is a fundamental yet challenging task in the multimodal understanding fields. While recent grounding transfer works have advanced the field through one-tower architectures, they still suffer from two primary limitations: (1) over-entangled multimodal representations that exacerbate deceptive modality biases, and (2) insufficient semantic reasoning that hinders the comprehension of referential cues. In this paper, we propose BARE, a bias-aware and reasoning-enhanced framework for one-tower visual grounding. BARE introduces a mechanism that preserves modality-specific features and constructs referential semantics through three novel modules: (i) language salience modulator, (ii) visual bias correction and (iii) referential relationship enhancement, which jointly mitigate multimodal distractions and enhance referential comprehension. Extensive experimental results on five benchmarks demonstrate that BARE not only achieves state-of-the-art performance but also delivers superior computational efficiency compared to existing approaches. The code is publicly accessible at https://github.com/Marloweeee/BARE.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 68 of its 88 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
68 of 88 references.
References · 68
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
38 more
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2015Fast R-CNNcited by 2,930
- 2015VQA: Visual Question Answeringcited by 2,489
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 553
- 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 337
- 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
- 2023GRES: Generalized Referring Expression Segmentationcited by 252
- 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
- 2019RUBi: Reducing Unimodal Biases in Visual Question Answeringcited by 183
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2020Counterfactual Samples Synthesizing for Robust Visual Question Answeringcited by 153
- 2022Analyzing Transformers in Embedding Spacecited by 131
- 2021UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modelingcited by 122
- 2023ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalitiescited by 117
- 2022Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)cited by 115
- 2019Automatically Neutralizing Subjective Bias in Textcited by 105
- 2024Low-Rank Few-Shot Adaptation of Vision-Language Modelscited by 103
- 2024GroundingGPT:Language Enhanced Multi-modal Grounding Modelcited by 101
- 2019Learning to Compose and Reason with Language Tree Structures for Visual Groundingcited by 98
- 2020Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Modelscited by 90
- 2016Deep Feature Interpolation for Image Content Changescited by 80
- 2020On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answeringcited by 78
- 2022Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoningcited by 69
- 2024Text4Seg: Reimagining Image Segmentation as Text Generationcited by 59
- 2022Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Groundingcited by 52
- 2024Toward Visual Grounding: A Surveycited by 52
- 2022TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformercited by 41
- 2022Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Modelscited by 40
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.