TokenFocus-VQA: Enhancing Text-to-Image Alignment with Position-Aware Focus and Multi-Perspective Aggregations on LVLMs
Not on the map. Why?
Abstract (arXiv)
While text-to-image (T2I) generation models have achieved remarkable progress in recent years, existing evaluation methodologies for vision-language alignment still struggle with the fine-grained semantic matching. Current approaches based on global similarity metrics often overlook critical token-level correspondences between textual descriptions and visual content. To this end, we present TokenFocus-VQA, a novel evaluation framework that leverages Large Vision-Language Models (LVLMs) through visual question answering (VQA) paradigm with position-specific probability optimization. Our key innovation lies in designing a token-aware loss function that selectively focuses on probability distributions at pre-defined vocabulary positions corresponding to crucial semantic elements, enabling precise measurement of fine-grained semantical alignment. The proposed framework further integrates ensemble learning techniques to aggregate multi-perspective assessments from diverse LVLMs architectures, thereby achieving further performance enhancement. Evaluated on the NTIRE 2025 T2I Quality Assessment Challenge Track 1, our TokenFocus-VQA ranks 2nd place (0.8445, only 0.0001 lower than the 1st method) on public evaluation and 2nd place (0.8426) on the official private test set, demonstrating superiority in capturing nuanced text-image correspondences compared to conventional evaluation methods.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 47 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
30 of 47 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023Qwen Technical Reportcited by 3,344
- 2016Improved Techniques for Training GANscited by 2,970
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
18 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 428
- 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 425
- 2018Stacked Cross Attention for Image-Text Matchingcited by 416
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
- 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 67
- 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
- 2024EvalMuse-40K: A Reliable and Fine-Grained Benchmark with Comprehensive Human Annotations for Text-to-Image Generation Model Evaluationcited by 39
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 14
- 2023A Contrastive Compositional Benchmark for Text-to-Image Synthesis: A Study with Unified Text-to-Image Fidelity Metricscited by 12
- 2025REAL: Realism Evaluation of Text-to-Image Generation Models for Effective Data Augmentationcited by 4
- 2024Multi-modal Generative Models in Recommendation Systemcited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AdaFV: Rethinking of Visual-Language alignment for VLM acceleration
- 2025When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs
- 2025Delta-LLaVA: Base-then-Specialize Alignment for Token-Efficient Vision-Language Models
- 2025Rethinking Visual Token Reduction in LVLMs Under Cross-Modal Misalignment
- 2026Aligning What Vision-Language Models See and Perceive with Adaptive Information Flow
- 2024Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMs
- 2023What You See is What You Read? Improving Text-Image Alignment Evaluation
- 2025Semantic-Clipping: Efficient Vision-Language Modeling with Semantic-Guidedd Visual Selection