mlsanityData to 7 Oct 2026

Champion Solution for the WSDM2023 Toloka VQA Challenge

arXiv 2301.09045 ↗First posted 22 Jan 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

In this report, we present our champion solution to the WSDM2023 Toloka Visual Question Answering (VQA) Challenge. Different from the common VQA and visual grounding (VG) tasks, this challenge involves a more complex scenario, i.e. inferring and locating the object implicitly specified by the given interrogative question. For this task, we leverage ViT-Adapter, a pre-training-free adapter network, to adapt multi-modal pre-trained Uni-Perceiver for better cross-modal localization. Our method ranks first on the leaderboard, achieving 77.5 and 76.347 IoU on public and private test sets, respectively. It shows that ViT-Adapter is also an effective paradigm for adapting the unified perception model to vision-language downstream tasks. Code and models will be released at https://github.com/czczup/ViT-Adapter/tree/main/wsdm2023.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 22 Jan 2023.

Builds on

36 of 41 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2017Mask R-CNNcited by 7,259
  10. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  11. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  12. 2015VQA: Visual Question Answeringcited by 2,489
24 more
  1. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  2. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  3. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  4. 2016Modeling Context in Referring Expressionscited by 1,054
  5. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  6. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  7. 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
  8. 2019Panoptic Feature Pyramid Networkscited by 644
  9. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  10. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
  11. 2021TransVG: End-to-End Visual Grounding with Transformerscited by 269
  12. 2016Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Groundingcited by 243
  13. 2020A survey of loss functions for semantic segmentationcited by 216
  14. 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 194
  15. 2021Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Taskscited by 124
  16. 2019Learning to Compose and Reason with Language Tree Structures for Visual Groundingcited by 98
  17. 2020Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Groundingcited by 50
  18. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  19. 2021Visual Grounding with Transformerscited by 42
  20. 2021DCAN: Improving Temporal Action Detection via Dual Context Aggregationcited by 36
  21. 2020Dynamic Sampling Networks for Efficient Action Recognition in Videoscited by 34
  22. 2022DQ-DETR: Dual Query Detection Transformer for Phrase Extraction and Groundingcited by 24
  23. 2021Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalizationcited by 15
  24. 20221st Place Solutions for the UVO Challenge 2022cited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 0; 2025: 1.

3 papers.

  1. 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 24
  2. 2023Toloka Visual Question Answering Benchmarkcited by 10
  3. 2025Comprehension of Multilingual Expressions Referring to Target Objects in Visual Inputscited by 1