mlsanityData to 14 Oct 2026

Asymmetric Cross-Modal Fine-Grained Visual Categorization: ACF-Net and the BirdPro Benchmark

arXiv 2608.25520 ↗First posted 26 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Audio-visual cross-modal Fine-Grained Visual Categorization (FGVC) aims to identify fine-grained categories by jointly leveraging visual and auditory information. However, FGVC under asymmetric cross-modal scenarios has received limited attention, where paired video and audio are not strictly synchronized and may not even correspond to the same individual or moment. Such weak and ambiguous cross-modal correspondence poses substantial challenges to effective representation learning and modality alignment. To address these issues, we propose ACF-Net, a novel optical flow-guided framework for asymmetric audio-visual fine-grained learning. ACF-Net consists of two key modules: Optical Flow-Guided Motion (OFGM) and Asymmetric CrossModal Adaptive Fusion (ACAF). OFGM captures motion-sensitive visual cues and suppresses irrelevant background interference, thereby enhancing discriminative dynamic representations in videos. ACAF estimates modality reliability under weakly matched audio-video pairs and performs uncertainty-aware adaptive fusion to improve category-level recognition robustness. To support research on asymmetric cross-modal FGVC, we further construct BirdPro, a new bird-oriented audio-visual benchmark, since existing datasets often lack large-scale category-level audio-video associations under non-strict temporal and instance correspondence. BirdPro contains 1,919 audio recordings and 11,965 videos covering 194 bird species. Extensive experiments show that ACF-Net achieves the best results compared with representative baseline methods, outperforming the strongest baselines by 2.97% and 1.92% in the fused and mismatched settings, respectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

20 of 35 references.

References · 20

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  3. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
  4. 2023Multimodal Deep Learningcited by 258
  5. 2017Gated Multimodal Units for Information Fusioncited by 248
  6. 2016Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Groundingcited by 243
  7. 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
  8. 2021TransFG: A Transformer Architecture for Fine-grained Recognitioncited by 132
  9. 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 116
  10. 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 81
  11. 2024A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detectioncited by 23
  12. 2022BATFormer: Towards Boundary-Aware Lightweight Transformer for Efficient Medical Image Segmentationcited by 14
8 more
  1. 2023StreamFlow: Streamlined Multi-Frame Optical Flow Estimation for Video Sequencescited by 12
  2. 2023Multimodal Imbalance-Aware Gradient Modulation for Weakly-supervised Audio-Visual Video Parsingcited by 11
  3. 2024SAMCT: Segment Any CT Allowing Labor-Free Task-Indicator Promptscited by 5
  4. 2025PrePrompt: Predictive prompting for class incremental learningcited by 3
  5. 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detectioncited by 3
  6. 2023Concept Drift and Long-Tailed Distribution in Fine-Grained Visual Categorization: Benchmark and Methodcited by 2
  7. 2026YUV20K: A Complexity-Driven Benchmark and Trajectory-Aware Alignment Model for Video Camouflaged Object Detectioncited by 2
  8. 2026High-Resolution Underwater Camouflaged Object Detection: GBU-UCOD Dataset and Topology-Aware and Frequency-Decoupled Networkscited by 1

Built on by

Not cited yet.