Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval
Not on the map. Why?
Abstract (arXiv)
Large-scale biodiversity monitoring platforms increasingly rely on multimodal wildlife observations. While recent foundation models enable rich semantic representations across vision, audio, and language, retrieving relevant observations from massive archives remains challenging due to the computational cost of high-dimensional similarity search. In this work, we introduce compact hypercube embeddings for fast text-based wildlife observation retrieval, a framework that enables efficient text-based search over large-scale wildlife image and audio databases using compact binary representations. Building on the cross-view code alignment hashing framework, we extend lightweight hashing beyond a single-modality setup to align natural language descriptions with visual or acoustic observations in a shared Hamming space. Our approach leverages pretrained wildlife foundation models, including BioCLIP and BioLingual, and adapts them efficiently for hashing using parameter-efficient fine-tuning. We evaluate our method on large-scale benchmarks, including iNaturalist2024 for text-to-image retrieval and iNatSounds2024 for text-to-audio retrieval, as well as multiple soundscape datasets to assess robustness under domain shift. Results show that retrieval using discrete hypercube embeddings achieves competitive, and in several cases superior, performance compared to continuous embeddings, while drastically reducing memory and search cost. Moreover, we observe that the hashing objective consistently improves the underlying encoder representations, leading to stronger retrieval and zero-shot generalization. These results demonstrate that binary, language-based retrieval enables scalable and efficient search over large wildlife archives for biodiversity monitoring systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
12 of 22 references.
References · 12
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 159
- 2022Image-text Retrieval: A Survey on Recent Research and Developmentcited by 55
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 48
- 2020A Survey on Deep Hashing Methodscited by 47
- 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
- 2024TaxaBind: A Unified Embedding Space for Ecological Applicationscited by 33
- 2024INQUIRE: A Natural World Text-to-Image Retrieval Benchmarkcited by 33
- 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 20
- 2023BIRB: A Generalization Benchmark for Information Retrieval in Bioacousticscited by 19
- 2025The iNaturalist Sounds Datasetcited by 17
- 2025Image Hashing via Cross-View Code Alignment in the Age of Foundation Modelscited by 2
Built on by
Not cited yet.