mlsanityData to 7 Oct 2026

Multimodal Taxonomic Conditioning for Generative Plankton Imagery

arXiv 2609.11673 ↗First posted 10 Sep 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated plankton imaging produces severely long-tailed datasets, where the rare taxa of greatest ecological interest have too few images to train or evaluate classifiers reliably. We generate synthetic plankton imagery conditioned on taxonomy: a CLIP encoder is adapted on a large plankton corpus with a ranked contrastive objective extended to deep, ragged taxonomies, then frozen to condition a parameter-efficient diffusion transformer. We evaluate synthetic sample quality on distributional fidelity and downstream classifier utility.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 18 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

14 of 18 references.

References · 14

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2025DINOv3cited by 1,297
  8. 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 159
  9. 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 48
  10. 2022Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positivescited by 37
  11. 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generationcited by 7
  12. 2024FineDiffusion: Scaling up Diffusion Models for Fine-grained Image Generation with 10,000 Classescited by 5
2 more
  1. 2025Self-Supervised Pretraining for Fine-Grained Plankton Recognitioncited by 4
  2. 2026Planktonzilla: Multimodal dataset and models for understanding plankton ecosystemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion Representations for Fine-Grained Image Classification: A Marine Plankton Case Study
  2. 2026TaxaAdapter: Vision Taxonomy Models are Key to Fine-grained Image Generation over the Tree of Life
  3. 2024Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation
  4. 2026ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs
  5. 2025Taxonomic Reasoning for Rare Arthropods: Combining Dense Image Captioning and RAG for Interpretable Classification
  6. 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors
  7. 2026Can Edge-Deployable Vision-Language Models Identify Species?
  8. 2025FishNet++: Analyzing the capabilities of Multimodal Large Language Models in marine biology