mlsanityData to 7 Oct 2026

Nomic Embed Vision: Expanding the Latent Space

arXiv 2406.18587 ↗First posted 6 Jun 2024cs.CV cs.AIcited by 19

Not on the map. Why?

Abstract (arXiv)

This technical report describes the training of nomic-embed-vision, a highly performant, open-code, open-weights image embedding model that shares the same latent space as nomic-embed-text. Together, nomic-embed-vision and nomic-embed-text form the first unified latent space to achieve high performance across vision, language, and multimodal tasks.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 24 of its 32 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

24 of 32 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  9. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  11. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  12. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
12 more
  1. 2023Vision Transformers Need Registerscited by 844
  2. 2022When and why vision-language models behave like bags-of-words, and what to do about it?cited by 603
  3. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
  4. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 562
  5. 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 553
  6. 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
  7. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
  8. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  9. 2023Teaching CLIP to Count to Tencited by 194
  10. 2023Image Captioners Are Scalable Vision Learners Toocited by 89
  11. 2024Jina CLIP: Your CLIP Model Is Also Your Text Retrievercited by 46
  12. 2023Three Towers: Flexible Contrastive Learning with Pretrained Image Modelscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 13.

19 papers.

Sort:

By area:

  1. 2024Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documentscited by 17
  2. 2026Nemotron ColEmbed V2: Top-Performing Late Interaction Embedding Models for Visual Document Retrievalcited by 8
  3. 2026Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrievalcited by 8
  4. 2025AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoningcited by 7
  5. 2025VIBE: Vector Index Benchmark for Embeddingscited by 6
  6. 2026jina-embeddings-v5-omni: Geometry-preserving Embeddings via Locked Aligned Towerscited by 4
  7. 2026MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documentscited by 3
  8. 2025Towards Text-Image Interleaved Retrievalcited by 2
  9. 2026LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinementcited by 1
  10. 2025Solving Inverse Problems in Stochastic Self-Organizing Systems through Invariant Representationscited by 0
  11. 2025Targeted perturbations reveal brain-like local coding axes in robustified, but not standard, ANN-based brain modelscited by 0
  12. 2026Language-Agnostic Visual Embeddings for Cross-Script Handwriting Retrievalcited by 0
7 more
  1. 2026MiRAGE: A Multiagent Framework for Generating Multimodal Multihop Question-Answer Dataset for RAG Evaluationcited by 0
  2. 2026Visual Product Search Benchmarkcited by 0
  3. 2026HIVE: Query, Hypothesize, Verify An LLM Framework for Multimodal Reasoning-Intensive Retrievalcited by 0
  4. 2026Revealing Geography-Driven Signals in Zone-Level Claim Frequency Models: An Empirical Study using Environmental and Visual Predictorscited by 0
  5. 2026Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platformcited by 0
  6. 2026VaRS-Doc: Interpretation-Aware Variant Representations via Latent Self-Probing for Visual Document Retrievalcited by 0
  7. 2026CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfercited by 0