LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs
Not on the map. Why?
Cited by 358 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Multi-modal language-vision models trained on hundreds of millions of image-text pairs (e.g. CLIP, DALL-E) gained a recent surge, showing remarkable capability to perform zero- or few-shot learning and transfer even in absence of per-sample labels on target image data. Despite this trend, to date there has been no publicly available datasets of sufficient scale for training such models from scratch. To address this issue, in a community effort we build and release for public LAION-400M, a dataset with CLIP-filtered 400 million image-text pairs, their CLIP embeddings and kNN indices that allow efficient similarity search.
Key facts. Cited by 1,555 papers in the map (data through 14 Oct 2026). Builds on 11 of its 12 references that are in the map. First posted on arXiv 3 Nov 2021.
Builds on
11 of 12 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2021Scaling Vision Transformerscited by 999
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
- 2020Scaling Laws for Autoregressive Generative Modelingcited by 522
- 2019One Epoch Is All You Needcited by 41
Built on by
Citing papers per year: 2021: 10; 2022: 132; 2023: 465; 2024: 468; 2025: 355; 2026: 125.
1,555 papers.
Sort:
By area:
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
38 more
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 648
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023Learning Interactive Real-World Simulatorscited by 458
50 most cited of 1,555 All 1,555 (JSON)
- 2026KARAMEL: Knowledge-Aware Ranking for Multimodal Entity Linking in the Arts via Heterogeneous Graphs12 Oct 2026
- 2026DepthTile: Depth-Guided Existing-Image Self-Tiling with Input-Side Tileability Assessment12 Oct 2026
- 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreement2 Oct 2026
- 2026SceneJail: Exploiting Video Scenario Context to Jailbreak Multimodal LLMs30 Sep 2026
- 2026Inductive Visual Logic for Few-Shot Out-Of-Distribution Adaptation in VLMs29 Sep 2026
- 2026Dual-Mode Low-Rank Learner with Bridge-Prototype Ensemble for Vision-Language Class-Incremental Learning29 Sep 2026
- 2026VLM4Cluster: Benchmarking Deep Clustering In the Era of Vision-Language Pre-training29 Sep 2026
- 2026ScAn-Bench: Evaluating Scaling Analysis Methodology28 Sep 2026
- 2026What Paired Evaluations Reveal under Visual Perturbations28 Sep 2026
- 2026TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking25 Sep 2026
- 2026TraceGuard: Adaptive Multimodal Poison Filtering through Cross-Feature Rank Agreement24 Sep 2026
- 2026A Data-Interventional Framework for Auditing Privacy and Fairness in Generative Medical Imaging22 Sep 2026
38 more
- 2026QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation19 Sep 2026
- 2026MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction17 Sep 2026
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026CORE: Improving Compositional Reasoning in MLLM Embedding via Reranker Distillation3 Sep 2026
- 2026Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision28 Aug 2026
- 2026LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training25 Aug 2026
- 2026What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models25 Aug 2026
- 2026VersaDB: A High-Performance AI Storage Database for Unifying Mutimodal Datasets24 Aug 2026
- 2026Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval23 Aug 2026
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoning18 Aug 2026
- 2026MASCOT: Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval12 Aug 2026
- 2026Rethinking Text-Based Image Retrieval in Specific Domain11 Aug 2026
- 2026RL-Native Distillation: Exploiting Scored Trajectories for Few-Step Image Generation10 Aug 2026
- 2026Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection1 Aug 2026
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model27 Jul 2026
- 2026UniGen-AR: Unifying Visual Generation with Auto-Regressive Modeling27 Jul 2026
- 2026OSVE: One Step Video Editing with One Step Diffusion Models22 Jul 2026
- 2026Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality16 Jul 2026
- 2026Cluster with Auctions for Vector Search15 Jul 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2026ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP25 Jun 2026
- 2026ARIA: Adaptive Region-Based Importance Allocation for Conditional Diffusion Distillation22 Jun 2026
- 2026Data Selection Through Iterative Self-Filtering for Vision-Language Settings22 Jun 2026
- 2026FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs22 Jun 2026
- 2026CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models19 Jun 2026
- 2026MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning19 Jun 2026
- 2026Toward 360-Degree Indoor Panorama Editing via Tuning-Free Diffusion Model with Refocusing Cross-Attention12 Jun 2026
- 2026A Unifying Framework for Concept-Based Representational Similarity8 Jun 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Construction2 Jun 2026
- 2026Chroma Clues: Leveraging Color Statistics to Detect Synthetic Images1 Jun 2026
- 2026Multimodal Group Emotion Recognition In-the-Wild Towards a Privacy-Safe Non-Individual Approach27 May 2026
- 2026RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation25 May 2026
- 2026Towards the Connection between Activation Sparsity and Flat Minima25 May 2026
- 2026MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset20 May 2026
- 2026Tunable MAGMAX: Preference-Aware Model Merging for Continual Learning20 May 2026
- 2026PixVerve: Advancing Native UHR Image Generation to 100MP with a Large-Scale High-Quality Dataset19 May 2026
50 newest of 1,555 All 1,555 (JSON)
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2023Otter: A Multi-Modal Model with In-Context Instruction Tuningcited by 550
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2022Blended Latent Diffusioncited by 432
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
12 most cited of 336 All 336 (JSON)
- 2026SceneJail: Exploiting Video Scenario Context to Jailbreak Multimodal LLMs30 Sep 2026
- 2026Inductive Visual Logic for Few-Shot Out-Of-Distribution Adaptation in VLMs29 Sep 2026
- 2026VLM4Cluster: Benchmarking Deep Clustering In the Era of Vision-Language Pre-training29 Sep 2026
- 2026QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation19 Sep 2026
- 2026What Does Prompt Learning Change? -A Natural-Language Concept Analysis of Vision-Language Models25 Aug 2026
- 2026MemCatalyst: Amplifying Data Auditing on Vision-Language Models via Data Poisoning18 Aug 2026
- 2026MASCOT: Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval12 Aug 2026
- 2026CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models19 Jun 2026
- 2026MIRCaps: A Large-Scale Mixed-Domain Dataset with Image-Level and Region-Level Captions for Fine-Grained Vision-Language Learning19 Jun 2026
- 2026Sparse Autoencoders as Plug-and-Play Firewalls for Adversarial Attack Detection in VLMs8 May 2026
- 2026Dynamic Cluster Data Sampling for Efficient and Long-Tail-Aware Vision-Language Pre-training30 Apr 2026
- 2026Evian: Towards Explainable Visual Instruction-tuning Data Auditing22 Apr 2026
12 newest of 336 All 336 (JSON)
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
12 most cited of 294 All 294 (JSON)
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026OSVE: One Step Video Editing with One Step Diffusion Models22 Jul 2026
- 2026ARIA: Adaptive Region-Based Importance Allocation for Conditional Diffusion Distillation22 Jun 2026
- 2026FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs22 Jun 2026
- 2026Toward 360-Degree Indoor Panorama Editing via Tuning-Free Diffusion Model with Refocusing Cross-Attention12 Jun 2026
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers17 May 2026
- 2026What Matters for Diffusion-Friendly Latent Manifold? Prior-Aligned Autoencoders for Latent Diffusion8 May 2026
- 2026Watch Your Step: Information Injection in Diffusion Models via Shadow Timestep Embedding1 May 2026
- 2026DiffMagicFace: Identity Consistent Facial Editing of Real Videos15 Apr 2026
- 2026Roots Beneath the Cut: Uncovering the Risk of Concept Revival in Pruning-Based Unlearning for Diffusion Models28 Feb 2026
- 2026Semantic Routing: Exploring Multi-Layer LLM Feature Weighting for Diffusion Transformers3 Feb 2026
- 2026OpenVTON-Bench: A Large-Scale High-Resolution Benchmark for Controllable Virtual Try-On Evaluation30 Jan 2026
12 newest of 294 All 294 (JSON)
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
- 2023Knowledge Editing for Large Language Models: A Surveycited by 194
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2023Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenizationcited by 87
- 2025Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learningcited by 84
- 2024CogCoM: A Visual Language Model with Chain-of-Manipulations Reasoningcited by 67
- 2023Hierarchical Spatio-temporal Decoupling for Text-to-Video Generationcited by 50
- 2024A Survey on Evaluation of Multimodal Large Language Modelscited by 46
- 2023CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Modelscited by 43
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Modelscited by 29
12 most cited of 44 All 44 (JSON)
- 2026CORE: Improving Compositional Reasoning in MLLM Embedding via Reranker Distillation3 Sep 2026
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model27 Jul 2026
- 2026ReasonCLIP-58M: Visually Grounded Commonsense Reasoning Supervision for CLIP25 Jun 2026
- 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouching30 Apr 2026
- 2026Chain-of-Models Pre-Training: Rethinking Training Acceleration of Vision Foundation Models14 Apr 2026
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026ConceptCoder: Improve Code Reasoning via Concept Learning24 Mar 2026
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysis14 Mar 2026
- 2026Perception-Aware Multimodal Spatial Reasoning from Monocular Images7 Mar 2026
- 2026TextShield-R1: Reinforced Reasoning for Tampered Text Detection23 Feb 2026
- 2026Thinker: A vision-language foundation model for embodied intelligence29 Jan 2026
- 2025Can Small Training Runs Reliably Guide Data Curation? Rethinking Proxy-Model Practice30 Dec 2025
12 newest of 44 All 44 (JSON)
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 75
- 2022Membership Inference Attacks Against Text-to-image Generation Modelscited by 69
- 2024Unified Gradient-Based Machine Unlearning with Remain Geometry Enhancementcited by 45
- 2023Practical Membership Inference Attacks Against Large-Scale Multi-Modal Models: A Pilot Studycited by 38
- 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 18
- 2024Adversarial Backdoor Defense in CLIPcited by 10
- 2023DeepfakeArt Challenge: A Benchmark Dataset for Generative AI Art Forgery and Data Poisoning Detectioncited by 9
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarkscited by 7
- 2025SafeVision: Efficient Image Guardrail with Robust Policy Adherence and Explainabilitycited by 4
- 2025NSFW-Classifier Guided Prompt Sanitization for Safe Text-to-Image Generationcited by 3
- 2025Customize Multi-modal RAI Guardrails with Precedent-based predictionscited by 2
12 most cited of 16 All 16 (JSON)
- 2026Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection1 Aug 2026
- 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks8 Jul 2026
- 2026When Safe Concepts Become Unsafe: Multi-Concept Compositional Vulnerabilities in Text-to-Image Models17 Apr 2026
- 2025Unconsciously Forget: Mitigating Memorization; Without Knowing What is being Memorized10 Dec 2025
- 2025SafeVision: Efficient Image Guardrail with Robust Policy Adherence and Explainability28 Oct 2025
- 2025Customize Multi-modal RAI Guardrails with Precedent-based predictions28 Jul 2025
- 2025NSFW-Classifier Guided Prompt Sanitization for Safe Text-to-Image Generation23 Jun 2025
- 2025A Unified and Scalable Membership Inference Method for Visual Self-supervised Encoder via Part-aware Capability15 May 2025
- 2024Unified Gradient-Based Machine Unlearning with Remain Geometry Enhancement29 Sep 2024
- 2024Adversarial Backdoor Defense in CLIP24 Sep 2024
- 2024Targeted Unlearning with Single Layer Unlearning Gradient16 Jul 2024
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models20 Oct 2023
12 newest of 16 All 16 (JSON)
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
- 2023Are aligned neural networks adversarially aligned?cited by 315
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardscited by 243
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimizationcited by 119
- 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Datasetcited by 35
- 2024Ctrl-U: Robust Conditional Image Generation via Uncertainty-aware Reward Modelingcited by 14
- 2024Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Modelscited by 9
- 2024PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adaptercited by 7
- 2026Stitched Value Model for Diffusion Alignmentcited by 2
- 2025Human Preference-Aligned Concept Customization Benchmark via Decomposed Evaluationcited by 1
- 2026M-MiniGPT4: Multilingual VLLM Alignment via Translated Datacited by 0
- 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreementcited by 0
- 2026DEPICT: Scoring Text-to-Image Alignment by Answer Agreement2 Oct 2026
- 2026Stitched Value Model for Diffusion Alignment19 May 2026
- 2026M-MiniGPT4: Multilingual VLLM Alignment via Translated Data31 Mar 2026
- 2025Human Preference-Aligned Concept Customization Benchmark via Decomposed Evaluation3 Sep 2025
- 2024Ctrl-U: Robust Conditional Image Generation via Uncertainty-aware Reward Modeling15 Oct 2024
- 2024SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset20 Jun 2024
- 2024ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization6 Jun 2024
- 2024Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models2 Apr 2024
- 2024PaLM2-VAdapter: Progressively Aligned Language Model Makes a Strong Vision-language Adapter16 Feb 2024
- 2023Are aligned neural networks adversarially aligned?26 Jun 2023
- 2023Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards7 Jun 2023
- 2023Aligning Text-to-Image Models using Human Feedback23 Feb 2023
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 220
- 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 210
- 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 64
- 2023Learning Customized Visual Models with Retrieval-Augmented Knowledgecited by 58
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
- 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
- 2023Improving Image Recognition by Retrieving from Web-Scale Image-Text Datacited by 20
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuningcited by 15
- 2025A Survey of LLM × DATAcited by 4
- 2025LEANN: A Low-Storage Vector Indexcited by 4
- 2025MV-RAG: Retrieval Augmented Multiview Diffusioncited by 0
- 2025MV-RAG: Retrieval Augmented Multiview Diffusion22 Aug 2025
- 2025LEANN: A Low-Storage Vector Index9 Jun 2025
- 2025A Survey of LLM × DATA24 May 2025
- 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlook23 Mar 2025
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation12 Feb 2025
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning17 Jun 2024
- 2023Improving Image Recognition by Retrieving from Web-Scale Image-Text Data11 Apr 2023
- 2023Learning Customized Visual Models with Retrieval-Augmented Knowledge17 Jan 2023
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text6 Oct 2022
- 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generator29 Sep 2022
- 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models26 Jul 2022
- 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretrainingcited by 187
- 2023CLIP-KD: An Empirical Study of CLIP Model Distillationcited by 87
- 2025MobileCLIP2: Improving Multi-Modal Reinforced Trainingcited by 21
- 2024Active Data Curation Effectively Distills Large-Scale Multimodal Modelscited by 19
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Trainingcited by 7
- 2023MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillationcited by 1
- 2025Context Aware Grounded Teacher for Source Free Object Detectioncited by 0
- 2026Generalizable Knowledge Distillation from Vision Foundation Models for Semantic Segmentationcited by 0
- 2026CLIP-RD: Relational Distillation for Efficient CLIP Knowledge Distillationcited by 0
- 2026Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervisioncited by 0
- 2026Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision28 Aug 2026
- 2026CLIP-RD: Relational Distillation for Efficient CLIP Knowledge Distillation26 Mar 2026
- 2026Generalizable Knowledge Distillation from Vision Foundation Models for Semantic Segmentation3 Mar 2026
- 2025MobileCLIP2: Improving Multi-Modal Reinforced Training28 Aug 2025
- 2025Context Aware Grounded Teacher for Source Free Object Detection21 Apr 2025
- 2024Active Data Curation Effectively Distills Large-Scale Multimodal Models27 Nov 2024
- 2023Improving CLIP Robustness with Knowledge Distillation and Self-Training19 Sep 2023
- 2023CLIP-KD: An Empirical Study of CLIP Model Distillation24 Jul 2023
- 2023MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation21 Mar 2023
- 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining25 Aug 2022
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approachescited by 7
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modelingcited by 5
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling2 Dec 2025
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar 2025
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generation8 Mar 2024
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approaches26 Jan 2024
- 2023Learning Interactive Real-World Simulators9 Oct 2023
- 2023Language Is Not All You Need: Aligning Perception with Language Models27 Feb 2023
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb 2023
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge17 Jun 2022
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 139
- 2025Preacher: Paper-to-Video Agentic Systemcited by 6
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 6
- 2025VC-Agent: An Interactive Agent for Customized Video Dataset Collectioncited by 1
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Conceptscited by 0
- 2026FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Constructioncited by 0
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026FineGen: A VLM-based Multi-Agent Framework for Fine-Grained Image-Text Dataset Construction2 Jun 2026
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Concepts11 Jan 2026
- 2025VC-Agent: An Interactive Agent for Customized Video Dataset Collection25 Sep 2025
- 2025Preacher: Paper-to-Video Agentic System13 Aug 2025
- 2025Magma: A Foundation Model for Multimodal AI Agents18 Feb 2025
- 2023From Sparse to Soft Mixtures of Expertscited by 248
- 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Expertscited by 203
- 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 138
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
- 2023Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perceptioncited by 19
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcyclingcited by 0
- 2026Enhancing Mixture-of-Experts Specialization via Cluster-Aware Upcycling15 Apr 2026
- 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generation3 Sep 2025
- 2024Aria: An Open Multimodal Native Mixture-of-Experts Model8 Oct 2024
- 2023From Sparse to Soft Mixtures of Experts2 Aug 2023
- 2023Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception10 May 2023
- 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts6 Jun 2022
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Datacited by 49
- 2024Zero-Shot Distillation for Image Encoders: How to Make Effective Use of Synthetic Datacited by 4
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptationcited by 1
- 2025mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data12 Feb 2025
- 2024Zero-Shot Distillation for Image Encoders: How to Make Effective Use of Synthetic Data25 Apr 2024
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptation29 Jun 2023
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models30 Jan 2023
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentationcited by 31
- 2025Survey of Vision-Language-Action Models for Embodied Manipulationcited by 7
- 2025Transferring Vision-Language-Action Models to Industry Applications: Architectures, Performance, and Challengescited by 4
- 2025Transferring Vision-Language-Action Models to Industry Applications: Architectures, Performance, and Challenges27 Sep 2025
- 2025Survey of Vision-Language-Action Models for Embodied Manipulation21 Aug 2025
- 2025Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentation8 Aug 2025
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun 2024
- 2023Language Prompt for Autonomous Drivingcited by 111
- 2023Language Prompt for Autonomous Driving8 Sep 2023
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
12 most cited of 791 All 791 (JSON)
- 2026KARAMEL: Knowledge-Aware Ranking for Multimodal Entity Linking in the Arts via Heterogeneous Graphs12 Oct 2026
- 2026DepthTile: Depth-Guided Existing-Image Self-Tiling with Input-Side Tileability Assessment12 Oct 2026
- 2026Dual-Mode Low-Rank Learner with Bridge-Prototype Ensemble for Vision-Language Class-Incremental Learning29 Sep 2026
- 2026ScAn-Bench: Evaluating Scaling Analysis Methodology28 Sep 2026
- 2026What Paired Evaluations Reveal under Visual Perturbations28 Sep 2026
- 2026TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking25 Sep 2026
- 2026TraceGuard: Adaptive Multimodal Poison Filtering through Cross-Feature Rank Agreement24 Sep 2026
- 2026A Data-Interventional Framework for Auditing Privacy and Fairness in Generative Medical Imaging22 Sep 2026
- 2026MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction17 Sep 2026
- 2026LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training25 Aug 2026
- 2026VersaDB: A High-Performance AI Storage Database for Unifying Mutimodal Datasets24 Aug 2026
- 2026Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval23 Aug 2026
12 newest of 791 All 791 (JSON)