mlsanityData to 14 Oct 2026

Text2Stereo: Repurposing Stable Diffusion for Stereo Generation with Consistency Rewards

arXiv 2506.05367 ↗First posted 27 May 2025cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

In this paper, we propose a novel diffusion-based approach to generate stereo images given a text prompt. Since stereo image datasets with large baselines are scarce, training a diffusion model from scratch is not feasible. Therefore, we propose leveraging the strong priors learned by Stable Diffusion and fine-tuning it on stereo image datasets to adapt it to the task of stereo generation. To improve stereo consistency and text-to-image alignment, we further tune the model using prompt alignment and our proposed stereo consistency reward functions. Comprehensive experiments demonstrate the superiority of our approach in generating high-quality stereo images across diverse scenarios, outperforming existing methods.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 46 of its 54 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

46 of 54 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  11. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
34 more
  1. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  2. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  5. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  6. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  7. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
  8. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  9. 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
  10. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  11. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  12. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  13. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  14. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
  15. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  16. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  17. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
  18. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  19. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  20. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  21. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
  22. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
  23. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  24. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  25. 2018Layer-structured 3D Scene Inference via View Synthesiscited by 82
  26. 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
  27. 2023Optimizing DDPM Sampling with Shortcut Fine-Tuningcited by 81
  28. 2016Memory-Efficient Backpropagation Through Timecited by 78
  29. 2023NeRF-Supervised Deep Stereocited by 46
  30. 2023Text2Immersion: Generative Immersive Scene with 3D Gaussianscited by 43
  31. 2020Holopix50k: A Large-Scale In-the-wild Stereo Image Datasetcited by 36
  32. 2024StereoDiffusion: Training-Free Stereo Image Generation Using Latent Diffusion Modelscited by 25
  33. 2023Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuningcited by 22
  34. 2023SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Imagescited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Integrating Reinforcement Learning with Visual Generative Models: Foundations and Advancescited by 12
  2. 2026StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generation
  2. 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
  3. 2024VividDreamer: Towards High-Fidelity and Efficient Text-to-3D Generation
  4. 2023If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selection
  5. 2026Adaptive Auxiliary Prompt Blending for Target-Faithful Diffusion Generation
  6. 2025Reusing Computation in Text-to-Image Diffusion for Efficient Generation of Image Sets
  7. 2023DreamDistribution: Learning Prompt Distribution for Diverse In-distribution Generation
  8. 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion