mlsanityData to 7 Oct 2026

Enhancing In-context Panoramic Generation via Geometric-aware Pretraining

arXiv 2607.08765 ↗First posted 9 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: https://zry000.github.io/Canvas360/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 77 of its 93 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

77 of 93 references.

References · 77

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  10. 2022Scalable Diffusion Models with Transformerscited by 5,931
  11. 2022Generative Adversarial Networkscited by 5,603
  12. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
38 more
  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2016Improved Techniques for Training GANscited by 2,938
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  13. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  14. 2025Qwen-Image Technical Reportcited by 973
  15. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  16. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  17. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  18. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  19. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  20. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  21. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  22. 2025Mean Flows for One-step Generative Modelingcited by 524
  23. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  24. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  25. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  26. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  27. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  28. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  29. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
  30. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  31. 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
  32. 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
  33. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  34. 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
  35. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
  36. 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
  37. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
  38. 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55

50 most cited of 77 All 77 (JSON)

Built on by

Not cited yet.