Enhancing In-context Panoramic Generation via Geometric-aware Pretraining
Not on the map. Why?
Abstract (arXiv)
In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: https://zry000.github.io/Canvas360/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 77 of its 93 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
77 of 93 references.
References · 77
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
38 more
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2016Improved Techniques for Training GANscited by 2,938
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
- 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
50 most cited of 77 All 77 (JSON)
Built on by
Not cited yet.