360Anything: Geometry-Free Lifting of Images and Videos to 360deg
Not on the map. Why?
Abstract (arXiv)
Lifting perspective images and videos to 360deg panoramas enables immersive 3D world generation. Existing approaches often rely on explicit geometric alignment between the perspective and the equirectangular projection (ERP) space. Yet, this requires known camera metadata, obscuring the application to in-the-wild data where such calibration is typically absent or noisy. We propose 360Anything, a geometry-free framework built upon pre-trained diffusion transformers. By treating the perspective input and the panorama target simply as token sequences, 360Anything learns the perspective-to-equirectangular mapping in a purely data-driven way, eliminating the need for camera information. Our approach achieves state-of-the-art performance on both image and video perspective-to-360deg generation, outperforming prior works that use ground-truth camera information. We also trace the root cause of the seam artifacts at ERP boundaries to zero-padding in the VAE encoder, and introduce Circular Latent Encoding to facilitate seamless generation. Finally, we show competitive results in zero-shot camera FoV and orientation estimation benchmarks, demonstrating 360Anything's deep geometric understanding and broader utility in computer vision tasks. Additional results are available at https://360anything.github.io/.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 85 of its 110 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
85 of 110 references.
References · 85
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018Demystifying MMD GANscited by 1,293
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2025Qwen-Image Technical Reportcited by 1,044
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024OmniGen: Unified Image Generationcited by 394
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2020How Much Position Information Do Convolutional Neural Networks Encode?cited by 172
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 161
- 2025Video World Models with Long-term Spatial Memorycited by 136
- 2021SPEC: Seeing People in the Wild with an Estimated Cameracited by 135
- 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2023PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigationcited by 77
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2024360DVD: Controllable Panorama Video Generation with 360-Degree Video Diffusion Modelcited by 58
- 2023LDM3D: Latent Diffusion Model for 3Dcited by 53
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPEcited by 2
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modelingcited by 1
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Spacecited by 1
- 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splattingcited by 0
- 2026SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360^circ Panorama Generationcited by 0
- 2026Can 4D Foundation Models Remember?cited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Can 4D Foundation Models Remember?17 Sep 2026
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul 2026
- 2026SpheRoPE: Zero-Shot Optimization-Free 360 Panorama Generation with Spherical RoPE30 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026SHERPA: Seam-aware Harmonized ERP Adaptation for Open-Domain 360^circ Panorama Generation10 Jun 2026
- 2026PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion
- 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion
- 2025PanoWorld-X: Generating Explorable Panoramic Worlds via Sphere-Aware Video Diffusion
- 2025Look Beyond: Two-Stage Scene View Generation via Panorama and Video Diffusion
- 2026Mover360: Controllable Object Manipulation in 360deg Panoramic Images
- 2025ViewPoint: Panoramic Video Generation with Pretrained Diffusion Models
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views