RenderFormer++: Scalable and Physics-Informed Feed-Forward Neural Rendering
Not on the map. Why?
Abstract (arXiv)
We present RenderFormer++, a scalable and physics-informed feed-forward neural rendering framework for global illumination in mesh scenes. Existing Transformer-based neural rendering methods such as RenderFormer achieve promising cross-scene generalization, but lack explicit transport priors and scale poorly due to quadratic triangle-level attention. To address these issues, we introduce Physics-Informed Transport Guidance (PITG), which embeds rendering-equation-inspired inductive biases into the attention mechanism and introduces a transport consistency loss, encouraging physics-informed light transport modeling. We further propose Hierarchical Object-Centric Tokenization (HOCT), which aggregates triangle-level features into compact object-level tokens via cross-attention with learnable queries, substantially reducing computational and memory costs. Extensive experiments demonstrate that RenderFormer++ achieves scalable and generalizable feed-forward global illumination rendering across complex large-scale scenes with competitive rendering quality and substantially improved efficiency over RenderFormer. The code will be made publicly available upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
12 of 28 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2021Real-time Neural Radiance Caching for Path Tracingcited by 91
- 2021Neural Radiositycited by 33
- 2025RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illuminationcited by 23
- 2022Active Exploration for Neural Global Illumination of Variable Scenescited by 11
- 2025Neural Parametric Mixtures for Path Guidingcited by 7
- 2023Online Neural Path Guiding with Normalized Anisotropic Spherical Gaussianscited by 6
Built on by
Not cited yet.