NeAR: Coupled Neural Asset-Renderer Stack
Not on the map. Why?
Abstract (arXiv)
Neural asset authoring and neural rendering have traditionally evolved as disjoint paradigms: one generates digital assets for fixed graphics pipelines, while the other maps conventional assets to images. However, treating them as independent entities limits the potential for end-to-end optimization in fidelity and consistency. In this paper, we bridge this gap with NeAR, a Coupled Neural Asset--Renderer Stack. We argue that co-designing the asset representation and the renderer creates a robust "contract" for superior generation. On the asset side, we introduce the Lighting-Homogenized SLAT (LH-SLAT). Leveraging a rectified-flow model, NeAR lifts casually lit single images into a canonical, illumination-invariant latent space, effectively suppressing baked-in shadows and highlights. On the renderer side, we design a lighting-aware neural decoder tailored to interpret these homogenized latents. Conditioned on HDR environment maps and camera views, it synthesizes relightable 3D Gaussian splats in real-time without per-object optimization. We validate NeAR on four tasks: (1) G-buffer-based forward rendering, (2) random-lit reconstruction, (3) unknown-lit relighting, and (4) novel-view relighting. Extensive experiments demonstrate that our coupled stack outperforms state-of-the-art baselines in both quantitative metrics and perceptual quality. We hope this coupled asset-renderer perspective inspires future graphics stacks that view neural assets and renderers as co-designed components instead of independent entities.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 23 Nov 2025.
Builds on
52 of 63 references.
References · 52
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022A ConvNet for the 2020scited by 3,545
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023Vision Transformers Need Registerscited by 844
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
38 more
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
- 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
- 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
- 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Modelscited by 55
- 2023UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generationcited by 47
- 2024GS^3: Efficient Relighting with Triple Gaussian Splattingcited by 42
- 2023Relighting Neural Radiance Fields with Shadow and Highlight Hintscited by 41
- 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 38
- 2024A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesiscited by 37
- 2025LightLab: Controlling Light Sources in Images with Diffusion Modelscited by 36
- 2024IllumiNeRF: 3D Relighting Without Inverse Renderingcited by 29
- 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
- 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
- 2025RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illuminationcited by 23
- 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
- 2023TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshescited by 14
- 20253D Student Splatting and Scoopingcited by 14
- 2025Light of Normals: Unified Feature Representation for Universal Photometric Stereocited by 8
- 2023Relit-NeuLF: Efficient Relighting and Novel View Synthesis via Neural 4D Light Fieldcited by 7
- 2025ROGR: Relightable 3D Objects using Generative Relightingcited by 7
- 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generationcited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 7
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shadingcited by 1
- 2026LumiTokens: 3D Relighting via Token-Space Lighting Transformationcited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026LumiTokens: 3D Relighting via Token-Space Lighting Transformation18 Aug 2026
- 2026Monocular Avatar Reconstruction via Cascaded Diffusion Priors and UV-Space Differentiable Shading26 Jun 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026