mlsanityData to 7 Oct 2026

NeAR: Coupled Neural Asset-Renderer Stack

arXiv 2511.18600 ↗First posted 23 Nov 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Neural asset authoring and neural rendering have traditionally evolved as disjoint paradigms: one generates digital assets for fixed graphics pipelines, while the other maps conventional assets to images. However, treating them as independent entities limits the potential for end-to-end optimization in fidelity and consistency. In this paper, we bridge this gap with NeAR, a Coupled Neural Asset--Renderer Stack. We argue that co-designing the asset representation and the renderer creates a robust "contract" for superior generation. On the asset side, we introduce the Lighting-Homogenized SLAT (LH-SLAT). Leveraging a rectified-flow model, NeAR lifts casually lit single images into a canonical, illumination-invariant latent space, effectively suppressing baked-in shadows and highlights. On the renderer side, we design a lighting-aware neural decoder tailored to interpret these homogenized latents. Conditioned on HDR environment maps and camera views, it synthesizes relightable 3D Gaussian splats in real-time without per-object optimization. We validate NeAR on four tasks: (1) G-buffer-based forward rendering, (2) random-lit reconstruction, (3) unknown-lit relighting, and (4) novel-view relighting. Extensive experiments demonstrate that our coupled stack outperforms state-of-the-art baselines in both quantitative metrics and perceptual quality. We hope this coupled asset-renderer perspective inspires future graphics stacks that view neural assets and renderers as co-designed components instead of independent entities.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

52 of 63 references.

References · 52

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022A ConvNet for the 2020scited by 3,545
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023Vision Transformers Need Registerscited by 844
  10. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  12. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
38 more
  1. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  2. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  3. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  4. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
  5. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
  6. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
  7. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  8. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  9. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  10. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  11. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
  12. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  13. 2024RGBleftrightarrowX: Image decomposition and synthesis using material- and lighting-aware diffusion modelscited by 159
  14. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  15. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  16. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  17. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  18. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
  19. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  20. 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Modelscited by 55
  21. 2023UniDream: Unifying Diffusion Priors for Relightable Text-to-3D Generationcited by 47
  22. 2024GS^3: Efficient Relighting with Triple Gaussian Splattingcited by 42
  23. 2023Relighting Neural Radiance Fields with Shadow and Highlight Hintscited by 41
  24. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 38
  25. 2024A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesiscited by 37
  26. 2025LightLab: Controlling Light Sources in Images with Diffusion Modelscited by 36
  27. 2024IllumiNeRF: 3D Relighting Without Inverse Renderingcited by 29
  28. 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
  29. 2024RelitLRM: Generative Relightable Radiance for Large Reconstruction Modelscited by 23
  30. 2025RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illuminationcited by 23
  31. 2024TAR3D: Creating High-Quality 3D Assets via Next-Part Predictioncited by 16
  32. 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
  33. 2023TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshescited by 14
  34. 20253D Student Splatting and Scoopingcited by 14
  35. 2025Light of Normals: Unified Feature Representation for Universal Photometric Stereocited by 8
  36. 2023Relit-NeuLF: Efficient Relighting and Novel View Synthesis via Neural 4D Light Fieldcited by 7
  37. 2025ROGR: Relightable 3D Objects using Generative Relightingcited by 7
  38. 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generationcited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.