mlsanityData to 7 Oct 2026

NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code

arXiv 2603.00805 ↗First posted 28 Feb 2026cs.CV cs.MAcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

The proliferation of neural radiance field (NeRF) research requires significant efforts to reimplement papers before building upon them. We introduce NERFIFY, a multi-agent framework that reliably converts NeRF research papers into trainable Nerfstudio plugins, in contrast to generic paper-to-code methods and frontier models like GPT-5 that usually fail to produce runnable code. NERFIFY achieves domain-specific executability through six key innovations: (1) Context-free grammar (CFG): LLM synthesis is constrained by Nerfstudio formalized as a CFG, ensuring generated code satisfies architectural invariants. (2) Graph-of-Thought code synthesis: Specialized multi-file-agents generate repositories in topological dependency order, validating contracts and errors at each node. (3) Compositional citation recovery: Agents automatically retrieve and integrate components (samplers, encoders, proposal networks) from citation graphs of references. (4) Visual feedback: Artifacts are diagnosed through PSNR-minima ROI analysis, cross-view geometric validation, and VLM-guided patching to iteratively improve quality. (5) Knowledge enhancement: Beyond reproduction, methods can be improved with novel optimizations. (6) Benchmarking: An evaluation framework is designed for NeRF paper-to-code synthesis across 30 diverse papers. On papers without public implementations, NERFIFY achieves visual quality matching expert human code (+/-0.5 dB PSNR, +/-0.2 SSIM) while reducing implementation time from weeks to minutes. NERFIFY demonstrates that a domain-aware design enables code translation for complex vision papers, potentiating accelerated and democratized reproducible research. Code, data and implementations will be publicly released.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 65 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

56 of 65 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025ResearchCodeAgent: An LLM Multi-Agent System for Automated Codification of Research Methodologies28 Apr

Other references · 55

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  9. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2023Teaching Large Language Models to Self-Debugcited by 963
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
38 more
  1. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
  2. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  4. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  5. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  6. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  7. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  8. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
  9. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
  10. 2024AutoCodeRover: Autonomous Program Improvementcited by 272
  11. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  12. 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
  13. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
  14. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 108
  15. 2019A Step Toward Quantifying Independently Reproducible Machine Learning Researchcited by 77
  16. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  17. 2023SeaThru-NeRF: Neural Radiance Fields in Scattering Mediacited by 75
  18. 2022E-NeRF: Neural Radiance Fields from a Moving Event Cameracited by 70
  19. 2025Paper2Code: Automating Code Generation from Scientific Papers in Machine Learningcited by 67
  20. 2023Clover: Closed-Loop Verifiable Code Generationcited by 62
  21. 2023Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedracited by 57
  22. 2021NeRF in detail: Learning to sample for view synthesiscited by 35
  23. 2024The Scene Language: Representing Scenes with Programs, Words, and Embeddingscited by 31
  24. 2023L2MAC: Large Language Model Automatic Computer for Extensive Code Generationcited by 30
  25. 2025AutoReproduce: Automatic AI Experiment Reproduction with Paper Lineagecited by 29
  26. 2025Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agentscited by 19
  27. 2025AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Paperscited by 18
  28. 2025RPG: A Repository Planning Graph for Unified and Scalable Codebase Generationcited by 18
  29. 2023PyNeRF: Pyramidal Neural Radiance Fieldscited by 16
  30. 2024Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?cited by 15
  31. 2025DeepCode: Open Agentic Codingcited by 14
  32. 2024SIGNeRF: Scene Integrated Generation for Neural Radiance Fieldscited by 11
  33. 2025Reflective Paper-to-Code Reproduction Enabled by Fine-Grained Verificationcited by 9
  34. 2023Efficient Ray Sampling for Radiance Fields Reconstructioncited by 8
  35. 2024Combining LLM Code Generation with Formal Specifications and Reactive Program Synthesiscited by 7
  36. 2023Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fieldscited by 6
  37. 2023L0-Sampler: An L0 Model Guided Volume Sampling for NeRFcited by 4
  38. 2024BioNeRF: Biologically Plausible Neural Radiance Fields for View Synthesiscited by 4

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code
  2. 2025PaperDebugger: A Plugin-Based Multi-Agent System for In-Editor Academic Writing, Review, and Editing
  3. 2026On Accelerating Grounded Code Development for Research
  4. 2026PaperClaw: Harnessing Agents for Autonomous Research and Human-in-the-Loop Refinement
  5. 2026Crafter: A Multi-Agent Harness for Editable Scientific Figure Generation from Diverse Inputs
  6. 2026SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions
  7. 2026DIAGPaper: Diagnosing Valid and Specific Weaknesses in Scientific Papers via Multi-Agent Reasoning
  8. 2026SA-Bench: Evaluating Semantic Alignment in LLM-Based Paper Reproduction