# Mixed Reality Interface for Digital Twin of Plant Factory

arXiv: https://arxiv.org/abs/2211.00597 · HTML: https://mlsanity.com/paper/2211.00597/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 33 references that are in the map.
- First posted on arXiv 29 Oct 2022.

## Builds on (most cited first, 10 of 10)

- [D-NeRF: Neural Radiance Fields for Dynamic Scenes](https://mlsanity.com/paper/2011.13961/) (2020)
- [Nerfies: Deformable Neural Radiance Fields](https://mlsanity.com/paper/2011.12948/) (2020)
- [Depth-supervised NeRF: Fewer Views and Faster Training for Free](https://mlsanity.com/paper/2107.02791/) (2021)
- [NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images](https://mlsanity.com/paper/2111.13679/) (2021)
- [NeRF-VAE: A Geometry Aware 3D Scene Generative Model](https://mlsanity.com/paper/2104.00587/) (2021)
- [E-NeRF: Neural Radiance Fields from a Moving Event Camera](https://mlsanity.com/paper/2208.11300/) (2022)
- [S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint](https://mlsanity.com/paper/2210.08936/) (2022)
- [Machine learning approach to remove ion interference effect in agricultural nutrient solutions](https://mlsanity.com/paper/1907.10794/) (2019)
- [ODE network model for nonlinear and complex agricultural nutrient solution system](https://mlsanity.com/paper/1907.10800/) (2019)
- [Control of nonlinear, complex and black-boxed greenhouse system with reinforcement learning](https://mlsanity.com/paper/1907.12690/) (2019)

## Built on by (most cited first, 1 of 1)

- [CongNaMul: A Dataset for Advanced Image Processing of Soybean Sprouts](https://mlsanity.com/paper/2308.15690/) (2023)

## Abstract (arXiv)

An easier and intuitive interface architecture is necessary for digital twin of plant factory. I suggest an immersive and interactive mixed reality interface for digital twin models of smart farming, for remote work rather than simulation of components. The environment is constructed with UI display and a streaming background scene, which is a real time scene taken from camera device located in the plant factory, processed with deformable neural radiance fields. User can monitor and control the remote plant factory facilities with HMD or 2D display based mixed reality environment. This paper also introduces detailed concept and describes the system architecture to implement suggested mixed reality interface.