# Linking Vision and Multi-Agent Communication through Visible Light Communication using Event Cameras

arXiv: https://arxiv.org/abs/2402.05619 · HTML: https://mlsanity.com/paper/2402.05619/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Feb 2024.

## Built on by (most cited first, 5 of 5)

- [Motion-Aware Optical Camera Communication with Event Cameras](https://mlsanity.com/paper/2412.00816/) (2024)
- [MoCom: Motion-based Inter-MAV Visual Communication Using Event Vision and Spiking Neural Networks](https://mlsanity.com/paper/2510.14770/) (2025)
- [Event-based Optical Marker Systems: A survey](https://mlsanity.com/paper/2504.20736/) (2025)
- [Event Interval Modulation: A Novel Scheme for Event-based Optical Camera Communication](https://mlsanity.com/paper/2510.14245/) (2025)
- [Experimental Demonstration of Event-based Optical Camera Communication in Long-Range Outdoor Environment](https://mlsanity.com/paper/2510.14266/) (2025)

## Abstract (arXiv)

Various robots, rovers, drones, and other agents of mass-produced products are expected to encounter scenes where they intersect and collaborate in the near future. In such multi-agent systems, individual identification and communication play crucial roles. In this paper, we explore camera-based visible light communication using event cameras to tackle this problem. An event camera captures the events occurring in regions with changes in brightness and can be utilized as a receiver for visible light communication, leveraging its high temporal resolution. Generally, agents with identical appearances in mass-produced products are visually indistinguishable when using conventional CMOS cameras. Therefore, linking visual information with information acquired through conventional radio communication is challenging. We empirically demonstrate the advantages of a visible light communication system employing event cameras and LEDs for visual individual identification over conventional CMOS cameras with ArUco marker recognition. In the simulation, we also verified scenarios where our event camera-based visible light communication outperforms conventional radio communication in situations with visually indistinguishable multi-agents. Finally, our newly implemented multi-agent system verifies its functionality through physical robot experiments.
