# CONVERGE: A Multi-Agent Vision-Radio Architecture for xApps

arXiv: https://arxiv.org/abs/2508.04556 · HTML: https://mlsanity.com/paper/2508.04556/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 12 of its 26 references that are in the map.
- First posted on arXiv 6 Aug 2025.

## Builds on (most cited first, 12 of 12)

- [YOLOv3: An Incremental Improvement](https://mlsanity.com/paper/1804.02767/) (2018)
- [BoT-SORT: Robust Associations Multi-Pedestrian Tracking](https://mlsanity.com/paper/2206.14651/) (2022)
- [A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems](https://mlsanity.com/paper/1902.10265/) (2019)
- [Integrated Sensing and Communications: Towards Dual-functional Wireless Networks for 6G and Beyond](https://mlsanity.com/paper/2108.07165/) (2021)
- [Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoff](https://mlsanity.com/paper/2102.09527/) (2021)
- [Millimeter Wave Base Stations with Cameras: Vision Aided Beam and Blockage Prediction](https://mlsanity.com/paper/1911.06255/) (2019)
- [ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communications](https://mlsanity.com/paper/1911.06257/) (2019)
- [Towards Intelligent Millimeter and Terahertz Communication for 6G: Computer Vision-aided Beamforming](https://mlsanity.com/paper/2209.02258/) (2022)
- [VOMTC: Vision Objects for Millimeter and Terahertz Communications](https://mlsanity.com/paper/2409.09330/) (2024)
- [Intelligent Closed-loop RAN Control with xApps in OpenRAN Gym](https://mlsanity.com/paper/2208.14877/) (2022)
- [SLICES, a scientific instrument for the networking community](https://mlsanity.com/paper/2502.09783/) (2025)
- [Vision-Radio Experimental Infrastructure Architecture Towards 6G](https://mlsanity.com/paper/2402.19416/) (2024)

## Abstract (arXiv)

Telecommunications and computer vision have evolved independently. With the emergence of high-frequency wireless links operating mostly in line-of-sight, visual data can help predict the channel dynamics by detecting obstacles and help overcoming them through beamforming or handover techniques. This paper proposes a novel architecture for delivering real-time radio and video sensing information to O-RAN xApps through a multi-agent approach, and introduces a new video function capable of generating blockage information for xApps, enabling Integrated Sensing and Communications. Experimental results show that the delay of sensing information remains under 1,ms and that an xApp can successfully use radio and video sensing information to control the 5G/6G RAN in real-time.