# Manboformer: Learning Gaussian Representations via Spatial-temporal Attention Mechanism

arXiv: https://arxiv.org/abs/2503.04863 · HTML: https://mlsanity.com/paper/2503.04863/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 20 of its 28 references that are in the map.
- First posted on arXiv 6 Mar 2025.

## Builds on (most cited first, 20 of 20)

- [nuScenes: A multimodal dataset for autonomous driving](https://mlsanity.com/paper/1903.11027/) (2019)
- [Deformable DETR: Deformable Transformers for End-to-End Object Detection](https://mlsanity.com/paper/2010.04159/) (2020)
- [Occupancy Networks: Learning 3D Reconstruction in Function Space](https://mlsanity.com/paper/1812.03828/) (2018)
- [BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers](https://mlsanity.com/paper/2203.17270/) (2022)
- [BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation](https://mlsanity.com/paper/2205.13542/) (2022)
- [BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View](https://mlsanity.com/paper/2112.11790/) (2021)
- [Tri-Perspective View for Vision-Based 3D Semantic Occupancy Prediction](https://mlsanity.com/paper/2302.07817/) (2023)
- [BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework](https://mlsanity.com/paper/2205.13790/) (2022)
- [GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Prediction](https://mlsanity.com/paper/2405.17429/) (2024)
- [3D Object Detection from Images for Autonomous Driving: A Survey](https://mlsanity.com/paper/2202.02980/) (2022)
- [Time Efficiency in Optimization with a Bayesian-Evolutionary Algorithm](https://mlsanity.com/paper/2005.04166/) (2020)
- [Vision-Based Human Pose Estimation via Deep Learning: A Survey](https://mlsanity.com/paper/2308.13872/) (2023)
- [Learning Directed Locomotion in Modular Robots with Evolvable Morphologies](https://mlsanity.com/paper/2001.07804/) (2020)
- [Learning Locomotion Skills in Evolvable Robots](https://mlsanity.com/paper/2010.09531/) (2020)
- [A Semantic Web Technology Index](https://mlsanity.com/paper/2201.07034/) (2022)
- [Class Binarization to NeuroEvolution for Multiclass Classification](https://mlsanity.com/paper/2308.13876/) (2023)
- [A Virtual Reality Training System for Automotive Engines Assembly and Disassembly](https://mlsanity.com/paper/2311.02108/) (2023)
- [The Key Artificial Intelligence Technologies in Early Childhood Education: A Review](https://mlsanity.com/paper/2401.05403/) (2023)
- [SUSTechGAN: Image Generation for Object Detection in Adverse Conditions of Autonomous Driving](https://mlsanity.com/paper/2408.01430/) (2024)
- [DIR-BHRNet: A Lightweight Network for Real-time Vision-based Multi-person Pose Estimation on Smartphones](https://mlsanity.com/paper/2407.13777/) (2024)

## Abstract (arXiv)

Compared with voxel-based grid prediction, in the field of 3D semantic occupation prediction for autonomous driving, GaussianFormer proposed using 3D Gaussian to describe scenes with sparse 3D semantic Gaussian based on objects is another scheme with lower memory requirements. Each 3D Gaussian function represents a flexible region of interest and its semantic features, which are iteratively refined by the attention mechanism. In the experiment, it is found that the Gaussian function required by this method is larger than the query resolution of the original dense grid network, resulting in impaired performance. Therefore, we consider optimizing GaussianFormer by using unused temporal information. We learn the Spatial-Temporal Self-attention Mechanism from the previous grid-given occupation network and improve it to GaussianFormer. The experiment was conducted with the NuScenes dataset, and the experiment is currently underway.