Keeping it Local, Tiny and Real: Automated Report Generation on Edge Computing Devices for Mechatronic-Based Cognitive Systems
Not on the map. Why?
Abstract (arXiv)
Recent advancements in Deep Learning enable hardware-based cognitive systems, that is, mechatronic systems in general and robotics in particular with integrated Artificial Intelligence, to interact with dynamic and unstructured environments. While the results are impressive, the application of such systems to critical tasks like autonomous driving as well as service and care robotics necessitate the evaluation of large amount of heterogeneous data. Automated report generation for Mobile Robotics can play a crucial role in facilitating the evaluation and acceptance of such systems in various domains. In this paper, we propose a pipeline for generating automated reports in natural language utilizing various multi-modal sensors that solely relies on local models capable of being deployed on edge computing devices, thus preserving the privacy of all actors involved and eliminating the need for external services. In particular, we evaluate our implementation on a diverse dataset spanning multiple domains including indoor, outdoor and urban environments, providing quantitative as well as qualitative evaluation results. Various generated example reports and other supplementary materials are available via a public repository.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 48 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
27 of 48 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Segment Anythingcited by 8,158
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2023Scaling Open-Vocabulary Object Detectioncited by 335
15 more
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
- 2024World Models for Autonomous Driving: An Initial Surveycited by 79
- 2024FastVLM: Efficient Vision Encoding for Vision Language Modelscited by 76
- 2023A Survey of Techniques for Optimizing Transformer Inferencecited by 35
- 2024A Review of Multi-Modal Large Language and Vision Modelscited by 30
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Enginescited by 29
- 2024Is a 3D-Tokenized LLM the Key to Reliable Autonomous Driving?cited by 20
- 2024Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmarkcited by 19
- 2024Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Modelscited by 15
- 2024Blind Spots and Biases: Exploring the Role of Annotator Cognitive Biases in NLPcited by 11
- 2024TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Modelscited by 4
- 2025Small Vision-Language Models: A Survey on Compact Architectures and Techniquescited by 4
- 2024STAA: Spatio-Temporal Attention Attribution for Real-Time Interpreting Transformer-based Video Modelscited by 2
- 2025Vision Language Model-based Testing of Industrial Autonomous Mobile Robotscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.