Data Leakage in Automotive Perception: Practitioners' Insights
Not on the map. Why?
Abstract (arXiv)
Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliability of machine learning (ML) models in safety-critical systems such as automotive perception. While leakage is widely recognized in research, little is known about how industrial practitioners actually perceive and manage it in practice. This study investigates practitioners' knowledge, experiences, and mitigation strategies around data leakage through ten semi-structured interviews with system design, development, and verification engineers working on automotive perception functions development. Using reflexive thematic analysis, we identify that knowledge of data leakage is widespread and fragmented along role boundaries: ML engineers conceptualize it as a data-splitting or validation issue, whereas design and verification roles interpret it in terms of representativeness and scenario coverage. Detection commonly arises through generic considerations and observed performance anomalies rather than implying specific tools. However, data leakage prevention is more commonly practiced, which depends mostly on experience and knowledge sharing. These findings suggest that leakage control is a socio-technical coordination problem distributed across roles and workflows. We discuss implications for ML reliability engineering, highlighting the need for shared definitions, traceable data practices, and continuous cross-role communication to institutionalize data leakage awareness within automotive ML development.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 28 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
11 of 28 references.
References · 11
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2018Safely Entering the Deep: A Review of Verification and Validation for Machine Learning and a Challenge Elicitation in the Automotive Industrycited by 38
- 2020Adoption and Effects of Software Engineering Best Practices in Machine Learningcited by 33
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2023On Leakage in Machine Learning Pipelinescited by 7
- 2020A Review on Near Duplicate Detection of Images using Computer Vision Techniquescited by 4
- 2023Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challengescited by 4
- 2024On Train-Test Class Overlap and Detection for Image Retrievalcited by 3
Built on by
Not cited yet.