mlsanityData to 7 Oct 2026

OpenLKA: An Open Dataset of Lane Keeping Assist from Recent Car Models under Real-world Driving Conditions

arXiv 2505.09092 ↗First posted 14 May 2025cs.CV cs.ROcited by 1

On the map: End-to-end autonomous driving → VLMs for autonomous driving

Abstract (arXiv)

Lane Keeping Assist (LKA) is widely adopted in modern vehicles, yet its real-world performance remains underexplored due to proprietary systems and limited data access. This paper presents OpenLKA, the first open, large-scale dataset for LKA evaluation and improvement. It includes 400 hours of driving data from 62 production vehicle models, collected through extensive road testing in Tampa, Florida and global contributions from the Comma.ai driving community. The dataset spans a wide range of challenging scenarios, including complex road geometries, degraded lane markings, adverse weather, lighting conditions and surrounding traffic. The dataset is multimodal, comprising: i) full CAN bus streams, decoded using custom reverse-engineered DBC files to extract key LKA events (e.g., system disengagements, lane detection failures); ii) synchronized high-resolution dash-cam video; iii) real-time outputs from Openpilot, providing accurate estimates of road curvature and lane positioning; iv) enhanced scene annotations generated by Vision Language Models, describing lane visibility, pavement quality, weather, lighting, and traffic conditions. By integrating vehicle-internal signals with high-fidelity perception and rich semantic context, OpenLKA provides a comprehensive platform for benchmarking the real-world performance of production LKA systems, identifying safety-critical operational scenarios, and assessing the readiness of current road infrastructure for autonomous driving. The dataset is publicly available at: https://github.com/OpenLKA/OpenLKA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLMs for autonomous driving, one of 9 directions in End-to-end autonomous driving. Builds on 8 of its 33 references that are in the map. First posted on arXiv 14 May 2025.

Builds on

8 of 33 references.

References · 8

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  5. 2019A Survey of Autonomous Driving: Common Practices and Emerging Technologiescited by 373
  6. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 201
  7. 2022Vision-Based Robust Lane Detection and Tracking under Different Challenging Environmental Conditionscited by 2
  8. 2024An Analysis of Driver-Initiated Takeovers during Assisted Driving and their Effect on Driver Satisfactioncited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025OpenLKA: an open dataset of lane keeping assist from market autonomous vehicles
  2. 2025Bridging Human Oversight and Black-box Driver Assistance: Vision-Language Models for Predictive Alerting in Lane Keeping Assist Systems
  3. 2025CleanMAP: Distilling Multimodal LLMs for Confidence-Driven Crowdsourced HD Map Updates
  4. 2022Towards Driving-Oriented Metric for Lane Detection Models
  5. 2024Developing, Analyzing, and Evaluating Vehicular Lane Keeping Algorithms Under Dynamic Lighting and Weather Conditions Using Electric Vehicles ↗
  6. 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Driving
  7. 2024Can LVLMs Obtain a Driver's License? A Benchmark Towards Reliable AGI for Autonomous Driving
  8. 2024XLD: A Cross-Lane Dataset for Benchmarking Novel Driving View Synthesis