mlsanityData to 14 Oct 2026

A Two-Stage Framework for Ego-Centric Key Object Identification via Object State Prediction

arXiv 2609.07125 ↗First posted 7 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel framework designed to enhance key object identification in autonomous driving. Existing methods primarily focus on either detecting objects independently or leveraging visual relationships, but they do not explicitly consider the ego vehicle's perspective in determining object importance. To address this gap, we propose a structured approach that integrates a virtual ego-vehicle representation and a modular object state predictor, enabling a more accurate estimation of object behaviors relative to the ego-vehicle. Subsequently, our framework employs spatial-temporal reasoning to refine key object identification, prioritizing objects based on their states and relative spatial information rather than relying solely on visual relationships. Experimental results on real-world driving datasets demonstrate the effectiveness of our approach in accurately detecting critical objects in complex traffic environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

29 of 38 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  7. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
  8. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  9. 2015An Introduction to Convolutional Neural Networkscited by 514
  10. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
  11. 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 278
  12. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
17 more
  1. 2019Talk2Car: Taking Control of Your Self-Driving Carcited by 142
  2. 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 126
  3. 2020Explainable Object-induced Action Decision for Autonomous Vehiclescited by 88
  4. 2023Rank2Tell: A Multimodal Driving Dataset for Joint Importance Ranking and Reasoningcited by 63
  5. 2017Predicting Driver Attention in Critical Situationscited by 61
  6. 2020Scene-Graph Augmented Data-Driven Risk Assessment of Autonomous Vehicle Decisionscited by 34
  7. 2020Interaction Graphs for Object Importance Estimation in On-road Driving Videoscited by 15
  8. 2022Important Object Identification with Semi-Supervised Learning for Autonomous Drivingcited by 13
  9. 2020Road Scene Graph: A Semantic Graph-Based Scene Representation Dataset for Intelligent Vehiclescited by 12
  10. 2023End-To-End Planning of Autonomous Driving in Industry and Academia: 2022-2023cited by 11
  11. 2020Off The Beaten Sidewalk: Pedestrian Prediction In Shared Spaces For Autonomous Vehiclescited by 4
  12. 2022An Attention-guided Multistream Feature Fusion Network for Localization of Risky Objects in Driving Videoscited by 4
  13. 2023Learning Pedestrian Actions to Ensure Safe Autonomous Drivingcited by 4
  14. 2020Ego-motion and Surrounding Vehicle State Estimation Using a Monocular Cameracited by 3
  15. 2021Dilated Fully Convolutional Neural Network for Depth Estimation from a Single Imagecited by 2
  16. 2024Are you a robot? Detecting Autonomous Vehicles from Behavior Analysiscited by 2
  17. 2022Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Imagecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RiskWorld: Object-Centric Latent World Modeling for Autonomous Driving Risk Identification
  2. 2026FlowAD: Ego-Scene Interactive Modeling for Autonomous Driving
  3. 2024CarFormer: Self-Driving with Learned Object-Centric Representations
  4. 2026EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Driving
  5. 2020PLOP: Probabilistic poLynomial Objects trajectory Planning for autonomous driving
  6. 2025Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Driving
  7. 2026BLInD: Learning Driver Intent as a Distribution over Future Ego Trajectories
  8. 2026Causality-Aware End-to-End Autonomous Driving via Ego-Centric Joint Scene Modeling