mlsanityData to 14 Oct 2026

Sage Deer: A Super-Aligned Driving Generalist Is Your Copilot

arXiv 2505.10257 ↗First posted 15 May 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The intelligent driving cockpit, an important part of intelligent driving, needs to match different users' comfort, interaction, and safety needs. This paper aims to build a Super-Aligned and GEneralist DRiving agent, SAGE DeeR. Sage Deer achieves three highlights: (1) Super alignment: It achieves different reactions according to different people's preferences and biases. (2) Generalist: It can understand the multi-view and multi-mode inputs to reason the user's physiological indicators, facial emotions, hand movements, body movements, driving scenarios, and behavioral decisions. (3) Self-Eliciting: It can elicit implicit thought chains in the language space to further increase generalist and super-aligned abilities. Besides, we collected multiple data sets and built a large-scale benchmark. This benchmark measures the deer's perceptual decision-making ability and the super alignment's accuracy.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 62 references that are in the map. First posted on arXiv 15 May 2025.

Builds on

37 of 62 references.

References · 37

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  5. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  7. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  8. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  9. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
  10. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  11. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  12. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
25 more
  1. 2023LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Modelcited by 602
  2. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  3. 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
  4. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  5. 2023PandaGPT: One Model To Instruction-Follow Them Allcited by 334
  6. 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
  7. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
  8. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
  9. 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 105
  10. 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehiclescited by 100
  11. 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehiclescited by 72
  12. 2023Personalized Autonomous Driving with Large Language Models: Field Experimentscited by 48
  13. 2020DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysiscited by 47
  14. 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 47
  15. 2020Driver Anomaly Detection: A Dataset and Contrastive Learning Approachcited by 41
  16. 2023AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perceptioncited by 39
  17. 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
  18. 2016Brain4Cars: Car That Knows Before You Do via Sensory-Fusion Deep Learning Architecturecited by 31
  19. 2023Neuron Structure Modeling for Generalizable Remote Physiological Measurementcited by 31
  20. 2019Driver Distraction Identification with an Ensemble of Convolutional Neural Networkscited by 26
  21. 2023Image Enhancement for Remote Photoplethysmography in a Low-Light Environmentcited by 23
  22. 2023Human-Centric Autonomous Systems With LLMs for User Command Reasoningcited by 22
  23. 2024GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computingcited by 22
  24. 2021The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimationcited by 19
  25. 2018Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets with Multi-stream Inputscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  2. 2026MILD: Mediator Agent System with Bidirectional Perception and Multi-Layered Alignment for Human-Vehicle Collaborationcited by 2