mlsanityData to 14 Oct 2026

NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities

arXiv 2311.01454 ↗First posted 2 Nov 2023cs.RO cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

We present Neural Signal Operated Intelligent Robots (NOIR), a general-purpose, intelligent brain-robot interface system that enables humans to command robots to perform everyday activities through brain signals. Through this interface, humans communicate their intended objects of interest and actions to the robots using electroencephalography (EEG). Our novel system demonstrates success in an expansive array of 20 challenging, everyday household activities, including cooking, cleaning, personal care, and entertainment. The effectiveness of the system is improved by its synergistic integration of robot learning algorithms, allowing for NOIR to adapt to individual users and predict their intentions. Our work enhances the way humans interact with robots, replacing traditional channels of interaction with direct, neural communication. Project website: https://noir-corl.github.io/.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 28 of its 77 references that are in the map. First posted on arXiv 2 Nov 2023.

Builds on

28 of 77 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  3. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  4. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
  5. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  6. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  7. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
  8. 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 89
  9. 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
  10. 2021Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Taskscited by 78
  11. 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learningcited by 77
  12. 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 59
16 more
  1. 2023Behavior Retrieval: Few-Shot Imitation Learning by Querying Unlabeled Datasetscited by 58
  2. 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planningcited by 43
  3. 2019Leveraging Human Guidance for Deep Reinforcement Learning Taskscited by 42
  4. 2020Widening the Pipeline in Human-Guided Reinforcement Learning with Explanation and Context-Aware Data Augmentationcited by 42
  5. 2020Deep Affordance Foresight: Planning Through What Can Be Done in the Futurecited by 41
  6. 2020The EMPATHIC Framework for Task Learning from Implicit Human Feedbackcited by 38
  7. 2022LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulationcited by 34
  8. 2018AGIL: Learning Attention from Human for Visuomotor Taskscited by 32
  9. 2021One-Shot Affordance Detectioncited by 32
  10. 2022One-Shot Transfer of Affordance Regions? AffCorrs!cited by 31
  11. 2017Translating Videos to Commands for Robotic Manipulation with Deep Recurrent Neural Networkscited by 21
  12. 2022Generalizable Task Planning through Representation Pretrainingcited by 19
  13. 2023Primitive Skill-based Robot Learning from Human Evaluative Feedbackcited by 15
  14. 2019Accelerated Robot Learning via Human Brain Signalscited by 13
  15. 2021Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Taskscited by 13
  16. 2020Maximizing BCI Human Feedback using Active Learningcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 2.

8 papers.

  1. 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 89
  2. 2024Vision-based Manipulation from Single Human Video with Open-World Object Graphscited by 50
  3. 2024UMBRAE: Unified Multimodal Brain Decodingcited by 32
  4. 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activitiescited by 31
  5. 2025Gated Uncertainty-Aware Runtime Dual Invariants for Neural Signal-Controlled Roboticscited by 0
  6. 2025NOIR 2.0: Neural Signal Operated Intelligent Robots for Everyday Activitiescited by 0
  7. 2026Sim-and-Human Co-training for Data-Efficient and Scene-Generalizable Bimanual Manipulationcited by 0
  8. 2026EEG-VID: Task-Guided Latent Predictive Pretraining for EEG Decoding and Assistive Target Selectioncited by 0