e-Inu: Simulating A Quadruped Robot With Emotional Sentience
Not on the map. Why?
Abstract (arXiv)
Quadruped robots are currently used in industrial robotics as mechanical aid to automate several routine tasks. However, presently, the usage of such a robot in a domestic setting is still very much a part of the research. This paper discusses the understanding and virtual simulation of such a robot capable of detecting and understanding human emotions, generating its gait, and responding via sounds and expression on a screen. To this end, we use a combination of reinforcement learning and software engineering concepts to simulate a quadruped robot that can understand emotions, navigate through various terrains and detect sound sources, and respond to emotions using audio-visual feedback. This paper aims to establish the framework of simulating a quadruped robot that is emotionally intelligent and can primarily respond to audio-visual stimuli using motor or audio response. The emotion detection from the speech was not as performant as ERANNs or Zeta Policy learning, still managing an accuracy of 63.5%. The video emotion detection system produced results that are almost at par with the state of the art, with an accuracy of 99.66%. Due to its "on-policy" learning process, the PPO algorithm was extremely rapid to learn, allowing the simulated dog to demonstrate a remarkably seamless gait across the different cadences and variations. This enabled the quadruped robot to respond to generated stimuli, allowing us to conclude that it functions as predicted and satisfies the aim of this work.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 37 references that are in the map. First posted on arXiv 3 Jan 2023.
Builds on
8 of 37 references.
References · 8
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019Frame attention networks for facial expression recognition in videoscited by 56
- 2021ERANNs: Efficient Residual Audio Neural Networks for Audio Pattern Recognitioncited by 29
- 2016FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognitioncited by 25
- 2019Speech Sentiment Analysis via Pre-trained Features from End-to-end ASR Modelscited by 21
- 2021Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognitioncited by 18
- 2018Sentiment Analysis on Speaker Specific Speech Datacited by 6
- 2017Facial Emotion Detection Using Convolutional Neural Networks and Representational Autoencoder Unitscited by 2
Built on by
Not cited yet.