Disentangled Sequence Clustering for Human Intention Inference
Not on the map. Why?
Abstract (arXiv)
Equipping robots with the ability to infer human intent is a vital precondition for effective collaboration. Most computational approaches towards this objective derive a probability distribution of "intent" conditioned on the robot's perceived state. However, these approaches typically assume task-specific labels of human intent are known a priori. To overcome this constraint, we propose the Disentangled Sequence Clustering Variational Autoencoder (DiSCVAE), a clustering framework capable of learning such a distribution of intent in an unsupervised manner. The proposed framework leverages recent advances in unsupervised learning to disentangle latent representations of sequence data, separating time-varying local features from time-invariant global attributes. As a novel extension, the DiSCVAE also infers a discrete variable to form a latent mixture model and thus enable clustering over these global sequence concepts, e.g. high-level intentions. We evaluate the DiSCVAE on a real-world human-robot interaction dataset collected using a robotic wheelchair. Our findings reveal that the inferred discrete variable coincides with human intent, holding promise for collaborative settings, such as shared control.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 23 Jan 2021.
Builds on
33 of 58 references.
References · 33
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Neural Discrete Representation Learningcited by 4,650
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2017Advances in Variational Inferencecited by 236
- 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
- 2016Variational Deep Embedding: An Unsupervised and Generative Approach to Clusteringcited by 219
21 more
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
- 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
- 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
- 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
- 2018Recent Advances in Autoencoder-Based Representation Learningcited by 130
- 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
- 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 120
- 2018Disentangled Sequential Autoencodercited by 117
- 2016Sequential Neural Models with Stochastic Layerscited by 115
- 2018Hierarchical Generative Modeling for Controllable Speech Synthesiscited by 93
- 2017Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Datacited by 92
- 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 92
- 2018Learning Disentangled Joint Continuous and Discrete Representationscited by 83
- 2018Shared Autonomy via Deep Reinforcement Learningcited by 65
- 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59
- 2019Theory and Evaluation Metrics for Learning Disentangled Representationscited by 57
- 2017Z-Forcing: Training Stochastic Recurrent Networkscited by 51
- 2015Shared Autonomy via Hindsight Optimizationcited by 46
- 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
- 2019Controlling Assistive Robots with Learned Latent Actionscited by 28
- 2019Multi-modal Probabilistic Prediction of Interactive Behavior via an Interpretable Modelcited by 13
Built on by
Citing papers per year: 2023: 1.
1 paper.