mlsanityData to 7 Oct 2026

Disentangled Sequence Clustering for Human Intention Inference

arXiv 2101.09500 ↗First posted 23 Jan 2021cs.RO cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Equipping robots with the ability to infer human intent is a vital precondition for effective collaboration. Most computational approaches towards this objective derive a probability distribution of "intent" conditioned on the robot's perceived state. However, these approaches typically assume task-specific labels of human intent are known a priori. To overcome this constraint, we propose the Disentangled Sequence Clustering Variational Autoencoder (DiSCVAE), a clustering framework capable of learning such a distribution of intent in an unsupervised manner. The proposed framework leverages recent advances in unsupervised learning to disentangle latent representations of sequence data, separating time-varying local features from time-invariant global attributes. As a novel extension, the DiSCVAE also infers a discrete variable to form a latent mixture model and thus enable clustering over these global sequence concepts, e.g. high-level intentions. We evaluate the DiSCVAE on a real-world human-robot interaction dataset collected using a robotic wheelchair. Our findings reveal that the inferred discrete variable coincides with human intent, holding promise for collaborative settings, such as shared control.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 23 Jan 2021.

Builds on

33 of 58 references.

References · 33

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2013Auto-Encoding Variational Bayescited by 3,980
  4. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  5. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  6. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  7. 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
  8. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  9. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
  10. 2017Advances in Variational Inferencecited by 236
  11. 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
  12. 2016Variational Deep Embedding: An Unsupervised and Generative Approach to Clusteringcited by 219
21 more
  1. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  2. 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
  3. 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
  4. 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
  5. 2018Recent Advances in Autoencoder-Based Representation Learningcited by 130
  6. 2018Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objectscited by 128
  7. 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 120
  8. 2018Disentangled Sequential Autoencodercited by 117
  9. 2016Sequential Neural Models with Stochastic Layerscited by 115
  10. 2018Hierarchical Generative Modeling for Controllable Speech Synthesiscited by 93
  11. 2017Unsupervised Learning of Disentangled and Interpretable Representations from Sequential Datacited by 92
  12. 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 92
  13. 2018Learning Disentangled Joint Continuous and Discrete Representationscited by 83
  14. 2018Shared Autonomy via Deep Reinforcement Learningcited by 65
  15. 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59
  16. 2019Theory and Evaluation Metrics for Learning Disentangled Representationscited by 57
  17. 2017Z-Forcing: Training Stochastic Recurrent Networkscited by 51
  18. 2015Shared Autonomy via Hindsight Optimizationcited by 46
  19. 2018Probabilistic Prediction of Vehicle Semantic Intention and Motioncited by 31
  20. 2019Controlling Assistive Robots with Learned Latent Actionscited by 28
  21. 2019Multi-modal Probabilistic Prediction of Interactive Behavior via an Interpretable Modelcited by 13

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.