Platform for Situated Intelligence
Not on the map. Why?
Abstract (arXiv)
We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities, a set of tools that enable visualization and debugging, and an ecosystem of components that encapsulate a variety of perception and processing technologies. These assets jointly provide the means for rapidly constructing and refining multimodal, integrative-AI systems, while retaining the efficiency and performance characteristics required for deployment in open-world settings.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 11 of its 44 references that are in the map. First posted on arXiv 29 Mar 2021.
Builds on
11 of 44 references.
References · 11
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2019Fixing the train-test resolution discrepancycited by 209
- 2018The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approachescited by 74
- 2017The Microsoft 2017 Conversational Speech Recognition Systemcited by 51
- 2017English Conversational Telephone Speech Recognition by Humans and Machinescited by 40
- 2016On Human Intellect and Machine Failures: Troubleshooting Integrative Machine Learning Systemscited by 18
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 2; 2024: 5; 2025: 1.
9 papers.
- 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysiscited by 18
- 2024The AffectToolbox: Affect Analysis for Everyonecited by 5
- 2024Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agentscited by 5
- 2023ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Modelscited by 3
- 2024PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videoscited by 3
- 2024TOM: A Development Platform For Wearable Intelligent Assistantscited by 3
- 2021Enabling a Social Robot to Process Social Cues to Detect when to Help a Usercited by 0
- 2024DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviourcited by 0
- 2025Dialogue Systems Engineering: A Survey and Future Directionscited by 0
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2024TOM: A Development Platform For Wearable Intelligent Assistants22 Jul 2024
- 2024DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour18 Jul 2024
- 2024Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents1 Jul 2024
- 2024PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videos14 Jun 2024
- 2024The AffectToolbox: Affect Analysis for Everyone23 Feb 2024
- 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis18 Aug 2023
- 2023ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models16 Jun 2023
- 2021Enabling a Social Robot to Process Social Cues to Detect when to Help a User18 Oct 2021