Visual Hide and Seek
Not on the map. Why?
Abstract (arXiv)
We train embodied agents to play Visual Hide and Seek where a prey must navigate in a simulated environment in order to avoid capture from a predator. We place a variety of obstacles in the environment for the prey to hide behind, and we only give the agents partial observations of their environment using an egocentric perspective. Although we train the model to play this game from scratch, experiments and visualizations suggest that the agent learns to predict its own visibility in the environment. Furthermore, we quantitatively analyze how agent weaknesses, such as slower speed, effect the learned policy. Our results suggest that, although agent weaknesses make the learning problem more challenging, they also cause more useful features to be learned. Our project website is available at: http://www.cs.columbia.edu/ ~bchen/visualhideseek/.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 0; 2023: 4; 2024: 3; 2025: 1.
13 papers.
Sort:
By area:
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2023An Unbiased Look at Datasets for Visuo-Motor Pre-Trainingcited by 41
- 2021GridToPix: Training Embodied Agents with Minimal Supervisioncited by 20
- 2023Adaptive Coordination in Social Embodied Rearrangementcited by 14
- 2024CREW: Facilitating Human-AI Teaming Researchcited by 11
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledgecited by 10
- 2021Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds numbercited by 7
- 2023LEMMA: Learning Language-Conditioned Multi-Robot Manipulationcited by 7
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2025CREW-WILDFIRE: Benchmarking Agentic Multi-Agent Collaborations at Scalecited by 5
- 2024Enabling Multi-Robot Collaboration from Single-Human Guidancecited by 3
- 2024GUIDE: Real-Time Human-Shaped Agentscited by 3
- 2025CREW-WILDFIRE: Benchmarking Agentic Multi-Agent Collaborations at Scale7 Jul 2025
- 2024GUIDE: Real-Time Human-Shaped Agents19 Oct 2024
- 2024Enabling Multi-Robot Collaboration from Single-Human Guidance30 Sep 2024
- 2024CREW: Facilitating Human-AI Teaming Research31 Jul 2024
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots19 Oct 2023
- 2023An Unbiased Look at Datasets for Visuo-Motor Pre-Training13 Oct 2023
- 2023LEMMA: Learning Language-Conditioned Multi-Robot Manipulation2 Aug 2023
- 2023Adaptive Coordination in Social Embodied Rearrangement31 May 2023
- 2021Visual design intuition: Predicting dynamic properties of beams from raw cross-section images14 Nov 2021
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledge20 Sep 2021
- 2021Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number16 Jun 2021
- 2021Visual Perspective Taking for Opponent Behavior Modeling11 May 2021
1 more
- 2021GridToPix: Training Embodied Agents with Minimal Supervision14 Apr 2021
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 220
- 2023An Unbiased Look at Datasets for Visuo-Motor Pre-Trainingcited by 41
- 2021GridToPix: Training Embodied Agents with Minimal Supervisioncited by 20
- 2023Adaptive Coordination in Social Embodied Rearrangementcited by 14
- 2024CREW: Facilitating Human-AI Teaming Researchcited by 11
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledgecited by 10
- 2021Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds numbercited by 7
- 2023LEMMA: Learning Language-Conditioned Multi-Robot Manipulationcited by 7
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2024Enabling Multi-Robot Collaboration from Single-Human Guidancecited by 3
- 2024GUIDE: Real-Time Human-Shaped Agentscited by 3
- 2021Visual design intuition: Predicting dynamic properties of beams from raw cross-section imagescited by 0
- 2024GUIDE: Real-Time Human-Shaped Agents19 Oct 2024
- 2024Enabling Multi-Robot Collaboration from Single-Human Guidance30 Sep 2024
- 2024CREW: Facilitating Human-AI Teaming Research31 Jul 2024
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots19 Oct 2023
- 2023An Unbiased Look at Datasets for Visuo-Motor Pre-Training13 Oct 2023
- 2023LEMMA: Learning Language-Conditioned Multi-Robot Manipulation2 Aug 2023
- 2023Adaptive Coordination in Social Embodied Rearrangement31 May 2023
- 2021Visual design intuition: Predicting dynamic properties of beams from raw cross-section images14 Nov 2021
- 2021Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledge20 Sep 2021
- 2021Reinforcement learning for pursuit and evasion of microswimmers at low Reynolds number16 Jun 2021
- 2021Visual Perspective Taking for Opponent Behavior Modeling11 May 2021
- 2021GridToPix: Training Embodied Agents with Minimal Supervision14 Apr 2021