# Meta-Objects: Interactive and Multisensory Virtual Objects Learned from the Real World for Use in Augmented Reality

arXiv: https://arxiv.org/abs/2404.17179 · HTML: https://mlsanity.com/paper/2404.17179/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Apr 2024.

## Built on by (most cited first, 4 of 4)

- [SceneLinker: Compositional 3D Scene Generation via Semantic Scene Graph from RGB Sequences](https://mlsanity.com/paper/2602.02974/) (2026)
- [MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins](https://mlsanity.com/paper/2603.12936/) (2026)
- [From Speech-to-Spatial: Grounding Utterances on A Live Shared View with Augmented Reality](https://mlsanity.com/paper/2602.03059/) (2026)
- [SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes](https://mlsanity.com/paper/2609.19815/) (2026)

## Abstract (arXiv)

We introduce the concept of a meta-object, a next-generation virtual object that inherits the form, properties, and functions of its real-world counterpart, enabling seamless synchronization, interaction, and sharing between the physical and virtual worlds. While plenty of today's virtual objects provide some sensory feedback and dynamic behavior, meta-objects fully integrate interactive and multisensory features within a structured data framework to enable real-time immersive experiences in a post-metaverse intelligent simulation platform. Three key components underpin the utilization of meta-objects in the post-metaverse: property-embedded modeling for physical and action realism, adaptive multisensory feedback tailored to user interactions, and a scene graph-based intelligence simulation platform for scalable and efficient ecosystem integration. By leveraging meta-objects through wearable AR/VR devices, the post-metaverse facilitates seamless interactions that transcend spatial and temporal barriers, paving the way for a transformative reality-virtuality convergence.