N0-Foundation: Towards the Age of Tactile Intelligence
Not on the map. Why?
Abstract (arXiv)
We present N0-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale multimodal data, tactile representation learning, and standardized evaluation. First, we engineer the infrastructure for scalable data collection, including a vision-based tactile sensor, a tactile Universal Manipulation Interface (UMI), and a synchronized visuo-tactile data collection system supporting both robot embodiments and UMI-based demonstrations. Leveraging this infrastructure, we construct NeoData, which contains more than 30000 hours of synchronized visual and tactile demonstrations, spanning six embodiments, 450 tasks, and billions of paired RGB and tactile frames collected through a mixture of real-robot teleoperation and UMI-based demonstrations. To facilitate open research, we further release OpenNeoData, a 5000-hour open-source subset of NeoData. The dataset addresses a central limitation of existing manipulation corpora, critical for deformable-object manipulation, precise assembly, delicate force control, and sustained surface interaction. Capitalizing on the large-scale, heterogeneous tactile measurements, we propose NeoForce, a visuo-tactile representation model that learn transferable tactile representations across different sensor designs. To enable systematic evaluation of tactile embodied models built upon our infrastructure, datasets and tactile representations, we further propose a comprehensive benchmark, which combines the real-world NeoReal suite and the simulated NeoSim suite for standardized evaluation. Experiments across both suites show that policies benefit from the physical contact state rather than from the device-specific appearance of the tactile signal. We release the dataset, the representation, and the benchmark, aiming at supporting future work on tactile-enabled embodied manipulation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 78 of its 92 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
78 of 92 references.
References · 78
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2014Going Deeper with Convolutionscited by 4,231
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
38 more
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2026World Action Models are Zero-shot Policiescited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 239
- 2025Unified Video Action Modelcited by 195
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2024UMI on Legs: Making Manipulation Policies Mobile with Manipulation-Centric Whole-body Controllerscited by 67
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2021Generic Event Boundary Detection: A Benchmark for Event Segmentationcited by 64
- 2025DexUMI: Using Human Hand as the Universal Manipulation Interface for Dexterous Manipulationcited by 58
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 49
- 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 48
- 2023cuRobo: Parallelized Collision-Free Minimum-Jerk Robot Motion Generationcited by 46
- 2021Taxim: An Example-based Simulation Model for GelSight Tactile Sensorscited by 42
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2024FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Datasetcited by 36
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 34
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 33
- 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 30
- 2025Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Grippercited by 29
- 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 27
50 most cited of 78 All 78 (JSON)
Built on by
Not cited yet.