Learning Physical Interaction: A Survey of Tactile- and Force-aware Robot Learning
Not on the map. Why?
Abstract (arXiv)
Physically grounded robot intelligence requires robots to perceive, reason about, and regulate their interactions with the physical world. This capability is particularly critical in contact-sensitive manipulation, where successful task execution depends not only on visual perception and motion generation, but also on force regulation and adaptive control. In this context, recent robot learning methods have made substantial progress by integrating force, tactile, vision, language, and proprioceptive sensing into learned manipulation policies. In parallel, many systems adopt multi-phase architectures that combine high-level policies, action-refinement modules, and low-level controllers to bridge semantic task understanding with reactive physical execution. Despite these advances, existing surveys have not explicitly reviewed force- and tactile-aware robot learning from a unified perspective that jointly captures multimodal sensing and multi-phase system design. This survey addresses this gap by proposing TF-ART, a Tactile/Force-Aware Robot learning Taxonomy for multimodal and multi-phase frameworks, which maps individual methods into a unified hierarchical structure. The framework characterizes how recent works organize observation modalities, encode and fuse heterogeneous sensory inputs, generate and refine actions across multiple phases, and connect learned policies to reactive robot-end control. Building on this methodological view, we further examine the task settings and infrastructure requirements of physical interaction, thereby integrating both algorithmic and practical perspectives on force- and tactile-aware robot learning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 101 of its 266 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
101 of 266 references.
References · 101
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2017Gated Multimodal Units for Information Fusioncited by 248
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 197
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 108
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 91
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 75
- 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 73
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 60
- 2025VTLA: Vision-Tactile-Language-Action Model with Preference Learning for Insertion Manipulationcited by 55
- 2026RoboReward: General-Purpose Vision-Language Reward Models for Roboticscited by 53
- 2025TLA: Tactile-Language-Action Model for Contact-Rich Manipulationcited by 47
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
- 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulationcited by 38
- 2025VLA-Touch: Enhancing Vision-Language-Action Models with Dual-Level Tactile Feedbackcited by 38
- 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensingcited by 38
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 36
- 2025FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learningcited by 34
- 2025TA-VLA: Elucidating the Design Space of Torque-aware Vision-Language-Action Modelscited by 32
- 2026LLM-as-a-Verifier: A General-Purpose Verification Frameworkcited by 30
- 2020Event-Driven Visual-Tactile Sensing and Learning for Robotscited by 29
- 2026Visuo-Tactile World Modelscited by 29
- 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulationcited by 22
- 2025Dexterous Manipulation through Imitation Learning: A Surveycited by 21
- 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignmentcited by 21
- 2025Tactile-VLA: Unlocking Vision-Language-Action Model's Physical Knowledge for Tactile Generalizationcited by 19
- 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulationcited by 19
- 2026Dream-Tac: A Unified Tactile World Action Model for Contact-Rich Robot Manipulationcited by 19
- 2025Learning to Feel the Future: DreamTacVLA for Contact-Rich Manipulationcited by 18
- 2026World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetrycited by 18
- 2026FD-VLA: Force-Distilled Vision-Language-Action Model for Contact-Rich Manipulationcited by 17
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 17
- 2025OPENTOUCH: Bringing Full-Hand Touch to Real-World Interactioncited by 15
- 2026FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulationcited by 15
50 most cited of 101 All 101 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.