FT-NCFM: An Influence-Aware Data Distillation Framework for Efficient VLA Models
On the map: Vision-language-action models → VLA architectures and generalization
Abstract (arXiv)
The powerful generalization of Vision-Language-Action (VLA) models is bottlenecked by their heavy reliance on massive, redundant, and unevenly valued datasets, hindering their widespread application. Existing model-centric optimization paths, such as model compression (which often leads to performance degradation) or policy distillation (whose products are model-dependent and lack generality), fail to fundamentally address this data-level challenge. To this end, this paper introduces FT-NCFM, a fundamentally different, data-centric generative data distillation framework. Our framework employs a self-contained Fact-Tracing (FT) engine that combines causal attribution with programmatic contrastive verification to assess the intrinsic value of samples. Guided by these assessments, an adversarial NCFM process synthesizes a model-agnostic, information-dense, and reusable data asset. Experimental results on several mainstream VLA benchmarks show that models trained on just 5% of our distilled coreset achieve a success rate of 85-90% compared with training on the full dataset, while reducing training time by over 80%. Our work demonstrates that intelligent data distillation is a highly promising new path for building efficient, high-performance VLA models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
32 of 40 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
20 more
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
- 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 83
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulationcited by 69
- 2022Zero-Shot Temporal Action Detection via Vision-Language Promptingcited by 65
- 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
- 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
- 2025Dataset Distillation with Neural Characteristic Function: A Minmax Perspectivecited by 45
- 2023Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Correctionscited by 44
- 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
- 2025DataMIL: Selecting Data for Robot Imitation Learning with Datamodelscited by 25
- 2023BotanicGarden: A High-Quality Dataset for Robot Navigation in Unstructured Natural Environmentscited by 21
- 2024Empowering Embodied Manipulation: A Bimanual-Mobile Robot Manipulation Dataset for Household Taskscited by 19
- 2024Zero-Shot Coreset Selection via Iterative Subspace Samplingcited by 9
- 2024UniGraspTransformer: Simplified Policy Distillation for Scalable Dexterous Robotic Graspingcited by 9
- 2024Revisiting inverse Hessian vector products for calculating influence functionscited by 8
- 2025DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Roboticscited by 8
- 2025Distillation-PPO: A Novel Two-Stage Reinforcement Learning Framework for Humanoid Robot Perceptive Locomotioncited by 7
- 2023TreeScope: An Agricultural Robotics Dataset for LiDAR-Based Mapping of Trees in Forests and Orchardscited by 4
- 2024Continual Policy Distillation of Reinforcement Learning-based Controllers for Soft Robotic In-Hand Manipulationcited by 4
- 2025The Impact of Coreset Selection on Spurious Correlations and Group Robustnesscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026VLA Foundry: A Unified Framework for Training Vision-Language-Action Models
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy
- 2026CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models
- 2026FastOPD: On-Policy Distillation for Lightweight VLA Deployment
- 2026VLANeXt: Recipes for Building Strong VLA Models
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
- 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models