mlsanityData to 7 Oct 2026

FT-NCFM: An Influence-Aware Data Distillation Framework for Efficient VLA Models

arXiv 2511.16233 ↗First posted 20 Nov 2025cs.ROcited by 1

On the map: Vision-language-action models → VLA architectures and generalization

Abstract (arXiv)

The powerful generalization of Vision-Language-Action (VLA) models is bottlenecked by their heavy reliance on massive, redundant, and unevenly valued datasets, hindering their widespread application. Existing model-centric optimization paths, such as model compression (which often leads to performance degradation) or policy distillation (whose products are model-dependent and lack generality), fail to fundamentally address this data-level challenge. To this end, this paper introduces FT-NCFM, a fundamentally different, data-centric generative data distillation framework. Our framework employs a self-contained Fact-Tracing (FT) engine that combines causal attribution with programmatic contrastive verification to assess the intrinsic value of samples. Guided by these assessments, an adversarial NCFM process synthesizes a model-agnostic, information-dense, and reusable data asset. Experimental results on several mainstream VLA benchmarks show that models trained on just 5% of our distilled coreset achieve a success rate of 85-90% compared with training on the full dataset, while reducing training time by over 80%. Our work demonstrates that intelligent data distillation is a highly promising new path for building efficient, high-performance VLA models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

32 of 40 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  5. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  6. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  7. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  8. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  9. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  10. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  11. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  12. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
20 more
  1. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
  2. 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 83
  3. 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulationcited by 69
  4. 2022Zero-Shot Temporal Action Detection via Vision-Language Promptingcited by 65
  5. 2023A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Modelscited by 61
  6. 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
  7. 2025Dataset Distillation with Neural Characteristic Function: A Minmax Perspectivecited by 45
  8. 2023Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Correctionscited by 44
  9. 2025ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Modelscited by 43
  10. 2025DataMIL: Selecting Data for Robot Imitation Learning with Datamodelscited by 25
  11. 2023BotanicGarden: A High-Quality Dataset for Robot Navigation in Unstructured Natural Environmentscited by 21
  12. 2024Empowering Embodied Manipulation: A Bimanual-Mobile Robot Manipulation Dataset for Household Taskscited by 19
  13. 2024Zero-Shot Coreset Selection via Iterative Subspace Samplingcited by 9
  14. 2024UniGraspTransformer: Simplified Policy Distillation for Scalable Dexterous Robotic Graspingcited by 9
  15. 2024Revisiting inverse Hessian vector products for calculating influence functionscited by 8
  16. 2025DRAE: Dynamic Retrieval-Augmented Expert Networks for Lifelong Learning and Task Adaptation in Roboticscited by 8
  17. 2025Distillation-PPO: A Novel Two-Stage Reinforcement Learning Framework for Humanoid Robot Perceptive Locomotioncited by 7
  18. 2023TreeScope: An Agricultural Robotics Dataset for LiDAR-Based Mapping of Trees in Forests and Orchardscited by 4
  19. 2024Continual Policy Distillation of Reinforcement Learning-based Controllers for Soft Robotic In-Hand Manipulationcited by 4
  20. 2025The Impact of Coreset Selection on Spurious Correlations and Group Robustnesscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLA Foundry: A Unified Framework for Training Vision-Language-Action Models
  2. 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
  3. 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy
  4. 2026CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models
  5. 2026FastOPD: On-Policy Distillation for Lightweight VLA Deployment
  6. 2026VLANeXt: Recipes for Building Strong VLA Models
  7. 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
  8. 2026Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models