mlsanityData to 7 Oct 2026

Learning Nonlinear Systems In-Context: From Synthetic Data to Real-World Motor Control

arXiv 2602.07173 ↗First posted 6 Feb 2026cs.LG cs.SY eess.SYcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving LLM agents

Abstract (arXiv)

LLMs have shown strong in-context learning (ICL) abilities, but have not yet been extended to signal processing systems. Inspired by their design, we have proposed for the first time ICL using transformer models applicable to motor feedforward control, a critical task where classical PI and physics-based methods struggle with nonlinearities and complex load conditions. We propose a transformer based model architecture that separates signal representation from system behavior, enabling both few-shot finetuning and one-shot ICL. Pretrained on a large corpus of synthetic linear and nonlinear systems, the model learns to generalize to unseen system dynamics of real-world motors only with a handful of examples. In experiments, our approach generalizes across multiple motor load configurations, transforms untuned examples into accurate feedforward predictions, and outperforms PI controllers and physics-based feedforward baselines. These results demonstrate that ICL can bridge synthetic pretraining and real-world adaptability, opening new directions for data efficient control of physical systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-evolving LLM agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 15 of its 18 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

15 of 18 references.

References · 15

  1. 2022A Survey on In-context Learningcited by 717
  2. 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 700
  3. 2022High Fidelity Neural Audio Compressioncited by 673
  4. 2023Transformers as Algorithms: Generalization and Stability in In-context Learningcited by 220
  5. 2023What Algorithms can Transformers Learn? A Study in Length Generalizationcited by 198
  6. 2024The Evolution of Statistical Induction Heads: In-Context Learning Markov Chainscited by 115
  7. 2023How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representationscited by 72
  8. 2023Pre-Training to Learn in Contextcited by 41
  9. 2023From system models to class models: An in-context learning paradigmcited by 13
  10. 2023On the adaptation of in-context learners for system identificationcited by 5
  11. 2024Synthetic data generation for system identification: leveraging knowledge transfer from similar systemscited by 4
  12. 2023Data-driven feedforward control design for nonlinear systems: A control-oriented system identification approachcited by 1
3 more
  1. 2024Meta-learning of data-driven controllers with automatic model reference tuning: theory and experimental case studycited by 1
  2. 2024Reinforcement Learning for Motor Control: A Comprehensive Reviewcited by 1
  3. 2025In-Context Learning for Zero-Shot Speed Estimation of BLDC motorscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overview
  2. 2024On Foundation Models for Dynamical Systems from Purely Synthetic Data
  3. 2025Probing In-Context Learning: Impact of Task Complexity and Model Architecture on Generalization and Efficiency
  4. 2026Local Linearity of LLMs Enables Activation Steering via Model-Based Linear Optimal Control
  5. 2026Diffusion Sequence Models for Generative In-Context Meta-Learning of Robot Dynamics
  6. 2026In-Context World Modeling for Robotic Control
  7. 2024Decision Transformer as a Foundation Model for Partially Observable Continuous Control
  8. 2023A Generalist Dynamics Model for Control