mlsanityData to 7 Oct 2026

The Geometry of Sequential Learning: Lie-Bracket Prediction of Transfer Order

arXiv 2606.24993 ↗First posted 23 Jun 2026cs.LGcited by 8

On the map: LLM alignment / RLHF / preference optimisation → LLM preference optimization methods

Abstract (arXiv)

Sequential learning is order-dependent: from Pile-style next-token domain adaptation to instruction-SFT and DPO, N candidate sources induce N! possible curricula. We show that the local order effect is governed by a computable geometric quantity, the Lie-bracket commutator of gradient update fields, yielding a pairwise score for whether A->B or B->A is better for a target domain. The pairwise bracket primitive also defines a Lie-Bracket Tournament: with a shared theta_0 target-gradient reference, Hessian symmetry gives Borda/row-sum scores from one Hessian-vector product per source, O(N) dot products, and an O(N log N) sort, without materializing the O(N^2) edge matrix. Empirically, the planner reaches 98.1%/98.9% pairwise accuracy at k=1 for instruction-SFT/DPO, remains at 73.1%/72.2% at k=20, and preserves the original pretraining-domain evidence with 82.4-92.0% accuracy across four LLMs and 91.1% on diffusion. At curriculum scale, it recovers the best of all 3! schedules in 87.5% of trials, ranks 85 Stack programming-language source domains for a Python target in the 99th sampled percentile, and reaches the 99.0-99.6th sampled percentile on 56 MMLU subjects, sharply above the reported descending gradient-norm baseline. These results reframe sequential learning as a geometric tournament problem: commutators provide both local pairwise order information and a scalable primitive for many-domain schedules.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in LLM preference optimization methods, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 15 of its 34 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

15 of 34 references.

References · 15

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  5. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  6. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  7. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  8. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 565
  9. 2022Multi-Task Learning as a Bargaining Gamecited by 209
  10. 2020Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Modelscited by 167
  11. 2020Understanding Self-Training for Gradual Domain Adaptationcited by 149
  12. 2021Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learningcited by 16
3 more
  1. 2026Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 10
  2. 2025Commute Your Domains: Trajectory Optimality Criterion for Multi-Domain Learningcited by 9
  3. 2025Sequence Transferability and Task Order Selection in Continual Learningcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
  2. 2025Memory Determines Learning Direction: A Theory of Gradient-Based Optimization in State Space Models
  3. 2026Learning What to Imitate: Entropy-Aware Distribution Mixing
  4. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
  5. 2026Do Instruction-Tuned Models Always Perform Better Than Base Models? Evidence from Math and Domain-Shifted Benchmarks
  6. 2026A Comparative Analysis of Attention versus State-Space Models for In-Context Learning
  7. 2026The Complexity Ceiling Benchmark: A Multi-Domain Evaluation of Sequential Reasoning Under Depth Scaling
  8. 2026ForkLeft: Entropy-First Rollouts for Prefix-Aligned Autoregressive-to-Diffusion Distillation