TwistedMerge: Certified Higher-Order Diagnostics and Abstention for Model Merging
Not on the map. Why?
Abstract (arXiv)
Model merging combines independently trained or fine-tuned models, but pairwise alignability does not imply globally consistent alignment. We formulate merging as a finite descent problem in which checkpoints are local objects, alignment maps are transitions, and cycle products are residuals. TwistedMerge is a conservative certification pipeline that separates fixed-chart averaging, synchronization-removable gauge inconsistency, a certified central obstruction on a specified comparison complex, and nonabelian holonomy. A residual is promoted to a cohomology class only after inverse-consistency, coefficient-identification, centrality, and closure tests; otherwise the method abstains and returns an ordinary or synchronized fallback. We prove a constant-edge no-go result, frozen-complex three-way and predeclared-family error-control theorems, and a refinement test for comparison-complex sensitivity. A planted neural alignment defect is removed by cycle-consistent synchronization, showing that a nonzero cycle score alone is not a higher obstruction. Controlled central systems recover the predicted non-coboundary and projective-rank behavior, while noisy estimates move from certification to abstention without false lifts on the tested controls. A trained low-rank-adapter audit shows that naive factor averaging depends on the chosen GLr representative, whereas global factor synchronization and dense-delta SVD are stable. On natural checkpoint collections, cycle residuals do not predict merge degradation and no natural central or period-index class is certified. The results position descent theory as a falsifiable certification and abstention framework.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
13 of 38 references.
References · 13
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
- 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 471
- 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
- 2018Tropical Geometry of Deep Neural Networkscited by 95
- 2019On the Expressive Power of Deep Polynomial Neural Networkscited by 66
- 2024The Real Tropical Geometry of Neural Networkscited by 24
- 2025Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometrycited by 21
- 2024C2M3: Cycle-Consistent Multi-Model Mergingcited by 20
- 2025A Systematic Study of In-the-Wild Model Merging for Large Language Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.