mlsanityData to 14 Oct 2026

PRISM: A Predictive Protocol for Permutation Optimization via Landscape Diagnostics

arXiv 2608.08344 ↗First posted 8 Aug 2026cs.LG cs.AI math.OCcited by 0

Not on the map. Why?

Abstract (arXiv)

Permutation optimization arises whenever the components of a system are fixed but their ordering affects performance. We introduce PRISM, a predictive protocol for permutation optimization that measures a fitness landscape before selecting a search strategy. PRISM uses inexpensive landscape diagnostics, including one-step move autocorrelation and fitness-distance correlation, to predict useful mutation operators, identify when structured search is likely to outperform random sampling, and detect regimes in which search provides little advantage. Across synthetic permutation landscapes, neural architecture benchmarks, scientific machine learning pipelines, and large-language-model instruction ordering, the protocol makes testable predictions about search behavior before optimization begins. Exhaustive instruction-ordering experiments reveal substantial performance variation induced solely by permutation, while cross-model experiments show that useful ordering structure can transfer across model families and task difficulty. Additional experiments demonstrate that instruction ordering remains consequential after prompt wording is optimized, indicating that content optimization and ordering optimization are complementary. The results position PRISM not as a universally superior optimizer, but as a framework for determining when permutation search is useful, which representation and operator should be used, and when simpler alternatives are preferable.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

16 of 23 references.

References · 16

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  6. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  7. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  8. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  9. 2023Large Language Models as Optimizerscited by 864
  10. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  11. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  12. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
4 more
  1. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
  2. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  3. 2022On Fitness Landscape Analysis of Permutation Problems: From Distance Metrics to Mutation Operator Selectioncited by 2
  4. 2026Lost in the Prompt Order: Revealing the Limitations of Causal Attention in Language Modelscited by 2

Built on by

Not cited yet.