mlsanityData to 14 Oct 2026

Logical Judgments Under Pressure: Diagnosing Syllogistic Stability with Learned Soft Prefixes

arXiv 2607.18228 ↗First posted 20 Jul 2026cs.AI cs.CLcited by 0

On the map: Mixture-of-experts → MoE large language models

Abstract (arXiv)

To test how correct logical judgments respond to learned context, we prepend a soft prefix to an exactly labeled syllogistic reasoning benchmark while keeping the model fixed. Soft prefixes are opaque continuous vectors, so we characterize them through the behavior they induce across controlled variations in logical form and interface. By studying which prefixes succeed and how their effects generalize, we characterize how learned contextual pressure can override correct judgments and expose limits in a model's logical stability. Across Qwen3.6-35B-A3B MoE, Qwen3-8B, and Gemma 4 31B, learned prefixes redirect many correct answers and remain effective across unseen forms and interface changes. In repeated tests with Qwen3.6 MoE and Gemma, they outperform paired random controls in all 16 model--direction--split comparisons by 37 to 99 percentage points. Qwen3.6 MoE flip rates remain between 72% and 90% across wording and prompt changes, while Gemma validity prefixes retain 54% to 56% flip compared with less than 1% for matched random prefixes. Diagnostic tests show that the dominant effect is a broad preference for one answer meaning rather than fixed-symbol forcing or a logical operation that transfers reliably between tasks. The form of this bias differs across models. In both Qwen models, simple score models often predict which judgments will flip but not how far their margins will move, whereas Gemma's overall response is more closely approximated by the same models. These results show that the dominant behavioral effect of successful soft prefixes is a broad answer preference, while the remaining response reveals substantial model-specific differences in logical stability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE large language models, one of 12 directions in Mixture-of-experts. Builds on 22 of its 25 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

22 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May

Other references · 21

  1. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  6. 2023Steering Language Models With Activation Engineeringcited by 922
  7. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  8. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  9. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 722
  10. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 391
  11. 2023Towards Best Practices of Activation Patching in Language Models: Metrics and Methodscited by 359
  12. 2022Language models show human-like content effects on reasoning taskscited by 173
9 more
  1. 2024Soft Prompt Threats: Attacking Safety Alignment and Unlearning in Open-Source LLMs through the Embedding Spacecited by 91
  2. 2023A Systematic Comparison of Syllogistic Reasoning in Humans and Language Modelscited by 20
  3. 2023Evaluating Large Language Models with NeuBAROCO: Syllogistic Reasoning Ability and Human-like Biasescited by 14
  4. 2024A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferencescited by 13
  5. 2024SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoningcited by 9
  6. 2022Can Transformers Reason in Fragments of Natural Language?cited by 8
  7. 2024Sphere Neural-Networks for Rational Reasoningcited by 3
  8. 2025BIS Reasoning 1.0: The First Large-Scale Japanese Benchmark for Belief-Inconsistent Syllogistic Reasoningcited by 2
  9. 2026Data-driven Machine Learning Cannot Reach Symbolic-level Logical Reasoning -- The Limit of the Scaling Lawcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Does Prefix Matter in Reasoning Model Tuning?
  2. 2026Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure
  3. 2026Reasoning Stabilization Point: A Training-Time Signal for Stable Evidence and Shortcut Reliance
  4. 2026Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
  5. 2025Internal Reasoning vs. External Control: A Thermodynamic Analysis of Sycophancy in Large Language Models
  6. 2026Vernier: Probing Representational Misalignment Behind Lexical Gaps in Causal Reasoning
  7. 2026When Decodability Is Not Enough: Logical Validity Representations, Behavioral Dissociation, and Causal Tests in Language Models
  8. 2026Pressure, What Pressure? Sycophancy Disentanglement in Language Models via Reward Decomposition