mlsanityData to 14 Oct 2026

Answer Engineering: Local Trajectory Editing for Protocol-Constrained Decision Making in Large Language Models

arXiv 2606.21121 ↗First posted 19 Jun 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models can produce confident but protocol-invalid answers in domains where procedural compliance is critical. This paper presents Answer Engineering, a deterministic runtime and authoring layer that applies localized rule-guided interventions to the visible reasoning trajectory during standard autoregressive generation, without retraining, modifying model weights, or performing global search. The method is evaluated on a controlled clinical benchmark for sudden sensorineural hearing loss (SSNHL), where correct management depends on protocol-consistent interpretation of symptom timing, Weber/Rinne tuning-fork findings, and otoscopic findings. In the benchmark, step-by-step reasoning shifted rather than eliminated errors: compliant outcomes for SSNHL decreased from 54.5% under unguided generation to 25.1%, while acceptance on the conductive contrast condition increased from 1.6% to 58.9%. Local trajectory editing increased SSNHL compliance to 83.5% and conductive-case adherence to 77.9%, raising balanced accuracy from 42.0% under reasoning-only generation to 80.7%. The results support a systems-level view in which protocol adherence can be improved through auditable runtime control of reasoning trajectories, while also identifying limitations caused by rule coverage, trigger reliability, and persistent diagnosis-first generation dynamics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 48 references that are in the map. First posted on arXiv 19 Jun 2026.

Builds on

29 of 48 references.

References · 29

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Let's Verify Step by Stepcited by 3,789
  7. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  9. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  10. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  11. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  12. 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
17 more
  1. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
  2. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
  3. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  4. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
  5. 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
  6. 2023Faithful Chain-of-Thought Reasoningcited by 288
  7. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
  8. 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 170
  9. 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160
  10. 2023SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoningcited by 159
  11. 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoningcited by 110
  12. 2024Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Modelscited by 105
  13. 2024Controllable Text Generation for Large Language Models: A Surveycited by 57
  14. 2024DeAL: Decoding-time Alignment for Large Language Modelscited by 55
  15. 2024Automata-based constraints for language model decodingcited by 51
  16. 2025Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewardscited by 24
  17. 2023Towards A Unified View of Answer Calibration for Multi-Step Reasoningcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
  2. 2026PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
  3. 2025Learning to Steer: Input-dependent Steering for Multimodal LLMs
  4. 2026Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent
  5. 2025A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist
  6. 2026Uncertainty-Guided Latent Diagnostic Trajectory Learning for Sequential Clinical Diagnosis
  7. 2026EvalQReason: A Framework for Step-Level Reasoning Evaluation in Large Language Models
  8. 2026Words to World: Benchmarking LLMs in Interactive Physical Environments