DuET: Dual Execution for Test Output Prediction with Generated Code and Pseudocode
Not on the map. Why?
Abstract (arXiv)
This work addresses test output prediction, a key challenge in test case generation. To improve the reliability of predicted outputs by LLMs, prior approaches generate code first to ground predictions. One grounding strategy is direct execution of generated code, but even minor errors can cause failures. To address this, we introduce LLM-based pseudocode execution, which grounds prediction on more error-resilient pseudocode and simulates execution via LLM reasoning. We further propose DuET, a dual-execution framework that combines both approaches by functional majority voting. Our analysis shows the two approaches are complementary in overcoming the limitations of direct execution suffering from code errors, and pseudocode reasoning from hallucination. On LiveCodeBench, DuET achieves the state-of-the-art performance, improving Pass@1 by 13.6 pp.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
25 of 36 references.
References · 25
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
- 2022CodeT: Code Generation with Generated Testscited by 384
- 2024CRUXEval: A Benchmark for Code Reasoning, Understanding and Executioncited by 300
13 more
- 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
- 2024DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositoriescited by 72
- 2023CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modulescited by 58
- 2022Interactive Code Generation via Test-Driven User-Intent Formalizationcited by 50
- 2025No Prompt Left Behind: Exploiting Zero-Variance Prompts in LLM Reinforcement Learning via Entropy-Guided Advantage Shapingcited by 50
- 2023Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistencycited by 46
- 2023CodeCoT: Tackling Code Syntax Errors in CoT Reasoning for Code Generationcited by 29
- 2024Large Language Models as Test Case Generators: Performance Evaluation and Enhancementcited by 28
- 2024CoCoST: Automatic Complex Code Generation with Online Searching and Correctness Testingcited by 8
- 2020Semantic Scaffolds for Pseudocode-to-Code Generationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025S*: Test Time Scaling for Code Generation
- 2025LLM4VV: Evaluating Cutting-Edge LLMs for Generation and Evaluation of Directive-Based Parallel Programming Model Compiler Tests ↗
- 2025Unify and Triumph: Polyglot, Diverse, and Self-Consistent Generation of Unit Tests with LLMs
- 2024LeDex: Training LLMs to Better Self-Debug and Explain Code
- 2024Large-scale, Independent and Comprehensive study of the power of LLMs for test case generation
- 2026Execution-Anchored Hallucination Calibration Reranking for Verilog Code Generation ↗
- 2026On the risk of coding before testing: An empirical study on LLM-based test generation workflow
- 2026Consistency Meets Verification: Enhancing Test Generation Quality in Large Language Models Without Ground-Truth Solutions