MEC3O: Multi-Expert Consensus for Code Time Complexity Prediction
Not on the map. Why?
Abstract (arXiv)
Predicting the complexity of source code is essential for software development and algorithm analysis. Recently, Baik et al. (2025) introduced CodeComplex for code time complexity prediction. The paper shows that LLMs without fine-tuning struggle with certain complexity classes. This suggests that no single LLM excels at every class, but rather each model shows advantages in certain classes. We propose MEC3O, a multi-expert consensus system, which extends the multi-agent debate frameworks. MEC3O assigns LLMs to complexity classes based on their performance and provides them with class-specialized instructions, turning them into experts. These experts engage in structured debates, and their predictions are integrated through a weighted consensus mechanism. Our expertise assignments to LLMs effectively handle Degeneration-of-Thought, reducing reliance on a separate judge model, and preventing convergence to incorrect majority opinions. Experiments on CodeComplex show that MEC3O outperforms the open-source baselines, achieving at least 10% higher accuracy and macro-F1 scores. It also surpasses GPT-4o-mini in macro-F1 scores on average and demonstrates competitive on-par F1 scores to GPT-4o and GPT-o4-mini on average. This demonstrates the effectiveness of multi-expert debates and weight consensus strategy to generate the final predictions. Our code and data is available at https://github.com/suhanmen/MECO.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
20 of 34 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
- 2023Using an LLM to Help With Code Understandingcited by 222
- 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 153
8 more
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 123
- 2023Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)cited by 72
- 2019Macro F1 and Macro F1cited by 70
- 2023Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognitioncited by 48
- 2024A Performance Study of LLM-Generated Code on Leetcodecited by 48
- 2024Analyzing the Performance of Large Language Models on Code Summarizationcited by 19
- 2019Learning based Methods for Code Runtime Complexity Predictioncited by 5
- 2024CodeComplex: Dataset for Worst-Case Time Complexity Predictioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025BigO(Bench): Can LLMs Generate Code with Controlled Time and Space Complexity?
- 2026FormulaCode: Evaluating Agentic Optimization on Large Codebases
- 2025MARCO: Multi-Agent Code Optimization with Real-Time Knowledge Integration for High-Performance Computing
- 2026How Generation Architecture Shapes Code Complexity in Multi-Agent LLM Systems: A Paired Study on HumanEval
- 2024Self-Organized Agents: A LLM Multi-Agent Framework toward Ultra Large-Scale Code Generation and Optimization
- 2025SwiftSolve: A Self-Iterative, Complexity-Aware Multi-Agent Framework for Competitive Programming
- 2026OctoBench: Benchmarking Scaffold-Aware Instruction Following in Repository-Grounded Agentic Coding
- 2025MCTS-Judge: Test-Time Scaling in LLM-as-a-Judge for Code Correctness Evaluation