OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflections
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Efforts to improve Large Language Model (LLM) agent performance on complex tasks have largely focused on fine-tuning and iterative self-correction. However, these approaches often lack generalizable mechanisms for longterm learning and remain inefficient in dynamic environments. We introduce OmniReflect, a hierarchical, reflection-driven framework that constructs a constitution, a compact set of guiding principles distilled from task experiences, to enhance the effectiveness and efficiency of an LLM agent. OmniReflect operates in two modes: Self-sustaining, where a single agent periodically curates its own reflections during task execution, and Co-operative, where a Meta-advisor derives a constitution from a small calibration set to guide another agent. To construct these constitutional principles, we employ Neural, Symbolic, and NeuroSymbolic techniques, offering a balance between contextual adaptability and computational efficiency. Empirical results averaged across models show major improvements in task success, with absolute gains of +10.3% on ALFWorld, +23.8% on BabyAI, and +8.3% on PDDL in the Self-sustaining mode. Similar gains are seen in the Co-operative mode, where a lightweight Qwen3-4B ReAct agent outperforms all Reflexion baselines on BabyAI. These findings highlight the robustness and effectiveness of OmniReflect across environments and backbones.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 23 of its 41 references that are in the map. First posted on arXiv 20 Jun 2025.
Builds on
23 of 41 references.
Closest ancestors · 2
Same direction, newest first
- 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agents2 Feb
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan
Other references · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
9 more
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 255
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
- 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 125
- 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 106
- 2023Answering Questions by Meta-Reasoning over Multiple Chains of Thoughtcited by 87
- 2020PDDLGym: Gym Environments from PDDL Problemscited by 45
- 2023Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinementcited by 43
- 2024Unleashing the Potential of Large Language Models as Prompt Optimizers: Analogical Analysis with Gradient-based Model Optimizerscited by 35
- 2023InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operatorscited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs
- 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forward
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
- 2024Controlling Large Language Model Agents with Entropic Activation Steering
- 2026MIRROR: A Hierarchical Benchmark for Metacognitive Calibration in Large Language Models
- 2026Computer Environments Elicit General Agentic Intelligence in LLMs
- 2023Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
- 2024Offline Training of Language Model Agents with Functions as Learnable Weights