Cognitive-YOLO: LLM-Driven Architecture Synthesis from First Principles of Data for Object Detection
Not on the map. Why?
Abstract (arXiv)
General-purpose object detection algorithms face a domain-shift bottleneck when deployed in vertical scenarios, and manually customizing a network architecture relies heavily on expert experience with high trial-and-error cost. To address these problems, we present Cognitive-YOLO, an adaptive object-detection model synthesis system driven by a large language model (LLM) collaborating with an autonomous agent. Cognitive-YOLO builds a fully automated Analyze--Synthesize--Compile pipeline. First, a data-profiling module quantitatively extracts dataset features, guiding a ReAct-paradigm agent to autonomously retrieve matching network modules from a curated component library. Second, the LLM performs logical reasoning and topological assembly conditioned on the data features, producing a specification-compliant neural architecture description. Finally, a backend hybrid compiler dynamically instantiates the model, closing the loop with end-to-end training and evaluation scheduling. Cross-validation on datasets including rail-surface defects and rice diseases shows that the lightweight models synthesized by Cognitive-YOLO markedly compress the parameter count (down to 1.9M) while matching or surpassing mainstream baselines such as YOLOv11n in [email protected]:0.95, effectively balancing model compactness and feature-representation capability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 32 references that are in the map. First posted on arXiv 13 Dec 2025.
Builds on
22 of 32 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
10 more
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 242
- 2023LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimizationcited by 86
- 2021Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognitioncited by 71
- 2024DEIM: DETR with Improved Matching for Fast Convergencecited by 67
- 2023LLM Performance Predictors are good initializers for Architecture Searchcited by 29
- 2024LPZero: Language Model Zero-cost Proxy Search from Zerocited by 7
- 2025LLM-Guided Evolution: An Autonomous Model Optimization for Object Detectioncited by 5
- 2025PhaseNAS: Language-Model Driven Architecture Search with Dynamic Phase Adaptationcited by 2
- 2025Beyond CNNs: Efficient Fine-Tuning of Multi-Modal LLMs for Object Detection on Low-Data Regimescited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detection
- 2026Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning
- 2025Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models
- 2025You Only Look Once at Anytime (AnytimeYOLO): Analysis and Optimization of Early-Exits for Object-Detection
- 2024YOLO-RD: Introducing Relevant and Compact Explicit Knowledge to YOLO by Retriever-Dictionary
- 2024DA-Ada: Learning Domain-Aware Adapter for Domain Adaptive Object Detection
- 2025Fine-Tuning Florence2 for Enhanced Object Detection in Un-constructed Environments: Vision-Language Model Approach
- 2023Towards A Unified Neural Architecture for Visual Recognition and Reasoning