LEMUR 2: Unlocking Neural Network Diversity for AI
Not on the map. Why?
Abstract (arXiv)
Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain or deployment-aware evaluation. LEMUR 2 introduces a large-scale, extensible framework unifying generative, evaluative, and deployment pipelines to unlock neural-network diversity. It comprises over 14,000 distinct architectures and more than 750,000 structured training records documenting model performance, hyperparameters, and task outcomes. These models were produced through AST-based code mutation, genetic and reinforcement-learning evolution, generation of fractal architectures, and synthesis guided by a Large Language Model (LLM). This includes deep models generated with the retrieval-augmented system NN-RAG, which derived and used architectural motifs from over 900 PyTorch modules extracted from public repositories. LEMUR 2 further employs NN-VR and NN-Lite pipelines for automated deployment and latency benchmarking on heterogeneous mobile and Unity-based VR platforms, providing real-device performance metadata. It spans multimodal tasks, image captioning, text-to-image synthesis, and language modeling, supporting cross-domain analysis of architectural transferability. By linking diverse architectures, tasks, and deployment data, LEMUR 2 provides the data foundation for LLM fine-tuning and coupling diverse architectural origins with large-scale, cross-platform empirical validation. This dataset defines a new basis for reproducible and data-driven AI design, advancing the emerging paradigm of LLM-driven AutoML and architectural generalization across modalities and hardware.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
34 of 51 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
- 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 344
- 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
22 more
- 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
- 2018Auto-Keras: An Efficient Neural Architecture Search Systemcited by 171
- 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
- 2021HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmarkcited by 84
- 2020NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Searchcited by 64
- 2020NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processingcited by 60
- 2021TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Searchcited by 58
- 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 40
- 2022NAS-Bench-Graph: Benchmarking Graph Neural Architecture Searchcited by 25
- 2025Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?cited by 21
- 2025NNGPT: Rethinking AutoML with Large Language Modelscited by 13
- 2018AIRNet: Self-Supervised Affine Registration for 3D Medical Images using Neural Networkscited by 12
- 2025VIST-GPT: Ushering in the Era of Visual Storytelling with LLMs?cited by 11
- 2025Preparation of Fractal-Inspired Computational Architectures for Advanced Large Language Model Analysiscited by 11
- 2025A Retrieval-Augmented Generation Approach to Extracting Algorithmic Logic from Neural Networkscited by 11
- 2025AugmentGest: Can Random Data Cropping Augmentation Boost Gesture Recognition Performance?cited by 10
- 2025Enhancing LLM-Based Neural Network Generation: Few-Shot Prompting and Efficient Validation for Automated Architecture Designcited by 10
- 2026From Memorization to Creativity: LLM as a Designer of Novel Neural Architecturescited by 10
- 2025LLM as a Neural Architect: Controlled Generation of Image Captioning Models Under Strict API Contractscited by 9
- 2026From Brute Force to Semantic Insight: Performance-Guided Data Transformation Design with LLMscited by 7
- 2026Resource-Efficient Iterative LLM-Based NAS with Feedback Memorycited by 7
- 2026Closed-Loop LLM Discovery of Non-Standard Channel Priors in Vision Modelscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search
- 2024LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models
- 2026Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs
- 2026The nextAI Solution to the NeurIPS 2023 LLM Efficiency Challenge
- 2026LLM as a Tool, Not an Agent: Code-Mined Tree Transformations for Neural Architecture Search
- 2024Puzzle: Distillation-Based NAS for Inference-Optimized LLMs
- 2023Lemur: Harmonizing Natural Language and Code for Language Agents
- 2025The M-factor: A Novel Metric for Evaluating Neural Architecture Search in Resource-Constrained Environments