mlsanityData to 14 Oct 2026

LEMUR 2: Unlocking Neural Network Diversity for AI

arXiv 2607.06839 ↗First posted 7 Jul 2026cs.LG cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain or deployment-aware evaluation. LEMUR 2 introduces a large-scale, extensible framework unifying generative, evaluative, and deployment pipelines to unlock neural-network diversity. It comprises over 14,000 distinct architectures and more than 750,000 structured training records documenting model performance, hyperparameters, and task outcomes. These models were produced through AST-based code mutation, genetic and reinforcement-learning evolution, generation of fractal architectures, and synthesis guided by a Large Language Model (LLM). This includes deep models generated with the retrieval-augmented system NN-RAG, which derived and used architectural motifs from over 900 PyTorch modules extracted from public repositories. LEMUR 2 further employs NN-VR and NN-Lite pipelines for automated deployment and latency benchmarking on heterogeneous mobile and Unity-based VR platforms, providing real-device performance metadata. It spans multimodal tasks, image captioning, text-to-image synthesis, and language modeling, supporting cross-domain analysis of architectural transferability. By linking diverse architectures, tasks, and deployment data, LEMUR 2 provides the data foundation for LLM fine-tuning and coupling diverse architectural origins with large-scale, cross-platform empirical validation. This dataset defines a new basis for reproducible and data-driven AI design, advancing the emerging paradigm of LLM-driven AutoML and architectural generalization across modalities and hardware.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 51 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

34 of 51 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  7. 2016Densely Connected Convolutional Networkscited by 6,720
  8. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  9. 2018Self-Attention Generative Adversarial Networkscited by 809
  10. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 416
  11. 2019NAS-Bench-101: Towards Reproducible Neural Architecture Searchcited by 344
  12. 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
22 more
  1. 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
  2. 2018Auto-Keras: An Efficient Neural Architecture Search Systemcited by 171
  3. 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
  4. 2021HW-NAS-Bench:Hardware-Aware Neural Architecture Search Benchmarkcited by 84
  5. 2020NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Searchcited by 64
  6. 2020NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processingcited by 60
  7. 2021TransNAS-Bench-101: Improving Transferability and Generalizability of Cross-Task Neural Architecture Searchcited by 58
  8. 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 40
  9. 2022NAS-Bench-Graph: Benchmarking Graph Neural Architecture Searchcited by 25
  10. 2025Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?cited by 21
  11. 2025NNGPT: Rethinking AutoML with Large Language Modelscited by 13
  12. 2018AIRNet: Self-Supervised Affine Registration for 3D Medical Images using Neural Networkscited by 12
  13. 2025VIST-GPT: Ushering in the Era of Visual Storytelling with LLMs?cited by 11
  14. 2025Preparation of Fractal-Inspired Computational Architectures for Advanced Large Language Model Analysiscited by 11
  15. 2025A Retrieval-Augmented Generation Approach to Extracting Algorithmic Logic from Neural Networkscited by 11
  16. 2025AugmentGest: Can Random Data Cropping Augmentation Boost Gesture Recognition Performance?cited by 10
  17. 2025Enhancing LLM-Based Neural Network Generation: Few-Shot Prompting and Efficient Validation for Automated Architecture Designcited by 10
  18. 2026From Memorization to Creativity: LLM as a Designer of Novel Neural Architecturescited by 10
  19. 2025LLM as a Neural Architect: Controlled Generation of Image Captioning Models Under Strict API Contractscited by 9
  20. 2026From Brute Force to Semantic Insight: Performance-Guided Data Transformation Design with LLMscited by 7
  21. 2026Resource-Efficient Iterative LLM-Based NAS with Feedback Memorycited by 7
  22. 2026Closed-Loop LLM Discovery of Non-Standard Channel Priors in Vision Modelscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search
  2. 2024LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models
  3. 2026Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMs
  4. 2026The nextAI Solution to the NeurIPS 2023 LLM Efficiency Challenge
  5. 2026LLM as a Tool, Not an Agent: Code-Mined Tree Transformations for Neural Architecture Search
  6. 2024Puzzle: Distillation-Based NAS for Inference-Optimized LLMs
  7. 2023Lemur: Harmonizing Natural Language and Code for Language Agents
  8. 2025The M-factor: A Novel Metric for Evaluating Neural Architecture Search in Resource-Constrained Environments