mlsanityData to 7 Oct 2026

StackingNet: Collective Inference Across Independent AI Foundation Models

arXiv 2602.13792 ↗First posted 14 Feb 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence built on large foundation models has transformed language understanding, computer vision, and reasoning, yet these systems remain isolated and cannot readily share their capabilities. Coordinating the complementary strengths of independently developed, black-box foundation models is essential for trustworthy intelligent systems, yet no established method exists. Here we show that such coordination can be achieved through a meta-ensemble framework termed StackingNet, which aggregates the output predictions of independent models at inference. StackingNet improves accuracy, reduces individual-model error and group-wise disparities, ranks model reliability, and identifies or prunes models that degrade performance, all without access to internal parameters or training data. Across language comprehension, visual attribute estimation, and academic paper rating, it consistently outperforms individual models and classic ensembles, with gains that persist when the base models are uniformly strong. These gains stem from variance reduction and consensus alignment among independent models rather than from any emergent group cognition, and they widen as the model pool grows more diverse. By turning model diversity from a source of inconsistency into a resource for cooperation, StackingNet offers a practical path toward coordinated artificial intelligence, where progress emerges not only from larger single models but from principled cooperation among many specialized ones.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 86 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

34 of 86 references.

References · 34

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2023A Survey of Large Language Modelscited by 2,537
  8. 2015VQA: Visual Question Answeringcited by 2,489
  9. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  10. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  11. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  12. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
22 more
  1. 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
  2. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  3. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 480
  4. 2020Fairness in Machine Learning: A Surveycited by 369
  5. 2023Explainability for Large Language Models: A Surveycited by 331
  6. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
  7. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
  8. 2023AI Alignment: A Comprehensive Surveycited by 256
  9. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 201
  10. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  11. 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
  12. 2023The Science of Detecting LLM-Generated Textscited by 126
  13. 2019Artificial Intelligence: the global landscape of ethics guidelinescited by 107
  14. 2020Fair Regression with Wasserstein Barycenterscited by 99
  15. 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
  16. 2025Large language models for automated scholarly paper review: A surveycited by 59
  17. 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
  18. 2013Ranking and combining multiple predictors without labeled datacited by 22
  19. 2020Adversarial Crowdsourcing Through Robust Rank-One Matrix Completioncited by 21
  20. 2025Is Your Paper Being Reviewed by an LLM? Benchmarking AI Text Detection in Peer Reviewcited by 18
  21. 2021Understanding and Mitigating Accuracy Disparity in Regressioncited by 17
  22. 2024Attacks on Third-Party APIs of Large Language Modelscited by 14

Built on by

Not cited yet.