Multi-Novelty: Improve the Diversity and Novelty of Contents Generated by Large Language Models via inference-time Multi-Views Brainstorming
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) demonstrate remarkable proficiency in generating accurate and fluent text. However, they often struggle with diversity and novelty, leading to repetitive or overly deterministic responses. These limitations stem from constraints in training data, including gaps in specific knowledge domains, outdated information, and an over-reliance on textual sources. Such shortcomings reduce their effectiveness in tasks requiring creativity, multi-perspective reasoning, and exploratory thinking, such as LLM based AI scientist agents and creative artist agents . To address this challenge, we introduce inference-time multi-view brainstorming method, a novel approach that enriches input prompts with diverse perspectives derived from both textual and visual sources, which we refere to as "Multi-Novelty". By incorporating additional contextual information as diverse starting point for chain of thoughts, this method enhances the variety and creativity of generated outputs. Importantly, our approach is model-agnostic, requiring no architectural modifications and being compatible with both open-source and proprietary LLMs.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 18 Feb 2025.
Builds on
14 of 32 references.
References · 14
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
- 2024Delving into LLM-assisted writing in biomedical publications through excess vocabularycited by 78
- 2024Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scorescited by 50
- 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 48
- 2023Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytellingcited by 27
- 2024Dipper: Diversity in Prompts for Producing Large Language Model Ensembles in Reasoning taskscited by 22
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Avoidance Decoding for Diverse Multi-Branch Story Generationcited by 6
- 2026LLM Review: Enhancing Creative Writing via Blind Peer Review Feedbackcited by 5
- 2026Language of Thought Shapes Output Diversity in Large Language Modelscited by 4
- 2026Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learningcited by 1
- 2026Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning14 Sep 2026
- 2026Language of Thought Shapes Output Diversity in Large Language Models16 Jan 2026
- 2026LLM Review: Enhancing Creative Writing via Blind Peer Review Feedback12 Jan 2026
- 2025Avoidance Decoding for Diverse Multi-Branch Story Generation2 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
- 2024Brainstorming Brings Power to Large Language Models of Knowledge Reasoning
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debate
- 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models
- 2025Large Language Models for Scientific Idea Generation: A Creativity-Centered Survey
- 2026Can Language Models Imagine Without Seeing? Ekphrasis: Measuring Visual Creative Ideation in Text-Only LLMs
- 2025Exploring Design of Multi-Agent LLM Dialogues for Research Ideation
- 2024The Revolution of Multimodal Large Language Models: A Survey