Striking a Balance: Reader Takeaways and Preferences when Integrating Text and Charts
Not on the map. Why?
Abstract (arXiv)
While visualizations are an effective way to represent insights about information, they rarely stand alone. When designing a visualization, text is often added to provide additional context and guidance for the reader. However, there is little experimental evidence to guide designers as to what is the right amount of text to show within a chart, what its qualitative properties should be, and where it should be placed. Prior work also shows variation in personal preferences for charts versus textual representations. In this paper, we explore several research questions about the relative value of textual components of visualizations. 302 participants ranked univariate line charts containing varying amounts of text, ranging from no text (except for the axes) to a written paragraph with no visuals. Participants also described what information they could take away from line charts containing text with varying semantic content. We find that heavily annotated charts were not penalized. In fact, participants preferred the charts with the largest number of textual annotations over charts with fewer annotations or text alone. We also find effects of semantic content. For instance, the text that describes statistical or relational components of a chart leads to more takeaways referring to statistics or relational comparisons than text describing elemental or encoded components. Finally, we find different effects for the semantic levels based on the placement of the text on the chart; some kinds of information are best placed in the title, while others should be placed closer to the data. We compile these results into four chart design guidelines and discuss future implications for the combination of text and charts.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 4; 2024: 4; 2025: 5; 2026: 4.
17 papers.
Sort:
By area:
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 65
- 2025ChartCap: Mitigating Hallucination of Dense Chart Captioningcited by 7
- 2024C2: Scalable Auto-Feedback for LLM-based Chart Generationcited by 6
- 2024SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratingscited by 5
- 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 5
- 2023Grounded Intuition of GPT-Vision's Abilities with Scientific Imagescited by 3
- 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profilescited by 2
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Textcited by 2
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Modelscited by 2
- 2024An Image-based Typology for Visualizationcited by 1
5 more
- 2025Capturing Visualization Design Rationalecited by 1
- 2026AnnoBench: A Benchmark for Visualization Annotation Generationcited by 1
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Userscited by 0
- 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generationcited by 0
- 2026Same Chart, Different Story: Bias in Vision-Language Chart Interpretationcited by 0
- 2026Same Chart, Different Story: Bias in Vision-Language Chart Interpretation12 Aug 2026
- 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generation4 Aug 2026
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models22 May 2026
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text13 Aug 2025
- 2025ChartCap: Mitigating Hallucination of Dense Chart Captioning5 Aug 2025
- 2025Capturing Visualization Design Rationale19 Jun 2025
- 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profiles6 Jun 2025
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Users11 May 2025
- 2024C2: Scalable Auto-Feedback for LLM-based Chart Generation24 Oct 2024
- 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions29 Sep 2024
- 2024SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings26 Mar 2024
5 more
- 2024An Image-based Typology for Visualization7 Mar 2024
- 2023Grounded Intuition of GPT-Vision's Abilities with Scientific Images3 Nov 2023
- 2023VisText: A Benchmark for Semantically Rich Chart Captioning28 Jun 2023
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning24 May 2023
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagrams19 May 2023
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2025ChartCap: Mitigating Hallucination of Dense Chart Captioningcited by 7
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Modelscited by 2
- 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generationcited by 0
- 2026Same Chart, Different Story: Bias in Vision-Language Chart Interpretationcited by 0
- 2026Same Chart, Different Story: Bias in Vision-Language Chart Interpretation12 Aug 2026
- 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generation4 Aug 2026
- 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models22 May 2026
- 2025ChartCap: Mitigating Hallucination of Dense Chart Captioning5 Aug 2025
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning24 May 2023
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 65
- 2024C2: Scalable Auto-Feedback for LLM-based Chart Generationcited by 6
- 2024SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratingscited by 5
- 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 5
- 2023Grounded Intuition of GPT-Vision's Abilities with Scientific Imagescited by 3
- 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profilescited by 2
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Textcited by 2
- 2024An Image-based Typology for Visualizationcited by 1
- 2025Capturing Visualization Design Rationalecited by 1
- 2026AnnoBench: A Benchmark for Visualization Annotation Generationcited by 1
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Userscited by 0
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
- 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Text13 Aug 2025
- 2025Capturing Visualization Design Rationale19 Jun 2025
- 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profiles6 Jun 2025
- 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Users11 May 2025
- 2024C2: Scalable Auto-Feedback for LLM-based Chart Generation24 Oct 2024
- 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions29 Sep 2024
- 2024SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratings26 Mar 2024
- 2024An Image-based Typology for Visualization7 Mar 2024
- 2023Grounded Intuition of GPT-Vision's Abilities with Scientific Images3 Nov 2023
- 2023VisText: A Benchmark for Semantically Rich Chart Captioning28 Jun 2023
- 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagrams19 May 2023