mlsanityData to 7 Oct 2026

Striking a Balance: Reader Takeaways and Preferences when Integrating Text and Charts

arXiv 2208.01780 ↗First posted 2 Aug 2022cs.HCcited by 17

Not on the map. Why?

Abstract (arXiv)

While visualizations are an effective way to represent insights about information, they rarely stand alone. When designing a visualization, text is often added to provide additional context and guidance for the reader. However, there is little experimental evidence to guide designers as to what is the right amount of text to show within a chart, what its qualitative properties should be, and where it should be placed. Prior work also shows variation in personal preferences for charts versus textual representations. In this paper, we explore several research questions about the relative value of textual components of visualizations. 302 participants ranked univariate line charts containing varying amounts of text, ranging from no text (except for the axes) to a written paragraph with no visuals. Participants also described what information they could take away from line charts containing text with varying semantic content. We find that heavily annotated charts were not penalized. In fact, participants preferred the charts with the largest number of textual annotations over charts with fewer annotations or text alone. We also find effects of semantic content. For instance, the text that describes statistical or relational components of a chart leads to more takeaways referring to statistics or relational comparisons than text describing elemental or encoded components. Finally, we find different effects for the semantic levels based on the placement of the text on the chart; some kinds of information are best placed in the title, while others should be placed closer to the data. We compile these results into four chart design guidelines and discuss future implications for the combination of text and charts.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2022.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 4; 2025: 5; 2026: 4.

17 papers.

Sort:

By area:

  1. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
  2. 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
  3. 2023Graphologue: Exploring Large Language Model Responses with Interactive Diagramscited by 65
  4. 2025ChartCap: Mitigating Hallucination of Dense Chart Captioningcited by 7
  5. 2024C2: Scalable Auto-Feedback for LLM-based Chart Generationcited by 6
  6. 2024SciCapenter: Supporting Caption Composition for Scientific Figures with Machine-Generated Captions and Ratingscited by 5
  7. 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 5
  8. 2023Grounded Intuition of GPT-Vision's Abilities with Scientific Imagescited by 3
  9. 2025LaMP-Cap: Personalized Figure Caption Generation With Multimodal Figure Profilescited by 2
  10. 2025From Charts to Fair Narratives: Uncovering and Mitigating Geo-Economic Biases in Chart-to-Textcited by 2
  11. 2026ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Modelscited by 2
  12. 2024An Image-based Typology for Visualizationcited by 1
5 more
  1. 2025Capturing Visualization Design Rationalecited by 1
  2. 2026AnnoBench: A Benchmark for Visualization Annotation Generationcited by 1
  3. 2025Navigating the Rashomon Effect: How Personalization Can Help Adjust Interpretable Machine Learning Models to Individual Userscited by 0
  4. 2026ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generationcited by 0
  5. 2026Same Chart, Different Story: Bias in Vision-Language Chart Interpretationcited by 0