Natural Language Decompositions of Implicit Content Enable Better Text Representations
Not on the map. Why?
Abstract (arXiv)
When people interpret text, they rely on inferences that go beyond the observed language itself. Inspired by this observation, we introduce a method for the analysis of text that takes implicitly communicated content explicitly into account. We use a large language model to produce sets of propositions that are inferentially related to the text that has been observed, then validate the plausibility of the generated content via human judgments. Incorporating these explicit representations of implicit content proves useful in multiple problem settings that involve the human interpretation of utterances: assessing the similarity of arguments, making sense of a body of opinion data, and modeling legislative behavior. Our results suggest that modeling the meanings behind observed language, rather than the literal text alone, is a valuable direction for NLP and particularly its applications to social science.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 26 of its 82 references that are in the map. First posted on arXiv 23 May 2023.
Builds on
26 of 82 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
- 2019How Can We Know What Language Models Know?cited by 953
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2019PAWS: Paraphrase Adversaries from Word Scramblingcited by 395
14 more
- 2022WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creationcited by 200
- 2016Enhanced LSTM for Natural Language Inferencecited by 199
- 2020Generation-Augmented Retrieval for Open-domain Question Answeringcited by 186
- 2021Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarizationcited by 128
- 2019Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootingscited by 67
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2019Classification and Clustering of Arguments with Contextualized Word Embeddingscited by 57
- 2022SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Featurescited by 33
- 2021Misinfo Reaction Frames: Reasoning about Readers' Reactions to News Headlinescited by 32
- 2017Measuring the Similarity of Sentential Arguments in Dialogcited by 23
- 2020Text-Based Ideal Pointscited by 22
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2023Interactive Concept Learning for Uncovering Latent Themes in Large Text Collectionscited by 15
- 2019The Universal Decompositional Semantics Dataset and Decomp Toolkitcited by 10
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 11; 2026: 3.
18 papers.
Sort:
By area:
- 2024Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?cited by 68
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personascited by 17
- 2024Accurate and Nuanced Open-QA Evaluation Through Textual Entailmentcited by 12
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Surveycited by 12
- 2025Conversational User-AI Intervention: A Study on Prompt Rewriting for Improved LLM Response Generationcited by 10
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
- 2025BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principlecited by 6
- 2023"We Demand Justice!": Towards Social Context Grounding of Political Textscited by 4
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logscited by 4
- 2025Talking Point based Ideological Discourse Analysis in News Eventscited by 4
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Frameworkcited by 2
6 more
- 2023TopicGPT: A Prompt-based Topic Modeling Frameworkcited by 1
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themescited by 1
- 2025ConceptCarve: Dynamic Realization of Evidencecited by 0
- 2026Learning to Diagnose and Correct Moral Errors: Beyond Shallow Heuristics in Moral Alignmentcited by 0
- 2026Large Language Model and Formal Concept Analysis: a comparative study for Topic Modelingcited by 0
- 2026Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaningcited by 0
- 2026Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaning21 May 2026
- 2026Large Language Model and Formal Concept Analysis: a comparative study for Topic Modeling2 Feb 2026
- 2026Learning to Diagnose and Correct Moral Errors: Beyond Shallow Heuristics in Moral Alignment6 Jan 2026
- 2025Structuring the Unstructured: A Systematic Review of Text-to-Structure Generation for Agentic AI with a Universal Evaluation Framework17 Aug 2025
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning10 Jun 2025
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
- 2025Talking Point based Ideological Discourse Analysis in News Events10 Apr 2025
- 2025ConceptCarve: Dynamic Realization of Evidence9 Apr 2025
- 2025Conversational User-AI Intervention: A Study on Prompt Rewriting for Improved LLM Response Generation21 Mar 2025
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs16 Mar 2025
- 2025BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle22 Feb 2025
6 more
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Survey20 Feb 2025
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas20 Jan 2025
- 2024Accurate and Nuanced Open-QA Evaluation Through Textual Entailment26 May 2024
- 2024Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?19 Feb 2024
- 2023"We Demand Justice!": Towards Social Context Grounding of Political Texts15 Nov 2023
- 2023TopicGPT: A Prompt-based Topic Modeling Framework2 Nov 2023
- 2024Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question?cited by 68
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
- 2024Accurate and Nuanced Open-QA Evaluation Through Textual Entailmentcited by 12
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Surveycited by 12
- 2025Conversational User-AI Intervention: A Study on Prompt Rewriting for Improved LLM Response Generationcited by 10
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
- 2025BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principlecited by 6
- 2023"We Demand Justice!": Towards Social Context Grounding of Political Textscited by 4
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logscited by 4
- 2025Talking Point based Ideological Discourse Analysis in News Eventscited by 4
- 2023TopicGPT: A Prompt-based Topic Modeling Frameworkcited by 1
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themescited by 1
12 most cited of 16 All 16 (JSON)
- 2026Scene Abstraction for Lexical Semantics: Structured Representations of Situated Meaning21 May 2026
- 2026Large Language Model and Formal Concept Analysis: a comparative study for Topic Modeling2 Feb 2026
- 2026Learning to Diagnose and Correct Moral Errors: Beyond Shallow Heuristics in Moral Alignment6 Jan 2026
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning10 Jun 2025
- 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corpora29 May 2025
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
- 2025Talking Point based Ideological Discourse Analysis in News Events10 Apr 2025
- 2025ConceptCarve: Dynamic Realization of Evidence9 Apr 2025
- 2025Conversational User-AI Intervention: A Study on Prompt Rewriting for Improved LLM Response Generation21 Mar 2025
- 2025Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs16 Mar 2025
- 2025BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle22 Feb 2025
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Survey20 Feb 2025
12 newest of 16 All 16 (JSON)