mlsanityData to 14 Oct 2026

Text Has Curvature

arXiv 2602.13418 ↗First posted 13 Feb 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Does natural language text have an intrinsic curvature? Language is increasingly modeled in curved geometries - hyperbolic spaces for hierarchy, mixed-curvature manifolds for compositional structure - yet a basic scientific question remains unresolved: what does curvature mean for text itself, in a way that is native to language rather than an artifact of the embedding space we choose? We argue that text does indeed have curvature, and show how to detect it, define it, and use it. To this end, we propose Texture, a text-native, word-level discrete curvature signal, and make three contributions. (a) Existence: We provide empirical and theoretical certificates that semantic inference in natural corpora is non-flat. (b) Definition: We define Texture as a signed two-axis curvature of the word-in-context belief field - the differential of reconciliation between prefix and suffix - measuring, via a debiased Schr"odinger transport divergence, whether adding context from one side contracts the semantic effect of context from the other side (focus, positive) or expands it into competing continuations (fan-out, negative). (c) Utility: Texture is actionable: it serves as a general-purpose measurement and control primitive enabling geometry without geometric training; we instantiate it on two representative tasks, improving long-context inference through curvature-guided compression and retrieval-augmented generation through curvature-guided routing. Together, our results establish a text-native curvature paradigm, making Texture practically useful.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 20 of its 38 references that are in the map. First posted on arXiv 13 Feb 2026.

Builds on

20 of 38 references.

References · 20

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  7. 2016Pointer Sentinel Mixture Modelscited by 3,096
  8. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  9. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  10. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
  11. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  12. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
8 more
  1. 2018Hyperbolic Neural Networkscited by 402
  2. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
  3. 2021Efficient Attentions for Long Document Summarizationcited by 345
  4. 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 292
  5. 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 189
  6. 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 119
  7. 2025Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometriescited by 18
  8. 2025Spectro-Riemannian Graph Neural Networkscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Curved Inference: Concern-Sensitive Geometry in Large Language Model Residual Streams
  2. 2025HELM: Hyperbolic Large Language Models via Mixture-of-Curvature Experts
  3. 2026Context Is King: How In-Context Specification Shapes the Geometry of Concepts
  4. 2026Revisiting Anisotropy in Language Transformers: The Geometry of Learning Dynamics
  5. 2026Symmetry in language statistics shapes the geometry of model representations
  6. 2024A Grounded Typology of Word Classes
  7. 2026Seeing Is Not Addressing: Auditing Linguistic Access to Frozen Visual Geometry
  8. 2025ShapeShift: Text-to-Mosaic Synthesis via Semantic Phase-Field Guidance