# Complexity of Word Collocation Networks: A Preliminary Structural Analysis

arXiv: https://arxiv.org/abs/1310.5111 · HTML: https://mlsanity.com/paper/1310.5111/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Oct 2013.

## Built on by (most cited first, 17 of 17)

- [Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrations](https://mlsanity.com/paper/2308.14186/) (2023)
- [BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning](https://mlsanity.com/paper/2111.04287/) (2021)
- [The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT](https://mlsanity.com/paper/2101.09115/) (2021)
- [A Call for Standardization and Validation of Text Style Transfer Evaluation](https://mlsanity.com/paper/2306.00539/) (2023)
- [PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation](https://mlsanity.com/paper/2111.00506/) (2021)
- [Spelling Correction with Denoising Transformer](https://mlsanity.com/paper/2105.05977/) (2021)
- [AlphaZip: Neural Network-Enhanced Lossless Text Compression](https://mlsanity.com/paper/2409.15046/) (2024)
- [MoE Lens -- An Expert Is All You Need](https://mlsanity.com/paper/2603.05806/) (2026)
- [GoLongRL: Capability-Oriented Long Context Reinforcement Learning with Multitask Alignment](https://mlsanity.com/paper/2605.19577/) (2026)
- [DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting](https://mlsanity.com/paper/2101.11836/) (2021)
- [Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations](https://mlsanity.com/paper/2109.04602/) (2021)
- [Gradient-based inference of abstract task representations for generalization in neural networks](https://mlsanity.com/paper/2407.17356/) (2024)
- [Diversity-Driven Combination for Grammatical Error Correction](https://mlsanity.com/paper/2110.15149/) (2021)
- [Incorporating Stylistic Lexical Preferences in Generative Language Models](https://mlsanity.com/paper/2010.11553/) (2020)
- [Broccoli: Sprinkling Lightweight Vocabulary Learning into Everyday Information Diets](https://mlsanity.com/paper/2104.07941/) (2021)
- [Exposing the Functionalities of Neurons for Gated Recurrent Unit Based Sequence-to-Sequence Model](https://mlsanity.com/paper/2303.15072/) (2023)
- [SGD-KV: Summarization Guided KV Cache Compression](https://mlsanity.com/paper/2609.03235/) (2026)

## Abstract (arXiv)

In this paper, we explore complex network properties of word collocation networks (Ferret, 2002) from four different genres. Each document of a particular genre was converted into a network of words with word collocations as edges. We analyzed graphically and statistically how the global properties of these networks varied across different genres, and among different network types within the same genre. Our results indicate that the distributions of network properties are visually similar but statistically apart across different genres, and interesting variations emerge when we consider different network types within a single genre. We further investigate how the global properties change as we add more and more collocation edges to the graph of one particular genre, and observe that except for the number of vertices and the size of the largest connected component, network properties change in phases, via jumps and drops.