Zipf’s law revisited
Spoken dialog, linguistic units, parameters, and the principle of least effort
Bibliographic Data
| ID | 21640957 |
|---|---|
| Authors | Guido M Linders (0000-0002-2252-6260, Tilburg University), Max M Louwerse (0000-0003-0328-7070, Tilburg University) |
| Year | 2023 |
| Volume | 30 |
| Issue | 1 |
| Pages | 77-101 |
| Publication date | 2023-02-01 |
| Peer Reviewed | Yes |
| Open Access | Yes |
| Type | ARTICLE |
| Venue | Psychonomic Bulletin & Review (JOURNAL) |
| Journal identifiers | ISSN: 1069-9384 • E-ISSN: 1531-5320 |
| Publisher | Springer Science and Business Media LLC (PUBLISHER) |
| DOI | 10.3758/s13423-022-02142-9 |
| PMID | 35840837 |
| OpenAlex | W4285491425 |
| Language | EN |
| Citations received | 12 |
| References cited | 57 |
The ubiquitous inverse relationship between word frequency and word rank is commonly known as Zipf’s law. The theoretical underpinning of this law states that the inverse relationship yields decreased effort in both the speaker and hearer, the so-called principle of least effort. Most research has focused on showing an inverse relationship only for written monolog, only for frequencies and ranks of one linguistic unit, generally word unigrams, with strong correlations of the power law to the observed frequency distributions, with limited to no attention to psychological mechanisms such as the principle of least effort. The current paper extends the existing findings, by not focusing on written monolog but on a more fundamental form of communication, spoken dialog, by not only investigating word unigrams but also units quantified on syntactic, pragmatic, utterance, and nonverbal communicative levels by showing that the adequacy of Zipf’s formula seems ubiquitous, but the exponent of the power law curve is not, and by placing these findings in the context of Zipf’s principle of least effort through redefining effort in terms of cognitive resources available for communication. Our findings show that Zipf’s law also applies to a more natural form of communication—that of spoken dialog, that it applies to a range of linguistic units beyond word unigrams, that the general good fit of Zipf’s law needs to be revisited in light of the parameters of the formula, and that the principle of least effort is a useful theoretical framework for the findings of Zipf’s law
Dialog box · Linguistics · Natural language processing · Rule-based machine translation · Statistics · Utterance · Zipf's law · Computer Science · Digital Communication and Language · Language, Discourse, Communication Strategies · Mathematics · Psychology · Speech and dialogue systems · Artificial Intelligence
The spontaneity of Level-1 visual perspective taking
Information structure and changes in Moklen word-form
Core principles of melodic organisation emerge from transmission chains with random melodies
Constructing a web-accessible lexical database for core Tongan vocabulary
The Russian colour lexicon and its diatopic variation
A large-scale investigation of vowel co-occurrence patterns in the world’s lexicons
“Voilà un film original!”
Linear and hierarchical syntactic complexity of English E-commerce live-streaming by Chinese and American hosts
Deciphering cross-genre dynamics
Acoustic disambiguation of homophonous morphs is exceptional
Least Effort and Alignment in Task‐Oriented Communication
Information, iconicity and Zipf’s law of abbreviation in visual languages of global comics
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Using Language
Word Frequency Distributions
Timing in turn-taking and its implications for processing models of language
An integrated theory of language production and comprehension
Toward a mechanistic psychology of dialogue
Switchboard
Cross-linguistic regularities in the frequency of number words
Zipf’s word frequency law in natural language
Stanza
Word lengths are optimized for efficient communication
Grounding in communication.
Power-Law Distributions in Empirical Data
Human behavior and the principle of least effort.
Selected Studies of the Principle of Relative Frequency in Language
Multilingual statistical text analysis, Zipf's law and Hungarian speech generation
How many words do children know? A corpus-based estimation of children’s total vocabulary size
Toward a Taxonomy of a Set of Discourse Markers in Dialog
The Effects of Visibility on Dialogue and Performance in a Cooperative Problem Solving Task
Scaling Laws for Phonotactic Complexity in Spoken English Language Data
The Hcrc Map Task Corpus
A classification of illocutionary acts
| Unique citing works | 12 |
|---|---|
| Citations per year | 6 |
| Citation span | 2024 - 2026 (3) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 11 |