Joost Schilperoord
Biographic Data
| ID | 1081250 |
|---|---|
| NAME | Joost Schilperoord |
| GIVEN NAMES | Joost |
| FAMILY NAME | Schilperoord |
| SIGNATURE | SCHILPEROORD J |
| AFFILIATIONS | Tilburg University |
| ORCID | 0000-0002-1800-3600 |
| VERIFIED | Yes |
| TOTAL WORKS | 12 |
| TOTAL CITATIONS | 1 |
| WORKS AS AUTHOR | 11 |
| WORKS AS EDITOR | 1 |
| FIRST PUBLICATION YEAR | 2001 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 1 |
Three monkeys or one
In the three emoji sequence of , people differ in their interpretation of whether there are three different monkeys or one monkey changing postures. Such disagreements point to a key issue in visual meaning-making: how do people determine when multiple visual units refer to the same entity? The present study investigated which cues guide people's interpretation of continuity and co-reference in short emoji sequences. Participants viewed sequences…
Information, iconicity and Zipf’s law of abbreviation in visual languages of global comics
The sequential units of language (i.e. words) have often been characterized by a tension between diversity and universality in the triangulation between information content, length and frequency. Here we examine similar tensions in the sequential units of visual narratives (i.e. panels) by focusing on how many entities appear per panel in visual narratives from the TINTIN Corpus of 1,030 annotated comics from 144 countries (76,000+ panels). Rates…
Processing Incongruity for Mental Events in Comics
Visual narratives, like comics, at times show depictions of characters' imagination, dreams, or flashbacks, which seem incongruent with the ongoing primary narrative. Such "domain constructions" thus integrate an auxiliary domain (e.g. a dream) within the primary domain (the expected, physical storyworld), and may require readers to resolve seemingly non-co-referential figures as co-referential (e.g. when a character's dream shows that character …
Language acquisition in the multimodal parallel architecture
Karadöller et al. give a comprehensive review of first language acquisition in the vocal and especially bodily modalities, but they do not explicitly model a multimodal framework. The multimodal parallel architecture provides such a theoretical model that can explain both unimodal and multimodal communication. We will discuss this model, how it distinguishes what is innate and what is acquired, and how modalities relate to each other in acquisiti…
Anaphoric distance dependencies in visual narrative structure and processing
Linguistic syntax has often been claimed as uniquely complex due to features like anaphoric relations and distance dependencies. However, visual narratives of sequential images, like those in comics, have been argued to use sequencing mechanisms analogous to those in language. These narrative structures include "refiner" panels that "zoom in" on the contents of another panel. Similar to anaphora in language, refiners indexically connect inexplici…
Variation is information
In a usage-based framework, variation is part and parcel of our linguistic experiences, and therefore also of our mental representations of language. In this article, we bring attention to variation as a source of information. Instead of discarding variation as mere noise, we examine what it can reveal about the representation and use of linguistic knowledge. By means of metalinguistic judgment data, we demonstrate how to quantify and interpret f…
Different but the Same
When people comprehend language, they mentally represent object shape. Previous research has shown that objects that are mentioned in a simile construction (X is like Y) are represented as similarly shaped. The present study examined object shape in mental representations of negated similes (X is NOT like Y). In our experiment participants read negated similes or control sentences without a comparison structure. After having read the sentence, th…
Can pictures say no or not? Negation and denial in the visual mode
The Role of Shape in Comparing Objects
Comparing objects is a process necessary to cognitive tasks involving categorization. Shape is considered one of the primary vehicles for object categorization. We hypothesize that similarity in shape facilitates finding conceptual correspondences between objects, both for objects stemming from the same and from different conceptual categories. In the latter case, the comparison process requires the construction of an ad hoc category, which is al…
Perceptual and Conceptual Visual Rhetoric
This article identifies the structural and conceptual aspects of a visual construction often used in advertisements to establish a metaphoric or associative relation, that is, symmetric object alignment (SOA). It offers an account of the formal ingredients of SOA, which fall into two groups: object-constitutive factors (like size, shape, and color) and object-depictment factors (like perspective, orientation, and distance from viewing point). Bot…
Nonverbatim Captioning in Dutch Television Programs
In the Netherlands, as in most other European countries, closed captions for the deaf summarize texts rather than render them verbatim. Caption editors argue that in this way television viewers have enough time to both read the text and watch the program. They also claim that the meaning of the original message is properly conveyed. However, many deaf people demand verbatim subtitles so that they have full access to all original information. They…
Text representation
This book brings together linguistics and psycholinguistics. Text representation is considered a cognitive entity: a mental construct that plays a crucial role in both text production and text understanding. The focus is on referential and relational coherence and the role of linguistic characteristics as processing instructions from a text linguistic and discourse psychology point of view. Consequently, this book presents various research method…
Text representation
This book brings together linguistics and psycholinguistics. Text representation is considered a cognitive entity: a mental construct that plays a crucial role in both text production and text understanding. The focus is on referential and relational coherence and the role of linguistic characteristics as processing instructions from a text linguistic and discourse psychology point of view. Consequently, this book presents various research method…
Nonverbatim Captioning in Dutch Television Programs
In the Netherlands, as in most other European countries, closed captions for the deaf summarize texts rather than render them verbatim. Caption editors argue that in this way television viewers have enough time to both read the text and watch the program. They also claim that the meaning of the original message is properly conveyed. However, many deaf people demand verbatim subtitles so that they have full access to all original information. They…
Perceptual and Conceptual Visual Rhetoric
This article identifies the structural and conceptual aspects of a visual construction often used in advertisements to establish a metaphoric or associative relation, that is, symmetric object alignment (SOA). It offers an account of the formal ingredients of SOA, which fall into two groups: object-constitutive factors (like size, shape, and color) and object-depictment factors (like perspective, orientation, and distance from viewing point). Bot…
The Role of Shape in Comparing Objects
Comparing objects is a process necessary to cognitive tasks involving categorization. Shape is considered one of the primary vehicles for object categorization. We hypothesize that similarity in shape facilitates finding conceptual correspondences between objects, both for objects stemming from the same and from different conceptual categories. In the latter case, the comparison process requires the construction of an ad hoc category, which is al…
Can pictures say no or not? Negation and denial in the visual mode
Different but the Same
When people comprehend language, they mentally represent object shape. Previous research has shown that objects that are mentioned in a simile construction (X is like Y) are represented as similarly shaped. The present study examined object shape in mental representations of negated similes (X is NOT like Y). In our experiment participants read negated similes or control sentences without a comparison structure. After having read the sentence, th…
Variation is information
In a usage-based framework, variation is part and parcel of our linguistic experiences, and therefore also of our mental representations of language. In this article, we bring attention to variation as a source of information. Instead of discarding variation as mere noise, we examine what it can reveal about the representation and use of linguistic knowledge. By means of metalinguistic judgment data, we demonstrate how to quantify and interpret f…
Anaphoric distance dependencies in visual narrative structure and processing
Linguistic syntax has often been claimed as uniquely complex due to features like anaphoric relations and distance dependencies. However, visual narratives of sequential images, like those in comics, have been argued to use sequencing mechanisms analogous to those in language. These narrative structures include "refiner" panels that "zoom in" on the contents of another panel. Similar to anaphora in language, refiners indexically connect inexplici…
Processing Incongruity for Mental Events in Comics
Visual narratives, like comics, at times show depictions of characters' imagination, dreams, or flashbacks, which seem incongruent with the ongoing primary narrative. Such "domain constructions" thus integrate an auxiliary domain (e.g. a dream) within the primary domain (the expected, physical storyworld), and may require readers to resolve seemingly non-co-referential figures as co-referential (e.g. when a character's dream shows that character …
Language acquisition in the multimodal parallel architecture
Karadöller et al. give a comprehensive review of first language acquisition in the vocal and especially bodily modalities, but they do not explicitly model a multimodal framework. The multimodal parallel architecture provides such a theoretical model that can explain both unimodal and multimodal communication. We will discuss this model, how it distinguishes what is innate and what is acquired, and how modalities relate to each other in acquisiti…
Three monkeys or one
In the three emoji sequence of , people differ in their interpretation of whether there are three different monkeys or one monkey changing postures. Such disagreements point to a key issue in visual meaning-making: how do people determine when multiple visual units refer to the same entity? The present study investigated which cues guide people's interpretation of continuity and co-reference in short emoji sequences. Participants viewed sequences…
Information, iconicity and Zipf’s law of abbreviation in visual languages of global comics
The sequential units of language (i.e. words) have often been characterized by a tension between diversity and universality in the triangulation between information content, length and frequency. Here we examine similar tensions in the sequential units of visual narratives (i.e. panels) by focusing on how many entities appear per panel in visual narratives from the TINTIN Corpus of 1,030 annotated comics from 144 countries (76,000+ panels). Rates…
Computer Science (10 works) · Language, Metaphor, and Cognition (10 works) · Linguistics (9 works) · Psychology (8 works) · Categorization, perception, and language (6 works) · Cognitive psychology (6 works) · Artificial Intelligence (5 works) · Cognitive science (4 works) · Narrative (4 works) · Cognition (3 works)