Statistical or Embodied? Comparing Colorseeing, Colorblind, Painters, and Large Language Models in Their Processing of Color Metaphors
Bibliographic Data
Can metaphorical reasoning involving embodied experience—such as color perception—be learned from the statistics of language alone? Recent work finds that colorblind individuals robustly understand and reason abstractly about color, implying that color associations in everyday language might contribute to the metaphorical understanding of color. However, it is unclear how much colorblind individuals’ understanding of color is driven by language versus their limited (but no less embodied) visual experience. A more direct test of whether language supports the acquisition of humans’ understanding of color is whether large language models (LLMs)—those trained purely on text with no visual experience—can nevertheless learn to generate consistent and coherent metaphorical responses about color. Here, we conduct preregistered surveys that compare colorseeing adults, colorblind adults, and LLMs in how they (1) associate colors to words that lack established color associations and (2) interpret conventional and novel color metaphors. Colorblind and colorseeing adults exhibited highly similar and replicable color associations with novel words and abstract concepts. Yet, while GPT (a popular LLM) also generated replicable color associations with impressive consistency, its associations departed considerably from colorseeing and colorblind participants. Moreover, GPT frequently failed to generate coherent responses about its own metaphorical color associations when asked to invert its color associations or explain novel color metaphors in context. Consistent with this view, painters who regularly work with color pigments were more likely than all other groups to understand novel color metaphors using embodied reasoning. Thus, embodied experience may play an important role in metaphorical reasoning about color and the generation of conceptual connections between embodied associations
Cognitive psychology · Color vision · Embodied cognition · Perception · Synesthesia · Categorization, perception, and language · Computer Science · Language, Metaphor, and Cognition · Multisensory perception and integration · Psychology · Social Psychology · Artificial Intelligence
Language, Usage and Cognition
Grammars of Space
Toward a theory of semantic representation
Who Sees Human?
A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content
The representation of abstract words
Metaphor Interpretation as Embodied Simulation
How to Grow a Mind
Russian blues reveal effects of language on color discrimination
Brain mechanisms linking language and action
Regular morphology and the lexicon
What Mary Didn't Know
Explaining Embodied Cognition Results
Metaphors We Think With
Somatotopic Representation of Action Words in Human Motor and Premotor Cortex
Perceptual symbol systems
Impact of motor stroke on novel and conventional action metaphor comprehension
Divergences in color perception between deep neural networks and humans
Color associations in abstract semantic domains
Semantic distance predicts metaphoricity and creativity judgments in synesthetic metaphors
The Death of Dead Metaphor
Epistemic motives moderate the effect of metaphoric framing on attitudes
Exploring metaphor's epistemic function
Distance makes the metaphor grow stronger
From Usage to Grammar
Non-visual colour
Grounded Cognition
Epiphenomenal Qualia
Emergent analogical reasoning in large language models
What Metaphors Mean
| Unique citing works | 2 |
|---|---|
| Citations per year | 2 |
| Citation span | 2025 - 2026 (2) |
| Citation velocity | current |
| Highly cited | No |
| Citation types | Neutral: 2 |