Decoding Viewer Emotions in Visual Media

The emotional reaction of the viewer to visual media is one of the key issues of digital art and visual advertising online where the aesthetic impression directly determines the attention, memory, and choice. Current methods of evaluation are based on self-reports and superficial measures of engagement which provide little information on underlying affective reactions that underlie consumer behavior. This gap has been filled in this paper by considering viewer emotion decoding in the light of neuromarketing viewpoint that involves applying computational emotion analysis with visual media research. The main goal is to explore the effects of visual characteristics, narrative, and style in digital art and web-based advertisements in order to stimulate measurable emotional response and connect such a response to the results of engagement and persuasion. The paper is a synthesis of results on emotion recognition models, biometric measures, and behavioral analytics to create a hybrid framework of analytical analysis of affect-based visual comparison. The central results have shown that emotion-sensitive visual design is much more efficient in retaining attention, emotional appeal, and brand memorability, as positive affect and moderate arousal become the most prominent predictors of the viewer involvement in any platform. Moreover, the adaptive images in terms of emotions proved to be more effective than the non-adaptive ones in respect of having the artistic meaning and selling messages. The paper has a wider scope than commercial advertising in respect to digital art shows, immersive media and culturally contextual visual storytelling, with an emphasis on ethical aspects and issues on interpretability. This work provides a systematic base of the research on emotionally intelligent visual media and the potential further study of visual communication and neural markers by connecting neuromarketing and visual analytics based on AI and emotion recognition

Appeal to emotion · Decoding methods · Digital media · Eye movement · Eye tracking · Neuromarketing · Perception · Visual rhetoric · Aesthetic Perception and Analysis · Digital Media and Visual Art · Emotion and Mood Recognition

• Covid-19 pandemic and online learning

  Olasile Babatunde Adedoyin, Emrah Soykan•Interactive Learning Environments•2023

  Add to list