D Social Research

Analysis of Social Interaction Using Computer Vision

Bibliographic Data

ID2331146
AuthorsYoav Goldstein (0000-0002-0896-773X, Stanford Center of Professional Development, Stanford University, Stanford, CA, USA), Nicolas M Legewie (0000-0001-9605-1299, University of Erfurt, corresponding author), Doron Shiffer-Sebba (0000-0002-3417-3941, Institute for Policy Research, Northwestern University, Evanston, USA)
Year2023
Volume52
Issue3
Pages1201-1238
Publication date2023-08-01
Peer ReviewedYes
Open AccessYes
TypeARTICLE
VenueSociological Methods & Research (JOURNAL)
Journal identifiersISSN: 0049-1241 • E-ISSN: 1552-8294
PublisherSAGE Publications Inc (PUBLISHER)
DOI10.1177/00491241221147495
OpenAlexW4320922284
LanguageEN
Citations received4
References cited91

Video data offer important insights into social processes because they enable direct observation of real-life social interaction. Though such data have become abundant and increasingly accessible, they pose challenges to scalability and measurement. Computer vision (CV), i.e., software-based automated analysis of visual material, can help address these challenges, but existing CV tools are not sufficiently tailored to analyze social interactions. We describe our novel approach, '3D social research' (3DSR), which uses CV and 3D camera footage to study kinesics and proxemics, two core elements of social interaction. Using eight videos of a scripted interaction and five real-life street scene videos, we demonstrate how 3DSR expands sociologists' analytical toolkit by facilitating a range of scalable and precise measurements. We specifically emphasize 3DSR's potential for analyzing physical distance, movement in space, and movement rate - important aspects of kinesics and proxemics in interactions. We also assess data reliability when using 3DSR

Computer vision · Data science · Database · Gesture · Human–computer interaction · Kinesics · Multimedia · Proxemics · Scalability · Segmentation · Social relation · Artificial Intelligence · Computer Science · Participatory Visual Research Methods · Psychology · Social Psychology · Wildlife Ecology and Conservation · Zoonotic diseases and public health

Tools

Open DOIOpen Access