Jan Karem Höhne
Datos Biográficos
| ID | 230083 |
|---|---|
| NOMBRE | Jan Karem Höhne |
| NOMBRES | Jan Karem |
| APELLIDO | Höhne |
| FIRMA | HÖHNE J K |
| AFILIACIONES | Universitat Pompeu Fabra |
| ORCID | 0000-0003-1467-1975 |
| VERIFICADO | Sí |
| TOTAL DE OBRAS | 31 |
| TOTAL DE CITAS | 56 |
| TOTAL COMO AUTOR | 30 |
| TOTAL COMO EDITOR | 1 |
| PRIMER AÑO DE PUBLICACIÓN | 2017 |
| AÑO MÁS RECIENTE DE PUBLICACIÓN | 2026 |
| ÍNDICE H | 4 |
Identifying Bots Through LLM-Generated Text in Open Narrative Responses
Online survey participants are frequently recruited through social media platforms, opt-in online access panels, and river sampling approaches. Such online surveys are threatened by bots that shift survey outcomes and exploit incentives. In this proof-of-concept study, we advance the identification of bots driven by Large Language Models (LLMs) through the prediction of LLM-generated text in open narrative responses. We conducted an online survey…
Automatic speech-to-text transcription
LLM-driven bot infiltration
Following Political Science Students Through Their Methods Training
Teaching empirical social research methods as a compulsory part of a curriculum involves several challenges. Students are often unaware of the relevance of methodological training for their political science education and its value as a transferable skill. In addition, some students are afraid of the mathematical components of their applied statistics training. These challenges can have a diminishing effect on student success. We examine three di…
The sound of respondents
Web surveys completed on smartphones open novel ways for measuring respondents’ attitudes, behaviors, and beliefs that are crucial for social science research and many adjacent research fields. In this study, we make use of the built-in microphones of smartphones to record voice answers in a smartphone survey and extract non-verbal cues, such as amplitudes and pitches, from the collected voice data. This allows us to predict respondents’ level of…
Typing or Speaking? Comparing Text and Voice Answers to Open Questions on Sensitive Topics in Smartphone Surveys
The smartphone increase in web surveys, coupled with technological developments, provides novel opportunities for measuring attitudes. For example, smartphones allow the collection of voice instead of text answers by using the built-in microphone. This may facilitate answering questions with open answer formats resulting in richer information and higher data quality. So far, there is only a little body of research investigating voice and text ans…
Evaluating the response effort and data quality of established political solidarity measures
This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for …
Differences in measurement quality depending on recall
A large body of studies estimate the measurement quality of survey questions using multitrait-multimethod (MTMM) experiments. In these experiments, respondents are asked (nearly) identical questions at least twice. Most commonly, this is done within the same survey by, for instance, changing the response scale characteristics. However, it has frequently been argued that the estimates from these experiments might be biased when respondents recall …
Is there a growing use of mobile devices in web surveys? Evidence from 128 web surveys in Germany
Recent advances in web survey methodology were motivated by the observation that respondents increasingly use mobile devices, such as smartphones and tablets, to participate in web surveys. Even though we do not doubt this general observation, we argue that the claim is lacking a solid empirical basis. Most research on increasing mobile device use in web surveys covers limited periods of time and/or analyzes data from only one study or panel. The…
Question order effects
The measurement of political solidarities and related concepts is an important endeavor in numerous scientific disciplines, such as political and social science research. European surveys, such as the Eurobarometer, frequently measure these concepts for people's home country and Europe raising questions with respect to the order of precedence. Research has shown that the order of asking questions can have a profound impact on answer behavior comp…
How to Detect and Influence Looking Up Answers to Political Knowledge Questions in Web Surveys
When answering political knowledge questions in web surveys, respondents can look up the correct answer on the Internet. This response behavior artificially inflates political knowledge scores that are supposed to measure fact-based information. In the present study, we address the existing knowledge gaps of previous research regarding looking up answers to political knowledge questions in web surveys. We conducted an experimental study based on …
New insights on respondents’ recall ability and memory effects when repeatedly measuring political efficacy
Many study designs in social science research rely on repeated measurements implying that the same respondents are asked the same (or nearly the same) questions at least twice. An assumption made by such study designs is that respondents second answer does not depend on their first answer. However, if respondents recall their initial answer and base their second answer on it memory effects may affect the survey outcome. In this study, I investiga…
Squats in Surveys
Digital health data that accompany data from traditional surveys are becoming increasingly important in health-related research. For instance, smartphones have many built-in sensors, such as accelerometers that measure acceleration so that they offer many new research possibilities. Such acceleration data can be used as a more objective supplement to health and physical fitness measures (or survey questions). In this study, we therefore investiga…
Are respondents ready for audio and voice communication channels in online surveys
Technological advancements and changes in online survey participation pave the way for new data collection methods. Particularly, the increasing smartphone rate in online surveys facilitates a re-consideration of prevailing communication channels to, for instance, naturalize the communication process between researchers and respondents and to collect more in-depth and high-quality data. However, so far, there is a lack of information on whether r…
Measuring subjective social stratification
Previous research has shown that question characteristics, such as the shape of rating scales, can affect how respondents interpret and respond to questions. For example, earlier studies reported different response distributions for questions employing rating scales in the form of a ladder and in the form of a pyramid. The current experiment, implemented in a probability-based online panel (N = 4,377), re-visits and extends this research by exami…
Looking up Answers to Political Knowledge Questions in Web Surveys
Political knowledge can affect measures obtained in public opinion research and political science. When asked political knowledge questions, some respondents look up the answers online, inflating political knowledge scores. This response behavior is detectable in web surveys using paradata. This study investigates whether and to what extent respondents switch away from the survey to search for answers online using JavaScript OnBlur functions. Res…
Measurement properties of completely and end labeled unipolar and bipolar scales in Likert-type questions on income (in)equality
Grundlagen - Methoden - Anwendungen in den Sozialwissenschaften
Switching away
Mismatching middle options
Measuring respondents’ attitudes is a crucial task in numerous social science disciplines. A popular way to measure attitudes is to use survey questions with rating scales. However, research has shown that especially the design of rating scales can have a profound impact on respondents’ answer behavior. While some scale design aspects, such as scale length and direction, are frequently researched, some other scale design aspects, such as scale mi…
Evaluating political parties
The rise of smartphone surveys, coupled with technological advancements, provide new ways for measuring respondents’ political attitudes. The use of open questions with requests for voice answers instead of text answers may simplify the answer process and provide nuanced information. So far, research comparing the measurement quality of text and voice answers is scarce. We therefore conducted an experiment in a smartphone survey (N = 2,402) to in…
Repeatedly Measuring Political Interest
It is common practice in behavioral and social sciences to repeat questions, such as in pretest–posttest designs. However, if respondents recall their first answer to a repeated question and use it to decide their second answer, this may cause memory effects, affecting empirical findings. So far, only a few studies have investigated respondents’ recall ability and memory effects in surveys. Thus, we conducted an experiment in a probability-based …
Measuring Income (In)equality
In social science research, unipolar and bipolar scales are commonly used methods in measuring respondents’ attitudes and opinions. Compared to other rating scale characteristics, scale polarity (unipolar and bipolar) and its effects on response behavior have rarely been addressed in previous research. To fill this gap in the literature, we investigate whether and to what extent fully verbalized unipolar and bipolar scales influence response beha…
Completion Conditions and Response Behavior in Smartphone Surveys
This study utilizes acceleration data from smartphone sensors to predict motion conditions of smartphone respondents. Specifically, we predict whether respondents are moving or nonmoving on a survey page level to learn about distractions and the situational conditions under which respondents complete smartphone surveys. The predicted motion conditions allow us to (1) estimate the proportion of smartphone respondents who are moving during survey c…
Augmenting Surveys With Data From Sensors and Apps
The increasing volume of “Big Data” produced by sensors and smart devices can transform the social and behavioral sciences. Several successful studies used digital data to provide new insights into social reality. This special issue argues that the true power of these data for the social sciences lies in connecting new data sources with surveys. While new digital data are rich in volume, they seldomly cover the full population nor do they provide…
Looking up Answers to Political Knowledge Questions in Web Surveys
Political knowledge can affect measures obtained in public opinion research and political science. When asked political knowledge questions, some respondents look up the answers online, inflating political knowledge scores. This response behavior is detectable in web surveys using paradata. This study investigates whether and to what extent respondents switch away from the survey to search for answers online using JavaScript OnBlur functions. Res…
Investigating the Adequacy of Response Time Outlier Definitions in Computer-Based Web Surveys Using Paradata SurveyFocus
Web surveys are commonly used in social research because they are usually cheaper, faster, and simpler to conduct than other modes. They also enable researchers to capture paradata such as response times. Particularly, the determination of proper values to define outliers in response time analyses has proven to be an intricate challenge. In fact, to a certain degree, researchers determine them arbitrarily. In this study, we use “SurveyFocus (SF)”…
Scale direction effects in agree/disagree and item-specific questions
The effect of the response scale direction on response behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such response order effects occur, the literature reports mixed evidence. Furthermore, different question formats seem to vary in their susceptibility to these effects. We therefore investigate the occurrence of response order effects in Agree/Disagree (A/D) and Item-Specific (IS) ques…
Augmenting Surveys With Data From Sensors and Apps
The increasing volume of “Big Data” produced by sensors and smart devices can transform the social and behavioral sciences. Several successful studies used digital data to provide new insights into social reality. This special issue argues that the true power of these data for the social sciences lies in connecting new data sources with surveys. While new digital data are rich in volume, they seldomly cover the full population nor do they provide…
How to Detect and Influence Looking Up Answers to Political Knowledge Questions in Web Surveys
When answering political knowledge questions in web surveys, respondents can look up the correct answer on the Internet. This response behavior artificially inflates political knowledge scores that are supposed to measure fact-based information. In the present study, we address the existing knowledge gaps of previous research regarding looking up answers to political knowledge questions in web surveys. We conducted an experimental study based on …
Evaluating political parties
The rise of smartphone surveys, coupled with technological advancements, provide new ways for measuring respondents’ political attitudes. The use of open questions with requests for voice answers instead of text answers may simplify the answer process and provide nuanced information. So far, research comparing the measurement quality of text and voice answers is scarce. We therefore conducted an experiment in a smartphone survey (N = 2,402) to in…
Investigating Cognitive Effort and Response Quality of Question Formats in Web Surveys Using Paradata
Measuring attitudes and opinions employing agree/disagree (A/D) questions is a common method in social research because it appears to be possible to measure different constructs with identical response scales. However, theoretical considerations suggest that A/D questions require a considerable cognitive processing. Item-specific (IS) questions, in contrast, offer content-related response categories, implying less cognitive processing. To investi…
Typing or Speaking? Comparing Text and Voice Answers to Open Questions on Sensitive Topics in Smartphone Surveys
The smartphone increase in web surveys, coupled with technological developments, provides novel opportunities for measuring attitudes. For example, smartphones allow the collection of voice instead of text answers by using the built-in microphone. This may facilitate answering questions with open answer formats resulting in richer information and higher data quality. So far, there is only a little body of research investigating voice and text ans…
Mismatching middle options
Measuring respondents’ attitudes is a crucial task in numerous social science disciplines. A popular way to measure attitudes is to use survey questions with rating scales. However, research has shown that especially the design of rating scales can have a profound impact on respondents’ answer behavior. While some scale design aspects, such as scale length and direction, are frequently researched, some other scale design aspects, such as scale mi…
Eye-tracking methodology
In social research, the use of agree/disagree (A/D) questions is a popular method for measuring attitudes. Research has shown that A/D questions require complex cognitive processing and are susceptible to response bias. Thus, some researchers recommend the use of item-specific (IS) questions. This study examines the processing of A/D and IS questions, using eye-tracking methodology. By recording respondents’ eye movements, how respondents process…
Measurement properties of completely and end labeled unipolar and bipolar scales in Likert-type questions on income (in)equality
Measuring Income (In)equality
In social science research, unipolar and bipolar scales are commonly used methods in measuring respondents’ attitudes and opinions. Compared to other rating scale characteristics, scale polarity (unipolar and bipolar) and its effects on response behavior have rarely been addressed in previous research. To fill this gap in the literature, we investigate whether and to what extent fully verbalized unipolar and bipolar scales influence response beha…
Investigating the impact of violations of the “left and top means first” heuristic on response behavior and data quality
Web surveys are an established data collection mode that use written language to provide information. The written language is accompanied by visual elements, such as presentation formats and shapes. However, research has shown that visual elements influence response behavior because respondents sometimes use interpretive heuristics to make sense of the visual elements. One such heuristic is the ‘left and top means first’ (LTMF) heuristic, which s…
Scale direction effects in agree/disagree and item-specific questions
The effect of the response scale direction on response behavior is a well-known phenomenon in survey research. While there are several approaches to explaining how such response order effects occur, the literature reports mixed evidence. Furthermore, different question formats seem to vary in their susceptibility to these effects. We therefore investigate the occurrence of response order effects in Agree/Disagree (A/D) and Item-Specific (IS) ques…
Investigating the Adequacy of Response Time Outlier Definitions in Computer-Based Web Surveys Using Paradata SurveyFocus
Web surveys are commonly used in social research because they are usually cheaper, faster, and simpler to conduct than other modes. They also enable researchers to capture paradata such as response times. Particularly, the determination of proper values to define outliers in response time analyses has proven to be an intricate challenge. In fact, to a certain degree, researchers determine them arbitrarily. In this study, we use “SurveyFocus (SF)”…
Investigating Cognitive Effort and Response Quality of Question Formats in Web Surveys Using Paradata
Measuring attitudes and opinions employing agree/disagree (A/D) questions is a common method in social research because it appears to be possible to measure different constructs with identical response scales. However, theoretical considerations suggest that A/D questions require a considerable cognitive processing. Item-specific (IS) questions, in contrast, offer content-related response categories, implying less cognitive processing. To investi…
Eye-tracking methodology
In social research, the use of agree/disagree (A/D) questions is a popular method for measuring attitudes. Research has shown that A/D questions require complex cognitive processing and are susceptible to response bias. Thus, some researchers recommend the use of item-specific (IS) questions. This study examines the processing of A/D and IS questions, using eye-tracking methodology. By recording respondents’ eye movements, how respondents process…
SurveyMotion
Participation in web surveys via smartphones increased continuously in recent years. The reasons for this increase are a growing proportion of smartphone owners and an increase in mobile Internet access. However, research has shown that smartphone respondents are frequently distracted and/or multitasking, which might affect completion and response behavior in a negative way. We propose ‘SurveyMotion (SMotion)’, a JavaScript-based tool for mobile …
Investigating the impact of violations of the “left and top means first” heuristic on response behavior and data quality
Web surveys are an established data collection mode that use written language to provide information. The written language is accompanied by visual elements, such as presentation formats and shapes. However, research has shown that visual elements influence response behavior because respondents sometimes use interpretive heuristics to make sense of the visual elements. One such heuristic is the ‘left and top means first’ (LTMF) heuristic, which s…
Grundlagen - Methoden - Anwendungen in den Sozialwissenschaften
Switching away
Mismatching middle options
Measuring respondents’ attitudes is a crucial task in numerous social science disciplines. A popular way to measure attitudes is to use survey questions with rating scales. However, research has shown that especially the design of rating scales can have a profound impact on respondents’ answer behavior. While some scale design aspects, such as scale length and direction, are frequently researched, some other scale design aspects, such as scale mi…
Evaluating political parties
The rise of smartphone surveys, coupled with technological advancements, provide new ways for measuring respondents’ political attitudes. The use of open questions with requests for voice answers instead of text answers may simplify the answer process and provide nuanced information. So far, research comparing the measurement quality of text and voice answers is scarce. We therefore conducted an experiment in a smartphone survey (N = 2,402) to in…
Repeatedly Measuring Political Interest
It is common practice in behavioral and social sciences to repeat questions, such as in pretest–posttest designs. However, if respondents recall their first answer to a repeated question and use it to decide their second answer, this may cause memory effects, affecting empirical findings. So far, only a few studies have investigated respondents’ recall ability and memory effects in surveys. Thus, we conducted an experiment in a probability-based …
Measuring Income (In)equality
In social science research, unipolar and bipolar scales are commonly used methods in measuring respondents’ attitudes and opinions. Compared to other rating scale characteristics, scale polarity (unipolar and bipolar) and its effects on response behavior have rarely been addressed in previous research. To fill this gap in the literature, we investigate whether and to what extent fully verbalized unipolar and bipolar scales influence response beha…
Completion Conditions and Response Behavior in Smartphone Surveys
This study utilizes acceleration data from smartphone sensors to predict motion conditions of smartphone respondents. Specifically, we predict whether respondents are moving or nonmoving on a survey page level to learn about distractions and the situational conditions under which respondents complete smartphone surveys. The predicted motion conditions allow us to (1) estimate the proportion of smartphone respondents who are moving during survey c…
Augmenting Surveys With Data From Sensors and Apps
The increasing volume of “Big Data” produced by sensors and smart devices can transform the social and behavioral sciences. Several successful studies used digital data to provide new insights into social reality. This special issue argues that the true power of these data for the social sciences lies in connecting new data sources with surveys. While new digital data are rich in volume, they seldomly cover the full population nor do they provide…
Squats in Surveys
Digital health data that accompany data from traditional surveys are becoming increasingly important in health-related research. For instance, smartphones have many built-in sensors, such as accelerometers that measure acceleration so that they offer many new research possibilities. Such acceleration data can be used as a more objective supplement to health and physical fitness measures (or survey questions). In this study, we therefore investiga…
Are respondents ready for audio and voice communication channels in online surveys
Technological advancements and changes in online survey participation pave the way for new data collection methods. Particularly, the increasing smartphone rate in online surveys facilitates a re-consideration of prevailing communication channels to, for instance, naturalize the communication process between researchers and respondents and to collect more in-depth and high-quality data. However, so far, there is a lack of information on whether r…
Measuring subjective social stratification
Previous research has shown that question characteristics, such as the shape of rating scales, can affect how respondents interpret and respond to questions. For example, earlier studies reported different response distributions for questions employing rating scales in the form of a ladder and in the form of a pyramid. The current experiment, implemented in a probability-based online panel (N = 4,377), re-visits and extends this research by exami…
Looking up Answers to Political Knowledge Questions in Web Surveys
Political knowledge can affect measures obtained in public opinion research and political science. When asked political knowledge questions, some respondents look up the answers online, inflating political knowledge scores. This response behavior is detectable in web surveys using paradata. This study investigates whether and to what extent respondents switch away from the survey to search for answers online using JavaScript OnBlur functions. Res…
Measurement properties of completely and end labeled unipolar and bipolar scales in Likert-type questions on income (in)equality
New insights on respondents’ recall ability and memory effects when repeatedly measuring political efficacy
Many study designs in social science research rely on repeated measurements implying that the same respondents are asked the same (or nearly the same) questions at least twice. An assumption made by such study designs is that respondents second answer does not depend on their first answer. However, if respondents recall their initial answer and base their second answer on it memory effects may affect the survey outcome. In this study, I investiga…
Evaluating the response effort and data quality of established political solidarity measures
This experimental study aims to check and improve the quality of 16 established survey measures of political solidarities and related concepts, such as redistribution and social trust. Political solidarities are defined as one’s willingness to share the costs that result from public redistribution that favours people other than oneself and thus constitute a subset of welfare state attitudes. The pre-registered study plan included suggestions for …
Differences in measurement quality depending on recall
A large body of studies estimate the measurement quality of survey questions using multitrait-multimethod (MTMM) experiments. In these experiments, respondents are asked (nearly) identical questions at least twice. Most commonly, this is done within the same survey by, for instance, changing the response scale characteristics. However, it has frequently been argued that the estimates from these experiments might be biased when respondents recall …
Is there a growing use of mobile devices in web surveys? Evidence from 128 web surveys in Germany
Recent advances in web survey methodology were motivated by the observation that respondents increasingly use mobile devices, such as smartphones and tablets, to participate in web surveys. Even though we do not doubt this general observation, we argue that the claim is lacking a solid empirical basis. Most research on increasing mobile device use in web surveys covers limited periods of time and/or analyzes data from only one study or panel. The…
Question order effects
The measurement of political solidarities and related concepts is an important endeavor in numerous scientific disciplines, such as political and social science research. European surveys, such as the Eurobarometer, frequently measure these concepts for people's home country and Europe raising questions with respect to the order of precedence. Research has shown that the order of asking questions can have a profound impact on answer behavior comp…
How to Detect and Influence Looking Up Answers to Political Knowledge Questions in Web Surveys
When answering political knowledge questions in web surveys, respondents can look up the correct answer on the Internet. This response behavior artificially inflates political knowledge scores that are supposed to measure fact-based information. In the present study, we address the existing knowledge gaps of previous research regarding looking up answers to political knowledge questions in web surveys. We conducted an experimental study based on …
Psychology (25 obras) · Survey Methodology and Nonresponse (24 obras) · Computer Science (19 obras) · Social Psychology (15 obras) · Mathematics (12 obras) · Social and Intergroup Psychology (11 obras) · Social Psychology (10 obras) · Statistics (10 obras) · World Wide Web (10 obras) · Political science (9 obras)