Lars Kaczmirek
Biographic Data
| ID | 133763 |
|---|---|
| NAME | Lars Kaczmirek |
| GIVEN NAMES | Lars |
| FAMILY NAME | Kaczmirek |
| SIGNATURE | KACZMIREK L |
| AFFILIATIONS | GESIS - Leibniz Institute for the Social Sciences |
| ORCID | 0000-0003-4868-2541 |
| VERIFIED | Yes |
| TOTAL WORKS | 12 |
| TOTAL CITATIONS | 94 |
| AUTHOR COUNT | 11 |
| EDITOR COUNT | 1 |
| FIRST PUBLICATION YEAR | 2007 |
| LATEST PUBLICATION YEAR | 2023 |
| H-INDEX | 6 |
A meta-analysis of worldwide recruitment rates in 23 probability-based online panels, between 2007 and 2019
This study is a meta-analysis of overall recruitment rate (ORR) in probability-based online panel research. In this study, we included 23 general population probability-based online panels (out of 28 identified and described) covering 15 countries and provided a comprehensive overview of their methodological approaches to recruitment. We calculated the average ORR and carried out a meta-regression with selected moderators. On average less than 1 …
Social and Behavioral Research and the Internet
Highlighting the progress made by researchers in using Web-based surveys for data collection, this timely volume summarizes the experiences of leading behavioral and social scientists from Europe and the US who collected data using the Internet. Some chapters present theory, methodology, design, and implementation, while others focus on best practice examples and/or issues such as data quality and understanding paradata. A number of contributors …
Left Feels Right
The literature on human-computer interaction consistently stresses the importance of reducing the cognitive effort required by users who interact with a computer in order to improve the experience and enhance usability and comprehension. Applying this perspective to web surveys, questionnaire designers are advised to strive for layouts that facilitate the response process and reduce the effort required to select an answer. In this article, we exa…
How Do Respondents Attend to Verbal Labels in Rating Scales
Two formats of labeling in rating scales are commonly used in questionnaires: verbal labels for end categories only (END form) and verbal labels for each of the categories (ALL form). We examine attention processes and respondents' burden in using verbal labels in rating scales. Attention was tracked in a laboratory setting employing eye-tracking technology. The results of the two experiments are presented: One applied seven and the other applied…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
Sample Composition Discrepancies in Different Stages of a Probability-based Online Panel
We report sample composition discrepancies related to demographic and personality variables occurring in different stages of development of a probability-based online panel. The first stage-selecting eligible participants-produces differences between Internet users and nonusers in age, education, and gender distribution as well as in the personality traits of openness to experience, conscientiousness, and extraversion. The second and third stages…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Seeing Through the Eyes of the Respondent
Asking questions is the predominant method of gathering information about people’s beliefs, values, attitudes, behaviors, and states of affairs (e.g., Foddy, 1993; Schuman & Presser, 1981). To ensure that the data obtained through surveys are reliable and lead to valid conclusions, respondents must comprehend the questions as intended by the survey designer and find it easy to answer them accurately. More specifically, they must understand the it…
Cognitive burden of survey questions and response times
An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To exa…
Prenotification in Web-Based Access Panel Surveys
To compare the effectiveness of different prenotification and invitation procedures in a web-based three-wave access panel survey over 3 consecutive months, we experimentally varied the contact mode in a fully crossed two-factorial design with (a) three different prenotification conditions (mobile short messaging service [SMS], e-mail, no prenotice) and (b) two “invitation and reminder” conditions (SMS, e-mail). A group with nearly complete mobil…
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Seeing Through the Eyes of the Respondent
Asking questions is the predominant method of gathering information about people’s beliefs, values, attitudes, behaviors, and states of affairs (e.g., Foddy, 1993; Schuman & Presser, 1981). To ensure that the data obtained through surveys are reliable and lead to valid conclusions, respondents must comprehend the questions as intended by the survey designer and find it easy to answer them accurately. More specifically, they must understand the it…
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
How Do Respondents Attend to Verbal Labels in Rating Scales
Two formats of labeling in rating scales are commonly used in questionnaires: verbal labels for end categories only (END form) and verbal labels for each of the categories (ALL form). We examine attention processes and respondents' burden in using verbal labels in rating scales. Attention was tracked in a laboratory setting employing eye-tracking technology. The results of the two experiments are presented: One applied seven and the other applied…
Prenotification in Web-Based Access Panel Surveys
To compare the effectiveness of different prenotification and invitation procedures in a web-based three-wave access panel survey over 3 consecutive months, we experimentally varied the contact mode in a fully crossed two-factorial design with (a) three different prenotification conditions (mobile short messaging service [SMS], e-mail, no prenotice) and (b) two “invitation and reminder” conditions (SMS, e-mail). A group with nearly complete mobil…
Left Feels Right
The literature on human-computer interaction consistently stresses the importance of reducing the cognitive effort required by users who interact with a computer in order to improve the experience and enhance usability and comprehension. Applying this perspective to web surveys, questionnaire designers are advised to strive for layouts that facilitate the response process and reduce the effort required to select an answer. In this article, we exa…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
A meta-analysis of worldwide recruitment rates in 23 probability-based online panels, between 2007 and 2019
This study is a meta-analysis of overall recruitment rate (ORR) in probability-based online panel research. In this study, we included 23 general population probability-based online panels (out of 28 identified and described) covering 15 countries and provided a comprehensive overview of their methodological approaches to recruitment. We calculated the average ORR and carried out a meta-regression with selected moderators. On average less than 1 …
Sample Composition Discrepancies in Different Stages of a Probability-based Online Panel
We report sample composition discrepancies related to demographic and personality variables occurring in different stages of development of a probability-based online panel. The first stage-selecting eligible participants-produces differences between Internet users and nonusers in age, education, and gender distribution as well as in the personality traits of openness to experience, conscientiousness, and extraversion. The second and third stages…
Prenotification in Web-Based Access Panel Surveys
To compare the effectiveness of different prenotification and invitation procedures in a web-based three-wave access panel survey over 3 consecutive months, we experimentally varied the contact mode in a fully crossed two-factorial design with (a) three different prenotification conditions (mobile short messaging service [SMS], e-mail, no prenotice) and (b) two “invitation and reminder” conditions (SMS, e-mail). A group with nearly complete mobil…
Cognitive burden of survey questions and response times
An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To exa…
Seeing Through the Eyes of the Respondent
Asking questions is the predominant method of gathering information about people’s beliefs, values, attitudes, behaviors, and states of affairs (e.g., Foddy, 1993; Schuman & Presser, 1981). To ensure that the data obtained through surveys are reliable and lead to valid conclusions, respondents must comprehend the questions as intended by the survey designer and find it easy to answer them accurately. More specifically, they must understand the it…
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
Sample Composition Discrepancies in Different Stages of a Probability-based Online Panel
We report sample composition discrepancies related to demographic and personality variables occurring in different stages of development of a probability-based online panel. The first stage-selecting eligible participants-produces differences between Internet users and nonusers in age, education, and gender distribution as well as in the personality traits of openness to experience, conscientiousness, and extraversion. The second and third stages…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
Left Feels Right
The literature on human-computer interaction consistently stresses the importance of reducing the cognitive effort required by users who interact with a computer in order to improve the experience and enhance usability and comprehension. Applying this perspective to web surveys, questionnaire designers are advised to strive for layouts that facilitate the response process and reduce the effort required to select an answer. In this article, we exa…
How Do Respondents Attend to Verbal Labels in Rating Scales
Two formats of labeling in rating scales are commonly used in questionnaires: verbal labels for end categories only (END form) and verbal labels for each of the categories (ALL form). We examine attention processes and respondents' burden in using verbal labels in rating scales. Attention was tracked in a laboratory setting employing eye-tracking technology. The results of the two experiments are presented: One applied seven and the other applied…
Social and Behavioral Research and the Internet
Highlighting the progress made by researchers in using Web-based surveys for data collection, this timely volume summarizes the experiences of leading behavioral and social scientists from Europe and the US who collected data using the Internet. Some chapters present theory, methodology, design, and implementation, while others focus on best practice examples and/or issues such as data quality and understanding paradata. A number of contributors …
A meta-analysis of worldwide recruitment rates in 23 probability-based online panels, between 2007 and 2019
This study is a meta-analysis of overall recruitment rate (ORR) in probability-based online panel research. In this study, we included 23 general population probability-based online panels (out of 28 identified and described) covering 15 countries and provided a comprehensive overview of their methodological approaches to recruitment. We calculated the average ORR and carried out a meta-regression with selected moderators. On average less than 1 …
Psychology (12 works) · Survey Methodology and Nonresponse (11 works) · Computer Science (10 works) · Cognition (5 works) · Cognitive psychology (5 works) · Social Psychology (5 works) · Sociology (5 works) · Artificial Intelligence (4 works) · Mathematics (4 works) · Social Media and Politics (4 works)