Dorothée Behr
Dados Biográficos
| ID | 120334 |
|---|---|
| NOME | Dorothée Behr |
| PRENOMES | Dorothée |
| SOBRENOME | Behr |
| ASSINATURA | BEHR D |
| AFILIAÇÕES | GESIS - Leibniz Institute for the Social Sciences |
| ORCID | 0000-0002-2653-0531 |
| VERIFICADO | Sim |
| TOTAL DE OBRAS | 14 |
| TOTAL DE CITAÇÕES | 128 |
| TOTAL COMO AUTOR | 13 |
| TOTAL COMO EDITOR | 0 |
| PRIMEIRO ANO DE PUBLICAÇÃO | 2012 |
| ANO MAIS RECENTE DE PUBLICAÇÃO | 2024 |
| ÍNDICE H | 7 |
Showcasing the usefulness of web probing
It is generally taken for granted that comparability in comparative research hinges, among others, on the quality of questionnaire translations. However, what do slight differences in translation mean for respondents’ answers? In this article, we look at a combination of quantitative evidence from split-ballot experiments and qualitative evidence from additional probing questions for three items that were translated according to different transla…
Using Machine Translation and Post-Editing in the TRAPD Approach
A highly controlled experimental setting using a sample of questions from the European Social Survey (ESS) and European Values Study (EVS) was used to test the effects of integrating machine translation and post-editing into the Translation, Review, Adjudication, Pretesting, and Documentation (TRAPD) approach in survey translation. Four experiments were conducted in total, two concerning the language pair English-German and two in the language pa…
Measurement invariance in the social sciences
Open-ended versus Closed Probes
The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is in a closed format, whereby the response categories for the closed probes are developed during previo…
Exploring Mental Models behind Self-rated Health and Subjective Life Expectancy through Web Probing
Self-rated health (SRH) and subjective life expectancy (SLE) are widely used for understanding health and predicting mortality. However, what these items measure remains unclear, due to the lack of conceptual frameworks. We administered a web survey across the United States, Great Britain, Germany, Spain, and Mexico. The questionnaire included SRH and SLE, each immediately followed by a question that probed respondents' thought processes. We exam…
Using Apples and Oranges to Judge Quality? Selection of Appropriate Cross-National Indicators of Response Quality in Open-Ended Questions
Methodological studies usually gauge response quality in narrative open-ended questions with the proportion of nonresponse, response length, response time, and number of themes mentioned by respondents. However, not all of these indicators may be comparable and appropriate for evaluating open-ended questions in a cross-national context. This study assesses the cross-national appropriateness of these indicators and their potential bias. For the an…
Assessing the use of back translation
Back translation – the ‘re-translation’ of a translated questionnaire back into the original language and the subsequent comparison of the original version and the back translation – is a controversial assessment method for questionnaire translations. Recently, cross-cultural survey methodologists have followed the call for more empirical research on this method. This article adds to the small body of research by drawing on the back translation d…
Comparing Cognitive Interviewing and Online Probing
This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific national pride. While probing answers in CI show indications for a higher response quality, OP can comp…
Translating Answers to Open-ended Survey Questions in Cross-cultural Research
Open-ended probing questions in cross-cultural surveys help uncover equivalence problems in cross-cultural survey research. For languages that a project team does not understand, probe answers need to be translated into a common project language. This article presents a case study on translating open-ended, that is, narrative answers. It describes how the translation can be approached to obtain high-quality translations and how translation, codin…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Assessing the use of back translation
Back translation – the ‘re-translation’ of a translated questionnaire back into the original language and the subsequent comparison of the original version and the back translation – is a controversial assessment method for questionnaire translations. Recently, cross-cultural survey methodologists have followed the call for more empirical research on this method. This article adds to the small body of research by drawing on the back translation d…
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Measurement invariance in the social sciences
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
Comparing Cognitive Interviewing and Online Probing
This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific national pride. While probing answers in CI show indications for a higher response quality, OP can comp…
Translating Answers to Open-ended Survey Questions in Cross-cultural Research
Open-ended probing questions in cross-cultural surveys help uncover equivalence problems in cross-cultural survey research. For languages that a project team does not understand, probe answers need to be translated into a common project language. This article presents a case study on translating open-ended, that is, narrative answers. It describes how the translation can be approached to obtain high-quality translations and how translation, codin…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
Exploring Mental Models behind Self-rated Health and Subjective Life Expectancy through Web Probing
Self-rated health (SRH) and subjective life expectancy (SLE) are widely used for understanding health and predicting mortality. However, what these items measure remains unclear, due to the lack of conceptual frameworks. We administered a web survey across the United States, Great Britain, Germany, Spain, and Mexico. The questionnaire included SRH and SLE, each immediately followed by a question that probed respondents' thought processes. We exam…
Open-ended versus Closed Probes
The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is in a closed format, whereby the response categories for the closed probes are developed during previo…
Using Apples and Oranges to Judge Quality? Selection of Appropriate Cross-National Indicators of Response Quality in Open-Ended Questions
Methodological studies usually gauge response quality in narrative open-ended questions with the proportion of nonresponse, response length, response time, and number of themes mentioned by respondents. However, not all of these indicators may be comparable and appropriate for evaluating open-ended questions in a cross-national context. This study assesses the cross-national appropriateness of these indicators and their potential bias. For the an…
Using Machine Translation and Post-Editing in the TRAPD Approach
A highly controlled experimental setting using a sample of questions from the European Social Survey (ESS) and European Values Study (EVS) was used to test the effects of integrating machine translation and post-editing into the Translation, Review, Adjudication, Pretesting, and Documentation (TRAPD) approach in survey translation. Four experiments were conducted in total, two concerning the language pair English-German and two in the language pa…
Assessing Cross-National Equivalence of Measures of Xenophobia
When items eliciting attitudes or beliefs toward immigrants are used in cross-national research, equivalence of measurement across countries is a necessary prerequisite. Equivalence requires that respondents in all countries have at least ‘‘comparable’’ groups of immigrants in mind, although this might include different groups in terms of ethnicity, education, or legal status, for instance. The ideal situation that respondents have exactly the sa…
Asking Probing Questions in Web Surveys
Cognitive interviewing is a well-established method for evaluating and improving a questionnaire prior to fielding. However, its present implementation brings with it some challenges, notably in terms of small sample sizes or the possibility of interviewer effects. In this study, the authors test web surveys through nonprobability online panels as a supplemental means to implement cognitive interviewing techniques. The overall goal is to tackle t…
Cognitive Probes in Web Surveys
In this study, we explore to what extent the visual presentation of open-ended probes, in connection with different prior probing exposure, impacts on response quality. We experiment with two text box sizes for a specific immigrant probe ( Which type of immigrants were you thinking of when you answered the question?). On the one hand, we use a standard size equal to the other text box sizes in the survey but oversized for the specific response ta…
Testing the Validity of Gender Ideology Items by Implementing Probing Questions in Web Surveys
This article examines the use of probing techniques in web surveys to identify validity problems of items. Conventional cognitive interviewing is usually based on small sample sizes and thus precludes quantifying the findings in a meaningful way or testing small or special subpopulations characterized by their response behavior. This article investigates probing in web surveys as a supplementary way to look at item validity. Data come from a web …
Translating Answers to Open-ended Survey Questions in Cross-cultural Research
Open-ended probing questions in cross-cultural surveys help uncover equivalence problems in cross-cultural survey research. For languages that a project team does not understand, probe answers need to be translated into a common project language. This article presents a case study on translating open-ended, that is, narrative answers. It describes how the translation can be approached to obtain high-quality translations and how translation, codin…
Assessing the use of back translation
Back translation – the ‘re-translation’ of a translated questionnaire back into the original language and the subsequent comparison of the original version and the back translation – is a controversial assessment method for questionnaire translations. Recently, cross-cultural survey methodologists have followed the call for more empirical research on this method. This article adds to the small body of research by drawing on the back translation d…
Comparing Cognitive Interviewing and Online Probing
This study compares the application of probing techniques in cognitive interviewing (CI) and online probing (OP). Even though the probing is similar, the methods differ regarding typical mode setting, sample size, level of interactivity, and goals. We analyzed probing answers to the International Social Survey Programme item battery on specific national pride. While probing answers in CI show indications for a higher response quality, OP can comp…
Using Apples and Oranges to Judge Quality? Selection of Appropriate Cross-National Indicators of Response Quality in Open-Ended Questions
Methodological studies usually gauge response quality in narrative open-ended questions with the proportion of nonresponse, response length, response time, and number of themes mentioned by respondents. However, not all of these indicators may be comparable and appropriate for evaluating open-ended questions in a cross-national context. This study assesses the cross-national appropriateness of these indicators and their potential bias. For the an…
Exploring Mental Models behind Self-rated Health and Subjective Life Expectancy through Web Probing
Self-rated health (SRH) and subjective life expectancy (SLE) are widely used for understanding health and predicting mortality. However, what these items measure remains unclear, due to the lack of conceptual frameworks. We administered a web survey across the United States, Great Britain, Germany, Spain, and Mexico. The questionnaire included SRH and SLE, each immediately followed by a question that probed respondents' thought processes. We exam…
Measurement invariance in the social sciences
Open-ended versus Closed Probes
The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is in a closed format, whereby the response categories for the closed probes are developed during previo…
Showcasing the usefulness of web probing
It is generally taken for granted that comparability in comparative research hinges, among others, on the quality of questionnaire translations. However, what do slight differences in translation mean for respondents’ answers? In this article, we look at a combination of quantitative evidence from split-ballot experiments and qualitative evidence from additional probing questions for three items that were translated according to different transla…
Using Machine Translation and Post-Editing in the TRAPD Approach
A highly controlled experimental setting using a sample of questions from the European Social Survey (ESS) and European Values Study (EVS) was used to test the effects of integrating machine translation and post-editing into the Translation, Review, Adjudication, Pretesting, and Documentation (TRAPD) approach in survey translation. Four experiments were conducted in total, two concerning the language pair English-German and two in the language pa…
Psychology (12 obras) · Computer Science (10 obras) · Survey Methodology and Nonresponse (9 obras) · Sociology (7 obras) · Artificial Intelligence (6 obras) · Interview (5 obras) · Quality (philosophy (5 obras) · Social Psychology (5 obras) · Statistics (5 obras) · Applied Psychology (4 obras)