Roger E Millsap
Biographic Data
| ID | 225629 |
|---|---|
| NAME | Roger E Millsap |
| GIVEN NAMES | Roger E |
| FAMILY NAME | Millsap |
| SIGNATURE | MILLSAP R E |
| AFFILIATIONS | Arizona State University |
| ORCID | 0000-0002-9417-2860 |
| VERIFIED | Yes |
| TOTAL WORKS | 29 |
| TOTAL CITATIONS | 67 |
| AUTHOR COUNT | 28 |
| EDITOR COUNT | 1 |
| FIRST PUBLICATION YEAR | 1990 |
| LATEST PUBLICATION YEAR | 2017 |
| H-INDEX | 4 |
Testing measurement invariance in longitudinal data with ordered-categorical measures.
A goal of developmental research is to examine individual changes in constructs over time. The accuracy of the models answering such research questions hinges on the assumption of longitudinal measurement invariance: The repeatedly measured variables need to represent the same construct in the same metric over time. Measurement invariance can be studied through factor models examining the relations between the observed indicators and the latent c…
The Role of Social and Personal Identities in Self-Esteem Among Ethnic Minority College Students
3,009) as well as how personal and social identities are jointly associated with self-esteem. Results indicated that the structure of personal-social identity profiles significantly differed across ethnicity, but also indicated some commonalities. The study identified three profiles among Blacks, four among Asian Americans, and two among Latinos. Some personal-social identity profiles were common across multiple ethnic groups, but others were uni…
Mexican-Origin Youth Participation in Extracurricular Activities
Using the Bollen-Stine Bootstrapping Method for Evaluating Approximate Fit Indices
Accepting that a model will not exactly fit any empirical data, global approximate fit indices quantify the degree of misfit. Recent research (Chen et al., 2008) has shown that using fixed conventional cut-points for approximate fit indices can lead to decision errors. Instead of using fixed cut-points for evaluating approximate fit indices, this study focuses on the meaning of approximate fit and introduces a new method to evaluate approximate f…
Family Influences on Mexican American Adolescents’ Romantic Relationships
This study examined prospective associations between the family context and adolescents' romantic relationships as moderated by adolescents' gender and culture among Mexican American families ( N = 189). Adolescents at Time 1 (early adolescence) were on average 12.29 years of age ( SD = .50) and 54% female. Mothers and fathers reported on family structure and dynamics during early adolescence, and youth reported on their romantic relationship inv…
Participation Patterns Among Mexican–American Parents Enrolled in a Universal Intervention and Their Association with Child Externalizing Outcomes
This study used growth mixture modeling to examine attendance trajectories among 292 Mexican–American primary female caregivers enrolled in a universal preventive intervention and the effects of health beliefs, participation intentions, cultural influences, and intervention group cohesion on trajectory group membership as well as trajectory group differences on a distal outcome, immediate posttest teacher report of child externalizing (T2). Resul…
Quantitative Psychology Research
The 78th Annual Meeting of the Psychometric Society (IMPS) builds on the Psychometric Society's mission to share quantitative methods relevant to psychology. The chapters of this volume present cutting-edge work in the field. Topics include studies of item response theory, computerized adaptive testing, cognitive diagnostic modeling, and psychological scaling. Additional psychometric topics relate to structural equation modeling, factor analysis,…
Factorial Invariance in Multiple Populations
A multiple testing method for examining factorial invariance for latent constructs evaluated by multiple indicators in distinct populations is outlined. The procedure is based on the false discovery rate concept and multiple individual restriction tests and resolves general limitations of a popular factorial invariance testing approach. The discussed method controls the overall significance level and is associated with higher power than conventio…
Statistical Power for a Simultaneous Test of Factorial and Predictive Invariance
A common finding in studies of differential prediction across groups is that although regression slopes are the same or similar across groups, group differences exist in regression intercepts. Building on earlier work by Birnbaum (1979) , Millsap (1998) presented an invariant factor model that would explain such intercept differences as arising due to unique variance or measurement error in the predictors and criterion. The model can be tested ev…
Maternal Warmth Moderates the Link between Harsh Discipline and Later Externalizing Behaviors for Mexican American Adolescents
To understand the role of harsh discipline in the development of Mexican American youth outcomes, researchers must consider contextual variables that may affect youths' perceptions of their parents' behavior such as maternal warmth
Statistical Approaches to Measurement Invariance
This book reviews the statistical procedures used to detect measurement bias. Measurement bias is examined from a general latent variable perspective so as to accommodate different forms of testing in a variety of contexts including cognitive or clinical variables, attitudes, personality dimensions, or emotional states. Measurement models that underlie psychometric practice are described, including their strengths and limitations. Practical strat…
Sage Handbook of Quantitative Methods in Psychology
The Sage Handbook of Quantitative Methods in Psychology
Doctoral training in statistics, measurement, and methodology in psychology
In a survey of all PhD programs in psychology in the United States and Canada, the authors documented the quantitative methodology curriculum (statistics, measurement, and research design) to examine the extent to which innovations in quantitative methodology have diffused into the training of PhDs in psychology. In all, 201 psychology PhD programs (86%) participated. This survey replicated and extended a previous survey (L. S. Aiken, S. G. West,…
Academic Success of Mexican Origin Adolescent Boys and Girls
Mexican American Adolescents’ Cultural Orientation, Externalizing Behavior and Academic Engagement
This study of 598 7th grade students of Mexican origin examined the role of traditional cultural values as a mediator of the effects of immigrant status, Mexican cultural orientation and Anglo cultural orientation on adolescent externalizing behavior and academic engagement. Immigrant status of adolescents and their maternal caregivers uniquely predicted increased Mexican cultural orientation and decreased Anglo cultural orientation, and both Mex…
Measurement Bias Across Gender on the Children's Depression Inventory
Confirmatory factor analysis for ordered-categorical measures (CFA-OCM) and rating scale item response theory (IRT) analyses explore measurement bias across gender on the Children's Depression Inventory (CDI) in a community sample of 779 children in the third and sixth grades. Given the set of statistical criteria, IRT and CFA-OCM generally establish measurement equivalence. Results substantiate both Craighead et al.'s five-factor model and IRT m…
Engaging Mexican Origin Families in a School-Based Preventive Intervention
Positive Parenting as a Protective Resource for Parentally Bereaved Children
Positive parenting was examined as a protective resource against the adverse effects of negative life events on parentally bereaved children's mental health problems. The sample consisted of 313 recently bereaved children ages 8 to 16 and their current caregiver. Both the compensatory (direct effect independent of negative life events) and the stress-buffer (interactive effect with negative life events) protective resource models were examined an…
Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations.
Studies of factorial invariance examine whether a common factor model holds across multiple populations with identical parameter values. Partial factorial invariance exists when some, but not all, parameters are invariant. The literature on factorial invariance is unclear about what should be done if partial invariance is found. One approach to this problem evaluates the impact of partial invariance on accuracy of selection on the basis of a comp…
Assessing Factorial Invariance in Ordered-Categorical Measures
The factor analysis of ordered-categorical measures has been described in the literature on factor analysis, but the extension of the analysis to the multiple-population case is less well-known. For example, a comprehensive statement of identification conditions for the multiple-population case seems absent in the literature. We review this multiple-population extension here, with an emphasis on model specification and identification. The use of …
Group Differences in Regression Intercepts
Studies of differential prediction typically examine group differences in linear regression slopes or intercepts for predicting criterion scores from one or more test scores. When there are no group differences in slopes, what are the implications of differences in regression intercepts for the measurement equivalence of the tests or criterion across groups? Measurement equivalence is here defined as factorial invariance under a single-factor mod…
Measurement Invariance, Predictive Invariance, and the Duality Paradox
The statistical literature on bias in psychological testing distinguishes at least two forms of bias: measurement bias and predictive bias. Measurement bias concerns group differences in the relationship between a test and the latent variable to be measured. Predictive bias concerns group differences in the relationship between a test and an external criterion. How are these two forms of bias related? For example. if a test is unbiased in the pre…
Statistical Evidence in Salary Discrimination Studies
Fairness in the allocation of salary is often evaluated using statistical reasoning. A common principle is that among employees of equal merit, there should be no systematic differences in salary distributions between demographic groups. In practice, complete information on merit may be lacking. When observed measures of merit are incomplete or unreliable, statistical analyses that use such measures may be misleading. We present theoretical, nonp…
Methodology Review
Statistical methods developed over the last decade for detecting measurement bias in psycho logical and educational tests are reviewed. Earlier methods for assessing measurement bias generally have been replaced by more sophisticated statistical techniques, such as the Mantel-Haenszel procedure, the standardization approach, logistic regression models, and item response theory approaches. The review employs a conceptual framework that distin guis…
Academic Success of Mexican Origin Adolescent Boys and Girls
Mexican American Adolescents’ Cultural Orientation, Externalizing Behavior and Academic Engagement
This study of 598 7th grade students of Mexican origin examined the role of traditional cultural values as a mediator of the effects of immigrant status, Mexican cultural orientation and Anglo cultural orientation on adolescent externalizing behavior and academic engagement. Immigrant status of adolescents and their maternal caregivers uniquely predicted increased Mexican cultural orientation and decreased Anglo cultural orientation, and both Mex…
Family Influences on Mexican American Adolescents’ Romantic Relationships
This study examined prospective associations between the family context and adolescents' romantic relationships as moderated by adolescents' gender and culture among Mexican American families ( N = 189). Adolescents at Time 1 (early adolescence) were on average 12.29 years of age ( SD = .50) and 54% female. Mothers and fathers reported on family structure and dynamics during early adolescence, and youth reported on their romantic relationship inv…
Maternal Warmth Moderates the Link between Harsh Discipline and Later Externalizing Behaviors for Mexican American Adolescents
To understand the role of harsh discipline in the development of Mexican American youth outcomes, researchers must consider contextual variables that may affect youths' perceptions of their parents' behavior such as maternal warmth
Mexican-Origin Youth Participation in Extracurricular Activities
Positive Parenting as a Protective Resource for Parentally Bereaved Children
Positive parenting was examined as a protective resource against the adverse effects of negative life events on parentally bereaved children's mental health problems. The sample consisted of 313 recently bereaved children ages 8 to 16 and their current caregiver. Both the compensatory (direct effect independent of negative life events) and the stress-buffer (interactive effect with negative life events) protective resource models were examined an…
Participation Patterns Among Mexican–American Parents Enrolled in a Universal Intervention and Their Association with Child Externalizing Outcomes
This study used growth mixture modeling to examine attendance trajectories among 292 Mexican–American primary female caregivers enrolled in a universal preventive intervention and the effects of health beliefs, participation intentions, cultural influences, and intervention group cohesion on trajectory group membership as well as trajectory group differences on a distal outcome, immediate posttest teacher report of child externalizing (T2). Resul…
Quick-Reference Tables to Determine the Significance of the Difference between Two Correlation Coefficients from Two Independent Samples
A number of research questions (e.g., differential validity, moderator variables) require comparisons of correlation coefficients across independent populations. In the two population case, the test statistic used in these comparisons is not a simple function of the difference between the sample correlations. Hence, this difference is not a direct indicator of significance. The formula can be rewritten to give the value of the larger correlation …
Isolating Gender Differences in Test Anxiety
Using confirmatory factor analysis (CFA) with nonzero latent means, the factor structure of the Test Anxiety (Attitude) Inventory (TAI) across genders was investigated. Two underlying factors, worry and emotionality, have been identified in previous research efforts. A total of 501 college freshmen (219 men and 282 women) from a large urban university participated in the current study. Results support the invariance of the traditional two-factor …
Confirmatory Measurement Model Comparisons Using Latent Means
Confirmatory factor analysis (CFA) is often used to verify measurement models derived from classical test theory: the parallel, tau-equivalent, and congeneric test models. In this application, CFA is traditionally applied to the observed covariance or correlation matrix, ignoring the observed mean structure. But CFA is easily extended to allow nonzero observed and latent means. The use of CFA with nonzero latent means in testing six measurement m…
Some Mathematical Relationships Between Three-Mode Component Analysis and Stationary Component Analysis
One application of three-mode component analysis is in the analysis of longitudinal multivariate data. Millsap and Meredith (1988) have developed a component analysis method for this application that uses stationary compositing weights. This article presents theorems giving constraints which must be satisfied for equivalency between the component representations provided by three-mode component analysis and by methods employing stationary composi…
Methodology Review
Statistical methods developed over the last decade for detecting measurement bias in psycho logical and educational tests are reviewed. Earlier methods for assessing measurement bias generally have been replaced by more sophisticated statistical techniques, such as the Mantel-Haenszel procedure, the standardization approach, logistic regression models, and item response theory approaches. The review employs a conceptual framework that distin guis…
Statistical Evidence in Salary Discrimination Studies
Fairness in the allocation of salary is often evaluated using statistical reasoning. A common principle is that among employees of equal merit, there should be no systematic differences in salary distributions between demographic groups. In practice, complete information on merit may be lacking. When observed measures of merit are incomplete or unreliable, statistical analyses that use such measures may be misleading. We present theoretical, nonp…
Measurement Invariance, Predictive Invariance, and the Duality Paradox
The statistical literature on bias in psychological testing distinguishes at least two forms of bias: measurement bias and predictive bias. Measurement bias concerns group differences in the relationship between a test and the latent variable to be measured. Predictive bias concerns group differences in the relationship between a test and an external criterion. How are these two forms of bias related? For example. if a test is unbiased in the pre…
Group Differences in Regression Intercepts
Studies of differential prediction typically examine group differences in linear regression slopes or intercepts for predicting criterion scores from one or more test scores. When there are no group differences in slopes, what are the implications of differences in regression intercepts for the measurement equivalence of the tests or criterion across groups? Measurement equivalence is here defined as factorial invariance under a single-factor mod…
Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations.
Studies of factorial invariance examine whether a common factor model holds across multiple populations with identical parameter values. Partial factorial invariance exists when some, but not all, parameters are invariant. The literature on factorial invariance is unclear about what should be done if partial invariance is found. One approach to this problem evaluates the impact of partial invariance on accuracy of selection on the basis of a comp…
Assessing Factorial Invariance in Ordered-Categorical Measures
The factor analysis of ordered-categorical measures has been described in the literature on factor analysis, but the extension of the analysis to the multiple-population case is less well-known. For example, a comprehensive statement of identification conditions for the multiple-population case seems absent in the literature. We review this multiple-population extension here, with an emphasis on model specification and identification. The use of …
Positive Parenting as a Protective Resource for Parentally Bereaved Children
Positive parenting was examined as a protective resource against the adverse effects of negative life events on parentally bereaved children's mental health problems. The sample consisted of 313 recently bereaved children ages 8 to 16 and their current caregiver. Both the compensatory (direct effect independent of negative life events) and the stress-buffer (interactive effect with negative life events) protective resource models were examined an…
Measurement Bias Across Gender on the Children's Depression Inventory
Confirmatory factor analysis for ordered-categorical measures (CFA-OCM) and rating scale item response theory (IRT) analyses explore measurement bias across gender on the Children's Depression Inventory (CDI) in a community sample of 779 children in the third and sixth grades. Given the set of statistical criteria, IRT and CFA-OCM generally establish measurement equivalence. Results substantiate both Craighead et al.'s five-factor model and IRT m…
Engaging Mexican Origin Families in a School-Based Preventive Intervention
Doctoral training in statistics, measurement, and methodology in psychology
In a survey of all PhD programs in psychology in the United States and Canada, the authors documented the quantitative methodology curriculum (statistics, measurement, and research design) to examine the extent to which innovations in quantitative methodology have diffused into the training of PhDs in psychology. In all, 201 psychology PhD programs (86%) participated. This survey replicated and extended a previous survey (L. S. Aiken, S. G. West,…
Academic Success of Mexican Origin Adolescent Boys and Girls
Mexican American Adolescents’ Cultural Orientation, Externalizing Behavior and Academic Engagement
This study of 598 7th grade students of Mexican origin examined the role of traditional cultural values as a mediator of the effects of immigrant status, Mexican cultural orientation and Anglo cultural orientation on adolescent externalizing behavior and academic engagement. Immigrant status of adolescents and their maternal caregivers uniquely predicted increased Mexican cultural orientation and decreased Anglo cultural orientation, and both Mex…
The Sage Handbook of Quantitative Methods in Psychology
Sage Handbook of Quantitative Methods in Psychology
Statistical Approaches to Measurement Invariance
This book reviews the statistical procedures used to detect measurement bias. Measurement bias is examined from a general latent variable perspective so as to accommodate different forms of testing in a variety of contexts including cognitive or clinical variables, attitudes, personality dimensions, or emotional states. Measurement models that underlie psychometric practice are described, including their strengths and limitations. Practical strat…
Factorial Invariance in Multiple Populations
A multiple testing method for examining factorial invariance for latent constructs evaluated by multiple indicators in distinct populations is outlined. The procedure is based on the false discovery rate concept and multiple individual restriction tests and resolves general limitations of a popular factorial invariance testing approach. The discussed method controls the overall significance level and is associated with higher power than conventio…
Statistical Power for a Simultaneous Test of Factorial and Predictive Invariance
A common finding in studies of differential prediction across groups is that although regression slopes are the same or similar across groups, group differences exist in regression intercepts. Building on earlier work by Birnbaum (1979) , Millsap (1998) presented an invariant factor model that would explain such intercept differences as arising due to unique variance or measurement error in the predictors and criterion. The model can be tested ev…
Maternal Warmth Moderates the Link between Harsh Discipline and Later Externalizing Behaviors for Mexican American Adolescents
To understand the role of harsh discipline in the development of Mexican American youth outcomes, researchers must consider contextual variables that may affect youths' perceptions of their parents' behavior such as maternal warmth
Using the Bollen-Stine Bootstrapping Method for Evaluating Approximate Fit Indices
Accepting that a model will not exactly fit any empirical data, global approximate fit indices quantify the degree of misfit. Recent research (Chen et al., 2008) has shown that using fixed conventional cut-points for approximate fit indices can lead to decision errors. Instead of using fixed cut-points for evaluating approximate fit indices, this study focuses on the meaning of approximate fit and introduces a new method to evaluate approximate f…
Family Influences on Mexican American Adolescents’ Romantic Relationships
This study examined prospective associations between the family context and adolescents' romantic relationships as moderated by adolescents' gender and culture among Mexican American families ( N = 189). Adolescents at Time 1 (early adolescence) were on average 12.29 years of age ( SD = .50) and 54% female. Mothers and fathers reported on family structure and dynamics during early adolescence, and youth reported on their romantic relationship inv…
Participation Patterns Among Mexican–American Parents Enrolled in a Universal Intervention and Their Association with Child Externalizing Outcomes
This study used growth mixture modeling to examine attendance trajectories among 292 Mexican–American primary female caregivers enrolled in a universal preventive intervention and the effects of health beliefs, participation intentions, cultural influences, and intervention group cohesion on trajectory group membership as well as trajectory group differences on a distal outcome, immediate posttest teacher report of child externalizing (T2). Resul…
Statistics (18 works) · Mathematics (17 works) · Psychology (16 works) · Structural equation modeling (13 works) · Advanced Statistical Modeling Techniques (11 works) · Computer Science (11 works) · Confirmatory factor analysis (11 works) · Developmental psychology (11 works) · Econometrics (11 works) · Measurement invariance (10 works)