Stefanie A Wind
Biographic Data
| ID | 839706 |
|---|---|
| NAME | Stefanie A Wind |
| GIVEN NAMES | Stefanie A |
| FAMILY NAME | Wind |
| SIGNATURE | WIND S A |
| AFFILIATIONS | University of Alabama |
| ORCID | 0000-0002-1599-375X |
| VERIFIED | Yes |
| TOTAL WORKS | 43 |
| TOTAL CITATIONS | 15 |
| AUTHOR COUNT | 43 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 2013 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 2 |
Exploring the Psychometric Properties of the Learning Organisation Profile Among School Administrators
The purpose of this study is to explore the psychometric properties of the Learning Organisation Profile (LOP) instrument among a school personnel population using a modern measurement theory approach. Compared to previous studies in which researchers focused primarily on the dimensional structure of the LOP, our analysis included an item response theory approach that allowed us to evaluate individual items for evidence of useful psychometric pro…
Making Meaning of Item Response Theory in Counseling Research
A Longitudinal Examination of the Psychometric Properties of the Counselor Burnout Inventory in a Sample of Professional Counselors Using Item Response Theory
What Counseling Researchers Should Know About Evaluating Person Fit
Updating the Spatial Activities and Videogame Survey for Use in Development Research
Childhood experiences and activities, including sports, videogames, and toys, have long been of interest in understanding cognitive development and later individual differences. In particular, the malleability of spatial reasoning suggests that early experiences, including a variety of spatial activities, may have a significant impact on the development of students’ spatial ability skills. In the present study, we sought to update the most widely…
A multigroup invariance analysis of the association between information, communication and technology engagement on students’ reading achievement in public and private schools in the United States
A Computerized Adaptive Approach to Measuring Faculty Assessment Literacy
The purpose of this study was to generate an item bank for assessing faculty members’ assessment literacy and to examine the applicability and feasibility of a Computerized Adaptive Test (CAT) approach to monitor assessment literacy among faculty members. In developing this assessment using a sequential mixed-methods research design, our goal was to create a simple, quick, and precise screening tool for assessing literacy in higher education. Aft…
Exploring the psychometric characteristics of the Gendered Racial Microaggressions Scale in Black college women
The GRMS exhibited acceptable psychometric properties and can be used to understand the progression and nature of GRMs as a construct and to identify individuals who experience different frequencies and stress appraisals of GRMs. This instrument warrants use and exploration in future research. (PsycInfo Database Record (c) 2025 APA, all rights reserved)
Rater Connectedness Affects Student Achievement Estimates and Ordered Rankings in Formal Music Performance Assessments
A persistent concern in music performance assessments is the quality of ratings assigned by judges. Differences in rater judgment are most concerning in cases when student performances are scored by different raters (i.e., disconnected rating designs)—bringing into question the comparability of scores between raters and students. We used data from a formal solo music performance assessment to demonstrate and explore the impact of different data c…
Relative Adiposity and Body Dissatisfaction in Young Adult Sexual Minority Women
The purpose of this study was to examine potential differences in body mass index (BMI), relative adiposity (%Fat), and body dissatisfaction (BD) between heterosexual (HSW) and sexual minority women (SMW). Young adult women (n = 84; 23.8% SMW; 21.9 ± 3.8 years) were included in our analysis. %Fat was assessed using a four-compartment model. BD was assessed using the Body Shape Questionnaire (BSQ), the BD subscale of the Eating Disorders Inventory…
Gender differences in children’s fears
Children’s fears have received scholarly attention for well over 50 years. A considerable amount of literature has focused on such fear variables as fear intensity and fear prevalence scores and age and gender differences. We used meta-analysis to systematically review the findings related to gender differences in children’s fear intensity scores and fear prevalence scores and to examine the moderator effect of sample, year of study, and type of …
Item Response Theory
The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using IRT approaches to explore measurement precision. We discuss the theoretical foundations and assumption…
Item Response Theory Analysis of the Cultural Humility and Enactment Scale – Supervision
Detecting Rating Scale Malfunctioning With the Partial Credit Model and Generalized Partial Credit Model
Rating scale analysis techniques provide researchers with practical tools for examining the degree to which ordinal rating scales (e.g., Likert-type scales or performance assessment rating scales) function in psychometrically useful ways. When rating scales function as expected, researchers can interpret ratings in the intended direction (i.e., lower ratings mean “less” of a construct than higher ratings), distinguish between categories in the sc…
A sequential approach to detecting differential rater functioning in sparse rater-mediated assessment networks
Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting DRF may be limited in sparse rating designs, where it is not possible for every rater to score every s…
Acute Responses to High-Intensity Back Squats with Bilateral Blood Flow Restriction
This study examined the acute effects of high-intensity resistance exercise with blood flow restriction (BFR) on performance and fatigue, metabolic stress, and markers of inflammation (interleukin-6 (IL-6)), muscle damage (myoglobin), angiogenesis (vascular endothelial growth factor (VEGF)). Thirteen resistance-trained participants (four female, 24.8 ± 4.7 years) performed four sets of barbell back-squats (75% 1RM) to failure under two conditions…
Development of the Trauma-Informed Practice Scales – School Counseling Programs Version (Tips-SCP)
We evaluated the psychometric properties of the Trauma Informed Practice Scales – School Counseling Programs Version scores using item response theory with a sample of 270 school counselors. Participants ranged in age from 24 to 69 years (M = 42.82, SD = 9.96). Participants identified as female (81.5%), male (14.1%) or unreported (4.4%,). Participants' racial and ethnic backgrounds were: White (79.3%), African American or Black (5.6%), Multiracia…
Psychometric evaluation of a new internalization of learning motivation (ILM) scale
Identifying Problematic Item Characteristics With Small Samples Using Mokken Scale Analysis
Researchers frequently use Mokken scale analysis (MSA), which is a nonparametric approach to item response theory, when they have relatively small samples of examinees. Researchers have provided some guidance regarding the minimum sample size for applications of MSA under various conditions. However, these studies have not focused on item-level measurement problems, such as violations of monotonicity or invariant item ordering (IIO). Moreover, th…
Evaluating the Psychometric Properties of a Proposed Farsi Version of the Interpersonal Reactivity Index Using Item Response Theory
Purpose Although researchers have examined empathy among many populations worldwide, investigations of empathy among Farsi-speakers are limited. The purpose of this study is to evaluate the psychometric properties of the Interpersonal Reactivity Index (IRI) for Farsi-speakers (IRI-Farsi). Methods After translating, we explored psychometric properties of the IRI-Farsi with exploratory factor analysis and item response theory using a sample of Iran…
The Development of the Client Meaningful Experiences Scale
Item response theory was used to study the psychometric properties of the Client Meaningful Experiences Scale (CMES). In a sample of 306 adult counseling clients, we examined the dimensional structure of the scale, item-fit, and person-fit statistics. Implications of these findings for counselors, counselors-in-training, and counseling researchers were discussed
Development of the Trauma-Informed Practice Scales – Supervision Version (Tips-SV)
Using item response theory, we examined the psychometric properties of scores on the Trauma-Informed Practice Scales – Supervision Version (TIPS-SV) – a unidimensional measure of supervisees’ perceptions of their supervisors’ adherence to trauma-informed supervision – in a sample of 312 supervisees. Implications for research and supervision practice are discussed
Exploring the Impact of Missing Data on Residual-Based Dimensionality Analysis for Measurement Models
Researchers frequently use Rasch models to analyze survey responses because these models provide accurate parameter estimates for items and examinees when there are missing data. However, researchers have not fully considered how missing data affect the accuracy of dimensionality assessment in Rasch analyses such as principal components analysis (PCA) of standardized residuals. Because adherence to unidimensionality is a prerequisite for the appr…
Detecting Rater Biases in Sparse Rater-Mediated Assessment Networks
Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to facilitate model estimation. These incomplete scoring designs present challenges for detecting rater biases, or differential rater functioning (DRF). The purpose of this study is to illus…
An Examination of the Counselor Burnout Inventory Using Item Response Theory in Early Career Post-Master’s Counselors
We examined the psychometric properties of the Counselor Burnout Inventory (CBI) with 560 early career, post-master’s counselors. We tested the dimensional structure of the CBI, item ordering, and the function of the rating scale using item response theory. Implications of the findings for researchers, counselors, and counselor educators are discussed
An Examination of the Counselor Burnout Inventory Using Item Response Theory in Early Career Post-Master’s Counselors
We examined the psychometric properties of the Counselor Burnout Inventory (CBI) with 560 early career, post-master’s counselors. We tested the dimensional structure of the CBI, item ordering, and the function of the rating scale using item response theory. Implications of the findings for researchers, counselors, and counselor educators are discussed
What Counseling Researchers Should Know About Evaluating Person Fit
Development of the Trauma-Informed Practice Scales – Supervision Version (Tips-SV)
Using item response theory, we examined the psychometric properties of scores on the Trauma-Informed Practice Scales – Supervision Version (TIPS-SV) – a unidimensional measure of supervisees’ perceptions of their supervisors’ adherence to trauma-informed supervision – in a sample of 312 supervisees. Implications for research and supervision practice are discussed
Item Response Theory
The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using IRT approaches to explore measurement precision. We discuss the theoretical foundations and assumption…
Item Response Theory Analysis of the Cultural Humility and Enactment Scale – Supervision
Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments
The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard setting process employing the Multiple Yes-No, modified Angoff standard setting procedure to set the…
Rater fairness in music performance assessment
The purpose of this study was to investigate model-data fit and differential rater functioning in the context of large group music performance assessment using the Many-Facet Rasch Partial Credit Measurement Model. In particular, we sought to identify whether or not expert raters’ ( N = 24) severity was invariant across four school levels (middle school, high school, collegiate, professional). Interaction analyses suggested that differential rate…
Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis
Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rate…
Teacher evaluation
Adjacent-Categories Mokken Models for Rater-Mediated Assessments
Molenaar extended Mokken’s original probabilistic-nonparametric scaling models for use with polytomous data. These polytomous extensions of Mokken’s original scaling procedure have facilitated the use of Mokken scale analysis as an approach to exploring fundamental measurement properties across a variety of domains in which polytomous ratings are used, including rater-mediated educational assessments. Because their underlying item step response f…
Exploring Incomplete Rating Designs With Mokken Scale Analysis
Recent research has explored the use of models adapted from Mokken scale analysis as a nonparametric approach to evaluating rating quality in educational performance assessments. A potential limiting factor to the widespread use of these techniques is the requirement for complete data, as practical constraints in operational assessment systems often limit the use of complete rating designs. In order to address this challenge, this study explores …
The Stabilizing Influences of Linking Set Size and Model–Data Fit in Sparse Rater-Mediated Assessment Networks
Previous research includes frequent admonitions regarding the importance of establishing connectivity in data collection designs prior to the application of Rasch models. However, details regarding the influence of characteristics of the linking sets used to establish connections among facets, such as locations on the latent variable, model–data fit, and sample size, have not been thoroughly explored. These considerations are particularly importa…
Exploring Within-Rater Category Ordering
The interpretation of ratings from educational performance assessments assumes that rating scale categories are ordered as expected (i.e., higher ratings correspond to higher levels of judged student achievement). However, this assumption must be verified empirically using measurement models that do not impose ordering constraints on the rating scale category thresholds, such as item response theory models based on adjacent-categories probabiliti…
A systematic review of methods for evaluating rating quality in language assessment
The use of assessments that require rater judgment (i.e., rater-mediated assessments) has become increasingly popular in high-stakes language assessments worldwide. Using a systematic literature review, the purpose of this study is to identify and explore the dominant methods for evaluating rating quality within the context of research on large-scale rater-mediated language assessments. Results from the review of 259 methodological and applied st…
Influence of a physical education teacher’s perceived age on high school pupils’ perceptions of effectiveness and learning
Few studies have focused on the issues older physical education (PE) teachers encounter which may limit their effectiveness. The purpose of this study was to examine the influence of a PE teacher’s apparent age on high school pupils’ learning and perceptions of the teacher. Participants were 114 ninth, tenth, eleventh, and twelfth grade pupils. They were randomly assigned to watch one of two virtually identical filmed swimming lessons taught by t…
Using Guttman errors to explore rater fit in rater-mediated performance assessments
Model-data fit indices for raters provide insight into the degree to which raters demonstrate psychometric properties defined as useful within a measurement framework. Fit statistics for raters are particularly relevant within frameworks based on invariant measurement, such as Rasch measurement theory and Mokken scale analysis. A simple approach to examining invariance is to examine assessment data for evidence of Guttman errors. I used real and …
Exploring decision consistency and decision accuracy across rating designs in rater-mediated music performance assessments
Music performance assessments frequently include panels of raters who evaluate the quality of musical performances using rating scales. As a result of practical considerations, it is often not possible to obtain ratings from every rater on every performance (i.e., complete rating designs). When there are differences in rater severity, and not all raters rate all performances, ratings of musical performances and their resulting classification (e.g…
Investigating rater accuracy in the context of secondary-level solo instrumental music performance
In any performance-based musical assessment context, construct-irrelevant variability attributed to raters is a cause of concern when constructing a validity argument. Therefore, evidence of rater quality is a necessary criterion for psychometrically sound (i.e., valid, reliable, and fair) rater-mediated music performance assessments. Rater accuracy is a type of rater quality index that measures the distance between raters’ operational ratings an…
Exploring patterns of principal judgments in teacher evaluation related to reported gender and years of experience
Exploring the Combined Effects of Rater Misfit and Differential Rater Functioning in Performance Assessments
Rater effects, or raters’ tendencies to assign ratings to performances that are different from the ratings that the performances warranted, are well documented in rater-mediated assessments across a variety of disciplines. In many real-data studies of rater effects, researchers have reported that raters exhibit more than one effect, such as a combination of misfit and systematic biases related to student subgroups (i.e., differential rater functi…
A nonparametric procedure for exploring differences in rating quality across test-taker subgroups in rater-mediated writing assessments
Differences in rater judgments that are systematically related to construct-irrelevant characteristics threaten the fairness of rater-mediated writing assessments. Accordingly, it is essential that researchers and practitioners examine the degree to which the psychometric quality of rater judgments is comparable across test-taker subgroups. Nonparametric procedures for exploring these differences are promising because they allow researchers and p…
Negotiation patterns of a preservice physical education teacher and his students during sport education
Previous research on negotiations between physical education teachers and students has been purely qualitative. The purpose of this study was to produce a quantified negotiation profile for one preservice teacher (George) while he taught three sport education (SE) seasons. The specific research questions we attempted to answer were as follows: (a) What forms did negotiations between the preservice teacher and his students take during the SE seaso…
Not Just Generalizability
Teacher evaluation systems often include classroom observations in which raters use rating scales to evaluate teachers’ effectiveness. Recently, researchers have promoted the use of multifaceted approaches to investigating reliability using Generalizability theory, instead of rater reliability statistics. Generalizability theory allows analysts to quantify the contribution of multiple sources of variance (e.g., raters and tasks) to measurement er…
An Examination of the Counselor Burnout Inventory Using Item Response Theory in Early Career Post-Master’s Counselors
We examined the psychometric properties of the Counselor Burnout Inventory (CBI) with 560 early career, post-master’s counselors. We tested the dimensional structure of the CBI, item ordering, and the function of the rating scale using item response theory. Implications of the findings for researchers, counselors, and counselor educators are discussed
Exploring the Impact of Missing Data on Residual-Based Dimensionality Analysis for Measurement Models
Researchers frequently use Rasch models to analyze survey responses because these models provide accurate parameter estimates for items and examinees when there are missing data. However, researchers have not fully considered how missing data affect the accuracy of dimensionality assessment in Rasch analyses such as principal components analysis (PCA) of standardized residuals. Because adherence to unidimensionality is a prerequisite for the appr…
Detecting Rater Biases in Sparse Rater-Mediated Assessment Networks
Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to facilitate model estimation. These incomplete scoring designs present challenges for detecting rater biases, or differential rater functioning (DRF). The purpose of this study is to illus…
Psychometric evaluation of a new internalization of learning motivation (ILM) scale
Identifying Problematic Item Characteristics With Small Samples Using Mokken Scale Analysis
Researchers frequently use Mokken scale analysis (MSA), which is a nonparametric approach to item response theory, when they have relatively small samples of examinees. Researchers have provided some guidance regarding the minimum sample size for applications of MSA under various conditions. However, these studies have not focused on item-level measurement problems, such as violations of monotonicity or invariant item ordering (IIO). Moreover, th…
Evaluating the Psychometric Properties of a Proposed Farsi Version of the Interpersonal Reactivity Index Using Item Response Theory
Purpose Although researchers have examined empathy among many populations worldwide, investigations of empathy among Farsi-speakers are limited. The purpose of this study is to evaluate the psychometric properties of the Interpersonal Reactivity Index (IRI) for Farsi-speakers (IRI-Farsi). Methods After translating, we explored psychometric properties of the IRI-Farsi with exploratory factor analysis and item response theory using a sample of Iran…
The Development of the Client Meaningful Experiences Scale
Item response theory was used to study the psychometric properties of the Client Meaningful Experiences Scale (CMES). In a sample of 306 adult counseling clients, we examined the dimensional structure of the scale, item-fit, and person-fit statistics. Implications of these findings for counselors, counselors-in-training, and counseling researchers were discussed
Psychology (34 works) · Psychometrics (23 works) · Developmental psychology (20 works) · Item response theory (20 works) · Computer Science (17 works) · Psychometric Methodologies and Testing (17 works) · Rating scale (17 works) · Clinical Psychology (15 works) · Mathematics (15 works) · Statistics (15 works)