George Engelhard
Biographic Data
| ID | 139349 |
|---|---|
| NAME | George Engelhard |
| GIVEN NAMES | George |
| FAMILY NAME | Engelhard |
| SIGNATURE | ENGELHARD G |
| AFFILIATIONS | Emory University |
| ORCID | 0000-0002-1694-8942 |
| VERIFIED | Yes |
| TOTAL WORKS | 25 |
| TOTAL CITATIONS | 19 |
| WORKS AS AUTHOR | 25 |
| WORKS AS EDITOR | 0 |
| FIRST PUBLICATION YEAR | 1990 |
| LATEST PUBLICATION YEAR | 2026 |
| H-INDEX | 2 |
Identification and Diagnosis of Misreporting in Surveys
Misreporting and other forms of aberrant responding can undermine the validity of survey-based inferences. Person-level evaluation of aberrant responses is rarely conducted because inspecting individual response patterns is time-intensive. This study proposes an integrated approach for identifying, classifying, and interpreting misfitting response patterns using nonparametric visualizations of person response functions combined with clustering of…
Guidelines for Analyzing Rating Scale Data Using Rasch Measurement Theory in Counseling Research
Examining the Psychometric Properties of the Perceived Stress Scale in Black Women During the Perinatal Period Using Explanatory Rasch Models
Identification of Writing Strategies in Educational Assessments with an Unsupervised Learning Measurement Framework
This study proposes a framework that leverages natural language processing and unsupervised machine learning techniques to measure, identify, and classify examinees’ writing strategies. The framework integrates three categories of writing strategies (text complexity, evidence use, and argument structure) to identify the characteristics of examinees’ writing. Additionally, a measurement model is used to calibrate examinees’ writing proficiency. An…
Functional Approaches for Modeling Unfolding Data
The purpose of this study is to introduce a functional approach for modeling unfolding response data. Functional data analysis (FDA) has been used for examining cumulative item response data, but a functional approach has not been systematically used with unfolding response processes. A brief overview of FDA is presented and illustrated within the context of unfolding data. Seven decision parameters are described that can provide a guide to condu…
Rasch Models for Solving Measurement Problems
Using a Bifactor Model to Measure Food Insecurity in Households with Children
Exploring decision consistency and decision accuracy across rating designs in rater-mediated music performance assessments
Music performance assessments frequently include panels of raters who evaluate the quality of musical performances using rating scales. As a result of practical considerations, it is often not possible to obtain ratings from every rater on every performance (i.e., complete rating designs). When there are differences in rater severity, and not all raters rate all performances, ratings of musical performances and their resulting classification (e.g…
Exploring the Impersonal Judgments and Personal Preferences of Raters in Rater-Mediated Assessments With Unfolding Models
The purpose of this study is to explore the use of unfolding models for evaluating the quality of ratings obtained in rater-mediated assessments. Two different judgmental processes can be used to conceptualize ratings: impersonal judgments and personal preferences. Impersonal judgments are typically expected in rater-mediated assessments, and these ratings reflect a cumulative response process. However, raters may also be influenced by their pers…
Using Household Fit Indices to Examine the Psychometric Quality of Food Insecurity Measures
This study focuses on model–data fit with a particular emphasis on household-level fit within the context of measuring household food insecurity. Household fit indices are used to examine the psychometric quality of household-level measures of food insecurity. In the United States, measures of food insecurity are commonly obtained from the U.S. Household Food Security Survey Module (HFSSM, 18 items) of the Current Population Survey Food Security …
Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis
Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rate…
Evaluating Rater Accuracy in Rater-Mediated Assessments Using an Unfolding Model
The number of performance assessments continues to increase around the world, and it is important to explore new methods for evaluating the quality of ratings obtained from raters. This study describes an unfolding model for examining rater accuracy. Accuracy is defined as the difference between observed and expert ratings. Dichotomous accuracy ratings (0 = inaccurate, 1 = accurate) are unfolded into three latent categories: inaccurate below expe…
Rater fairness in music performance assessment
The purpose of this study was to investigate model-data fit and differential rater functioning in the context of large group music performance assessment using the Many-Facet Rasch Partial Credit Measurement Model. In particular, we sought to identify whether or not expert raters’ ( N = 24) severity was invariant across four school levels (middle school, high school, collegiate, professional). Interaction analyses suggested that differential rate…
Perspectives of Adults With Epilepsy and Their Support Persons on Self-Management Support
Social support is an important mechanism for improving self-management, although little is known about its role in epilepsy self-management. We examined the type of support provided to people with epilepsy and its influence on self-management. We conducted in-depth interviews with 22 people with epilepsy and 16 support persons, representing 14 pairs and 10 unpaired individuals. We analyzed the data using principles of grounded theory. Supporters,…
Invariant Measurement
This introductory text describes the principles of invariant measurement, how invariant measurement can be achieved with Rasch models, and how to use invariant measurement to solve measurement problems in the social, behavioral, and health sciences. Rasch models are used throughout but a comparison of Rasch models to other item response theory (IRT) models is also provided. Written with students in mind, the manuscript was class tested to help ma…
Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments
The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard setting process employing the Multiple Yes-No, modified Angoff standard setting procedure to set the…
How Good is Good Enough? Educational Standard Setting and its Effect on African American Test Takers
Jade Caines, George Engelhard, Jr., How Good is Good Enough? Educational Standard Setting and its Effect on African American Test Takers, The Journal of Negro Education, Vol. 81, No. 3, Special Issue: Testing and Assessing African Americans: Past, Present, and Future Problems and Promises (Summer 2012), pp. 228-240
Evaluating the Bookmark Judgments of Standard-Setting Panelists
The purpose of this study is to describe a new approach for evaluating the judgments of standard-setting panelists within the context of the bookmark procedure. The bookmark procedure is widely used for setting performance standards on high-stakes assessments. A many-faceted Rasch (MFR) model is proposed for evaluating the bookmark judgments of the panelists, and its use illustrated with standard-setting judgments from the Michigan Educational As…
Using Explanatory Item Response Theory Modeling to Investigate Context Effects of Differential Item Functioning for Students With Disabilities
To address whether or not modifications in test administration influence item functioning for students with disabilities on a high-stakes statewide problem-solving assessment, a sample of 868 students (with and without disabilities) from 74 Georgia schools were randomly assigned to one of three testing conditions (resource guide, calculator, or standard administration). The authors describe a conceptual framework for investigating measurement inv…
Examining the grading practices of teachers
Using Item Response Theory and Model—Data Fit to Conceptualize Differential Item and Person Functioning for Students With Disabilities
The major purpose of this study is to describe a conceptual framework for examining differential item functioning (DIF) and differential person functioning (DPF) as types of model—data misfit within the context of assessing students with disabilities. Specifically, DIF and DPF can be viewed through the lens of residual analyses. Residual analyses can be used to explore DIF (item fit) as well as extended to explore DPF (person fit). One of the adv…
Evaluating the Quality of Ratings Obtained from Standard-Seting Judges
The purpose of this study is to describe a new approach based on Rasch measurement theory for examining the quality of ratings obtained from standard-setting judges. This new approach is based on the adaptation and modification of several indicators of rating errors. To explore the usefulness of the Rasch measurement theory, the ratings of the nine judges who took part in the standard-setting process on a certification examination for nurses were…
Historical Views of Invariance
The purpose of this study is to provide a historical perspective on the concept of invariance within measurement theory. Two major classes of invariant measurement are described—sample-invariant item calibration and item-invariant measurement of individuals. The work of Stevens is used to help clarify the concept of invariance. The importance of invariance as a key measurement concept is then illustrated with the measurement theories of Thorndike…
The Influences of Mode of Discourse, Experiential Demand, and Gender on the Quality of Student Writing
Preview this article: The Influences of Mode of Discourse, Experiential Demand, and Gender on the Quality of Student Writing, Page 1 of 1 /docserver/preview/fulltext/rte/26/3/researchintheteachingofenglish15437-1.gif
Home environment and the competitiveness of highly accomplished individuals in four talent fields
Examining the grading practices of teachers
Rasch Models for Solving Measurement Problems
Perspectives of Adults With Epilepsy and Their Support Persons on Self-Management Support
Social support is an important mechanism for improving self-management, although little is known about its role in epilepsy self-management. We examined the type of support provided to people with epilepsy and its influence on self-management. We conducted in-depth interviews with 22 people with epilepsy and 16 support persons, representing 14 pairs and 10 unpaired individuals. We analyzed the data using principles of grounded theory. Supporters,…
Home environment and the competitiveness of highly accomplished individuals in four talent fields
Home environment and the competitiveness of highly accomplished individuals in four talent fields
Historical Views of Invariance
The purpose of this study is to provide a historical perspective on the concept of invariance within measurement theory. Two major classes of invariant measurement are described—sample-invariant item calibration and item-invariant measurement of individuals. The work of Stevens is used to help clarify the concept of invariance. The importance of invariance as a key measurement concept is then illustrated with the measurement theories of Thorndike…
The Influences of Mode of Discourse, Experiential Demand, and Gender on the Quality of Student Writing
Preview this article: The Influences of Mode of Discourse, Experiential Demand, and Gender on the Quality of Student Writing, Page 1 of 1 /docserver/preview/fulltext/rte/26/3/researchintheteachingofenglish15437-1.gif
Evaluating the Quality of Ratings Obtained from Standard-Seting Judges
The purpose of this study is to describe a new approach based on Rasch measurement theory for examining the quality of ratings obtained from standard-setting judges. This new approach is based on the adaptation and modification of several indicators of rating errors. To explore the usefulness of the Rasch measurement theory, the ratings of the nine judges who took part in the standard-setting process on a certification examination for nurses were…
Using Item Response Theory and Model—Data Fit to Conceptualize Differential Item and Person Functioning for Students With Disabilities
The major purpose of this study is to describe a conceptual framework for examining differential item functioning (DIF) and differential person functioning (DPF) as types of model—data misfit within the context of assessing students with disabilities. Specifically, DIF and DPF can be viewed through the lens of residual analyses. Residual analyses can be used to explore DIF (item fit) as well as extended to explore DPF (person fit). One of the adv…
Examining the grading practices of teachers
Evaluating the Bookmark Judgments of Standard-Setting Panelists
The purpose of this study is to describe a new approach for evaluating the judgments of standard-setting panelists within the context of the bookmark procedure. The bookmark procedure is widely used for setting performance standards on high-stakes assessments. A many-faceted Rasch (MFR) model is proposed for evaluating the bookmark judgments of the panelists, and its use illustrated with standard-setting judgments from the Michigan Educational As…
Using Explanatory Item Response Theory Modeling to Investigate Context Effects of Differential Item Functioning for Students With Disabilities
To address whether or not modifications in test administration influence item functioning for students with disabilities on a high-stakes statewide problem-solving assessment, a sample of 868 students (with and without disabilities) from 74 Georgia schools were randomly assigned to one of three testing conditions (resource guide, calculator, or standard administration). The authors describe a conceptual framework for investigating measurement inv…
How Good is Good Enough? Educational Standard Setting and its Effect on African American Test Takers
Jade Caines, George Engelhard, Jr., How Good is Good Enough? Educational Standard Setting and its Effect on African American Test Takers, The Journal of Negro Education, Vol. 81, No. 3, Special Issue: Testing and Assessing African Americans: Past, Present, and Future Problems and Promises (Summer 2012), pp. 228-240
Invariant Measurement
This introductory text describes the principles of invariant measurement, how invariant measurement can be achieved with Rasch models, and how to use invariant measurement to solve measurement problems in the social, behavioral, and health sciences. Rasch models are used throughout but a comparison of Rasch models to other item response theory (IRT) models is also provided. Written with students in mind, the manuscript was class tested to help ma…
Using the Many-Faceted Rasch Model to Evaluate Standard Setting Judgments
The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard setting process employing the Multiple Yes-No, modified Angoff standard setting procedure to set the…
Perspectives of Adults With Epilepsy and Their Support Persons on Self-Management Support
Social support is an important mechanism for improving self-management, although little is known about its role in epilepsy self-management. We examined the type of support provided to people with epilepsy and its influence on self-management. We conducted in-depth interviews with 22 people with epilepsy and 16 support persons, representing 14 pairs and 10 unpaired individuals. We analyzed the data using principles of grounded theory. Supporters,…
Rater fairness in music performance assessment
The purpose of this study was to investigate model-data fit and differential rater functioning in the context of large group music performance assessment using the Many-Facet Rasch Partial Credit Measurement Model. In particular, we sought to identify whether or not expert raters’ ( N = 24) severity was invariant across four school levels (middle school, high school, collegiate, professional). Interaction analyses suggested that differential rate…
Exploring Rating Quality in Rater-Mediated Assessments Using Mokken Scale Analysis
Mokken scale analysis is a probabilistic nonparametric approach that offers statistical and graphical tools for evaluating the quality of social science measurement without placing potentially inappropriate restrictions on the structure of a data set. In particular, Mokken scaling provides a useful method for evaluating important measurement properties, such as invariance, in contexts where response processes are not well understood. Because rate…
Evaluating Rater Accuracy in Rater-Mediated Assessments Using an Unfolding Model
The number of performance assessments continues to increase around the world, and it is important to explore new methods for evaluating the quality of ratings obtained from raters. This study describes an unfolding model for examining rater accuracy. Accuracy is defined as the difference between observed and expert ratings. Dichotomous accuracy ratings (0 = inaccurate, 1 = accurate) are unfolded into three latent categories: inaccurate below expe…
Using Household Fit Indices to Examine the Psychometric Quality of Food Insecurity Measures
This study focuses on model–data fit with a particular emphasis on household-level fit within the context of measuring household food insecurity. Household fit indices are used to examine the psychometric quality of household-level measures of food insecurity. In the United States, measures of food insecurity are commonly obtained from the U.S. Household Food Security Survey Module (HFSSM, 18 items) of the Current Population Survey Food Security …
Exploring decision consistency and decision accuracy across rating designs in rater-mediated music performance assessments
Music performance assessments frequently include panels of raters who evaluate the quality of musical performances using rating scales. As a result of practical considerations, it is often not possible to obtain ratings from every rater on every performance (i.e., complete rating designs). When there are differences in rater severity, and not all raters rate all performances, ratings of musical performances and their resulting classification (e.g…
Exploring the Impersonal Judgments and Personal Preferences of Raters in Rater-Mediated Assessments With Unfolding Models
The purpose of this study is to explore the use of unfolding models for evaluating the quality of ratings obtained in rater-mediated assessments. Two different judgmental processes can be used to conceptualize ratings: impersonal judgments and personal preferences. Impersonal judgments are typically expected in rater-mediated assessments, and these ratings reflect a cumulative response process. However, raters may also be influenced by their pers…
Using a Bifactor Model to Measure Food Insecurity in Households with Children
Rasch Models for Solving Measurement Problems
Functional Approaches for Modeling Unfolding Data
The purpose of this study is to introduce a functional approach for modeling unfolding response data. Functional data analysis (FDA) has been used for examining cumulative item response data, but a functional approach has not been systematically used with unfolding response processes. A brief overview of FDA is presented and illustrated within the context of unfolding data. Seven decision parameters are described that can provide a guide to condu…
Identification of Writing Strategies in Educational Assessments with an Unsupervised Learning Measurement Framework
This study proposes a framework that leverages natural language processing and unsupervised machine learning techniques to measure, identify, and classify examinees’ writing strategies. The framework integrates three categories of writing strategies (text complexity, evidence use, and argument structure) to identify the characteristics of examinees’ writing. Additionally, a measurement model is used to calibrate examinees’ writing proficiency. An…
Identification and Diagnosis of Misreporting in Surveys
Misreporting and other forms of aberrant responding can undermine the validity of survey-based inferences. Person-level evaluation of aberrant responses is rarely conducted because inspecting individual response patterns is time-intensive. This study proposes an integrated approach for identifying, classifying, and interpreting misfitting response patterns using nonparametric visualizations of person response functions combined with clustering of…
Guidelines for Analyzing Rating Scale Data Using Rasch Measurement Theory in Counseling Research
Examining the Psychometric Properties of the Perceived Stress Scale in Black Women During the Perinatal Period Using Explanatory Rasch Models
Psychology (21 works) · Item response theory (13 works) · Mathematics (13 works) · Computer Science (12 works) · Developmental psychology (12 works) · Psychometric Methodologies and Testing (12 works) · Psychometrics (12 works) · Rasch model (11 works) · Statistics (11 works) · Context (archaeology) (6 works)