Robert L Brennan
Biographic Data
| ID | 9251613 |
|---|---|
| NAME | Robert L Brennan |
| GIVEN NAMES | Robert L |
| FAMILY NAME | Brennan |
| SIGNATURE | BRENNAN R L |
| AFFILIATIONS | University of Iowa |
| VERIFIED | No |
| TOTAL WORKS | 13 |
| TOTAL CITATIONS | 0 |
| AUTHOR COUNT | 13 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1972 |
| LATEST PUBLICATION YEAR | 2022 |
| H-INDEX | 0 |
Extended Multivariate Generalizability Theory With Complex Design Structures
This article extends multivariate generalizability theory (MGT) to tests with different random-effects designs for each level of a fixed facet. There are numerous situations in which the design of a test and the resulting data structure are not definable by a single design. One example is mixed-format tests that are composed of multiple-choice and free-response items, with the latter involving variability attributable to both items and raters. In…
Test Equating, Scaling, and Linking: Methods and Practices
Unbiased Estimates of Variance Components With Bootstrap Procedures
This article provides general procedures for obtaining unbiased estimates of variance components for any random-model balanced design under any bootstrap sampling plan, with the focus on designs of the type typically used in generalizability theory. The results reported here are particularly helpful when the bootstrap is used to estimate standard errors of estimated variance components. For the p × i design, Wiley (2000) provided formulas for cor…
Bootstrap Estimates of Standard Errors in Generalizability Theory
Estimating standard errors of estimated variance components has long been a challenging task in generalizability theory. Researchers have speculated about the potential applicability of the bootstrap for obtaining such estimates, but they have identified problems (especially bias) in using the bootstrap. Using Brennan's bias-correcting procedures (which extend the work of Wiley), as well as a proposed set of rules for picking a bootstrap procedur…
Test Equating, Scaling, and Linking: Methods and Practices
Generalizability Theory
Conditional Scale-Score Standard Errors of Measurement under Binomial and Compound Binomial Assumptions
This article develops two procedures for estimating individual-level conditional standard errors of measurement (SEMs) for scale scores, assuming tests consist of dichotomously scored items. Using binomial model assumptions, one procedure provides a scale-score analogue of Lord’s raw-score SEM. Assuming a compound binomial model, another procedure provides a scale-score analogue of Feldt’s raw-score SEM. These two procedures are compared to a pol…
Conditional Scale-Score Standard Errors of Measurement Under Binomial and Compound Binomial Assumptions
Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness
Evidence of the uncertainty attached to school and individual scores is required to avoid over interpretation of results. Generalizability analysis provides in the standard error a suitable indicator of uncertainty. Assessments depart from traditional measurements in ways that require extensions and re interpretatons of generalizability analysis. The authors find, for example, that in many analyses the variance component interpreted as Pupil x Ta…
Generalizability Analyses of Work Keys Listening and Writing Tests
In this article, univariate and multivariate generalizability theory is employed to examine psychometric characteristics of Listening and Writing tests developed by American College Testing (ACT) for its Work Keys program. For both of these tests, the same tape-recorded messages provide the stimuli for written responses that are evaluated by raters. Of particular concern are the numbers of messages and raters needed for adequate measurement preci…
Coefficient Kappa: Some Uses, Misuses, and Alternatives
This paper considers some appropriate and inappropriate uses of coefficient kappa and alternative kappa-like statistics. Discussion is restricted to the descriptive characteristics of these statistics for measuring agreement with categorical data in studies of reliability and validity. Special consideration is given to assumptions about whether marginals are fixed a priori, or free to vary. In reliability studies, when marginals are fixed, coeffi…
The Calculation of Reliability From a Split-Plot Factorial Design
This paper treats the question, "How should one estimate the reliability of school (or classroom) means when persons are nested within schools (or classrooms)?" We begin by reviewing the use of variance components in the estimation of reliability from a randomized block (RB) design. Then we extend this rationale to the estimation of reliability (or generalizability) coefficients in a split-plot factorial (SPF) design with persons nested within sc…
A Generalized Upper-Lower Item Discrimination Index
No prominent works on this page.
A Generalized Upper-Lower Item Discrimination Index
The Calculation of Reliability From a Split-Plot Factorial Design
This paper treats the question, "How should one estimate the reliability of school (or classroom) means when persons are nested within schools (or classrooms)?" We begin by reviewing the use of variance components in the estimation of reliability from a randomized block (RB) design. Then we extend this rationale to the estimation of reliability (or generalizability) coefficients in a split-plot factorial (SPF) design with persons nested within sc…
Coefficient Kappa: Some Uses, Misuses, and Alternatives
This paper considers some appropriate and inappropriate uses of coefficient kappa and alternative kappa-like statistics. Discussion is restricted to the descriptive characteristics of these statistics for measuring agreement with categorical data in studies of reliability and validity. Special consideration is given to assumptions about whether marginals are fixed a priori, or free to vary. In reliability studies, when marginals are fixed, coeffi…
Generalizability Analyses of Work Keys Listening and Writing Tests
In this article, univariate and multivariate generalizability theory is employed to examine psychometric characteristics of Listening and Writing tests developed by American College Testing (ACT) for its Work Keys program. For both of these tests, the same tape-recorded messages provide the stimuli for written responses that are evaluated by raters. Of particular concern are the numbers of messages and raters needed for adequate measurement preci…
Generalizability Analysis for Performance Assessments of Student Achievement or School Effectiveness
Evidence of the uncertainty attached to school and individual scores is required to avoid over interpretation of results. Generalizability analysis provides in the standard error a suitable indicator of uncertainty. Assessments depart from traditional measurements in ways that require extensions and re interpretatons of generalizability analysis. The authors find, for example, that in many analyses the variance component interpreted as Pupil x Ta…
Conditional Scale-Score Standard Errors of Measurement under Binomial and Compound Binomial Assumptions
This article develops two procedures for estimating individual-level conditional standard errors of measurement (SEMs) for scale scores, assuming tests consist of dichotomously scored items. Using binomial model assumptions, one procedure provides a scale-score analogue of Lord’s raw-score SEM. Assuming a compound binomial model, another procedure provides a scale-score analogue of Feldt’s raw-score SEM. These two procedures are compared to a pol…
Conditional Scale-Score Standard Errors of Measurement Under Binomial and Compound Binomial Assumptions
Generalizability Theory
Test Equating, Scaling, and Linking: Methods and Practices
Unbiased Estimates of Variance Components With Bootstrap Procedures
This article provides general procedures for obtaining unbiased estimates of variance components for any random-model balanced design under any bootstrap sampling plan, with the focus on designs of the type typically used in generalizability theory. The results reported here are particularly helpful when the bootstrap is used to estimate standard errors of estimated variance components. For the p × i design, Wiley (2000) provided formulas for cor…
Bootstrap Estimates of Standard Errors in Generalizability Theory
Estimating standard errors of estimated variance components has long been a challenging task in generalizability theory. Researchers have speculated about the potential applicability of the bootstrap for obtaining such estimates, but they have identified problems (especially bias) in using the bootstrap. Using Brennan's bias-correcting procedures (which extend the work of Wiley), as well as a proposed set of rules for picking a bootstrap procedur…
Test Equating, Scaling, and Linking: Methods and Practices
Extended Multivariate Generalizability Theory With Complex Design Structures
This article extends multivariate generalizability theory (MGT) to tests with different random-effects designs for each level of a fixed facet. There are numerous situations in which the design of a test and the resulting data structure are not definable by a single design. One example is mixed-format tests that are composed of multiple-choice and free-response items, with the latter involving variability attributable to both items and raters. In…
Mathematics (11 works) · Statistics (11 works) · Computer Science (10 works) · Econometrics (8 works) · Generalizability theory (7 works) · Psychology (5 works) · Variance (accounting) (5 works) · Test (biology) (4 works) · Variance components (4 works) · Developmental psychology (3 works)