Power of a Test That is Robust against Variance Heterogeneity

Welch (1947) proposed an adjusted t test that can be used to correct the serious bias in Type I error protection that is otherwise present when both sample sizes and variances are unequal. The implications of the Welch adjustment for power of tests for the difference between two treatments across k levels of a concomitant factor are evaluated in this article for k x 2 designs with unequal sample sizes and unequal variances. Analyses confirm that, although Type I error is uniformly controlled, power of the Welch test of significance for the main effect of treatments remains rather seriously dependent on direction of the correlation between unequal variances and unequal sample sizes. Nevertheless, considering the fact that analysis of variance is not an acceptable option in such cases, the Welch t test appears to have an important role to play in the analysis of experimental data

Analysis of variance · Econometrics · Economics · Power (physics · Statistics · Test (biology · Variance (accounting · Advanced Statistical Methods and Models · Advanced Statistical Process Monitoring · Mathematics · Optimal Experimental Design Methods · Psychology · Social Psychology

• Some Properties of Preliminary Tests of Equality of Variances in the Two-Sample Location Problem

  Donald W Zimmerman•The Journal of General Psychology•1996

  Add to list

• The Generalization of ‘Student's’ Problem When Several Different Population Varlances Are Involved

  B L WELCH•Biometrika•1947

  Add to list

• Tests That are Robust against Variance Heterogeneity in k × 2 Designs with Unequal Cell Frequencies

  Open Access•John E Overall, Robert S Atlas et al.•Psychological Reports•1995

  Add to list