Meta‐Analysis

The small sample studies typical of psychological research produce seemingly contradictory results, and reliance on statistical significance tests causes study results to appear even more conflicting. Meta-analysis integrates the findings across such studies to reveal the simpler patterns of relations that underlie research literatures, thus providing a basis for theory development. Meta-analysis can correct for the distorting effects of sampling error, measurement error, and other artifacts that produce the illusion of conflicting findings. This chapter discusses these artifacts and the procedures used to correct for them. Different approaches to meta-analysis are discussed. Applications of meta-analysis in I/O psychology and other areas are discussed and evidence is presented that meta-analysis is transforming research in psychology. Meta-analysis has become almost ubiquitous. One indication of this is that, as of October 12, 2011, Google listed more than 9 million entries for meta-analysis.

Cognitive psychology · Data science · Illusion · Meta-analysis · Psychological research · Sample (material) · Statistics · Systematic error · Behavioral Health and Interventions · Computer Science · Diverse Approaches in Healthcare and Education Studies · Mathematics · Meta-analysis and systematic reviews · Psychology · Social Psychology

• Meta-analysis

  John E Hunter•Meta-analysis•1982

  Incluir item

• Publication Bias in Meta‐Analysis

  Open Access•Hannah Rothstein, Alex J Sutton et al.•Publication bias in meta-analysis•2005

  Incluir item

• Meta-Analytic Procedures for Social Research

  Robert Rosenthal•Meta-Analytic Procedures for…•1991

  Incluir item

• The Handbook of Research Synthesis and Meta-Analysis

  Harris M Cooper, Jeff C Valentine et al.•Handbook of Research Synthesis…•2019

  Incluir item

• Methods of Meta-Analysis

  Frank L Schmidt, John Hunter et al.•Methods of Meta-Analysis•2004

  Incluir item

• Theoretical risks and tabular asterisks

  Paul E Meehl•Journal of Consulting and…•1978

  Incluir item

• Validity of self-evaluation of ability

  P Alex Mabe, Paul A Mabe et al.•Journal of Applied Psychology•1982

  Incluir item

• The causal relation between job attitudes and performance

  Michael Riketta•Journal of Applied Psychology•2008

  Incluir item

• Fixed Effects vs. Random Effects Meta‐Analysis Models

  Open Access•J E Hunter, Frank L Schmidt•International Journal of…•2000

  Incluir item

• Development of a general solution to the problem of validity generalization.

  Frank L Schmidt, J E Hunter•Journal of Applied Psychology•1977

  Incluir item

• Fixed‐ versus random‐effects models in meta‐analysis

  Open Access•Frank L Schmidt, In‐sue Oh et al.•British Journal of Mathematical…•2009

  Incluir item

• Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

  John P A Ioannidis•JAMA•2005

  Incluir item

• Examining the impact of Culture's consequences

  Vas Taras, Bradley L Kirkman et al.•Journal of Applied Psychology•2010

  Incluir item

• The Case Against Statistical Significance Testing

  Ronald P Carver, Ronald Carver•Harvard Educational Review•1978

  Incluir item

• Meta‐regression Analysis

  Open Access•T D Stanley, Stephen B Jarrell•Journal of Economic Surveys•1989

  Incluir item

• Measurement error in psychological research

  Frank L Schmidt, J E Hunter•Psychological Methods•1996

  Incluir item

• A meta-analysis of the correlates of role conflict and ambiguity.

  Cynthia D Fisher, Richard Gitelson•Journal of Applied Psychology•1983

  Incluir item

• Dichotomization of continuous variables

  J E Hunter, Frank L Schmidt•Journal of Applied Psychology•1990

  Incluir item

• Statistical significance testing and cumulative knowledge in psychology

  Frank L Schmidt•Psychological Methods•1996

  Incluir item

• A Meta‐analysis of Teamwork Processes

  Open Access•Jeffery A LePine, Ronald F Piccolo et al.•Personnel Psychology•2008

  Incluir item

• Employment testing

  Frank L Schmidt, J E Hunter•American Psychologist•1981

  Incluir item

• How hard is hard science, how soft is soft science? The empirical cumulativeness of research

  Larry V Hedges•American Psychologist•1987

  Incluir item

• Psychotherapy outcome

  Janet Landman, Janet T Landman et al.•American Psychologist•1982

  Incluir item

• Wheat From Chaff

  Open Access•T D Stanley•The Journal of Economic…•2001

  Incluir item

• The statistical power of abnormal-social psychological research

  Jacob Cohen•Journal of Abnormal & Social…•1962

  Incluir item

• The job satisfaction–job performance relationship

  Timothy A Judge, Carl J Thoresen et al.•Psychological Bulletin•2001

  Incluir item

• What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology

  Frank L Schmidt•American Psychologist•1992

  Incluir item

• The earth is round (p < .05)

  Jacob Cohen•American Psychologist•1994

  Incluir item

• The efficacy of psychological, educational, and behavioral treatment

  Mark W Lipsey, Darryl Babe Wilson et al.•American Psychologist•1993

  Incluir item

• Cumulative research knowledge and social policy formulation

  J E Hunter, Frank L Schmidt•Psychology Public Policy and Law•1996

  Incluir item

• What Future Quantitative Social Science Research Could Look Like

  Open Access•Bruce Thompson•Educational Researcher•2002

  Incluir item

• Meta-Analysis of Research

  Richard S Mansfield, Thomas V Busse•Educational Researcher•1977

  Incluir item

• Things I have learned (so far)

  Jacob Cohen•American Psychologist•1990

  Incluir item

• Statistical methods in psychology journals

  Leland Wilkinson, Task Force on Statistical Inference•American Psychologist•1999

  Incluir item

• Toward Transformation in Social Knowledge

  Open Access•Kenneth J Gergen•Toward Transformation in Social…•1982

  Incluir item

• Publication Manual of the American Psychological Association

  Open Access•Rui Yao•Family and Consumer Sciences…•2011

  Incluir item

• Beyond the two disciplines of scientific psychology

  Lee J Cronbach•American Psychologist•1975

  Incluir item

• Primary, Secondary, and Meta-Analysis of Research

  Gene V Gla, Gene V Glass•Educational Researcher•1976

  Incluir item

• Fiedler's Contingency Theory of Leadership

  Lawrence H Peters, Darrell D Hartke et al.•Psychological Bulletin•1985

  Incluir item

• The fallacy of the null-hypothesis significance test

  William W Rozeboom•Psychological Bulletin•1960

  Incluir item

• Do studies of statistical power have an effect on the power of studies

  Peter Sedlmeier, Gerd Gigerenzer•Psychological Bulletin•1989

  Incluir item

• Comparing effect sizes of independent studies

  Robert Rosenthal, Donald B Rubin•Psychological Bulletin•1982

  Incluir item

• Estimation of effect size from a series of independent experiments

  Larry V Hedges•Psychological Bulletin•1982

  Incluir item

• School Desegregation and Black Achievement

  Open Access•Paul M Wortman, Fred B Bryant•Sociological Methods & Research•1985

  Incluir item