William R Shadish
Biographic Data
| ID | 1661342 |
|---|---|
| NAME | William R Shadish |
| GIVEN NAMES | William R |
| FAMILY NAME | Shadish |
| SIGNATURE | SHADISH W R |
| AFFILIATIONS | University of Memphis |
| VERIFIED | No |
| TOTAL WORKS | 42 |
| TOTAL CITATIONS | 159 |
| AUTHOR COUNT | 42 |
| EDITOR COUNT | 0 |
| FIRST PUBLICATION YEAR | 1981 |
| LATEST PUBLICATION YEAR | 2013 |
| H-INDEX | 6 |
Single-Case Intervention Research Design Standards
In an effort to responsibly incorporate evidence based on single-case designs (SCDs) into the What Works Clearinghouse (WWC) evidence base, the WWC assembled a panel of individuals with expertise in quantitative methods and SCD methodology to draft SCD standards. In this article, the panel provides an overview of the SCD standards recommended by the panel (henceforth referred to as the Standards) and adopted in Version 1.0 of the WWC’s official p…
Quasi-Experimental Design
Randomized Controlled Studies and Alternative Designs in Outcome Studies: Challenges and Opportunities
This article reviews several decades of the author’s meta-analytic and experimental research on the conditions under which nonrandomized experiments can approximate the results from randomized experiments (REs). Several studies make clear that we can expect accurate effect estimates from the regression discontinuity design, though its statistical power is lower, it estimates a different parameter than the RE, and its analysis is considerably more…
The importance of covariate selection in controlling for selection bias in observational studies.
The assumption of strongly ignorable treatment assignment is required for eliminating selection bias in observational studies. To meet this assumption, researchers often rely on a strategy of selecting covariates that they think will control for selection bias. Theory indicates that the most important covariates are those highly correlated with both the real selection process and the potential outcomes. However, when planning a study, it is rarel…
Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments
A key justification for using nonrandomized experiments is that, with proper adjustment, their results can well approximate results from randomized experiments. This hypothesis has not been consistently supported by empirical studies; however, previous methods used to study this hypothesis have confounded assignment method with other study features. To avoid these confounding factors, this study randomly assigned participants to be in a randomize…
Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisons
This paper analyzes 12 recent within‐study comparisons contrasting causal estimates from a randomized experiment with those from an observational study sharing the same treatment group. The aim is to test whether different causal estimates result when a counterfactual group is formed, either with or without random assignment, and when statistical adjustments for selection are made in the group from which random assignment is absent. We identify t…
Individually Randomized Group Treatment Trials: A Critical Appraisal of Frequently Used Design and Analytic Approaches
Objectives. We reviewed published individually randomized group treatment (IRGT) trials to assess researchers’ awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. Methods. We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. Results. Our review included 34 articles…
The Center for Epidemiologic Studies Depression Scale With a Young Adolescent Population: A Confirmatory Factor Analysis
The Center for Epidemiological Studies Depression scale (CES-D) was developed to assess the population prevalence of depression. The CES-D was developed and normed on an adult population. Since the CES-D's publication, various studies have both used and psychometrically assessed the scale for older adolescent populations. However, we found no report of the CES-D's psychometric properties for young adolescent populations. We conducted a confirmato…
On blowing trumpets to the tulips: To prove or not to prove the null hypothesis--Comment on Bösch, Steinkamp, and Boller (2006)
The H. Bösch, F. Steinkamp, and E. Boller meta-analysis reaches mixed and cautious conclusions about the possibility of psychokinesis. The authors argue that, for both methodological and philosophical reasons, it is nearly impossible to draw any conclusions from this body of research. The authors do not agree that any significant effect at all, no matter how small, is fundamentally important (Bösch et al., 2006, p. 517), and they suggest that psy…
Evidence-based Decision Making: Enhancing Systematic Reviews of Program Evaluation Results in Europe
Over the last 25 years, meta-analysis has been widely used to study the effects of practical treatment interventions in fields ranging from psychology and education to medicine and public health. The present article first describes the impact of meta-analysis. The article then presents a description of some preliminary results of a study of the main design characteristics of published interventions in Europe. In order to foster both better experi…
The effects of psychological therapies under clinically representative conditions: A meta-analysis
Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues.
Donald Campbell and Evaluation Theory
Evaluation Theory is Who We Are
All evaluators should know evaluation theory because it is central to our professional identity. It is what we talk about more than anything else, it seems to give rise to our most trenchant debates, it gives us the language we use for talking to ourselves and others, and perhaps most important, it is what makes us different from other professions. Especially in the latter regard, it is in our own self-interest to be explicit about this message, …
Evaluation theory is who we are
Donald Campbell and evaluation theory
Building the Policy Studies Enterprise: A Work in Progress
Policy studies has been one of the most dynamic parts of the social sciences over the past several decades. There has been substantial growth in the literature, the number of courses, the number of professionals who identify themselves with the field, and, arguably, in the impact on public sector and programs. The studies field is an eclectic one, claimed by public administrators, political scientists, economists, sociologists, psychologists, edu…
Outcome, attrition, and family–couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies
This review synthesizes drug abuse outcome studies that included a family-couples therapy treatment condition. The meta-analytic evidence, across 1,571 cases involving an estimated 3,500 patients and family members, favors family therapy over (a) individual counseling or therapy, (b) peer group therapy, and (c) family psychoeducation. Family therapy is as effective for adults as for adolescents and appears to be a cost-effective adjunct to methad…
Outcome, attrition, and family-couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies
The Development of Occupational Aspirations and Expectations among Inner-City Boys
The occupational aspirations and expectations of two populations of boys in grades 2, 4, 6, and 8 were examined in order (1) to describe what is unique about the development of job preferences among urban ghetto children who live in settings where many adult males are not well attached to the labor force and (2) to examine 6 reasons for any age- and population-dependent patterns there might be in job aspirations and job expectations. Findings sho…
Author Judgements about Works They Cite: Three Studies from Psychology Journals
Many researchers use citation counts to study science. But few studies explore the meanings of those citations. Oddly enough, least explored of all are judgements by the authors who cite them. This paper describes three empirical studies of citations in psychology journals that explored these judgements. In general, highly cited scholarly works are rated as exemplars and as being of higher quality, although there were differences between older an…
The Social Psychology of Science
Preface. Contributors. I. INTRODUCTION, BACKGROUND, AND OVERVIEW. 1. Social Psychology of Science: A Conceptual and Research Program, Shadish, Fuller, Gorman, Amabile, Kruglanski, Rosenthal, and Rosenwein. 2. The Social Psychology of Scientific Validity: An Epistemological Perspective and a Personalized History, Campbell. 3. The Social Psychology of Scientific Knowledge: Another Strong Programme, Fuller. II. SOCIAL PSYCHOLOGICAL CONTRIBUTIONS TO …
The logic of generalization: Five principles common to experiments and ethnographies
Both experiments and ethnographies are highly localized, so they are often criticized for lack of generalizability. The present article describes a logic of generalization that may help solve such problems. The logic consists of five principles outlined by Cook (1990): (a) proximal similarity, (b) heterogeneity of irrelevancies, (c) discriminant validity, (d) empirical interpolation and extrapolation, and (e) explanation. Because validity is a pr…
APA ethics and student authorship on master's theses
APA ethics and student authorship on master's theses
Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within‐study comparisons
This paper analyzes 12 recent within‐study comparisons contrasting causal estimates from a randomized experiment with those from an observational study sharing the same treatment group. The aim is to test whether different causal estimates result when a counterfactual group is formed, either with or without random assignment, and when statistical adjustments for selection are made in the group from which random assignment is absent. We identify t…
Author Judgements about Works They Cite: Three Studies from Psychology Journals
Many researchers use citation counts to study science. But few studies explore the meanings of those citations. Oddly enough, least explored of all are judgements by the authors who cite them. This paper describes three empirical studies of citations in psychology journals that explored these judgements. In general, highly cited scholarly works are rated as exemplars and as being of higher quality, although there were differences between older an…
Evidence-based Decision Making: Enhancing Systematic Reviews of Program Evaluation Results in Europe
Over the last 25 years, meta-analysis has been widely used to study the effects of practical treatment interventions in fields ranging from psychology and education to medicine and public health. The present article first describes the impact of meta-analysis. The article then presents a description of some preliminary results of a study of the main design characteristics of published interventions in Europe. In order to foster both better experi…
Evaluation Theory is Who We Are
All evaluators should know evaluation theory because it is central to our professional identity. It is what we talk about more than anything else, it seems to give rise to our most trenchant debates, it gives us the language we use for talking to ourselves and others, and perhaps most important, it is what makes us different from other professions. Especially in the latter regard, it is in our own self-interest to be explicit about this message, …
Evaluation theory is who we are
The effects of psychological therapies under clinically representative conditions: A meta-analysis
After Deinstitutionalization: The Present and Future of Mental Health Long‐Term Care Policy
Deinstitutionalization is perhaps the most widely recognized term in mental health policy. It has dominated our thinking about policy, especially about mental health long‐term care policy, for nearly 30 years. But it is less clear that it is still the best way to characterize current mental health long‐term care, or the best policy for the future. In this article, we explore some reasons why this is so, and we present a new picture of current men…
The logic of generalization: Five principles common to experiments and ethnographies
Both experiments and ethnographies are highly localized, so they are often criticized for lack of generalizability. The present article describes a logic of generalization that may help solve such problems. The logic consists of five principles outlined by Cook (1990): (a) proximal similarity, (b) heterogeneity of irrelevancies, (c) discriminant validity, (d) empirical interpolation and extrapolation, and (e) explanation. Because validity is a pr…
Policies of Inclusion and the Mentally Ill: Long‐Term Care in a New Environment
We propose “policies of inclusion” as a conceptualization of current mental health long‐term care policy. Inclusionary policies refer to the fact that deinstitutionalization, and all the policy changes associated with it, resulted in the forcible inclusion back into society of patients formerly excluded by institutional placement. This compelled both society and the patient to change in profound but often unpredicted ways. This conceptualization …
Randomized Controlled Studies and Alternative Designs in Outcome Studies: Challenges and Opportunities
This article reviews several decades of the author’s meta-analytic and experimental research on the conditions under which nonrandomized experiments can approximate the results from randomized experiments (REs). Several studies make clear that we can expect accurate effect estimates from the regression discontinuity design, though its statistical power is lower, it estimates a different parameter than the RE, and its analysis is considerably more…
Private-sector care for chronically mentally ill individuals: The more things change, the more they stay the same
Individually Randomized Group Treatment Trials: A Critical Appraisal of Frequently Used Design and Analytic Approaches
Objectives. We reviewed published individually randomized group treatment (IRGT) trials to assess researchers’ awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. Methods. We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. Results. Our review included 34 articles…
Longitudinal Outcomes of Nursing Home Care for Severely Mentally III Patients
More chronic mental patients reside in, and more mental health dollars go to, nursing homes than to any other single setting. Yet such care has been little studied. This article presents descriptive longitudinal outcomes from a study of such care for the outcomes of recidivism, symptomatology, social integration, and subjective well‐being. The study involved interviewing and gathering data on 163 patients in a sample of 20 skilled nursing and int…
Nursing home care for mental patients: Descriptive data and some propositions
Nursing homes play an important role in the community-based care of chronic mental patients, yet there is little research in that setting. The present study gathered and analyzed descriptive data on 20 nursing homes in a large urban area, including data about structure, staffing, policy, treatment, residents, discharge, psychosocial climate, and neighborhood characteristics. Results suggested a clear difference between skilled nursing versus inte…
The buck stops here: A survey of the financial status of PhD graduate students in psychology, 1966–1987
Optimizing Scientific Validity: Toward an Interdisciplinary Science Studies
In his lead article for this series, Campbell discusses the role of a "disputatious and mutually reinforcing community of truth seekers" in promoting a sociology of scientific validity. Situating his work in the broader context of the sociology of science, we first raise a number of questions about the conceptual and empirical warrant for his recommendations, local factors that might affect their implementation, and temporal and "level of analysi…
Criteria for success in deinstitutionalization: Perceptions of nursing homes by different interest groups
Studies of deinstitutionalization often use a limited set of criteria by which to judge success. Social integration and recidivism, for example, are particularly popular criteria. Yet such criteria may not reflect the diverse settings in which community care occurs, nor the diverse views of success held by different interest groups. The present study presents a methodology for developing more comprehensive criteria for evaluating social programs,…
Nursing home care for mental patients: Descriptive data and some propositions
Nursing homes play an important role in the community-based care of chronic mental patients, yet there is little research in that setting. The present study gathered and analyzed descriptive data on 20 nursing homes in a large urban area, including data about structure, staffing, policy, treatment, residents, discharge, psychosocial climate, and neighborhood characteristics. Results suggested a clear difference between skilled nursing versus inte…
Criteria for success in deinstitutionalization: Perceptions of nursing homes by different interest groups
Studies of deinstitutionalization often use a limited set of criteria by which to judge success. Social integration and recidivism, for example, are particularly popular criteria. Yet such criteria may not reflect the diverse settings in which community care occurs, nor the diverse views of success held by different interest groups. The present study presents a methodology for developing more comprehensive criteria for evaluating social programs,…
A method for monitoring the impact of sex-role stereotypes on the therapeutic behavior of beginning psychotherapists
A methodology for assessing the therapeutic behavior of trainees is described, and results of a pilot study are presented. Findings suggest that female therapists are likely at the outset to be less confident, directive, and interpretive and more inclined to conform to stereotypic feminine traits of passivity, warmth, and nurturance; males displayed no such clear pattern, and used both active and passive styles in therapy
Costs and effects in mental health policy
Costs and effects in mental health policy
Policy research: Lessons from the implementation of deinstitutionalization
Policy research: Lessons from the implementation of deinstitutionalization
"Comments on "Spiderman and the Burma Raiders: Collateral Organization Theory in Action
The person‐situation debate: A critical multiplist perspective
Critical multiplism is an approach to question and method choice predicated on the only partial validity of most current social science practices In the first part of this paper, the approach is described, and note is made of many of its advantages but also of two of its limitations Critical multiplism is then applied to the person‐situation debate The analysis reveals that major protagonists in the debate have often discussed different versions …
Optimizing Scientific Validity: Toward an Interdisciplinary Science Studies
In his lead article for this series, Campbell discusses the role of a "disputatious and mutually reinforcing community of truth seekers" in promoting a sociology of scientific validity. Situating his work in the broader context of the sociology of science, we first raise a number of questions about the conceptual and empirical warrant for his recommendations, local factors that might affect their implementation, and temporal and "level of analysi…
The buck stops here: A survey of the financial status of PhD graduate students in psychology, 1966–1987
The buck stops here: A survey of the financial status of PhD graduate students in psychology, 1966-1987
After Deinstitutionalization: The Present and Future of Mental Health Long‐Term Care Policy
Deinstitutionalization is perhaps the most widely recognized term in mental health policy. It has dominated our thinking about policy, especially about mental health long‐term care policy, for nearly 30 years. But it is less clear that it is still the best way to characterize current mental health long‐term care, or the best policy for the future. In this article, we explore some reasons why this is so, and we present a new picture of current men…
Policies of Inclusion and the Mentally Ill: Long‐Term Care in a New Environment
We propose “policies of inclusion” as a conceptualization of current mental health long‐term care policy. Inclusionary policies refer to the fact that deinstitutionalization, and all the policy changes associated with it, resulted in the forcible inclusion back into society of patients formerly excluded by institutional placement. This compelled both society and the patient to change in profound but often unpredicted ways. This conceptualization …
Longitudinal Outcomes of Nursing Home Care for Severely Mentally III Patients
More chronic mental patients reside in, and more mental health dollars go to, nursing homes than to any other single setting. Yet such care has been little studied. This article presents descriptive longitudinal outcomes from a study of such care for the outcomes of recidivism, symptomatology, social integration, and subjective well‐being. The study involved interviewing and gathering data on 163 patients in a sample of 20 skilled nursing and int…
Private-sector care for chronically mentally ill individuals: The more things change, the more they stay the same
Foundations of Program Evaluation: Theories of Practice
APA ethics and student authorship on master's theses
APA ethics and student authorship on master's theses
Author Judgements about Works They Cite: Three Studies from Psychology Journals
Many researchers use citation counts to study science. But few studies explore the meanings of those citations. Oddly enough, least explored of all are judgements by the authors who cite them. This paper describes three empirical studies of citations in psychology journals that explored these judgements. In general, highly cited scholarly works are rated as exemplars and as being of higher quality, although there were differences between older an…
The Social Psychology of Science
Preface. Contributors. I. INTRODUCTION, BACKGROUND, AND OVERVIEW. 1. Social Psychology of Science: A Conceptual and Research Program, Shadish, Fuller, Gorman, Amabile, Kruglanski, Rosenthal, and Rosenwein. 2. The Social Psychology of Scientific Validity: An Epistemological Perspective and a Personalized History, Campbell. 3. The Social Psychology of Scientific Knowledge: Another Strong Programme, Fuller. II. SOCIAL PSYCHOLOGICAL CONTRIBUTIONS TO …
The logic of generalization: Five principles common to experiments and ethnographies
Both experiments and ethnographies are highly localized, so they are often criticized for lack of generalizability. The present article describes a logic of generalization that may help solve such problems. The logic consists of five principles outlined by Cook (1990): (a) proximal similarity, (b) heterogeneity of irrelevancies, (c) discriminant validity, (d) empirical interpolation and extrapolation, and (e) explanation. Because validity is a pr…
The Development of Occupational Aspirations and Expectations among Inner-City Boys
The occupational aspirations and expectations of two populations of boys in grades 2, 4, 6, and 8 were examined in order (1) to describe what is unique about the development of job preferences among urban ghetto children who live in settings where many adult males are not well attached to the labor force and (2) to examine 6 reasons for any age- and population-dependent patterns there might be in job aspirations and job expectations. Findings sho…
Outcome, attrition, and family–couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies
This review synthesizes drug abuse outcome studies that included a family-couples therapy treatment condition. The meta-analytic evidence, across 1,571 cases involving an estimated 3,500 patients and family members, favors family therapy over (a) individual counseling or therapy, (b) peer group therapy, and (c) family psychoeducation. Family therapy is as effective for adults as for adolescents and appears to be a cost-effective adjunct to methad…
Outcome, attrition, and family-couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies
Psychology (37 works) · Medicine (17 works) · Sociology (14 works) · Psychiatry (11 works) · Computer Science (10 works) · Political science (10 works) · Social Psychology (9 works) · Mental health (8 works) · Epistemology (7 works) · Mathematics (7 works)