Statistics and replication experiments

Comparing interaction effects

Victor A. Benassi, Robert F Belli

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

A method is presented that allows the comparison and combination of interaction effects obtained in two or more experiments. Using an analysis of variance model, we first evaluated the interaction effects found in experiments conducted by Alloy and Abramson (1979, Experiment 2) and Bryson, Doan, and Pasquali (1984). Both experiments examined the same independent (level of depression and outcome frequency) and dependent (judgment of control) variables. Whereas Alloy and Abramson reported a significant depression ×outcome frequency interaction for female subjects, Bryson et al. failed to find any significant interaction effects. The latter authors challenged the replicability of the Alloy and Abramson results. Our reanalyses of the results from these two studies indicated that, for females, Bryson et al. produced an interaction effect not different from that of Alloy and Abramson. Our next task was to compare the conclusions reached from our analytical approach with those based on standard meta-analytic methods (Rosenthal, 1984). Finally, we evaluated the general utility of the two analytical approaches and made some general comments about replication experiments.

Original languageEnglish (US)
Pages (from-to)283-294
Number of pages12
JournalCognitive Therapy and Research
Volume13
Issue number3
DOIs
StatePublished - Jun 1 1989

Fingerprint

Depression
Analysis of Variance
Magnesium Salicylate

Keywords

  • analysis of variance
  • interaction effects
  • meta-analysis
  • replication

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Clinical Psychology

Cite this

Statistics and replication experiments : Comparing interaction effects. / Benassi, Victor A.; Belli, Robert F.

In: Cognitive Therapy and Research, Vol. 13, No. 3, 01.06.1989, p. 283-294.

Research output: Contribution to journalArticle

@article{f79789dd0e4c4c4d84ebbdba1265b46a,
title = "Statistics and replication experiments: Comparing interaction effects",
abstract = "A method is presented that allows the comparison and combination of interaction effects obtained in two or more experiments. Using an analysis of variance model, we first evaluated the interaction effects found in experiments conducted by Alloy and Abramson (1979, Experiment 2) and Bryson, Doan, and Pasquali (1984). Both experiments examined the same independent (level of depression and outcome frequency) and dependent (judgment of control) variables. Whereas Alloy and Abramson reported a significant depression ×outcome frequency interaction for female subjects, Bryson et al. failed to find any significant interaction effects. The latter authors challenged the replicability of the Alloy and Abramson results. Our reanalyses of the results from these two studies indicated that, for females, Bryson et al. produced an interaction effect not different from that of Alloy and Abramson. Our next task was to compare the conclusions reached from our analytical approach with those based on standard meta-analytic methods (Rosenthal, 1984). Finally, we evaluated the general utility of the two analytical approaches and made some general comments about replication experiments.",
keywords = "analysis of variance, interaction effects, meta-analysis, replication",
author = "Benassi, {Victor A.} and Belli, {Robert F}",
year = "1989",
month = "6",
day = "1",
doi = "10.1007/BF01173409",
language = "English (US)",
volume = "13",
pages = "283--294",
journal = "Cognitive Therapy and Research",
issn = "0147-5916",
publisher = "Springer New York",
number = "3",

}

TY - JOUR

T1 - Statistics and replication experiments

T2 - Comparing interaction effects

AU - Benassi, Victor A.

AU - Belli, Robert F

PY - 1989/6/1

Y1 - 1989/6/1

N2 - A method is presented that allows the comparison and combination of interaction effects obtained in two or more experiments. Using an analysis of variance model, we first evaluated the interaction effects found in experiments conducted by Alloy and Abramson (1979, Experiment 2) and Bryson, Doan, and Pasquali (1984). Both experiments examined the same independent (level of depression and outcome frequency) and dependent (judgment of control) variables. Whereas Alloy and Abramson reported a significant depression ×outcome frequency interaction for female subjects, Bryson et al. failed to find any significant interaction effects. The latter authors challenged the replicability of the Alloy and Abramson results. Our reanalyses of the results from these two studies indicated that, for females, Bryson et al. produced an interaction effect not different from that of Alloy and Abramson. Our next task was to compare the conclusions reached from our analytical approach with those based on standard meta-analytic methods (Rosenthal, 1984). Finally, we evaluated the general utility of the two analytical approaches and made some general comments about replication experiments.

AB - A method is presented that allows the comparison and combination of interaction effects obtained in two or more experiments. Using an analysis of variance model, we first evaluated the interaction effects found in experiments conducted by Alloy and Abramson (1979, Experiment 2) and Bryson, Doan, and Pasquali (1984). Both experiments examined the same independent (level of depression and outcome frequency) and dependent (judgment of control) variables. Whereas Alloy and Abramson reported a significant depression ×outcome frequency interaction for female subjects, Bryson et al. failed to find any significant interaction effects. The latter authors challenged the replicability of the Alloy and Abramson results. Our reanalyses of the results from these two studies indicated that, for females, Bryson et al. produced an interaction effect not different from that of Alloy and Abramson. Our next task was to compare the conclusions reached from our analytical approach with those based on standard meta-analytic methods (Rosenthal, 1984). Finally, we evaluated the general utility of the two analytical approaches and made some general comments about replication experiments.

KW - analysis of variance

KW - interaction effects

KW - meta-analysis

KW - replication

UR - http://www.scopus.com/inward/record.url?scp=0141612300&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141612300&partnerID=8YFLogxK

U2 - 10.1007/BF01173409

DO - 10.1007/BF01173409

M3 - Article

VL - 13

SP - 283

EP - 294

JO - Cognitive Therapy and Research

JF - Cognitive Therapy and Research

SN - 0147-5916

IS - 3

ER -