Advanced ANOVA/ANCOVA

< Advanced ANOVA
Resource type: this resource contains a tutorial or tutorial notes.
Completion status: this resource is considered to be complete.

This tutorial teaches use of analysis of covariance (ANCOVA) techniques, with practical exercises based on using SPSS.

Overview

Covariates

Example

If you are interested in testing the effect of computer experience on the attitude towards use of internet shopping, and you suspect that those with more positive attitudes toward shopping in general are more likely to have positive attitudes towards internet shopping, you may include attitude toward shopping as a covariate so as to remove its influence from the attitude towards internet shopping measure.

Assumptions

Assumptions to be met are those for ANOVA, plus:

  1. Covariates must be linearly related to the DV. The stronger the correlation, the more useful the CV will be. If there is no correlation, then the inclusion of the CV will slightly weaken the power of the test by needlessly consuming a degree of freedom.
  2. Covariates must have a homogeneity of regression (or homogeneity of slopes) effect (equal effects on the DV across the IV groups) - if there is a significant interaction between the covariate and the factor – you cannot use this procedure.
  3. The covariate should be unrelated to the IV.
  4. Covariates should not be overly correlated with one another.

The first two criteria can be checked via a scatterplot of the DV and the CV, with the IV as control variable (to check for equal slopes)

The third criteria depends on experimental design, e.g., if the CV is measured prior to the IV, then it cannot be affected by the IV.

The fourth criteria can be checked via correlations and scatterplots between the CVs.

The main ANOVA assumptions are that:

  1. Each of the observations are independent.
  2. The DV (and the CV) must be interval level of measurement.
  3. The underlying populations (of adjusted scores) must be normally distributed.
  4. Each of the underlying populations (of adjusted scores) must have the same variance.

The first two assumptions are a function of experimental design. The third and fourth assumptions are more difficult to test because we do not have the 'adjusted scores', so we cannot compare the variances of the adjusted scores across the IV groups, but SPSS provides a Levene's test for the homogeneity of variance for the adjusted scores. Fortunately, provided the samples are sufficiently large, the test is robust to violations of the normality assumption.

Example write-up

A one-way analysis of covariance (ANCOVA) was conducted. The independent variable, vitamin C, involved three levels: placebo, low dose, and high dose. The dependent variable was the number of days with cold symptoms during treatment and the covariate was the number of days with cold symptoms before treatment. The assumptions for ANCOVA were met. In particular, the homogeneity of the regression effect was evident for the covariate, and the covariate was linearly related to the dependent measure.

The ANCOVA was significant, F (2,26) = 6.45, p = .005. The strength of the relationship between vitamin C treatment and the dependent variable was very strong, as assessed by \eta_p^2, with the vitamin C factor accounting for 33 percent of the variance in dependent measure holding constant the number of days with pretreatment cold symptoms. The mean number of days with cold symptoms adjusted for initial differences were ordered as expected across the three vitamin C groups. The placebo group had the largest adjusted mean (M = 12.01), the low dose vitamin C group had a smaller adjusted mean (M = 7.71) and the high dose vitamin C group had the smallest adjusted mean (M = 6.67). Follow-up tests were conducted to evaluate pairwise differences among the adjusted means. The Holm’s sequential Bonferroni procedure was used to control for Type I error across the three pairwise comparisons. There were significant differences in the adjusted means between both groups that received vitamin C and the placebo, but no significant difference between the two vitamin C groups. [Standardised mean effect sizes to be added] e.g., effect size with covariate calculator

Descriptives

In presenting ANCOVA results, provide a table of means for each of the groups. If the same scale is used to measure the DV and the CV, then the unadjusted group means and SD (from Descriptives) can be presented. If a different scale is used for the DV and CV, then provide both the unadjusted mean (and SD) and the adjusted mean (and SE). The adjusted mean (controlling for the CV) is provided in the Estimated marginal means table.

Exercises

Teaching method

In a hypothetical educational psychology experiment, participants were randomly divided into two groups. One group was taught conventionally, and the other were taught using an innovative method. Prior to allocation to the groups, learning motivation was assessed. Improvements in academic achievement were measured as the DV.

Positive effect

Conduct an ANCOVA to test for differences in positive effect between males and females, adjusting for differences in age.

Vitamin C

Do low and high doses of Vitamin C reduce incidences of days suffered with a cold? Conduct an ANOVA using:

Therapy and depression

What is the effect of three different therapy types on depression, taking into account pre-existing depression levels? Use:

See also

External links

This article is issued from Wikiversity - version of the Wednesday, September 03, 2014. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.