Interpreting effect sizes

Throughout the BEE UK, the term “effect size” (ES) is used. This is the difference between the mean of the experimental group and the mean of the control group (after adjustment for any pre-test differences), divided by the standard deviation of the control group. When means or standard deviations are not reported, ES is often estimated from other information that is available.

What is considered a large effect size? There is no universally accepted definition. More is better, but often the quality of the research design is more important than the size of the effect. For example, a large experiment with random assignment to treatments that obtained an effect size of +0.20 is more important than a small, matched experiment with an effect size of +0.90. Small and matched studies are more likely to have unreliable, possibly biased findings, while you are more likely to be able to rely on the positive effect size in the large, randomised study.

One way to interpret the size of difference indicated by an effect size is to consider the improvement in percentile scores that would take place if a programme with a given effect size is implemented. The table opposite shows this: