When we want to compare the means of two independent groups, we can choose between two different tests:
Assumes that both groups of data are sampled from populations that follow a normal distribution and that both populations have the same variance.
Assumes that both groups of data are sampled from populations that follow a normal distribution, but it does not assume that those two populations have the same variance.
So, if the two samples do not have equal variance then it’s best to use the Welch’s t-test.
But how do we determine if the two samples have equal variance?
There are two ways to do so:
1. Use the Variance Rule of Thumb.
As a rule of thumb, if the ratio of the larger variance to the smaller variance is less than 4 then we can assume the variances are approximately equal and use the Student’s t-test.
For example, suppose we have the following two samples:
Sample 1 has a variance of 24.86 and sample 2 has a variance of 15.76.
The ratio of the larger sample variance to the smaller sample variance would be calculated as:
Ratio = 24.86 / 15.76 = 1.577
Since this ratio is less than 4, we could assume that the variances between the two groups are approximately equal.
Thus, we could proceed to perform Student’s t-test to determine if the two groups have the same mean.
2. Perform an F-test.
An F-test is a formal statistical test that uses the following null and alternative hypotheses:
HA: The samples do not have equal variances.
The test statistic is calculated as follows:
F = s12 / s22
where s12 and s22 are the sample variances.
If the p-value that corresponds to the test statistic is less than some significance level (like 0.05), then we have sufficient evidence to say that the samples do not have equal variances.
Once again suppose we have the following two samples:
To perform an F-test on these two samples, we can calculate the F test statistic as:
- F = s12 / s22
- F = 24.86 / 15.76
- F = 1.577
According to the , an F-value of 1.577 with numerator df = n1-1 = 12 and denominator df = n2-1 = 12 has a corresponding p-value of 0.22079.
Since this p-value is not less than .05, we fail to reject the null hypothesis. In other words, we can assume the sample variances are equal.
Thus, we could proceed to perform Student’s t-test to determine if the two groups have the same mean.
If you decide to perform the Student’s t-test, you can use the following tutorials as references:
And if you decide to perform the Welch’s t-test, you can use the following tutorials as references: