Lesson 3

Testing the Difference Between Means: The t-Test

This is one of the most important parts of this course in basic
statistics. Here were going to learn about testing the significance
of difference between means. What does that mean?
Suppose youre the superintendent, and one of your principals
bursts into your office enthusiastically and says, "I know youll be
happy to learn that after our big effort this year in reading, my third
graders improved from 187 to 195 on the state reading test!"
You immediately ask her, "Is the 8-point difference between those
means statistically significant?" When her eyes glaze over and she
says, "Huh?" you smile, forebearingly, (because youve taken this
course in basic statistics, and she hasnt), and you patiently explain
to her that simply because there is a numerical difference between
last years and this years mean scores doesnt mean that there is
real difference. It could be due to chance variation in the scores.
So how do we know when the difference between two means is
probably a real difference, not one due to chance? We have to say
"probably" because nothing in statistics is absolutely certain (as is
the case with most things in life). But there are statistical tests
which can tell us how likely a difference between two means is due
to chance.
One of the most widely used statistical methods for testing the
difference between means, and the one were going to get you upto-speed on, is called the t-test.
Lets go back to the salary data we worked with in Table 1 of Lesson
1, but now lets compare the mean salary of that group with another
group, and ask whether the mean salaries of the two groups are
significantly different.
First, lets look at the formula for the t-test, and determine what we
need to make the computation:

Where:
is the mean for Group 1.
is the mean for Group 2.
is the number of people in Group 1.

is the number of people in Group 2.

is the variance for Group 1.
is the variance for Group 2.
2
The only thing in this formula youre not familiar with is the symbol s , which stands for the variance. The variance is
the same as the standard deviation without the square root, i.e., its nothing more than the sum of the deviations of
all the scores from the mean divided by n-1.
The formula above is for testing the significance of difference between two independent samples, i.e., groups of
different people. If we wanted to test the difference between, say, the pre-test and post-test means of the same
group of people, we would use a different formula for dependent samples. That formula is:

Where:
is the sum of all the individuals pre-post score differences.
is the sum of all the individuals pre-post score differences squared.
is the number of paired observations.
But for now, well test the significance of difference between the mean salary of two different groups. You can try the
one for dependent samples on your own. (I knew youd welcome that opportunity.)
Tables 8 and 9 provide the numbers we need to compute the t-test for the difference in mean salaries of the two
groups.
Table 8
Salaries and t-Test Calculation Data for Group 1

Salary (X)

Frequency (f)

X - Mean (d)

fd

fd2

20

25

25

625

25

20

40

800

30

15

45

675

35

10

40

400

40

25

125

45

50

-5

-25

125

55

-10

-40

400

60

-15

-45

675

65

-20

-40

800

70

-25

-25

625

SUM

36

5,250

The variance (s2)

Table 9
Salaries and t-Test Calculation Data for Group 2
A

Salary(X)

Frequency (f)

X - Mean (d)

fd

fd2

20

27

25

22

44

968

30

17

51

867

35

12

36

432

40

28

196

45

12

24

50

-3

-18

54

55

-8

-40

320

60

-13

-39

507

65

-18

-36

648

70

-23

-46

1,058

SUM

36

5,074

The variance (s2)

You can see from a quick inspection of the two tables that the salary
distributions are similar. There a few more people making higher
salaries. The mean of the second group (which has been calculated

for you) is slightly higher (47 vs. 45 for the first group). And the
variance is smaller (145 vs. 150). So lets plug the numbers into the
t-test formula and see what we get.

We now know that t = .222. So what does that mean? Is the

difference between the two means statistically significant or not? To
find out whether a t-test of any value is significant or not, we simply
look it up in a table that can be found in the appendices of any
statistical text book. The quick answer in this case is no, it is not
statistically significant. That is, the 2-point difference in the mean
salaries of these two groups could likely have occurred by chance.
But thats the quick and dirty answer. Theres more about the
matter of statistical significance we need to understand. So were
going to that important topic now, and well return to this example
after weve done that.
Click here to go on to Lesson 4.

Research Design in Occupational Education

Copyright 1997. James P. Key. Oklahoma State University
Except for those materials which are supplied by different departments of the University
(ex. IRB, Thesis Handbook) and references used by permission.

MODULE S5 - "t" TEST

We are called on many times to determine if the mean performance of two groups are
significantly different. Those two groups might be students, cattle, plants, or other objects.

When attempting to determine if the difference between two means is greater than that
expected from chance, the "t" test may be the needed statistical technique. If the data is from a
normal population and at least ordinal in nature, then we are surer that this is the technique to
use. If you wish to generalize to a population, then the samples must be representative.
"t" is the difference between two sample means measured in terms of the standard error of those
means, or "t" is a comparison between two groups means which takes into account the
differences in group variation and group size of the two groups. The statistical hypothesis for
the "t" test is stated as the null hypothesis concerning differences. There is no significant
difference in achievement between group 1 and group 2 on the welding test.
Separate variance formula
Use the separate variance formula if:

Pooled Variance Formula

Use the pooled variance formula if:

Correlated Data Formula

If the samples are related (two measures from the same subject or matched pairs), the
correlated data formula is used.

In choosing the correct formula, it is fairly easy to determine if the sample sizes are equal. The
number of subjects are either the same or they are not.
However, to determine if the variances are homogeneous, use the formula F = s 2 (largest) / s2
(smallest). We compare the calculated F value to the F table value at the .05 or .01 level of
significance with n1 - 1 and n2 - 1 degrees of freedom.
If the calculated values >= table value, then the variances are not equal; if the calculated value
< table value, then the variances are equal.
Example - Calculate the "t" value to test for differences between the achievement of the two
samples.
Sample 1

Sample 2

x1

x2

-2

-4

16

-1

-2

16

15

10

25

40

=3

=5

*n - 1 used since n < 30

Test for equal sample sizes and homogeneity of variances
n1 = n2 = 5
F = s2 (largest)/s2 (smallest) = 10/2.5 = 4 with 4 and 4 degrees of freedom
F.05 with 4 and 4 degrees of freedom = 6.39
4 < 6.39 so assume s12 = s22
Since sample sizes and variances are equal, either the separate variance formula or the pooled
variance formula may be used.

Separate Variance Formula

with 8 degrees of freedom

Pooled Variance Formula

with 8 degrees of freedom

As shown in the above example, the degrees of freedom are calculated differently depending
upon whether the ns and ss are equal or not. We must check the degrees of freedom
corresponding with the formula we use.
To test the hypothesis, we compare the calculated value to the table value for the significance
level we have chosen. If the calculated value >= table value, we reject the null hypothesis and

conclude the difference is greater than that expected by chance. If the calculated value < table
value, we fail to reject the null hypothesis and conclude this amount of difference could have
been the result of chance.
In our example, our calculated value was -1.265 with 8 df and the table value for the .01 level
with 8 df was + 3.355. Since |-1.265| < |-3.355|, we accept the null hypothesis and conclude
that the mean difference in achievement between the two samples was no greater than would be
expected by chance.

Assumptions
1. Representative sample (Random)
2. Normal distribution for population
3. At least ordinal measures

SELF ASSESSMENT
1. State the conditions which would help you determine when to use the "t" test.
2. You wish to find out if one group of steers fed a special ration gained weight faster than a
similar group of steers on the regular ration. State the statistical hypothesis you would test.
3. Given the following rate of gain data, choose the "t" formula which fits the data.
Special Ration (x1)

Regular Ration (x2)

4. Using the data and the formula from problem 3, calculate the "t" value.
5. Calculate the degrees of freedom for problem 3.
6. Test your hypothesis at the .01 level of significance.

Relief of Duty as Housemaster

Mungazi Agrippa
<mungazimungazi@gmail.com>

6:26 AM (2
minutes ago)

to shorwi, shorwi
I write to you requesting a relief on the duty assigned to me of being a
housemaster. As you are aware, we introduced Computer Science at A'level
and that next year 2015, I would have two A'level classes, form 4 class and
form 2 class. The level of research associated with A'level classes needs
time. I would be having two exam classes which also bring with them
special challenges in terms of coursework preparation for form fours and
More
the project for upper sixth class. This coupled with the duty of being
housemaster, it is my feeling that the work load will somehow overwhelm
me. Given that I am also the secretary for the disciplinary committee, this
can worsen my plight if ever we are going to have some disciplinary issues.
All things being equal, I would like to concentrate on the A'level huddle
alone and probably consider the same duty after I establish a mark in
A'level Computer Science teaching.
I kindly ask you to consider my request for relief.
Please assist and advise me in the best interest of Hartzell High School
Yours Faithfully
Mungazi Agrippa
(Teacher)

shorwi
kawadza

Show details