Statistics Onesample ttest

1
StatisticsOne-sample t-test

• June 21, 2000

2
To Do

• Two-sample and related sample t-tests
• Chapter 9
• T-tests in SPSS

3
Comparing the z-test, one-sample and two-samples
t-tests

• The test equation has the same basic form

4
Two-sample research design

• An experiment that uses a separate sample for
  each treatment condition (or each population) is
  call an independent-samples research design
• We are interested in the mean difference between
  two populations

Population A
Population B
Unknown ? ?
Unknown ? ?
?A - ?B gt 0
Sample A
Sample B
5
Assumptions of the two-sample t-test

• The two random samples of dependant scores
  measure an interval or ratio variable
• The population of raw scores represented by each
  sample is normally distributed and best described
  by the mean.
• We do not know the variance of either population
  and must estimate it from the sample data.
• The populations represented by our samples have
  homogeneous variance.
• Homogeneity of variance means that the true
  variance of the two population distributions are
  the same.
• This is especially important when the sample
  sizes are not equal.

6
Null and alternative hypotheses tested by the
two-sample t-test

• Two-tailed hypotheses predicting a mean
  difference of zero
• Ha ?1 - ?2 ? 0
• Ho ?1 - ?2 0
• Two-tailed hypotheses predicting a non-zero mean
  difference
• Ha ?1 - ?2 ? 10
• Ho ?1 - ?2 10
• One-tailed hypotheses predicting a difference of
  zero
• Ha ?1 - ?2 gt 0
• Ho ?1 - ?2 0

7
Steps in conducting a independent-samples t-test

• Identify your experimental hypothesis (then your
  Ho and Ha) and select an alpha level (typically
  .05)
• Collect data from samples that meet the
  assumptions of the two-sample t-test and
  calculate the means and variances
• Calculate the pooled variance using the sample
  variances then calculate the standard error of
  the difference using the pooled variance then
  calculate tobt using the standard error of the
  difference
• Compare your tobt with the tcrit in the tables
• For two-sample t-tests, df (n1 - 1) (n2-1)
• Report your results and graph the means
• Calculate the confidence interval for the mean
  differences
• Calculate the effect size (using either rpb or d)

8
Calculating the error term of the two-sample
t-test

• In estimating two population mus we have two
  sources of error
• x1 approximates ?1 with some error
• x2 approximates ?2 with some error
• We are interested in the combined error of the
  samples so we pool the variance
• This gives us an average error of the two
  samples
• Weigh variances by their df
• Way of accounting for differences in sample sizes
• Larger samples get more weight because they are
  better estimates of the population
• Use the pooled variance to calculate the standard
  error of the difference

9
Sampling distribution of mean differences when ?1
- ?1 0

• We are interested in the significance of the
  difference of our sample scores
• So we have a sampling distribution of mean
  differences
• We are comparing our differences in sample means
  to the differences in population mus given by the
  null hypothesis

10
Results of the t-test

• Present the results of your t-test
• t(30) 2.94, p lt .05
• df 30
• tobt 2.94
• Difference is significant
• Calculate the confidence interval of the mu
  difference
• If we preformed the experiment on the population,
  we are 95 confident that the difference would be
  between about .90 and 5.08
• Calculate the effect size
• The strength of the relationship or how much the
  independent and dependant variable are related
• d tobt (.20, .50, .80)

11
Power

• How to enhance the power of you two-sample t-test
• Maximize the difference produced by the two
  conditions
• High impact manipulations
• Very different conditions of the independent
  variable
• Minimize the variability of the raw scores
• Good experimental control
• Eliminate extraneous variables
• Maximize the sample ns
• Smaller denominator when calculating tobt
• Larger df resulting in a smaller value of tcrit

12
Related-sample t-test

• t-Test experiments
• Related-sample t-test
• Designs
• Dependent variable
• Pros and cons

13
Types of designs using t-tests

• Single-sample
• One sample of subjects
• Comparing the mean and the mu
• Independent-samples
• Two samples of subjects
• Comparing two means
• Repeated-measures
• One sample of subjects measured twice
• Looking at the difference between the means of
  the two measurements
• Matched-subjects
• Two samples of subjects that are paired on a
  certain variable
• Looking at the difference between the two means

14
Designs for related samples

• Matched-sample design
• Each individual in one sample is matched with a
  subject in the other sample
• The matching is done so that the two individuals
  are equivalent (or nearly equivalent) with
  respect to a specific variable that the
  researcher would like to control
• Repeated-measures design
• A single sample of subjects are used to compare
  two different treatment conditions
• Each individual is measured in one treatment, and
  then the same individual is measured again in the
  second treatment. Thus, a repeated-measures study
  produces two sets of scores, but each is obtained
  from the same sample of subjects

15
Pros and Cons of Related Samples Designs

• Matched-samples design
• Pro More powerful control individual
  differences
• Con Matched on wrong variable
• Repeated-measures design
• Pro Even more powerful better control of
  individual differences
• Con Order effects
• The first survey may effect performance on the
  second survey
• Counter balance 50 get A then B 50 get B then
  A

16
Dependent variable in related-samples t-tests

• In both cases (matched and repeated designs), we
  subtract one score from the other and do a
  one-sample-like t-test on the average difference
  (D)
• Instead of the mean of x, we use the mean of D
• D x2 - x1 after - before
• Instead of a known mu value, we use a value given
  in the null hypothesis (i.e., set by the
  experimenter)

17
Hypotheses Tested

• Interested in whether or not any difference
  exists between scores in the first treatment and
  scores in the second treatment.
• Is the population mean difference (?D) equal to
  zero (no change) or has a change occurred?
• Two-tailed hypotheses
• Ha ?D ? 0 or Ha ?D ? 20
• Ho ?D 0 Ho ?D 20
• One-tailed hypotheses
• Ha ?D gt 0
• Ho ?D 0

18
Results of the t-test

• Present the results of your t-test
• t(30) 2.94, p lt .05
• df 30
• tobt 2.94
• Difference is significant
• Calculate the confidence interval of the mu
  difference
• If we preformed the experiment on the population,
  we are 95 confident that the difference would be
  between about .90 and 5.08

19
Effect Size

• Calculate the effect size
• The strength of the relationship or how much the
  independent and dependant variable are related
• d tobt
• Small - 20
• Medium - 50
• Large - 80

20
Power

• How to enhance the power of your two-sample
  t-test
• Maximize the difference produced by the two
  conditions
• High impact manipulations
• Very different conditions of the independent
  variable
• Minimize the variability of the raw scores
• Good experimental control
• Eliminate extraneous variables
• Maximize the sample ns
• Smaller denominator when calculating tobt
• Larger df resulting in a smaller value of tcrit

21
Learning Check

• 1 What assumptions must be satisfied for the
  repeated-measures t-test to be valid?
• Random samples, interval or ratio variables,
  population of differences (D) is normally
  distributed, homogeneous variance (always equal n
  sizes)
• 2 Describe some situations for which a
  repeated-measure design is well suited.
• When subjects are hard to find (requires less
  subjects) required by your research question
  (differences over time) individual differences
  are large (reduces error)

22
Learning Check

• 3 How is a matched-subjects design similar to a
  repeated-measures design? How do they differ?
• They both reduce the role of individual
  differences thereby increasing power. They differ
  in that there are two samples in the matched
  design and one in the repeated measures design.
• 4 The data from a research study consist of 8
  scores for each of two different treatment
  conditions. How many individual subjects would be
  needed to produce these data.
• a. For an independent-measures design?
• 16, two separate sample with n 8 in each
• b. For a repeated measures design?
• 8 subjects, the same 8 subjects are measured in
  both treatments
• c. For a matched-subjects design?
• 16 subjects, 8 matched pairs

23
The End