z 1-β

Statistics for clinicians
Biostatistics course by Kevin E. Kip, Ph.D., FAHA
Professor and Executive Director, Research Center
University of South Florida, College of Nursing
Professor, College of Public Health
Department of Epidemiology and Biostatistics
Associate Member, Byrd Alzheimer’s Institute
Morsani College of Medicine
Tampa, FL, USA
1
SECTION 5.1
Parameters and
factors that affect
sample size
Sample size estimation and
correlation
Learning Outcome:
Describe how margin of error, effect size,
and variability of the outcome affect
sample size estimates.
Overview:
 All studies should be designed to include a sufficient number of
participants to adequately address the research question.
 In clinical trials, small-to-modest effects are typically anticipated,
thus, large sample sizes are often needed.
 In some circumstances, sample sizes are determined by logistical or
financial constraints. While this may be reality, it does not ensure
that the research question can be adequately addressed.
 Sample size considerations should consider loss to follow-up,
subject crossover, suboptimal intervention compliance, and
outcome rates lower than anticipated.
 The concepts and formulas that follow are based on statistical
considerations irrespective of logistical or financial constraints.
“Effect Size”:
 Measure of the strength of the relationship, such as a drug effect
versus placebo on resolution of symptoms.
 Cohen’s “d” is a common measure of effect size used in sample
size estimation.
d=
x1 - x2
s
 General interpretation:
Cohen's d
0.2
0.5
0.8
Interpretation
Small
meduim
Large
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.).
Hillsdale, NJ: Lawrence Earlbaum Associates
Common z values (table 1) for
various confidence intervals:
Precision (margin of error)
90%
95%
99%
99.5%
1.645
1.960
2.575
2.800
Common z values (table 1) for type I and type II error rates:
Type I (z1-α/2)
Type II (z1-β)
0.10:
0.05:
0.01:
0.001:
0.20 (80% power):
0.84
0.10 (90% power):
1.282
1.645
1.960
2.575
2.800
SECTION 5.2
Sample size estimates for a
one sample continuous
outcome
Learning Outcome:
Calculate and interpret sample size
estimates for a one-sample continuous
outcome:
--- Estimate for a confidence interval
--- Estimate for a hypothesis test
Continuous Outcome – One Sample
Sample Size to
Estimate C.I.
Sample Size for
Hypothesis Test
C.I. for µ
H0: µ = µ0
n =
Zσ
E
2
n =
Z1 – α/2 + Z1 – β
ES =
ES
| µ1 - µ0 |
σ
2
Continuous Outcome – One Sample (C.I.)
Example: Estimate required sample size for a
95% C.I. of systolic blood pressure in children
with congenital heart disease ages 3 to 5.
Sample Size to
Estimate C.I.
C.I. for µ
n =
n =
Zσ
E
Zσ
E
Parameters:
2
Margin of error:
Assumed SD:
Desired C.I.:
2
=
1.96 x 20
5
5 units (mm/Hg)
20
95% (i.e. z = 1.96)
2
= 61.5
Continuous Outcome – One Sample (C.I.) - Practice
Example: Estimate required sample size for a
95% C.I. of body mass index among teenagers
ages 14 to 17 in Tampa, FL.
Sample Size to
Estimate C.I.
C.I. for µ
n =
n =
Zσ
E
Zσ
E
Parameters:
2
Margin of error:
Assumed SD:
Desired C.I.:
2
1.5 units
4.8
95% (i.e. z = 1.96)
2
=
= _______
Continuous Outcome – One Sample (C.I.) - Practice
Sample Size to
Estimate C.I.
C.I. for µ
n =
n =
Zσ
E
Zσ
E
2
2
Example: Estimate required sample size for a
95% C.I. of body mass index among teenagers
ages 14 to 17 in Tampa, FL.
Parameters:
Margin of error:
Assumed SD:
Desired C.I.:
1.96 x 4.8
=
1.5
1.5 units
4.8
95% (i.e. z = 1.96)
2
= 39.3
Continuous Outcome – One Sample (H0 Test)
Example: Compare mean fasting glucose
level in a sample of heavy coffee drinkers to
known values in the general population.
Sample Size for
Hypothesis Test
H0: µ = µ0
n=
Z1 – α/2 + Z1 – β
ES =
n=
Parameters/Assumptions:
2
General pop mean:
General pop SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
ES
| µ1 - µ0 |
| 100 - 95 |
ES =
= 0.51
9.8
σ
1.96 + 0.84
0.51
μ0 = 95.0 mg/dL
σ0 = 9.8
5 mg/dL
0.05
0.80
Note: 100 = 95 + 5
2
= 30.1
A sample size of n = 31 will ensure that a 2-sided
test with α=0.05 has 80% power to detect a
5 mg/dL difference in mean glucose levels
Continuous Outcome – One Sample (H0 Test)(Practice)
Example: Compare mean fasting cholesterol
level in a sample of intensive swimmers to
known values in the general population.
Sample Size for
Hypothesis Test
H0: µ = µ0
n=
Z1 – α/2 + Z1 – β
ES =
n=
ES
| µ1 - µ0 |
σ
Parameters/Assumptions:
2
General pop mean:
General pop SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
ES =
|
= _____
|
μ0 = 194.4 mg/dL
σ0 = 34.8
20 mg/dL
0.05
0.80
= __________
Continuous Outcome – One Sample (H0 Test)(Practice)
Example: Compare mean fasting cholesterol
level in a sample of intensive swimmers to
known values in the general population.
Sample Size for
Hypothesis Test
H0: µ = µ0
n=
Z1 – α/2 + Z1 – β
ES =
n=
Parameters/Assumptions:
2
General pop mean:
General pop SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
ES
| µ1 - µ0 |
| 174.4 – 194.4 |
ES =
= 0.575
34.8
σ
1.96 + 0.84
0.575
μ0 = 194.4 mg/dL
σ0 = 34.8
20 mg/dL
0.05
0.80
Note: 174.4 = 194.4 - 20
2
= 23.7
A sample size of n = 24 will ensure that a 2-sided
test with α=0.05 has 80% power to detect a
20 mg/dL difference in mean cholesterol levels
SECTION 5.3
Sample size estimates for a
two-sample (independent
groups) continuous outcome
Learning Outcome:
Calculate and interpret sample size
estimates for a two-sample
(independent groups) continuous
outcome:
--- Estimate for a confidence interval
--- Estimate for a hypothesis test
Continuous Outcome – Two Independent Samples
Sample Size to
Estimate C.I.
Sample Size for
Hypothesis Test
C.I. for (µ1 - µ2)
H0: µ1 = µ2
ni = 2
Zσ
E
2
ni = 2
Z1 – α/2 + Z1 – β
ES =
ES
| µ1 - µ2 |
σ
2
Continuous Outcome – Two Independent Samples (C.I.)
Sample Size to
Estimate C.I.
C.I. for (µ1 - µ2)
ni = 2
ni = 2
Zσ
E
2
Zσ
E
2
Example: Compare low-fat versus low-carb
diet in obese children for weight loss.
Parameters:
Margin of error:
Assumed pooled SD:
Desired C.I.:
Assumed drop out rate:
1.96 x 8.1
= 2
3
3 pounds
8.1 pounds
95% (i.e. z = 1.96)
20%
2
= 56.0 (per group; n1 and n2)
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = 112 / 0.80 = 140 subjects
Continuous Outcome – Two Independent Samples (C.I.)(Practice)
Sample Size to
Estimate C.I.
Example: Compare strength training versus aerobic
training for weight loss among obese adults.
Parameters:
C.I. for (µ1 - µ2)
ni = 2
ni = 2
Zσ
E
2
Zσ
E
Margin of error:
Assumed pooled SD:
Desired C.I.:
Assumed drop out rate:
4 pounds
12.2 pounds
95% (i.e. z = 1.96)
15%
2
=
= ____________________
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = ____________________________
Continuous Outcome – Two Independent Samples (C.I.)(Practice)
Sample Size to
Estimate C.I.
C.I. for (µ1 - µ2)
ni = 2
ni = 2
Zσ
E
2
Zσ
E
2
Example: Compare strength training versus aerobic
training for weight loss among obese adults.
Parameters:
Margin of error:
Assumed pooled SD:
Desired C.I.:
Assumed drop out rate:
4 pounds
12.2 pounds
95% (i.e. z = 1.96)
15%
2
1.96 x 12.2
= 2
= 71.5 (per group; n1 and n2)
4
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = 143 / 0.85 = 168.2 subjects
Continuous Outcome – Two Independent Samples (H0 Test)
Example: Compare systolic blood pressure
in a trial of a new drug vs. placebo.
Sample Size for
Hypothesis Test
Parameters/Assumptions:
H0: µ1 = µ2
ni = 2
Z1 – α/2 + Z1 – β
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
2
ES
| µ1 - µ2 |
ES =
σ
ni = 2
1.96 + 0.84
0.263
σ = 19.0 mg/dL
5 mg/dL
0.05
0.80
10%
5
= 0.263
ES =
19.0
2
ni = 226.4
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = 452.8 / 0.90 = 503 subjects
n = 452.8
A sample size of n = 503 will ensure that a 2sided test with α=0.05 has 80% power to detect
a 5 mg/dL difference in systolic blood pressure
between the 2 study groups.
Continuous Outcome – Two Independent Samples (H0 Test)(Practice)
Example: Compare hemoglobin A1c levels between
an insulin sensitizing and insulin augmentation drug.
Sample Size for
Hypothesis Test
Parameters/Assumptions:
H0: µ1 = µ2
ni = 2
Z1 – α/2 + Z1 – β
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
2
ES
| µ1 - µ2 |
ES =
σ
ni =
ES =
ni = _____
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = _________________________
= ______
n = _____
σ = 2.7
1.2
0.05
0.90
20%
Continuous Outcome – Two Independent Samples (H0 Test)(Practice)
Example: Compare hemoglobin A1c levels between
an insulin sensitizing and insulin augmentation drug.
Sample Size for
Hypothesis Test
Parameters/Assumptions:
H0: µ1 = µ2
ni = 2
Z1 – α/2 + Z1 – β
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
2
ES
| µ1 - µ2 |
ES =
σ
ni = 2
1.96 + 1.282
0.444
σ = 2.7
1.2
0.05
0.90
20%
1.2
= 0.444
ES =
2.7
2
ni = 106.4
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = 212.8 / 0.80 = 266 subjects
n = 212.8
A sample size of n = 266 will ensure that a 2sided test with α=0.05 has 90% power to detect
a 1.2(%) difference in hemoglobin A1c
between the 2 study groups.
SECTION 5.4
Sample size estimates for a
matched sample and a
continuous outcome
Learning Outcome:
Calculate and interpret sample size
estimates for a matched sample and a
continuous outcome
--- Estimate for a confidence interval
--- Estimate for a hypothesis test
Continuous Outcome – Two Matched Samples
Sample Size to
Estimate C.I.
Sample Size for
Hypothesis Test
H0: µd = 0
C.I. for µd
n=
Zσd
E
2
n=
Z1 – α/2 + Z1 – β
ES
ES =
µd
σd
2
Continuous Outcome – Two Matched Samples (C.I.)
Example: Crossover trial of low-fat and lowcarb diet in obese children for weight loss.
Each subject is assigned to both diets.
Sample Size to
Estimate C.I.
C.I. for µd
n=
Zσd
Parameters:
2
Margin of error:
Assumed SD (diff):
Desired C.I.:
Assumed drop out rate:
E
3 pounds difference
9.1 pounds
95% (i.e. z = 1.96)
30%
2
n=
1.96 x 9.1
3
n = 35.3
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = 35.3 / 0.70 = 50.5 subjects
Continuous Outcome – Two Matched Samples (C.I.)(Practice)
Sample Size to
Estimate C.I.
C.I. for µd
n=
n=
Zσd
E
2
Example: Crossover trial of 2 different
exercise programs for overweight adults. Each
subject is assigned to both programs.
Parameters:
Margin of error:
Assumed SD (diff):
Desired C.I.:
Assumed drop out rate:
2 pounds difference
5.6 pounds
95% (i.e. z = 1.96)
20%
n = ______
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = ______________________________
Continuous Outcome – Two Matched Samples (C.I.)(Practice)
Example: Crossover trial of 2 different
exercise programs for overweight adults. Each
subject is assigned to both programs.
Sample Size to
Estimate C.I.
C.I. for µd
n=
Zσd
Parameters:
2
Margin of error:
Assumed SD (diff):
Desired C.I.:
Assumed drop out rate:
E
2 pounds difference
5.6 pounds
95% (i.e. z = 1.96)
20%
2
n=
1.96 x 5.6
2
n = 30.1
Take into account the drop out rate:
N (number to enroll) / (% retained) = desired sample size
N = 30.1 / 0.80 = 37.6 subjects
Continuous Outcome – Two Matched Samples (H0 Test)
Example: Crossover trial of low-fat and
low-carb diet in obese children for weight
loss. Each subject is assigned to both diets.
Sample Size for
Hypothesis Test
H0: µd = 0
n=
Z1 – α/2 + Z1 – β
2
ES
µd
ES =
σd
n=
Parameters/Assumptions:
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
σd = 9.1 pounds
3 pounds
0.05
0.80
30%
3
ES =
= 0.33
9.1
1.96 + 0.84
0.33
2
= 72.1
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = 72.1 / 0.70 = 103.1 subjects
A sample size of n = 103 will ensure
that a 2-sided test with α=0.05 has
80% power to detect a 3 pound
difference between the 2 diets.
Continuous Outcome – Two Matched Samples (H0 Test)(Practice)
Example: Crossover trial of 2 memory enhancement
programs for adults with mild dementia. Each subject
is assigned to both programs (# words remembered).
Sample Size for
Hypothesis Test
Parameters/Assumptions:
H0: µd = 0
n=
Z1 – α/2 + Z1 – β
µd
ES =
σd
n=
ES
ES =
2
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
= _______
= __________
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = __________________________
σd = 3.4 words
2 words
0.05
0.80
20%
Continuous Outcome – Two Matched Samples (H0 Test)(Practice)
Example: Crossover trial of 2 memory enhancement
programs for adults with mild dementia. Each subject
is assigned to both programs (# words remembered).
Sample Size for
Hypothesis Test
Parameters/Assumptions:
H0: µd = 0
n=
Z1 – α/2 + Z1 – β
ES
µd
ES =
σd
n=
2
Estimated SD:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
Assumed dropout-rate:
σd = 3.4 words
2 words
0.05
0.80
20%
2
ES =
= 0.59
3.4
1.96 + 0.84
0.59
2
= 22.66
Take into account the drop out rate:
N (number to enroll) / (% retained)
N = 22.66 / 0.80 = 28.3 subjects
A sample size of n = 29 will ensure
that a 2-sided test with α=0.05 has
80% power to detect a 2 word
difference in memory recall between
the 2 programs.
SECTION 5.5
Sample size estimates for a
one sample dichotomous
outcome
Learning Outcome:
Calculate and interpret sample size
estimates for a one sample
dichotomous outcome
--- Estimate for a confidence interval
--- Estimate for a hypothesis test
Dichotomous Outcome – One Sample
Sample Size to
Estimate C.I.
Sample Size for
Hypothesis Test
H0: p = p0
C.I. for p
n = p(1-p)
Z
E
2
n=
Z1 – α/2 + Z1 – β
ES =
ES
| p1 – p0 |
p0(1– p0)
2
Dichotomous Outcome – One Sample (C.I.)
Sample Size to
Estimate C.I.
C.I. for p
n = p(1-p)
Z
E
Example: Estimate required sample size for
95% C.I. of the proportion of freshman at a
college who currently smoke cigarettes.
Parameters:
2
Margin of error:
Assumed prevalence (i)
Assumed prevalence (ii)
Desired C.I.:
5%
50% (i.e. no data available)
27% (i.e. national data)
95% (i.e. z = 1.96)
2
2
1.96
n = 0.5(1-0.5)
0.05
= 384.2
1.96
n = 0.27(1-0.27)
0.05
= 302.9
Dichotomous Outcome – One Sample (C.I.)(Practice)
Sample Size to
Estimate C.I.
C.I. for p
n = p(1-p)
Z
E
2
n=
Example: Estimate required sample size for 95% C.I.
of the proportion of male freshman at a college who
report binge drinking at least once a month.
Parameters:
Margin of error:
Assumed prevalence (ii)
Desired C.I.:
5%
14% (i.e. national data)
95% (i.e. z = 1.96)
= _______
Dichotomous Outcome – One Sample (C.I.)(Practice)
Sample Size to
Estimate C.I.
C.I. for p
n = p(1-p)
Z
E
2
Example: Estimate required sample size for 95% C.I.
of the proportion of male freshman at a college who
report binge drinking at least once a month.
Parameters:
Margin of error:
Assumed prevalence (ii)
Desired C.I.:
2
1.96
n = 0.14(1-0.14)
0.05
= 185.0
5%
14% (i.e. national data)
95% (i.e. z = 1.96)
Dichotomous Outcome – One Sample (H0 Test)
Example: Compare prevalence of high LDL
cholesterol (>159 mg/dL) between patients
with a history of CVD and a population
estimate of those without CVD.
Sample Size for
Hypothesis Test
H0: p = p0
Parameters/Assumptions:
2
n=
Z1 – α/2 + Z1 – β
ES
ES =
| p1 – p0 |
p0(1– p0)
General population proportion:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
| 0.31 – 0.26 |
ES =
= 0.114
0.26 (1– 0.26)
2
n=
1.96 + 1.282
0.114
p0 = 0.26 (26%)
0.05 (5%)
0.05
0.90
n = 808.9
A sample size of n = 809 will ensure
that a 2-sided test with α=0.05 has 90%
power to detect a difference of 0.05, or
5%, in the proportion of patients with a
history of CVD who have an elevated
LDL cholesterol level.
Dichotomous Outcome – One Sample (H0 Test)(Practice)
Example: Compare the prevalence of the metabolic
syndrome between patients with a history of alcohol
abuse and a population estimate of those without.
Sample Size for
Hypothesis Test
H0: p = p0
Parameters/Assumptions:
Z1 – α/2 + Z1 – β
General population proportion:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
2
n=
ES =
n=
ES
| p1 – p0 |
p0(1– p0)
|
ES =
n = ________
|
=_______
p0 = 0.22 (22%)
0.06 (6%)
0.05
0.80
Dichotomous Outcome – One Sample (H0 Test)(Practice)
Example: Compare the prevalence of the metabolic
syndrome between patients with a history of alcohol
abuse and a population estimate of those without.
Sample Size for
Hypothesis Test
H0: p = p0
Parameters/Assumptions:
Z1 – α/2 + Z1 – β
General population proportion:
Clinically important difference:
2-sided type I error rate (α):
Desired power (1-β):
2
n=
ES
ES =
| p1 – p0 |
p0(1– p0)
| 0.28 – 0.22 |
ES =
= 0.145
0.22 (1– 0.22)
2
n=
1.96 + 0.84
0.145
p0 = 0.22 (22%)
0.06 (6%)
0.05
0.80
n = 373.7
A sample size of n = 374 will ensure
that a 2-sided test with α=0.05 has 80%
power to detect a difference of 0.06, or
6%, in the proportion of patients with a
history of alcohol abuse who have the
metabolic syndrome.