Statistics for clinicians Biostatistics course by Kevin E. Kip, Ph.D., FAHA Professor and Executive Director, Research Center University of South Florida, College of Nursing Professor, College of Public Health Department of Epidemiology and Biostatistics Associate Member, Byrd Alzheimer’s Institute Morsani College of Medicine Tampa, FL, USA 1 SECTION 5.1 Parameters and factors that affect sample size Sample size estimation and correlation Learning Outcome: Describe how margin of error, effect size, and variability of the outcome affect sample size estimates. Overview: All studies should be designed to include a sufficient number of participants to adequately address the research question. In clinical trials, small-to-modest effects are typically anticipated, thus, large sample sizes are often needed. In some circumstances, sample sizes are determined by logistical or financial constraints. While this may be reality, it does not ensure that the research question can be adequately addressed. Sample size considerations should consider loss to follow-up, subject crossover, suboptimal intervention compliance, and outcome rates lower than anticipated. The concepts and formulas that follow are based on statistical considerations irrespective of logistical or financial constraints. “Effect Size”: Measure of the strength of the relationship, such as a drug effect versus placebo on resolution of symptoms. Cohen’s “d” is a common measure of effect size used in sample size estimation. d= x1 - x2 s General interpretation: Cohen's d 0.2 0.5 0.8 Interpretation Small meduim Large Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates Common z values (table 1) for various confidence intervals: Precision (margin of error) 90% 95% 99% 99.5% 1.645 1.960 2.575 2.800 Common z values (table 1) for type I and type II error rates: Type I (z1-α/2) Type II (z1-β) 0.10: 0.05: 0.01: 0.001: 0.20 (80% power): 0.84 0.10 (90% power): 1.282 1.645 1.960 2.575 2.800 SECTION 5.2 Sample size estimates for a one sample continuous outcome Learning Outcome: Calculate and interpret sample size estimates for a one-sample continuous outcome: --- Estimate for a confidence interval --- Estimate for a hypothesis test Continuous Outcome – One Sample Sample Size to Estimate C.I. Sample Size for Hypothesis Test C.I. for µ H0: µ = µ0 n = Zσ E 2 n = Z1 – α/2 + Z1 – β ES = ES | µ1 - µ0 | σ 2 Continuous Outcome – One Sample (C.I.) Example: Estimate required sample size for a 95% C.I. of systolic blood pressure in children with congenital heart disease ages 3 to 5. Sample Size to Estimate C.I. C.I. for µ n = n = Zσ E Zσ E Parameters: 2 Margin of error: Assumed SD: Desired C.I.: 2 = 1.96 x 20 5 5 units (mm/Hg) 20 95% (i.e. z = 1.96) 2 = 61.5 Continuous Outcome – One Sample (C.I.) - Practice Example: Estimate required sample size for a 95% C.I. of body mass index among teenagers ages 14 to 17 in Tampa, FL. Sample Size to Estimate C.I. C.I. for µ n = n = Zσ E Zσ E Parameters: 2 Margin of error: Assumed SD: Desired C.I.: 2 1.5 units 4.8 95% (i.e. z = 1.96) 2 = = _______ Continuous Outcome – One Sample (C.I.) - Practice Sample Size to Estimate C.I. C.I. for µ n = n = Zσ E Zσ E 2 2 Example: Estimate required sample size for a 95% C.I. of body mass index among teenagers ages 14 to 17 in Tampa, FL. Parameters: Margin of error: Assumed SD: Desired C.I.: 1.96 x 4.8 = 1.5 1.5 units 4.8 95% (i.e. z = 1.96) 2 = 39.3 Continuous Outcome – One Sample (H0 Test) Example: Compare mean fasting glucose level in a sample of heavy coffee drinkers to known values in the general population. Sample Size for Hypothesis Test H0: µ = µ0 n= Z1 – α/2 + Z1 – β ES = n= Parameters/Assumptions: 2 General pop mean: General pop SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): ES | µ1 - µ0 | | 100 - 95 | ES = = 0.51 9.8 σ 1.96 + 0.84 0.51 μ0 = 95.0 mg/dL σ0 = 9.8 5 mg/dL 0.05 0.80 Note: 100 = 95 + 5 2 = 30.1 A sample size of n = 31 will ensure that a 2-sided test with α=0.05 has 80% power to detect a 5 mg/dL difference in mean glucose levels Continuous Outcome – One Sample (H0 Test)(Practice) Example: Compare mean fasting cholesterol level in a sample of intensive swimmers to known values in the general population. Sample Size for Hypothesis Test H0: µ = µ0 n= Z1 – α/2 + Z1 – β ES = n= ES | µ1 - µ0 | σ Parameters/Assumptions: 2 General pop mean: General pop SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): ES = | = _____ | μ0 = 194.4 mg/dL σ0 = 34.8 20 mg/dL 0.05 0.80 = __________ Continuous Outcome – One Sample (H0 Test)(Practice) Example: Compare mean fasting cholesterol level in a sample of intensive swimmers to known values in the general population. Sample Size for Hypothesis Test H0: µ = µ0 n= Z1 – α/2 + Z1 – β ES = n= Parameters/Assumptions: 2 General pop mean: General pop SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): ES | µ1 - µ0 | | 174.4 – 194.4 | ES = = 0.575 34.8 σ 1.96 + 0.84 0.575 μ0 = 194.4 mg/dL σ0 = 34.8 20 mg/dL 0.05 0.80 Note: 174.4 = 194.4 - 20 2 = 23.7 A sample size of n = 24 will ensure that a 2-sided test with α=0.05 has 80% power to detect a 20 mg/dL difference in mean cholesterol levels SECTION 5.3 Sample size estimates for a two-sample (independent groups) continuous outcome Learning Outcome: Calculate and interpret sample size estimates for a two-sample (independent groups) continuous outcome: --- Estimate for a confidence interval --- Estimate for a hypothesis test Continuous Outcome – Two Independent Samples Sample Size to Estimate C.I. Sample Size for Hypothesis Test C.I. for (µ1 - µ2) H0: µ1 = µ2 ni = 2 Zσ E 2 ni = 2 Z1 – α/2 + Z1 – β ES = ES | µ1 - µ2 | σ 2 Continuous Outcome – Two Independent Samples (C.I.) Sample Size to Estimate C.I. C.I. for (µ1 - µ2) ni = 2 ni = 2 Zσ E 2 Zσ E 2 Example: Compare low-fat versus low-carb diet in obese children for weight loss. Parameters: Margin of error: Assumed pooled SD: Desired C.I.: Assumed drop out rate: 1.96 x 8.1 = 2 3 3 pounds 8.1 pounds 95% (i.e. z = 1.96) 20% 2 = 56.0 (per group; n1 and n2) Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = 112 / 0.80 = 140 subjects Continuous Outcome – Two Independent Samples (C.I.)(Practice) Sample Size to Estimate C.I. Example: Compare strength training versus aerobic training for weight loss among obese adults. Parameters: C.I. for (µ1 - µ2) ni = 2 ni = 2 Zσ E 2 Zσ E Margin of error: Assumed pooled SD: Desired C.I.: Assumed drop out rate: 4 pounds 12.2 pounds 95% (i.e. z = 1.96) 15% 2 = = ____________________ Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = ____________________________ Continuous Outcome – Two Independent Samples (C.I.)(Practice) Sample Size to Estimate C.I. C.I. for (µ1 - µ2) ni = 2 ni = 2 Zσ E 2 Zσ E 2 Example: Compare strength training versus aerobic training for weight loss among obese adults. Parameters: Margin of error: Assumed pooled SD: Desired C.I.: Assumed drop out rate: 4 pounds 12.2 pounds 95% (i.e. z = 1.96) 15% 2 1.96 x 12.2 = 2 = 71.5 (per group; n1 and n2) 4 Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = 143 / 0.85 = 168.2 subjects Continuous Outcome – Two Independent Samples (H0 Test) Example: Compare systolic blood pressure in a trial of a new drug vs. placebo. Sample Size for Hypothesis Test Parameters/Assumptions: H0: µ1 = µ2 ni = 2 Z1 – α/2 + Z1 – β Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: 2 ES | µ1 - µ2 | ES = σ ni = 2 1.96 + 0.84 0.263 σ = 19.0 mg/dL 5 mg/dL 0.05 0.80 10% 5 = 0.263 ES = 19.0 2 ni = 226.4 Take into account the drop out rate: N (number to enroll) / (% retained) N = 452.8 / 0.90 = 503 subjects n = 452.8 A sample size of n = 503 will ensure that a 2sided test with α=0.05 has 80% power to detect a 5 mg/dL difference in systolic blood pressure between the 2 study groups. Continuous Outcome – Two Independent Samples (H0 Test)(Practice) Example: Compare hemoglobin A1c levels between an insulin sensitizing and insulin augmentation drug. Sample Size for Hypothesis Test Parameters/Assumptions: H0: µ1 = µ2 ni = 2 Z1 – α/2 + Z1 – β Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: 2 ES | µ1 - µ2 | ES = σ ni = ES = ni = _____ Take into account the drop out rate: N (number to enroll) / (% retained) N = _________________________ = ______ n = _____ σ = 2.7 1.2 0.05 0.90 20% Continuous Outcome – Two Independent Samples (H0 Test)(Practice) Example: Compare hemoglobin A1c levels between an insulin sensitizing and insulin augmentation drug. Sample Size for Hypothesis Test Parameters/Assumptions: H0: µ1 = µ2 ni = 2 Z1 – α/2 + Z1 – β Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: 2 ES | µ1 - µ2 | ES = σ ni = 2 1.96 + 1.282 0.444 σ = 2.7 1.2 0.05 0.90 20% 1.2 = 0.444 ES = 2.7 2 ni = 106.4 Take into account the drop out rate: N (number to enroll) / (% retained) N = 212.8 / 0.80 = 266 subjects n = 212.8 A sample size of n = 266 will ensure that a 2sided test with α=0.05 has 90% power to detect a 1.2(%) difference in hemoglobin A1c between the 2 study groups. SECTION 5.4 Sample size estimates for a matched sample and a continuous outcome Learning Outcome: Calculate and interpret sample size estimates for a matched sample and a continuous outcome --- Estimate for a confidence interval --- Estimate for a hypothesis test Continuous Outcome – Two Matched Samples Sample Size to Estimate C.I. Sample Size for Hypothesis Test H0: µd = 0 C.I. for µd n= Zσd E 2 n= Z1 – α/2 + Z1 – β ES ES = µd σd 2 Continuous Outcome – Two Matched Samples (C.I.) Example: Crossover trial of low-fat and lowcarb diet in obese children for weight loss. Each subject is assigned to both diets. Sample Size to Estimate C.I. C.I. for µd n= Zσd Parameters: 2 Margin of error: Assumed SD (diff): Desired C.I.: Assumed drop out rate: E 3 pounds difference 9.1 pounds 95% (i.e. z = 1.96) 30% 2 n= 1.96 x 9.1 3 n = 35.3 Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = 35.3 / 0.70 = 50.5 subjects Continuous Outcome – Two Matched Samples (C.I.)(Practice) Sample Size to Estimate C.I. C.I. for µd n= n= Zσd E 2 Example: Crossover trial of 2 different exercise programs for overweight adults. Each subject is assigned to both programs. Parameters: Margin of error: Assumed SD (diff): Desired C.I.: Assumed drop out rate: 2 pounds difference 5.6 pounds 95% (i.e. z = 1.96) 20% n = ______ Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = ______________________________ Continuous Outcome – Two Matched Samples (C.I.)(Practice) Example: Crossover trial of 2 different exercise programs for overweight adults. Each subject is assigned to both programs. Sample Size to Estimate C.I. C.I. for µd n= Zσd Parameters: 2 Margin of error: Assumed SD (diff): Desired C.I.: Assumed drop out rate: E 2 pounds difference 5.6 pounds 95% (i.e. z = 1.96) 20% 2 n= 1.96 x 5.6 2 n = 30.1 Take into account the drop out rate: N (number to enroll) / (% retained) = desired sample size N = 30.1 / 0.80 = 37.6 subjects Continuous Outcome – Two Matched Samples (H0 Test) Example: Crossover trial of low-fat and low-carb diet in obese children for weight loss. Each subject is assigned to both diets. Sample Size for Hypothesis Test H0: µd = 0 n= Z1 – α/2 + Z1 – β 2 ES µd ES = σd n= Parameters/Assumptions: Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: σd = 9.1 pounds 3 pounds 0.05 0.80 30% 3 ES = = 0.33 9.1 1.96 + 0.84 0.33 2 = 72.1 Take into account the drop out rate: N (number to enroll) / (% retained) N = 72.1 / 0.70 = 103.1 subjects A sample size of n = 103 will ensure that a 2-sided test with α=0.05 has 80% power to detect a 3 pound difference between the 2 diets. Continuous Outcome – Two Matched Samples (H0 Test)(Practice) Example: Crossover trial of 2 memory enhancement programs for adults with mild dementia. Each subject is assigned to both programs (# words remembered). Sample Size for Hypothesis Test Parameters/Assumptions: H0: µd = 0 n= Z1 – α/2 + Z1 – β µd ES = σd n= ES ES = 2 Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: = _______ = __________ Take into account the drop out rate: N (number to enroll) / (% retained) N = __________________________ σd = 3.4 words 2 words 0.05 0.80 20% Continuous Outcome – Two Matched Samples (H0 Test)(Practice) Example: Crossover trial of 2 memory enhancement programs for adults with mild dementia. Each subject is assigned to both programs (# words remembered). Sample Size for Hypothesis Test Parameters/Assumptions: H0: µd = 0 n= Z1 – α/2 + Z1 – β ES µd ES = σd n= 2 Estimated SD: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): Assumed dropout-rate: σd = 3.4 words 2 words 0.05 0.80 20% 2 ES = = 0.59 3.4 1.96 + 0.84 0.59 2 = 22.66 Take into account the drop out rate: N (number to enroll) / (% retained) N = 22.66 / 0.80 = 28.3 subjects A sample size of n = 29 will ensure that a 2-sided test with α=0.05 has 80% power to detect a 2 word difference in memory recall between the 2 programs. SECTION 5.5 Sample size estimates for a one sample dichotomous outcome Learning Outcome: Calculate and interpret sample size estimates for a one sample dichotomous outcome --- Estimate for a confidence interval --- Estimate for a hypothesis test Dichotomous Outcome – One Sample Sample Size to Estimate C.I. Sample Size for Hypothesis Test H0: p = p0 C.I. for p n = p(1-p) Z E 2 n= Z1 – α/2 + Z1 – β ES = ES | p1 – p0 | p0(1– p0) 2 Dichotomous Outcome – One Sample (C.I.) Sample Size to Estimate C.I. C.I. for p n = p(1-p) Z E Example: Estimate required sample size for 95% C.I. of the proportion of freshman at a college who currently smoke cigarettes. Parameters: 2 Margin of error: Assumed prevalence (i) Assumed prevalence (ii) Desired C.I.: 5% 50% (i.e. no data available) 27% (i.e. national data) 95% (i.e. z = 1.96) 2 2 1.96 n = 0.5(1-0.5) 0.05 = 384.2 1.96 n = 0.27(1-0.27) 0.05 = 302.9 Dichotomous Outcome – One Sample (C.I.)(Practice) Sample Size to Estimate C.I. C.I. for p n = p(1-p) Z E 2 n= Example: Estimate required sample size for 95% C.I. of the proportion of male freshman at a college who report binge drinking at least once a month. Parameters: Margin of error: Assumed prevalence (ii) Desired C.I.: 5% 14% (i.e. national data) 95% (i.e. z = 1.96) = _______ Dichotomous Outcome – One Sample (C.I.)(Practice) Sample Size to Estimate C.I. C.I. for p n = p(1-p) Z E 2 Example: Estimate required sample size for 95% C.I. of the proportion of male freshman at a college who report binge drinking at least once a month. Parameters: Margin of error: Assumed prevalence (ii) Desired C.I.: 2 1.96 n = 0.14(1-0.14) 0.05 = 185.0 5% 14% (i.e. national data) 95% (i.e. z = 1.96) Dichotomous Outcome – One Sample (H0 Test) Example: Compare prevalence of high LDL cholesterol (>159 mg/dL) between patients with a history of CVD and a population estimate of those without CVD. Sample Size for Hypothesis Test H0: p = p0 Parameters/Assumptions: 2 n= Z1 – α/2 + Z1 – β ES ES = | p1 – p0 | p0(1– p0) General population proportion: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): | 0.31 – 0.26 | ES = = 0.114 0.26 (1– 0.26) 2 n= 1.96 + 1.282 0.114 p0 = 0.26 (26%) 0.05 (5%) 0.05 0.90 n = 808.9 A sample size of n = 809 will ensure that a 2-sided test with α=0.05 has 90% power to detect a difference of 0.05, or 5%, in the proportion of patients with a history of CVD who have an elevated LDL cholesterol level. Dichotomous Outcome – One Sample (H0 Test)(Practice) Example: Compare the prevalence of the metabolic syndrome between patients with a history of alcohol abuse and a population estimate of those without. Sample Size for Hypothesis Test H0: p = p0 Parameters/Assumptions: Z1 – α/2 + Z1 – β General population proportion: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): 2 n= ES = n= ES | p1 – p0 | p0(1– p0) | ES = n = ________ | =_______ p0 = 0.22 (22%) 0.06 (6%) 0.05 0.80 Dichotomous Outcome – One Sample (H0 Test)(Practice) Example: Compare the prevalence of the metabolic syndrome between patients with a history of alcohol abuse and a population estimate of those without. Sample Size for Hypothesis Test H0: p = p0 Parameters/Assumptions: Z1 – α/2 + Z1 – β General population proportion: Clinically important difference: 2-sided type I error rate (α): Desired power (1-β): 2 n= ES ES = | p1 – p0 | p0(1– p0) | 0.28 – 0.22 | ES = = 0.145 0.22 (1– 0.22) 2 n= 1.96 + 0.84 0.145 p0 = 0.22 (22%) 0.06 (6%) 0.05 0.80 n = 373.7 A sample size of n = 374 will ensure that a 2-sided test with α=0.05 has 80% power to detect a difference of 0.06, or 6%, in the proportion of patients with a history of alcohol abuse who have the metabolic syndrome.
© Copyright 2026 Paperzz