FOR THE NEXT GENERATION OF PHYSICIANS
← All USMLE guides
BIOSTATISTICS, EPIDEMIOLOGY AND ETHICS

Hypothesis testing: p-values, type I and II errors and power.

Null hypothesis, alpha and beta, statistical power, confidence intervals and the tests used for different data types.

Hypothesis testing questions define the error types and ask what changes power.

Errors

Type I error (alpha): rejecting a true null hypothesis; a false positive; usually set at 0.05. Type II error (beta): failing to reject a false null hypothesis; a false negative. Power equals one minus beta, conventionally 80 percent. Power increases with larger sample size, larger effect size and higher alpha.

P-values and intervals

The p-value is the probability of seeing data at least this extreme if the null hypothesis is true. A 95 percent confidence interval that does not include the null value (0 for a difference, 1 for a ratio) corresponds to p less than 0.05.

Which test

T-test compares means of two groups; ANOVA compares means of three or more; chi-square compares categorical data; paired t-test compares before and after in the same group; correlation (Pearson) measures linear relationship and regression predicts outcomes. Nonparametric alternatives are used when data are not normal.

Keep going in biostatistics, epidemiology and ethics

Related on USMLE WEB

Frequently asked questions

What is power?

The probability of detecting a true effect, equal to 1 minus beta.

Which test compares three or more means?

ANOVA.