Carrying Out a Test for the Difference Between Two Population Proportions
Turn sample percentages into a careful population conclusion. Calculate the pooled -statistic, find the correct -value and explain what the evidence means in the original situation.
By the end of this lesson, you should be able to:
- Calculate a two-proportion -statistic using the pooled null standard error.
- Choose a left, right or two-sided -value from the alternative hypothesis.
- Interpret the -value assuming the population proportions are equal.
- Compare the -value with the chosen significance level.
- Write a conclusion about the population claim, with the study’s scope in mind.
- Distinguish statistical significance from the size or practical importance of a difference.
Before you start: Review Topic 3.12: setting up the test. You should be comfortable with population proportions, hypotheses, pooling and the expected-count checks.
First time learning this? Follow the school study from its test plan to its conclusion, then try the worked examples.
Here to revise? Review the formulas and tail rules, then attempt the questions before opening the solutions.
The concept in 60 seconds
Independent random samples find that of students at School A and of at School B prefer digital study notes. The sample rates are and : A is ahead by percentage points.
The research question, chosen before examining the data, is: Is the population preference proportion higher at A? A two-proportion -test asks how unusual this sample difference would be if the population proportions were actually equal.
; . Define the same preference outcome and keep A minus B.
The positive sample difference is far into the right tail of the approximate null model.
Convincing evidence of a higher population preference proportion at A; the study does not establish a causal school effect.
The sample difference is an estimate, the -value is evidence under the equality null, and the conclusion concerns the population claim. Each step has a different job.
The school result: and the right-sided -value is approximately . At , reject the equality null. There is convincing evidence that A’s population preference proportion is higher. The small -value measures evidence against equality; it does not measure the probability that equality is true.
This lesson shows where those numbers come from and how to explain them. All numerical studies on this page are fictional teaching examples.
Quick check: is a difference of percentage points automatically convincing evidence?
No. Its strength as evidence also depends on sample sizes, variability, the alternative and whether the study meets the test conditions. A justified test measures the difference relative to its null standard error.
State and check the test plan
Let be the proportion of all School A students who prefer digital notes and the corresponding proportion at School B. Keep A minus B as the subtraction order throughout.
.
.
Use a two-sample -test for the difference between population proportions. For the school example, the problem specifies separate independent SRSs, sampled without replacement. The populations contain students.
- Random sampling and independence: the independent SRS design is given; the same students are not measured times.
- checks: and .
- Normality: with , the pooled expected counts are approximately . All are .
| Quantity | School A: group 1 | School B: group 2 |
|---|---|---|
| Success definition | Prefers digital notes | Prefers digital notes |
| Success count | ||
| Sample size | ||
| Other responses | ||
| Population size | ||
| Observed proportion | ||
| Pooled expected successes | ||
| Pooled expected failures |
Before calculating: justify the design, both checks when sampling without replacement, and all pooled expected counts. The sampling condition is not required merely for random assignment. A separate finite-population sampling stage can still require its own check. A calculator output does not repair paired responses, biased recruitment or failed expected counts.
Quick check: can I skip the conditions if software gives a very small -value?
No. The usual normal-approximation -value is useful only when the procedure is appropriate. Show why the design and count conditions support the test before treating its output as evidence.
Calculate the pooled -statistic
The statistic compares the observed sample difference with the null difference of , measured in estimated null standard errors.
, .
is the estimated standard deviation of the sample difference under the equality null. Pool because assumes a common success rate. Combining counts estimates that rate; it does not prove equality.
Use the sample difference A minus B; equality supplies the null difference.
Pool successes from students. Use both sample sizes in the pooled standard error.
A positive means the observed difference is above ; the alternative determines its evidence direction.
Both the numerator and the standard error use proportion units. Their ratio is a unit-free standardized statistic. The null standard error is not the unpooled confidence-interval standard error.
School calculation
; ; .
The observed difference is about null standard errors above . is about in proportion units, or percentage points. Use proportions consistently: and give the same ; does not.
Keep precision until the end. Use the full pooled fraction and stored when finding and the -value. Display rounded numbers for readability. The confidence-interval standard error uses separate and ; do not substitute that unpooled expression into this equality-null test.
Calculator check: TI-84 family
Open STAT → TESTS → . Enter , , and ; select , then Calculate. Expect and . Enter success counts, rather than sample proportions. Keep the group order and chosen alternative consistent. Menu wording can vary by model; TI’s official command reference identifies this test.
Quick check: what does a negative tell us?
The observed group 1 minus group 2 difference is below the null difference of . Whether that is evidence for depends on its direction. A negative can give a small left-sided -value and a large right-sided -value.
Find the correct -value
Under a justified equality-null model, the standardized statistic is approximately standard normal. Let represent a value from that model and the statistic from the data.
| Alternative for group 1 minus group 2 | -value rule | Results counted |
|---|---|---|
| At or above the observed | ||
| At or below the observed | ||
| At least as far from in either direction |