Justifying a Claim Based on a Confidence Interval for the Difference Between Two Population Proportions
An interval gives a range of plausible population differences. Learn what its signs tell you, how to assess a claimed difference and how to explain confidence without overstating the evidence.
By the end of this lesson, you should be able to:
- Interpret an interval for a difference between population proportions in context.
- Use and the endpoint signs to assess evidence of a difference.
- Assess an exact claimed value and distinguish it from an “at least” claim.
- Explain confidence level through repeated sampling.
- Recognize why an interval containing does not prove equality.
- Keep the group order, percentage-point units and study scope clear.
Before you start: Review Topic 3.10’s construction of a two-proportion interval. This lesson focuses on what the interval lets you say.
First time learning this? Follow the school interval through the sign check, claim check and contextual sentence.
Here to revise? Use the interpretation checklist, then attempt the questions before opening hints or solutions.
The concept in 60 seconds
Suppose a study compares the proportion of students who prefer digital study notes at School A with the corresponding proportion at School B. A justified confidence interval for , A minus B, is approximately .
We can use it to answer three questions:
- What difference is estimated? A’s population preference proportion is estimated to be percentage points higher than B’s, with confidence.
- Is there evidence of a difference? Yes, using this interval approach: is outside the interval, and every value in the interval is positive.
- Is an exact -percentage-point difference plausible? Yes. The value is inside the interval, so it is compatible with this interval. That does not prove it is the true difference.
Use an interval as evidence, not a guarantee. A confidence interval is calculated from random samples and may or may not capture the true population difference. A conclusion depends on a justified method and the stated confidence level.
Proportion of all School A students who prefer digital notes. The sample estimate is .
Proportion of all School B students with the same preference. The sample estimate is .
The interval estimates , not either school’s individual rate.
Sample data are fictional: at A and at B. State both target populations, the shared success outcome and the subtraction order before interpreting the interval.
Quick check: if is inside the interval, have we proved that the true difference is ?
No. It is value compatible with the interval. Other values inside are also compatible; the interval does not identify exact true difference.
Read the difference between proportions
All examples here are fictional teaching scenarios. In the main study, independent SRSs without replacement give successes out of at School A and out of at School B. Each success means “prefers digital notes.” The populations contain students at A and at B.
| Quantity | Meaning | Value or status |
|---|---|---|
| , | Population preference proportions at Schools A and B | Unknown |
| Fixed population difference, A minus B | Unknown parameter | |
| , | Observed sample preference proportions | and |
| Observed point estimate | ||
| confidence interval | Range estimating the population difference | Approximately |
| difference | Population proportions are equal |
confidence interval for : approximately .
Percentage-point range: approximately .
The sample difference is percentage points. The interval estimates the unknown difference between all students’ preference proportions at the schools. It is not an interval for either school’s own preference rate.
Percentage points are differences, not relative increases
Multiply a proportion difference by to express it in percentage points. A difference of is percentage points. A “ relative increase” requires a reference rate and a division; it is a different quantity.
A negative difference is meaningful
Each individual proportion lies between and , but can be negative. For example, means group 1’s success proportion is percentage points lower than group 2’s.
Reversing group order changes the signs
An interval for A minus B becomes for B minus A. The main interval becomes approximately . It describes the same comparison in the opposite order; confidence level and width do not change.
Quick check: does mean of School A students prefer digital notes?
No. Those endpoints describe an A-minus-B population difference, expressed as percentage points. They are not School A’s own population proportion.
Use to assess a difference
For a justified interval, check whether it contains . Then check whether its nonzero values are positive or negative.
Separate fictional independent-SRS studies, all with justified conditions and unpooled -intervals. Sample counts: positive: versus ; containing : versus ; negative: versus . Each study meets its separately stated population-size and observed-count checks in the lesson. All intervals use the same group order and common percentage-point scale. Endpoints are rounded from full-precision calculations. in an interval means insufficient evidence of a difference, not proof of equality.
Case 1: the interval is entirely positive
If , every value is positive. The interval provides convincing evidence that , using the confidence level and method stated.
For the school interval , is excluded. We have evidence that School A’s population preference proportion is higher than School B’s.
Case 2: the interval is entirely negative
If , every value is negative. The interval provides convincing evidence that .
An A-minus-B interval of , for example, gives evidence that A’s population success proportion is lower than B’s. The negative signs do not invalidate an interval for a difference.
Case 3: the interval contains
If , equality is compatible with the interval. There is insufficient evidence from this interval to conclude a difference between the population proportions.
For , both negative and positive differences are also plausible. The interval does not establish a direction.
“Insufficient evidence of a difference” does not mean “evidence of equality.” An interval containing also contains other possible differences. It may simply be too imprecise to establish whether a difference exists.
If an endpoint is exactly , is included for this decision. If a displayed endpoint is rounded to , use more precision before deciding whether is truly included.
Quick check: a sample difference is positive, but its interval is . Can we conclude the population difference is positive?
No. The interval includes and negative differences. A positive point estimate alone does not establish that the population difference is positive.
Assess a specific claim
For an exact claimed difference, check its location
Suppose someone claims that . Compare with the justified interval:
- Inside the interval: the claimed value is compatible with the interval. It is plausible under this confidence-interval approach, but not proved correct.
- Outside the interval: the interval provides evidence against that exact claimed value at the stated confidence level. It does not make the claim logically impossible.
| Exact claimed difference | Location | What the interval says |
|---|---|---|
| : equal proportions | Outside, below the lower bound | Evidence against ; the interval is entirely positive. |
| : percentage points | Inside | Compatible with this interval, but not proved correct. |
| : percentage points | Inside | Compatible with this interval, but not proved correct. |
| : percentage points | Outside, above the upper bound | Evidence against this exact value at the stated confidence level. |
These are exact-value claims. To assess “at least percentage points higher,” compare the lower bound with instead of checking whether is inside. Compatibility does not mean certainty or equal likelihood of all interval values.
For the main school interval, and are compatible, while and are excluded. Compatibility does not assign a probability to a claimed value or make all values inside equally likely.
“Exactly points” and “at least points” ask different questions
An exact claim asks whether is compatible. An “at least percentage points higher” claim asks whether the interval supports the whole difference being at least .
The main interval extends below . It therefore does not establish that A’s population proportion is at least percentage points higher than B’s, even though an exact -point difference is compatible.
Use the lower bound for a stronger positive claim
To support by the entire interval, require .
To support by the entire interval, require .
For the main interval, the unrounded lower bound is about :
- More than percentage points higher: supported by this interval because .
- At least percentage points higher: not established because the interval includes values below .
- At least percentage points higher: not established because the interval includes values below .
Similarly, to support a whole difference being below a threshold, compare the upper bound with that threshold. An interval may provide evidence of some difference without establishing that the difference is large enough to matter for a particular decision.
Quick check: an interval is . Does it support “more than points higher” and “more than points higher”?
It supports more than percentage points higher, because the lower bound exceeds . It does not establish more than points: values below remain in the interval.
Write a clear interval interpretation
A strong interpretation names the confidence level, both populations, the success outcome, the group order and the endpoint range.
Name the population preference proportion at School A and compare it with School B’s.
Convert the difference endpoints to percentage points; use “higher” because both are positive.
Make clear that the statement concerns all students in the school populations, not just the sampled students.
Connect these ingredients into one sentence. For a range crossing , describe the lower endpoint as “lower” and the upper endpoint as “higher,” or keep the signed population-difference range.
Main-example sentence: “We are confident that the proportion of all School A students who prefer digital notes is between and percentage points higher than the proportion of all School B students who prefer digital notes.”
When the interval crosses , retain the signed range
For a justified A-minus-B interval of , say:
“We are confident that the population proportion with the stated outcome in group A is between percentage points lower and percentage points higher than the corresponding proportion in group B.”
Replace the group names and outcome with the actual context. Do not describe the whole range as “higher,” because the lower endpoint is negative.
Justify a claim with a reason and a conclusion
Use this pattern: interval fact → meaning → contextual conclusion.
Example: “Because every value in the interval