Introduction to Stats · Chapter 3 · Probability Topics
Two tests decide how a pair of events relate — does knowing one tell you anything about the other, and can they even happen at the same time?
bookSHelf · Introduction to Statistics · §3.2 · a self-paced section
Outline — by the end of this section you will be able to
§3.2.1 — Independent Events
After each pick, the member goes back before the next draw. The same member can appear more than once, and the first result never changes the probabilities for the second pick. With-replacement draws are independent.
Once a member is picked, it is set aside. The next pick happens from a smaller population, so its probabilities are affected by what came before. Without-replacement draws are dependent.
Roll a fair die twice: whatever the first roll shows, the second roll still has six equally likely faces — the two outcomes are independent.
§3.2.1 — the formal test
Definition 3.2.1 — Independent Events
Two events A and B are independent if knowing that one occurred does not change the probability that the other occurs. Any one of these three equivalent statements confirms it:
P(A∣B)=P(A)orP(B∣A)=P(B)orP(A AND B)=P(A)⋅P(B)If none of the three holds, the events are dependent — knowing one changes the chance of the other. The three are equivalent whenever P(A) and P(B) are both positive; pick whichever is easiest to check.
Insight Note — default to dependent when you are unsure
If a problem does not say whether two events are independent, assume they are dependent until you can show otherwise.
The independence test is a one-line check. Assuming independence when the events are actually dependent silently over-counts P(A AND B) and can push a probability above 1.
Context Pause — why "and" gets a product
Independence is what buys you the product.
When two events are independent, P(A AND B)=P(A)⋅P(B) — the joint probability is just the product of the individual probabilities. Sections 3.3 and 3.4 generalize this to events that are not independent, where the AND has to be reconstructed from a conditional probability instead.
Your turn — two cards, two sampling plans
Try It Now 3.2.1
You draw two cards from a fair, well-shuffled 52-card deck. (a) You note the first card and put it back before drawing the second. Independent? (b) You set the first card aside before drawing the second. Independent?
(a) Replacing the card restores the full 52-card deck, so the first draw has no effect on the second — independent. (b) With only 51 cards left, the second draw's probabilities depend on what came out first — dependent.
§3.2.1 — a worked comparison
Example 3.2.1 — Cards drawn with and without replacement
With replacement: jack of spades, replace, ten of clubs, replace, jack of spades again. Every draw happens from a full 52-card deck — the three draws are independent.
Without replacement: seven of hearts (51 left), three of diamonds (50 left), jack of spades. Each draw's probabilities depend on what was already removed — the three draws are dependent.
Your turn — read the sampling plan from the cards
Try It Now 3.2.2
You pick three cards. (a) The cards are {jack of spades, seven of hearts, jack of spades}. With or without replacement? (b) The cards are {jack of spades, seven of hearts, five of diamonds}. With or without replacement?
(a) The jack of spades appears twice, and the deck has only one — it must have been replaced. (b) All three cards are distinct, which is consistent with either plan — cannot be determined from the cards alone.
§3.2.1 — reading the plan from a hand
Example 3.2.2 — Reading the sampling plan from the cards
(a) Four cards, not put back: {J♠,5♡,5♢,K♣}. (b) Four cards, each put back before the next pick: {J♠,7♡,6♡,K♠}.
Both hands have no card repeated — a repeat is the only mark a hand can carry that proves replacement. Here the surrounding text settles it: (a) is without replacement; (b) is with replacement.
Your turn — which hands are even possible?
Try It Now 3.2.3
Sample four cards without replacement, then again with replacement. Which of these outcomes are possible under each plan? (a) {J♠,5♡,5♢,K♣} (b) {Q♠,7♡,6♡,K♠} (c) {J♠,7♡,6♡,K♠}
All three hands are possible under both plans. Every card in every hand is distinct — none of the three hands carries a repeat, so none of them can distinguish with-replacement sampling from without.
§3.2.2 — Mutually Exclusive Events
Let S={1,2,…,10}, A={1,2,3,4,5}, B={4,5,6,7,8}, and C={7,9}.
A∩B={4,5}, so P(A AND B)=102=0 — not mutually exclusive.
A∩C=∅ and B∩C=∅ — both pairs share no outcomes, so both pairs are mutually exclusive.
When two events are mutually exclusive, A∩B=∅ — the OR rule then collapses to plain addition, because there is no overlap left to subtract.
§3.2.2 — the formal test
Definition 3.2.2 — Mutually Exclusive Events
Two events A and B are mutually exclusive if they cannot occur at the same time. Equivalently,
P(A AND B)=0To be mutually exclusive, the AND has to be exactly zero — a small shared probability is enough to rule it out.
Context Pause — default to "not mutually exclusive"
When in doubt, assume two events are not mutually exclusive.
The test is one line of arithmetic — assuming mutual exclusivity when the events actually overlap silently under-counts P(A OR B) and makes the answer too small.
Your turn — a complement in disguise
Try It Now 3.2.4
Draw two cards with replacement. Find P(at least one black). (Black suits: clubs, spades.)
"At least one black" is the complement of "both red." With replacement the draws are independent, so P(both red)=21⋅21=41, and
P(at least one black)=1−41=43§3.2.2 — five events on two coins
Example 3.2.3 — Flipping two coins: events and their relationships
Sample space {HH,HT,TH,TT}, each outcome equally likely.
A = at most one tail = {HH,HT,TH}, P(A)=43. B = all tails = {TT}, P(B)=41 — B=A′.
C = all heads = {HH}: C∩B=∅, so P(C AND B)=0 — C and B are mutually exclusive.
D = more than one tail = {TT}=B. E = heads first = {HH,HT}. P(at least one tail)=1−41=43.
Your turn — one white, one red, with replacement
Try It Now 3.2.5
A box has one white, one red ball; select one, replace, select again. W = white twice, D = different colors, F = white first. Find P(W),P(D),P(F); are W,D mutually exclusive? Are W,F independent?
Answer: P(W)=41, P(D)=21, P(F)=21. W={WW} and D={WR,RW} share no outcomes — mutually exclusive. But P(F∣W)=1=21=P(F), so W and F are not independent.
§3.2.2 — five probability questions on two coins
Example 3.2.4 — Flipping two coins: five probability questions
F = at most one tail = {HH,HT,TH}, P(F)=43. G = same face twice = {HH,TT}, P(G)=21.
F∩G={HH}, so P(F AND G)=41=0 — F and G are not mutually exclusive.
J = all tails = {TT}: F∩J=∅, so F and J are mutually exclusive — you cannot flip "at most one tail" and "all tails" together.
Try it in rāSHio
Open rāSHio and choose Calculators → Probability to check the five answers above against {HH,HT,TH,TT}. Enter the counts for F, G and J, then read P(F AND G) and P(F AND J) off the panel.
Mutual exclusivity is nothing more than that AND value landing on zero — seeing 41 beside 0 puts the whole distinction on one screen.
§3.2.2 — reading it off the panel
Figure 3.2.1: reading P(A AND B) and the two conditional probabilities off rāSHio's Calculators → Probability panel; run the same steps on the two-coin events above.
Your turn — Spanish and German
Try It Now 3.2.6
S = learning Spanish, G = learning German. P(S)=0.4, P(G)=0.2, P(S AND G)=0.08. Are S and G independent?
Yes — the product matches the AND, so S and G are independent.
§3.2.2 — a die, a complement, a conditional
Example 3.2.5 — Rolling a die: complements, intersections, a conditional
A = odd = {1,3,5}, B = even = {2,4,6} — complements, P(A)=P(B)=21. C = odd >2 = {3,5}, D = even <5 = {2,4}: C∩D=∅ — mutually exclusive.
E = <5 = {1,2,3,4}: C∩E={3}, so P(C AND E)=61=0 — C,E are not mutually exclusive.
Conditioning on A shrinks the space to {1,3,5}; two of three are in C, so P(C∣A)=32.
Your turn — a red-and-green marble bag
Try It Now 3.2.7
Six red marbles (1–6) and four green marbles (1–4), ten outcomes total. R = red, O = odd-numbered. Find P(R AND O).
Red-and-odd marbles: R1,R3,R5 — three of ten outcomes.
P(R AND O)=103=0.3Context Pause — three tests, one answer
The conditional form, the multiplication form, and the reverse conditional all encode the same idea.
P(M∣H)=P(M), P(M)⋅P(H)=P(M AND H), and the reverse conditional all say: knowing one event tells you nothing about the other. Use whichever lines up with the numbers you have.
§3.2.3 — confirming independence two ways
Example 3.2.6 — Showing independence two ways
M = taking math, H = taking science. P(M)=0.6, P(H)=0.5, P(M AND H)=0.3.
Both tests agree: M and H are independent — knowing a student takes science does not change the chance they take math.
Your turn — books and DVDs at the library
Try It Now 3.2.8
B = checks out a book, D = checks out a DVD. P(B)=0.40, P(D)=0.30, P(B AND D)=0.20. Find P(B∣D), P(D∣B); are B,D independent? mutually exclusive?
Answer: P(B∣D)=32≈0.667, P(D∣B)=0.5. P(B)⋅P(D)=0.12=0.20 — not independent. P(B AND D)=0.20=0 — not mutually exclusive.
§3.2.3 — English and speech classes
Example 3.2.7 — Three questions about two class events
C = English, D = speech. P(C)=0.75, P(D)=0.3, P(C∣D)=0.75, P(C AND D)=0.225.
P(C∣D)=0.75=P(C) → independent. P(C AND D)=0.225=0 → not mutually exclusive. P(D∣C)=0.750.225=0.3.
Your turn — fans, colors, and a recovered probability
Try It Now 3.2.9
70% root for the home team; 25% wear blue; 20% wear blue and root away; of away-team fans, 67% wear blue. A = roots away, L = wears blue. Independent? Mutually exclusive?
Answer: P(A)=0.30. P(A)⋅P(L)=0.075=0.20=P(A AND L) — not independent, and 0.20=0, so not mutually exclusive either.
§3.2.3 — a colored, numbered deck
Example 3.2.8 — Drawing one card from a colored, numbered deck
Three red (1–3), five blue (1–5) — eight outcomes. R, B, E=even. P(R)=83, P(B)=85, P(R AND B)=0 — mutually exclusive (a card can't be both colors).
P(E)=83. Let G=greater than 3, H=blue 1–4: P(G)=41=P(G∣H) — G,H are independent.
Your turn — Sam's commute
Try It Now 3.2.10
P(I)=0.44, P(F)=0.56, P(I AND F)=0 — Sam takes only one route. Find P(I OR F).
Zero AND means mutually exclusive, so the OR rule is simple addition:
P(I OR F)=0.44+0.56=1.00Context Pause — three tests for independence
Pick whichever test matches the numbers you were given.
P(W AND L)=P(W)⋅P(L), P(L∣W)=P(L), and the reverse conditional P(W∣L)=P(W) all encode the same idea — use whichever is convenient.
§3.2.3 — women and long hair
Example 3.2.9 — A class on women and long hair
60% of students are women; 50% have long hair; 45% are women with long hair; of the women, 75% have long hair. W = woman, L = long hair.
Both tests agree: not independent — knowing a student is a woman raises the chance of long hair from 0.50 to 0.75.
Try it in rāSHio
Open rāSHio and choose Calculators → Probability, then enter P(W)=0.60, P(L)=0.50 and P(W AND L)=0.45 so the panel shows the product beside the AND, and P(L∣W) beside P(L).
The tool will not tell you the events are dependent — it just sets 0.30 next to 0.45 and 0.75 next to 0.50, which is exactly the comparison both tests are asking you to make.
§3.2.3 — Independence and Mutual Exclusivity Are Different
Asks: can both happen? P(A AND B)=0. For events with positive probability, this rules out independence — the product P(A)⋅P(B) would have to be 0 too, and it can't be.
Asks: does one tell you anything about the other? Independent events can have a non-empty intersection, so they are usually not mutually exclusive.
Mutually exclusive events with positive probability are never independent — the two labels describe different relationships, not two ends of the same scale.
Your turn — white and red, with replacement, three events
Try It Now 3.2.11
Box: one white, one red, sampled with replacement. W=white twice, F=white first, S=white second. Find P(W), P(S∣F); are F,S independent? mutually exclusive? are W,F independent?
Answer: P(W)=41, P(S∣F)=21=P(S) — F,S independent, and both can happen so not mutually exclusive. W implies F, so P(F∣W)=1=21 — W,F not independent.
§3.2.3 — a coin and a die, built out
Example 3.2.10 — Coin flip and die roll: building a sample space
2×6=12 outcomes: {T1,…,T6,H1,…,H6}. A=heads-then-even = {H2,H4,H6}, P(A)=123. B=heads-then-3 = {H3}, P(B)=121.
A∩B=∅ — mutually exclusive. But P(A)⋅P(B)=481=0 — the AND and the product disagree, so A,B are dependent.
Key Terminology — the vocabulary this section put to work
independent events — two events A and B such that knowing one occurred does not change the probability the other occurred; P(A∣B)=P(A) or P(A AND B)=P(A)⋅P(B).
dependent events — two events that are not independent; knowing one changes the probability of the other.
mutually exclusive events — two events A and B that cannot occur at the same time; P(A AND B)=0.
sampling with replacement — each picked member is returned before the next pick, so a member can appear more than once and the picks are independent.
sampling without replacement — each picked member is set aside, so no member can appear twice and the picks are dependent.
complement — for an event A, the outcomes in the sample space not in A, written A′.
The headline result
The AND value is the whole story — for both tests
P(A AND B)=0 means mutually exclusive. P(A AND B)=P(A)⋅P(B) means independent. The same joint probability answers two different questions.
Mutually exclusive events with positive probability are never independent — and independent events, having a non-empty intersection, are usually not mutually exclusive.
† Default to dependent and to not mutually exclusive when a problem is silent on the relationship — both defaults are the conservative read, and both are wrong far less often than assuming the convenient shortcut.
§3.2 — conclusions
Independence and mutual exclusivity are two different questions with one shared number, P(A AND B). Read it against a product for independence, against zero for mutual exclusivity — never assume either without checking.
With replacement keeps draws independent; without replacement makes them dependent. And a positive AND rules out mutual exclusivity even when independence also fails — the two tests can both say "no" at once.
Next: §3.3 — Two Basic Rules of Probability, where these same AND and OR values become the multiplication and addition rules.