Calculating Intersection Probabilities

Welcome back to our journey into probability. In the last lesson, we introduced the concept of conditional probability and saw how it leads directly to the multiplication rule. We established that the probability of two events happening together, their intersection, could be found by rearranging the conditional probability formula.

Today, we will solidify your understanding of this crucial tool. The learning outcome for this lesson is to apply the multiplication rule to calculate the probability of the intersection of events. We will move beyond the initial definition and focus on its practical application, distinguishing between the cases for independent and dependent events and learning how to chain the rule for sequences of events. This skill is essential for modeling complex systems, a common task in computer science and data analysis.

The Two Faces of the Multiplication Rule

In our previous discussion, you learned that two events are independent if the occurrence of one does not affect the probability of the other. In contrast, they are dependent if one event's outcome influences the probability of the other. This distinction gives rise to two forms of the multiplication rule.

A great way to see both in action is to work through classic examples like coin flips and card draws.

Multiplication Rule of Probability | Probability Theory, Intersection of Two Events

This video from Wrath of Math provides a clear, concise walkthrough of the multiplication rule for both independent and dependent events.

First, watch the segment on independent events, which uses a coin-flipping example from the beginning. Next, watch the segment on dependent events, which uses a card-drawing example from this point. Notice how the probability of the second event is explicitly a conditional probability.

The General vs. The Specific Rule

As the video demonstrates, the two forms of the rule are:

General Multiplication Rule (for any events): The probability of events A and B both occurring is the probability of A occurring, multiplied by the probability of B occurring given that A has already occurred.
$P (A \cap B) = P (A) \times P (B ∣ A)$
Specific Multiplication Rule (for independent events only): The probability of independent events A and B both occurring is simply the product of their individual probabilities.
$P (A \cap B) = P (A) \times P (B)$

It's critical to see that the specific rule is not really a separate rule, but a special case of the general rule. When events A and B are independent, the definition of independence tells us that $P (B ∣ A) = P (B)$ . If you substitute this into the general formula, it simplifies directly to the specific formula. Therefore, the general multiplication rule is the fundamental principle that always holds true.

Let's reinforce these ideas with another set of examples in a written format.

Multiplication Rule for Calculating Probabilities

This article from Statistics By Jim provides clear explanations and relatable examples for both rules.

Please read the following sections: Start with the introduction to get a feel for the terminology, from the beginning of the article. Read the section "Specific Multiplication Rule" for an example involving independent events (the sleepy-packer scenario). Read the section "General Multiplication Rule" for an example with dependent events (the card-drawing example). As you read, pay close attention to the author's explanation of why the general rule works for both types of events.

Visualizing Sequential Events with Probability Trees

When dealing with a sequence of events, especially dependent ones, a probability tree is an invaluable tool for organizing your calculations.

The first set of branches represents the outcomes of the first event, with their probabilities.
The second set of branches shows the outcomes for the second event. Crucially, the probabilities on these branches are conditional on the outcome of the first event.
To find the probability of a specific sequence of outcomes (an intersection), you multiply the probabilities along the corresponding path from the root to the leaf. This is a direct, visual application of the general multiplication rule.

This diagram illustrates the structure for calculating intersections. The probability of the top-most outcome, $P(A \cap B)$, is found by multiplying $P(A)$ by $P(B|A)$ along the path.

Extending the Rule to Multiple Events

What if you need to find the probability of three or more events occurring together, like $P (A \cap B \cap C)$ ? The rule extends naturally. For three events, you would calculate:

P (A \cap B \cap C) = P (A) \times P (B ∣ A) \times P (C ∣ A \cap B)

In words, it's the probability of the first event, times the probability of the second given the first, times the probability of the third given that the first two have occurred.

This intuitive extension can be proven formally. Given your background in computer science, you'll recognize the structure of mathematical induction in the proof.

5.1 Intersection of Several Events · GitBook

This excerpt from the Data 140 textbook at Berkeley provides a formal basis for extending the multiplication rule.

Read the section "Intersection of Several Events". Focus on how it first uses a 3-card example to build intuition, and then uses induction to prove the general case for n events. This provides the rigorous justification for chaining probabilities together.

A Practical Application: Combining the Rules

Let's conclude by tackling a problem that requires you to thoughtfully apply both the general and specific rules. This is where your understanding is truly tested, as you must correctly identify which events are dependent and which are independent within the same problem context.

Multiplication Rule for Calculating Probabilities

We return to the Statistics By Jim article to solve a multi-step problem. The author sets up a scenario of packing for a trip.

Read the final two sections of the article: "Dependent Events: Tan Pants and Blue Shirts Example" (read this short section), which uses the general rule to find the probabilities of two sub-problems. "Bonus Example Problem!" (read this final section), which combines the results from the previous step. Pay close attention to why the specific rule for independent events is used at this final stage.

This example elegantly shows how a complex probability calculation can be broken down into smaller, manageable parts. The selection of pants affects the next selection of pants (dependent), and the selection of shirts affects the next selection of shirts (dependent), but the selection of pants and the selection of shirts are entirely independent of each other.

Conclusion

In this lesson, we focused on the practical application of the multiplication rule for finding the probability of intersections. You now have a solid framework for tackling problems involving sequential events, whether they are dependent or independent.

Key Takeaways:

The general multiplication rule, $P (A \cap B) = P (A) \times P (B ∣ A)$ , is the fundamental tool for calculating the probability of the intersection of two events.
For independent events, where $P (B ∣ A) = P (B)$ , the rule simplifies to $P (A \cap B) = P (A) \times P (B)$ .
The rule can be extended to find the probability of the intersection of any number of events by chaining conditional probabilities.
Probability trees are an excellent visual aid for organizing calculations involving sequential events.
Complex problems can often be solved by breaking them down and applying the appropriate rule (general or specific) to each component.

In our next lesson, we will synthesize everything we've learned about probability so far. You will solve applied problems that require you to strategically combine the addition rule, the multiplication rule, and the concept of conditional probability to arrive at a solution.