IB AA: Probability Fundamentals

Probability is the mathematical language of uncertainty. Mastering its fundamentals is essential not only for your IB exams but for interpreting data, assessing risks, and making reasoned predictions in virtually every field from science to finance.

The Foundation: Sample Spaces, Notation, and Axioms

Every probability problem begins with a clear definition of the sample space, denoted $S$ or $\Omega$. This is the set of all possible outcomes of a random experiment. For a single fair die, $S=\{1,2,3,4,5,6\}$. An event, typically denoted by capital letters like $A$ or $B$, is a subset of the sample space—a collection of outcomes you're interested in. For example, the event "rolling an even number" is $A=\{2,4,6\}$.

The probability of an event $A$ is written as $P(A)$. The modern theory rests on three axioms:

1. For any event $A$, $0\le P(A)\le 1$.
2. The probability of the sample space is $P(S)=1$.
3. If events $A_1,A_2,A_3,...$ are mutually exclusive (they cannot occur simultaneously), then $P(A_1\cup A_2\cup A_3...)=P(A_1)+P(A_2)+P(A_3)+...$.

These simple rules form the bedrock for all the complex theorems that follow. From them, we can derive useful rules like the complement rule: $P(A^{\prime })=1-P(A)$, where $A^{\prime }$ is the event "not A".

Visualizing Relationships: Venn and Tree Diagrams

When dealing with combined events (like $A$ AND $B$, or $A$ OR $B$), visualization is powerful. A Venn diagram uses overlapping circles within a rectangle (representing $S$) to show relationships between events. The overlap represents the intersection $A\cap B$ (outcomes in both $A$ and $B$). The total area of two circles represents the union $A\cup B$ (outcomes in $A$ or $B$ or both). Venn diagrams make rules like the addition rule intuitive: $$P(A\cup B)=P(A)+P(B)-P(A\cap B)$$ You subtract $P(A\cap B)$ to avoid double-counting the overlapping outcomes.

A tree diagram is ideal for modeling sequential or multi-stage experiments. Each branch represents a possible outcome at a stage, with its probability written on the branch. To find the probability of a sequence of events (e.g., "Heads then Tails"), you multiply the probabilities along the path. To find the probability of a compound event that can occur via multiple paths (e.g., "exactly one Head"), you add the probabilities of all relevant paths. Tree diagrams naturally lead us into discussions of independence and conditional probability.

Combined Events: Mutually Exclusive vs. Independent

These two concepts are among the most commonly confused. Mutually exclusive events cannot happen at the same time; if $A$ occurs, $B$ cannot. In set notation, $A\cap B=\varnothing$, meaning their intersection is empty. For mutually exclusive events, $P(A\cap B)=0$, simplifying the addition rule to $P(A\cup B)=P(A)+P(B)$.

Independent events are defined by how the occurrence of one does not affect the probability of the other. Formally, events $A$ and $B$ are independent if and only if $P(A\cap B)=P(A)\times P(B)$. This is also equivalent to saying $P(A|B)=P(A)$ and $P(B|A)=P(B)$. Independence is a property of the probability model, not the events themselves. For example, successive coin flips are typically independent. Crucially, mutually exclusive events with non-zero probability are never independent. If $A$ and $B$ are mutually exclusive and $A$ happens, you know for sure $B$ did not, so they affect each other's probabilities.

Conditional Probability and Bayes' Theorem

Conditional probability answers the question: "Given that event $B$ has occurred, what is the probability of $A$?" It is denoted $P(A|B)$ and calculated as: $$P(A|B)=\frac{P(A\cap B)}{P(B)},\text{provided }P(B)>0$$ You can think of this as restricting the sample space to only those outcomes where $B$ is true, and then asking what proportion of those outcomes also satisfy $A$. This formula is often rearranged to the multiplication rule: $P(A\cap B)=P(A|B)\times P(B)$.

For Higher Level students, this leads to the powerful Bayes' theorem. It allows us to "reverse" conditional probabilities. If we know $P(A|B)$, Bayes' theorem lets us find $P(B|A)$, provided we have some prior information $P(A)$ and $P(B)$. The theorem states: $$P(A|B)=\frac{P(B|A)\times P(A)}{P(B)}$$ Where $P(B)$ can often be found using the law of total probability: $P(B)=P(B|A)P(A)+P(B|A^{\prime })P(A^{\prime })$. Bayes' theorem is the cornerstone of updating beliefs with new evidence, used in medical testing (finding the probability of having a disease given a positive test result), machine learning, and statistical inference.

Common Pitfalls

1. Confusing "Mutually Exclusive" with "Independent". Remember: mutually exclusive means they cannot happen together; independence means one does not affect the chance of the other. If $P(A)>0$ and $P(B)>0$, mutually exclusive events are always dependent.
2. Misapplying the Multiplication Rule. A common error is writing $P(A\cap B)=P(A)\times P(B)$ for all events. This formula only holds if $A$ and $B$ are independent. If they are not independent, you must use $P(A\cap B)=P(A|B)\times P(B)$.
3. Misinterpreting Conditional Probability. $P(A|B)$ is not the same as $P(B|A)$. For example, the probability of having a rare disease given a positive test $P(Disease|Positive)$ is very different from the probability of a positive test given the disease $P(Positive|Disease)$. Failing to distinguish these is known as the prosecutor's fallacy.
4. Forgetting to Check the "Given" Condition. When calculating a conditional probability $P(A|B)$, you must remember that your world has shrunk to the event $B$. All probabilities in that calculation must be consistent with that restricted sample space.

Summary

• The sample space defines all possible outcomes, and probability axioms provide the logical rules all calculations must follow.
• Venn diagrams help visualize unions and intersections of events, while tree diagrams are essential for modeling sequential processes.
• Mutually exclusive events cannot co-occur ($P(A\cap B)=0$), while independent events do not influence each other's likelihood ($P(A\cap B)=P(A)P(B)$).
• Conditional probability, $P(A|B)$, measures the probability of $A$ within the context of $B$ occurring. Its proper application is key to solving complex problems.
• At HL, Bayes' theorem provides a formal method for updating the probability of a hypothesis based on new evidence, reversing the condition in a probability statement.