Conditional Probability and Bayes’ Theorem (CAT-Level)
Quantitative Aptitude › Permutation, Combination and Probability · Topic 22.7
Conditional probability P(A|B) is the probability of event A given that event B has already occurred, and it equals P(A and B)/P(B). Bayes' theorem reverses the condition and finds the probability of a cause given an observed effect.
6 min read · Quantitative Aptitude · Permutation, Combination and Probability
Quick Answer
Conditional probability P(A|B) is the probability of event A given that event B has already occurred, and it equals P(A and B)/P(B). Bayes’ theorem reverses the condition and finds the probability of a cause given an observed effect.
At a Glance
- Conditional probability P(A|B) = P(A and B)/P(B)
- Multiplication rule P(A and B) = P(B) × P(A|B)
- Total probability P(B) = Σ P(Aᵢ) P(B|Aᵢ)
- Bayes’ theorem P(Aᵢ|B) = P(Aᵢ) P(B|Aᵢ)/P(B)
- Independent events P(A|B) = P(A)
Where Does It Fit?
This CAT-level topic extends the basic rules of Probability – Classical Definition and Basic Addition/Multiplication Rules. It is used in Probability Problems on Balls Drawn from Bags Without Replacement for draws without replacement and prepares the complement approach of Probability Using the Complementary Event Rule.
What Is Conditional Probability?
In short: once you know that B has happened, the sample space shrinks to B. The conditional probability is the share of B in which A also happens.
Conditional probability
- P(A|B) = P(A ∩ B)/P(B), provided P(B) > 0.
- P(A ∩ B) = P(B) × P(A|B) = P(A) × P(B|A).
- If A and B are independent, P(A|B) = P(A).
| Situation | Working | Probability |
|---|---|---|
| Two dice: sum 8, given the first die shows 3 | Second die must be 5: 1 out of 6 | 1/6 |
| Two dice: sum 8, given at least one die shows 4 | 11 outcomes have a 4, and only (4, 4) sums to 8 | 1/11 |
| Two cards drawn without replacement: second is an ace, given first is an ace | 3 aces left among 51 cards | 3/51 = 1/17 |
- Without replacement: successive draws are dependent, so use conditional probabilities.
- Reduced sample space: for small problems, list the outcomes in B and count those that also lie in A.
What Is Bayes’ Theorem?
In short: Bayes’ theorem finds the probability that a particular cause produced an observed result, using the prior probability of each cause and the chance that each cause gives that result.
Bayes’ theorem
- If A₁, A₂, …, Aₙ are mutually exclusive causes that cover all cases, then P(Aᵢ|B) = P(Aᵢ) P(B|Aᵢ) / [P(A₁) P(B|A₁) + … + P(Aₙ) P(B|Aₙ)].
- The denominator is the total probability P(B).
- Prior probability: the probability of a cause before the result is known, such as the share of items made by machine A.
- Posterior probability: the probability of the cause after the result is known.
- Test problems: a rare condition with a test that has some false positives gives a surprisingly low probability of actually having the condition after a positive result.
The method is a tree of two stages: first the cause, then the result.
Solved Examples
Example 1
Question: Two dice are thrown. Find the probability that the sum is 8 given that the first die shows 3.
- Given the first die is 3, there are 6 equally likely outcomes for the second die.
- The sum is 8 only if the second die is 5.
Answer: 1/6.
Example 2
Question: Two dice are thrown. Find the probability that the sum is 8 given that at least one die shows 4.
- Outcomes with at least one 4: 6 + 6 – 1 = 11.
- Among them, the sum is 8 only for (4, 4).
Answer: 1/11.
Example 3
Question: Two cards are drawn one after another without replacement. Find the probability that both are aces.
- P(first ace) = 4/52.
- P(second ace | first ace) = 3/51.
- Product = 12/2652.
Answer: 1/221.
Example 4
Question: Machine A makes 60% of items and 2% of its items are defective. Machine B makes 40% and 5% of its items are defective. An item is found defective. Find the probability that it came from A.
- P(A and defective) = 0.6 × 0.02 = 0.012.
- P(B and defective) = 0.4 × 0.05 = 0.020.
- P(defective) = 0.032.
- P(A | defective) = 0.012/0.032.
Answer: 3/8 = 0.375.
Example 5
Question: 1% of people have a disease. A test is positive for 90% of people with the disease and for 5% of people without it. Find the probability that a person with a positive test has the disease.
- P(disease and positive) = 0.01 × 0.90 = 0.009.
- P(no disease and positive) = 0.99 × 0.05 = 0.0495.
- P(positive) = 0.0585.
- P(disease | positive) = 0.009/0.0585.
Answer: 2/13, about 0.154.
Shortcuts and Tricks
- Draw a two-stage tree with causes on the first branches and results on the second.
- Multiply along each branch, add the branches that end in the observed result, and divide the branch of interest by the total.
- For conditional questions with small numbers, list the reduced sample space instead of using the formula.
- Check that the conditional probabilities of a fixed condition add up to 1.
- For draws without replacement, reduce both the numerator and denominator by one each time.
Common Mistakes
- Confusing P(A|B) with P(B|A).
- Using the independent multiplication rule when draws are without replacement.
- Dividing by the wrong total in Bayes’ problems; the denominator is all branches that give the observed result.
- Forgetting that a posterior probability depends on the prior probabilities.
- Taking the test sensitivity as the probability of having the disease.
Practice Questions
- Two dice are thrown. Find P(sum is 7 | first die shows 2).
- A bag has 3 red and 2 blue balls. Two are drawn without replacement. Find P(both red).
- P(A) = 0.4, P(B) = 0.5, P(A and B) = 0.2. Find P(A|B).
- Two cards are drawn without replacement. Find P(both are kings).
- In the machine problem above, find P(B | defective).
Answers: 1) 1/6; 2) 3/10; 3) 0.4; 4) 1/221; 5) 5/8.
Why Is This Topic Important?
- Foundation It explains how new information changes a probability.
- Exam use CAT-level sets use defective items, tests and drawing.
- Speed A tree diagram makes the working systematic.
- Link to counting Conditional probability is often the same as counting in a reduced set, as in Combination and Selection Problems.
What Comes Next?
The next topic is Probability Problems on Cards, Dice and Coins. It applies these rules to cards, dice and coins.
Key Terms and Formulas
- Conditional probability Probability given that another event occurred
- Prior probability Probability before new information
- Posterior probability Probability after new information
- Total probability The sum over all causes
- False positive A positive result for someone without the condition
- Partition A set of exclusive events that cover all cases
Related Topics
- Probability – Classical Definition and Basic Addition/Multiplication Rules
- Probability Problems on Cards, Dice and Coins
- Fundamental Principle of Counting (Addition and Multiplication Rules)
- Permutation of Distinct Objects and Objects with Repetition
Exam Corner
Points to Remember
- P(A|B) = P(A and B)/P(B).
- Multiply along a branch.
- Bayes’ denominator is the total probability.
- Without replacement means dependent draws.
- P(A|B) and P(B|A) are different.
Do Not Confuse With
- P(A|B) vs P(B|A) They answer different questions.
- Independent vs dependent With replacement is independent, and without replacement is dependent.
- Prior vs posterior Prior is before the result, and posterior is after.
- Sensitivity vs probability of disease A positive test does not mean the disease is certain.
Memory Hook
Shrink to B, then count A inside it.
GS Relevance
Frequently Asked Questions
What is conditional probability?
Conditional probability is the probability of an event A given that another event B has already occurred, and it equals the probability of A and B together divided by the probability of B. It works by shrinking the sample space to the outcomes in B.
What is Bayes' theorem?
Bayes' theorem gives the probability of a cause given an observed result. It says that P(A given B) equals P(A) times P(B given A), divided by the total probability of B, which is the sum of such products over all possible causes.
How do you find the probability of two aces without replacement?
To find the probability of drawing two aces without replacement, multiply the probability that the first card is an ace, which is 4 over 52, by the probability that the second is an ace given the first was, which is 3 over 51. The product is 1 over 221.
How does conditional probability differ for independent events?
For independent events, knowing that one event occurred does not change the probability of the other, so P(A given B) equals P(A). Then the probability of both events is the product of the two probabilities, and drawing with replacement gives independence.
Why is a positive test often not conclusive for a rare disease?
When a disease is rare, the number of healthy people with a false positive can be larger than the number of sick people with a true positive. With a 1 per cent rate, a 90 per cent sensitivity and a 5 per cent false positive rate, only about 15 per cent of positives are sick.
PYQ Practice — Statement Analysis
1 P(A|B) is always equal to P(B|A).
The two conditional probabilities answer different questions and are usually different.
2 For independent events A and B, P(A|B) = P(A).
Knowing B does not change the chance of A.
3 Two cards drawn without replacement are both aces with probability 1/221.
(4/52) × (3/51) = 1/221.
4 In Bayes' theorem the denominator is the total probability of the observed result.
It is the sum of the probabilities along all branches that give the result.
Related Topics
Browse the full Quantitative Aptitude index