Open In App

Conditional Probability

Improve
Improve
Like Article
Like
Save
Share
Report

Conditional probability is one of the types of probability in probability theory, where the probability of one event is dependent on the other event already happened. As this type of event is very common in real life, conditional probability is often used to determine the probability of such cases.

In this article, we will learn about the topic of conditional probability in detail, including its mathematical definition, formula, conditions of dependent and independent events based on the formula, and many more. So, let’s start our learning of this fundamental topic “Conditional Probability”.

What is Conditional Probability?

Conditional probability is the probability that depends on a previous result or event. Due to this fact, they help us understand how events are related to each other. Simply put, conditional probability tells us the likelihood of the occurrence of an event based on the occurrence of some previous outcome. 

With the help of conditional probability, we can tell apart dependent and independent events. When the probability of one event happening doesn’t influence the probability of any other event, then events are called independent, otherwise dependent events.

Learn more about dependent and independent events.

Definition of Conditional Probability

Conditional Probability is defined as the probability of any event occurring when another event has already occurred. 

In other words, it calculates the probability of one event happening given that a certain condition is satisfied. It is represented as P(A | B) which means the probability of A when B has already happened.

For Example, let’s consider the case of rolling two dice, sample space of this event is as follows:

{(1, 1), (1, 2), (1, 3), (1, 4), (1, 5), (1, 6),
(2, 1), (2, 2), (2, 3), (2, 4), (2, 5), (2, 6),
(3, 1), (3, 2), (3, 3), (3, 4), (3, 5), (3, 6),
(4, 1), (4, 2), (4, 3), (4, 4), (4, 5), (4, 6),
(5, 1), (5, 2), (5, 3), (5, 4), (5, 5), (5, 6),
(6, 1), (6, 2), (6, 3), (6, 4), (6, 5), (6, 6)}

Now, consider an event A = getting 3 on the first die and B = getting a sum of 9.

Then the probability of getting 9 when on the first die it’s already 3 is P(B | A),

which can be calculated as follows:

All the cases for the first die as 3 are (3, 1), (3, 2), (3, 3), (3, 4), (3, 5), (3, 6).

In all of these cases, only one case has a sum of 9.

Thus, P(B | A) = 1/36.

In case, we have to find P(A | B),

All cases where the sum is 9 are (3, 6), (4, 5), (5, 4), and (6, 3).

In all of these cases, only one case has 3 on the first die i.e., (3, 6)

Thus, P(A | B) = 1/36.

Conditional Probability Formula

As we can calculate the Conditional Probability of simple cases without any formula, just as we have seen in the above heading but for complex cases, we need a formula as we can’t possibly count all the cases for those. Let’s consider two events A and B, then the formula for conditional probability of A when B has already occurred is given by:

P(A|B) = P(A ∩ B) / P(B)

where,

  • P(A ∩ B) represents the probability of both events A and B occurring simultaneously
  • P(B) represents the probability of event B occurring

In other words, the conditional probability of A given B has already occurred is equal to the probability of the intersection of A and B divided by the probability of event B.

How to Calculate Conditional Probability?

To calculate the conditional probability, we can use the following step-by-step method:

Step 1: Identify the Events. Let’s call them Event A and Event B.

Step 2: Determine the Probability of Event A i.e., P(A)

Step 3: Determine the Probability of Event B i.e., P(B)

Step 4: Determine the Probability of Event A and B i.e., P(A∩B).

Step 5: Apply the Conditional Probability Formula and calculate the required probability.

Conditional Probability of Independent Events

When two events are independent, those conditional probability is the same as the probability of the event individually i.e., P(A | B ) is the same as P(A) as there is no effect of event B on the probability of event A. For independent events, A and B, the conditional probability of A and B with respect to each other is given as follows:

  • P(B|A)= P(B)
  • P(A|B)= P(A)

Conditional Probability Vs Joint Probability Vs Marginal Probability

The difference between Conditional Probability, Joint Probability, and Marginal Probability is given in the following table:

Parameter Conditional Probability Joint Probability Marginal Probability
Definition The probability of an event occurring given
that another event has already occurred.
The probability of two or more 
events occurring simultaneously.
The probability of an event occurring 
without considering any other events.
Calculation P(A | B) P(A ∩ B) P(A)
Variables involved Two or more events Two or more events Single event

Bayes’ Theorem

Bayes’ Theorem is a fundamental concept in probability theory named after the Reverend Thomas Bayes. It provides a mathematical framework for updating beliefs or hypotheses in light of new evidence or information. This theorem is extensively used in various fields, including statistics, machine learning, and artificial intelligence.

At its core, Bayes’ Theorem enables us to calculate the probability of a hypothesis being true given observed evidence. The theorem is expressed mathematically as follows:

P(A∣B) = (P(B∣A) × P(A))​ / P(B)

where:

  • P(A∣B) is the posterior probability of hypothesis A given evidence B.
  • P(B∣A) is the likelihood of observing evidence B given that hypothesis A is true.
  • P(A) is the prior probability of hypothesis A before observing any evidence.
  • P(B) is the probability of observing evidence B regardless of the truth of hypothesis A.

Here’s a breakdown of how Bayes’ Theorem works:

  1. Prior Probability P(A): This represents our initial belief in the likelihood of hypothesis A being true before considering any new evidence.
  2. Likelihood P(B∣A): This indicates the probability of observing the evidence B given that hypothesis A is true. It quantifies how well the evidence supports the hypothesis.
  3. Evidence P(B): This term serves as a normalization factor and represents the total probability of observing the evidence B across all possible hypotheses.
  4. Posterior Probability P(A∣B): This is the updated probability of hypothesis A being true after taking into account the observed evidence B. It’s what we’re ultimately interested in determining.

Bayes’ Theorem is particularly powerful because it allows us to incorporate new evidence incrementally, refining our beliefs as more data becomes available. This iterative process of updating beliefs with new evidence forms the basis of Bayesian inference, which is widely used in fields such as medical diagnosis, spam filtering, weather forecasting, and many others.

Bayes’ Theorem provides a principled approach for reasoning under uncertainty, making it a cornerstone of probabilistic reasoning and decision-making in diverse domains.

Conditional Probability with Example

There are various examples of conditional probability as in real life all the events are related to each other and happening any event affects the probability of another event. For example, if it rains, the probability of road accidents increases as roads have less friction. Let’s consider some problem-based examples here:

Tossing a Coin:

Let’s consider two events in tossing two coins be,

A: Getting a head on the first coin.

B: Getting a head on the second coin.

Sample space for tossing two coins is:

S = {HH, HT, TH, TT}

Conditional probability of getting a head on the second coin (B) given that we got a head on the first coin (A) is = P(B|A)

Since the coins are independent (one coin’s outcome does not affect the other), P(B|A) = P(B) = 0.5 (50%), which is the probability of getting a head on a single coin toss.

Drawing Cards:

In a deck of 52 cards where two cards are being drawn, then let’s consider the events be

A: Drawing a red card on the first draw, and

B: Drawing a red card on the second draw.

Conditional probability of drawing a red card on the second draw (B) given that we drew a red card on the first draw (A) is = P(B|A) 

After drawing a red card on the first draw, there are 25 red cards and 51 cards remaining in the deck. So, P(B|A) = 25/51 ≈ 0.49 (approximately 49%).

Properties of Conditional Probability 

Some of the common properties of conditional property are:

Property 1: Let’s consider an event A in any sample space S of an experiment.

P(S|A) = P(A|A) = 1

Property 2: For any two events A and B of a sample space S, and an event X such that P(X) ≠ 0,

P((A ∪ B)|X) = P(A|X) + P(B|X) – P((A ∩ B)|X)

Property 3: The order of set or events is important in conditional probability, i.e.,

P(A|B) ≠ P(B|A)

Property 4: The complement formula for probability only holds conditional probability if it is given in the context of the first argument in conditional probability i.e.,

P(A’|B)=1-P(A|B)

P(A|B’) ≠ 1-P(A|B)

Property 5: For any two or three independent events, the intersection of events can be calculated using the following formula:

  • For the intersection of two events A and B,

P(A â‹‚ B) = P(A) P(B)

  • For the intersection of three events A, B, and C,

P(A â‹‚ B â‹‚ C) = P(A) P(B) P(C)

Multiplication Rule of Probability

Multiplication Rule of Probability, when applied in the context of conditional probability, helps us calculate the probability of the intersection of two events when the probability of one event depends on the occurrence of the other event. This rule is crucial in understanding the joint probability of events under specific conditions.

In the context of conditional probability, the Multiplication Rule is often stated as follows:

P(A∩B) = P(A) × P(B∣A)

Here’s what each term represents:

  • P(A∩B): This denotes the probability that both events A and B occur simultaneously.
  • P(A): This represents the probability of event A happening.
  • P(B∣A): This is the conditional probability of event B occurring given that event A has already occurred.

To apply the Multiplication Rule in the context of conditional probability, we first calculate the probability of event A occurring. Then, we compute the probability of event B occurring given that event A has occurred. Multiplying these probabilities together gives us the joint probability of both events happening under the specified conditions.

This rule is particularly useful when dealing with events that are not independent, meaning that the occurrence of one event affects the probability of the other event. Conditional probability allows us to adjust probabilities based on known information, making predictions and calculations more accurate in real-world scenarios.

For example, consider the probability of drawing two cards from a deck without replacement. If we want to find the probability of drawing a red card followed by another red card, we use the Multiplication Rule of Probability with conditional probabilities. The probability of drawing a red card on the first draw is straightforward. However, the probability of drawing a red card on the second draw depends on whether a red card was drawn on the first draw, hence the need for conditional probability.

Solved Questions on Conditional Probability

Question 1: A bag contains 5 red balls and 7 blue balls. Two balls are drawn without replacement. What is the probability that the second ball drawn is red, given that the first ball drawn was red?

Solution:

Let the events be,

Event A: The first ball drawn is red.

Event B: The second ball drawn is red.

P(A) = 5/12 

and P(B) = 4/11 (as first ball drawn is already red, thus only 4 red balls remain in the bag)

Therefore, probability of the second ball drawn being red given that the first ball drawn was red is 4/11.

Question 2: A box contains 5 green balls and 3 yellow balls. Two balls are drawn without replacement. What is the probability that both balls are green?

Solution:

Let events be:

Event A: The first ball drawn is green, and

Event B: The second ball drawn is green.

P(A) = 5/8

P(B) = 4/7 ( as there are 4 green balls left out of 7)

Thus, probability that both balls drawn are green is (5/8) × (4/7) = 20/56 = 5/14.

Question 3: In a bag, there are 8 red marbles, 4 blue marbles, and 3 green marbles. If one marble is randomly drawn, what is the probability that it is not blue?

Solution:

Let the events be:

Event A: The marble drawn is not blue, and 

Event B: The marble drawn is blue.

As A and B are complementary Events, we know

P(A) = 1 – P(B)

⇒ P(A) = 1 – 4/15 

⇒ P(A) = (15 – 4)/15 

⇒ P(A) = 11/15

Thus, probability of drawing a marble out of bag which is not blue is 11/15.

Question 4: In a survey among a group of students, 70% play football, 60% play basketball, and 40% play both sports. If a student is chosen at random and it is known that the student plays basketball, what is the probability that the student also plays football?

Solution:

Let’s assume there are 100 students in the survey.

Number of students who play football = n(A) = 70

Number of students who play basketball = n(B) = 60

Number of students who play both sports = n(A ∩ B) = 40

To find the probability that a student plays football given that they play basketball, we use the conditional probability formula:

P(A|B) = n(A ∩ B) / n(B)

Substituting the values, we get:

P(A|B) = 40 / 60 = 2/3

Therefore, probability that a randomly chosen student who plays basketball also plays football is 2/3.

Question 5: In a deck of 52 playing cards, 4 cards are drawn without replacement. What is the probability that all 4 cards are aces, given that the first card drawn is an ace?

Solution:

Let the events be,

Event A: The first card drawn is an ace,

Event B: The second card drawn is an ace,

Event C: The third card drawn is an ace, and

Event D: The fourth card drawn is an ace.

P(A) = 4/52 (there are 4 ace out of 52)

P(B | A) = 3/51 (one is already drawn, thus 3 ace left)

P(C | A and B) = 2/50 (two is already drawn, thus 2 ace left)

P(D | A and B and C) = 1/49 (three is already drawn, thus 1 ace left)

To find the probability that all four cards are aces, we multiply the probabilities of the individual events.

P(A and B and C and D) = P(A) × P(B|A) × P(C|A and B) × P(D|A and B and C)

= (4/52) × (3/51) × (2/50) × (1/49)

= 1/270725

Therefore, probability that all 4 cards drawn are aces, given that the first card drawn is an ace, is 1/270725.

Applications of Conditional Probability

Various applications of conditional probability are,

Finance and Risk Management

Example: Assessing the probability of default for a borrower given certain financial indicators.

Application: Banks and financial institutions use conditional probability to evaluate the risk associated with loans and investments.

Healthcare and Diagnostics

Example: Determining the probability of a patient having a specific disease given the results of diagnostic tests.

Application: Conditional probability is crucial in medical diagnoses and decision-making, helping healthcare professionals make informed decisions based on test results.

Marketing and Customer Relationship Management (CRM)

Example: Predicting the probability of a customer making a purchase based on their past buying behavior.

Application: Businesses use conditional probability to tailor marketing strategies, optimize customer experiences, and personalize product recommendations.

Machine Learning and Artificial Intelligence

Example: Predicting the likelihood of a user clicking on a particular ad based on their online behavior.

Application: Conditional probability is fundamental in machine learning algorithms for tasks such as classification, recommendation systems, and natural language processing.

Weather Forecasting

Example: Estimating the probability of rain tomorrow given today’s weather conditions.

Application: Meteorologists use conditional probability to make weather predictions based on historical data and current atmospheric conditions.

Related Articles:

Set Theory

Addition Rule for Probability

Complement of a Set

Types of Events in Probability

Coin Toss Probability Formula

Mutually Exclusive Events

FAQs on Conditional Probability

What is conditional probability?

Conditional probability is a measure of the probability of an event occurring given that another event has already occurred or is known to have occurred. It is denoted as P(A|B), which reads as “the probability of event A given event B” .

How is conditional probability calculated?

Conditional probability is calculated using the formula: 

P(A|B) = P(A ∩ B) / P(B)

What is the difference between conditional probability and regular probability?

  • Regular probability, often referred to as unconditional probability, calculates the likelihood of an event occurring without any prior information and is the basic probability of an event in isolation.
  • Conditional probability takes into account additional information or the occurrence of another event to calculate the probability of a particular event.

Can conditional probability be greater than 1?

No, conditional probability cannot be greater than 1 as the conditional probability is a type of probability. It can only be between 0 and 1.

What is the relationship between conditional probability and independence?

Two events A and B are considered independent if the occurrence of one event does not affect the probability of the other event.

In terms of conditional probability, if events A and B are independent, then P(A|B) = P(A), and similarly, P(B|A) = P(B). In other words, the conditional probability of A given B is equal to the unconditional probability of A, and vice versa.

Can conditional probability be negative?

No, conditional probability cannot be negative as probabilities are always non-negative values between 0 and 1.

What is conditional probability with an example?

Conditional probability, denoted P(A|B), assesses the likelihood of event A happening, given that event B has already occurred. For example, in a medical test scenario, it calculates the chance of having a disease when the test result is positive. It’s a key concept in probability theory, helping us understand real-world situations where one event depends on another.

What is conditional probability class 10?

In class 10, conditional probability is about finding the chance of one event happening given another has occurred. For example, it helps determine the probability of rolling an even number when you already know the number rolled is greater than 3. It’s a basic concept in probability used to solve real-world problems.

What are the applications of conditional probability?

Conditional probability finds practical use in:

  1. Medical Diagnosis: Assessing disease probabilities from symptoms.
  2. Weather Forecasting: Predicting weather conditions based on data.
  3. Finance and Insurance: Analyzing risks and setting premiums.
  4. Quality Control: Detecting defects in manufacturing.
  5. Machine Learning: For recommendations and predictions.
  6. Epidemiology: Studying disease spread and prevention.
  7. Speech Recognition: Predicting words in language.
  8. Game Theory: Analyzing strategic decisions.
  9. Genetics: Assessing genetic trait inheritance.
  10. Sports Analytics: Predicting outcomes in sports.
  11. Marketing: Understanding customer behavior.
  12. Risk Management: Evaluating and mitigating risks.

It’s a versatile tool for decision-making and prediction in many fields.

What are the types of conditional probability?

  1. Simple Conditional Probability: Probability of one event given another.
  2. Joint Probability: Probability of multiple events occurring together.
  3. Marginal Probability: Probability of a single event without conditions.
  4. Conditional Probability Distribution: Probability distribution based on conditions.
  5. Posterior Probability: Updated probability after considering new evidence.
  6. Prior Probability: Initial probability before new evidence.
  7. Sequential Conditional Probability: Probability of events occurring in a specific sequence.
  8. Time Series Analysis: Predicting future events based on past data.
  9. Markov Chains: Transition probabilities between states in a sequence.


Last Updated : 14 Mar, 2024
Like Article
Save Article
Previous
Next
Share your thoughts in the comments
Similar Reads