🚀 Data Science Roadmap 2026

📘 Phase 2: Mathematics for Data Science

📖 Topic 5: Bayes' Theorem

Welcome back! 👋

In the previous lesson, you learned the fundamentals of Probability. Now we're moving to one of the most important concepts in probability and statistics for Data Science: Bayes' Theorem.

Bayes' Theorem helps us update the probability of an event when we receive new information.

It is particularly important in:

✅ Machine Learning

✅ Classification

✅ Medical diagnosis

✅ Fraud detection

✅ Spam detection

✅ Risk analysis

✅ Recommendation systems

🔹 1. What is Bayes' Theorem?

Bayes' Theorem calculates the probability of an event based on prior knowledge and new evidence.

In simple terms:

«Start with what you already know → receive new evidence → update your belief.»

🔹 2. Bayes' Theorem Formula ⭐

The formula is:

P(A|B) = P(B|A) × P(A)/P(B)

Where:

• P(A|B) → Probability of A given B

• P(B|A) → Probability of B given A

• P(A) → Prior probability of A

• P(B) → Probability of B

🔹 3. Understanding the Terms

Suppose we're trying to determine whether an email is spam.

Event A: Email is Spam

Evidence B: Email contains the word "Free"

Then: P(Spam | "Free") means: Probability that the email is spam given that it contains the word "Free".

🔹 4. Prior Probability

The prior probability represents what we believe before considering new evidence.

Suppose: 10% of all emails are spam.

P(Spam) = 0.10

This is our initial belief.

🔹 5. Likelihood

Now suppose: 80% of spam emails contain the word "Free".

P("Free" | Spam) = 0.80

This tells us how likely the evidence is if the email is actually spam.

🔹 6. Posterior Probability

After seeing the evidence, we want to calculate:

P(Spam | "Free")

This is called the posterior probability.

It represents our updated belief after receiving new information.

🔹 7. Simple Numerical Example ⭐

Suppose:

• P(Spam) = 0.10

• P(Free | Spam) = 0.80

• P(Free) = 0.20

Using Bayes' Theorem:

P(Spam | Free) = P(Free | Spam) × P(Spam)/P(Free)

= 0.80 × 0.10/0.20

= 0.08/0.20

= 0.40

Therefore: P(Spam | Free) = 40%

So after seeing the word "Free", our estimated probability that the email is spam increases from 10% to 40%.

🔹 8. Why Does Bayes' Theorem Matter?

Bayes' Theorem allows us to update probabilities when new evidence becomes available.

This is extremely useful when working with uncertain information.

Initial belief → New evidence → Updated probability

🔹 9. Bayes' Theorem in Machine Learning ⭐

One of the most famous applications is Naive Bayes.

Naive Bayes is a classification algorithm based on Bayes' Theorem.

It can be used for:

• Spam detection

• Sentiment analysis

• Text classification

• Document classification

• News classification

Example: Email → Extract words → Calculate probabilities → Spam probability = 92% → Classify as Spam

🔹 10. Medical Diagnosis Example

Suppose a disease is relatively rare. 1% of people have a disease.

A medical test is positive for 90% of people who have the disease.

At first glance, a positive test might seem to mean that the person almost certainly has the disease.