What is Bayes' theorem?

Bayes' theorem is a fundamental rule of probability theory that allows us to calculate the conditional probability of event A given event B, using known probabilities P(B|A), P(A), and P(B). The formula looks like this:

[ P(A|B) = \frac{P(B|A) \times P(A)}{P(B)} ]

Where:

• (P(A|B)) — the probability of event A given B (posterior probability)
• (P(B|A)) — the probability of event B given A (likelihood)
• (P(A)) — the prior probability of event A
• (P(B)) — the total probability of event B

Example of application: in machine learning, the naive Bayes classifier uses Bayes' theorem to determine the probability that an object belongs to a class based on features.

Example in Python:

# Suppose we have the probability of having the flu (A) and the probability of having a cough (B)
P_A = 0.01  # probability of having the flu
P_B_given_A = 0.8  # probability of cough given the flu
P_B = 0.1  # overall probability of cough

# Calculate the probability of having the flu given a cough
P_A_given_B = (P_B_given_A * P_A) / P_B
print(f"Probability of flu given a cough: {P_A_given_B:.2f}")

Bayes' theorem helps update our knowledge about probabilities based on new data.