Markov Chains and Markov Process - Part III

Markov Chain and Markov Process III unveiled in my lecture video available in this link <https://youtu.be/WQUaLNK7QAc>. Please visit this link.

Markov Chain and Markov Process - Part II

Taking a sick leave

The discussion on markov chain and markov process as a special case of conditional probability is continued today with an example of sickness and good health. The state of good health or bad health tomorrow for an individual can be explained by Markov Chains and Markov Process in the following manner.

P(bad health tomorrow )

=P(bad health today)P(bad health tomorrow|bad health today)+P(good health today)P(bad health tomorrow|good health today)

If a person is ill today  then the probability that he/she will feel ill tomorrow is higher than the probability that the person with good health feeling ill tomorrow. 

This can be explained by following notation.

P(bad health tomorrow|bad health today)>P(bad health tomorrow|good health today)

What is the probability that a person is ill on the third day (of the week)?

P(Bad health on third day)=P(bad health on second day)P(bad health on third day|bad health on second day)+P(good health on second day)P(bad health on third day| good health on second day) 

This  can be interlinked (like a chain) to the following expression

P(Bad health on second day)=P(bad health on first day)P(bad health on second day|bad health on first day)+P(good health on first day)P(bad health on second day| good health on first day) 

This inter-linkage (chain) will be discussed in detail in the next blog. 

Markov Chains and Markov Processes

Here the concept of conditional probability discussed in previous days  blogs (July 14 - July 30, 2017) is extended to Markov chain and Markov Processes. 

Let,

P(Rainy Day) = 0.3

P(Dry Day) = 0.7

We know that if it rains today then there are high chances that it might rain tomorrow that is the probability that it will rain tomorrow is high.  So the conditional probability that it will rain tomorrow given that it rains today is higher than the unconditional probability that it will rain tomorrow.

Notation wise

P(Rain Tomorrow|Rain Today)>P(Rain Tomorrow)

Conditional Probability>Unconditional Probability

P(Rains tomorrow)=P(Dry Today)P(Rains Tomorrow|Dry Today)+P(Rains Today)P(Rains Tomorrow|Rain Today)

Markov Processes are systems where outcome of the current state is highly dependent on the outcome of immediately preceding state.  Examples can be weather systems and state of well being of an individual. Here outcome of state today is heavily dependent on the  outcome of immediately preceding state. So probability that it rained one month ago has less influence on the probability that it rained today than the probability that it rained yesterday. State of well being of an individual can also be explained in the following manner. So these examples explain special case of conditional probability namely markov chains. This will be discussed in detail in the next blog.

Expectation and Conditional Expectation

The discussion on probability and conditional probability (previous day's blog) is continued to expectation and conditional expectation.

Let Z be a random variable denoting money spent by the state on the cardiac care of a citizen below 40 years.

E(Z) is the average money spent by the state per citizen below 40 years on its cardiac care.

E(Z)=P(Y1)E(Z|Y1)+P(Y2)E(Z|Y2)

=(Probability of a Heart attack before 40)(Average money spent by the state on caradiac care of a citizen with an incidence of heart attack before 40 years)+(Probability of no heart attack before 40 years)(Average money spent by the state on cardiac care of a citizen with no incidence of heart attack before 40)

so,

Expectation=Probability(condition1)* Conditional expectation+Probability(condition2)* Conditional expectation

Probability and Conditional Probability

The discussion is being continued. 

So,

Y1 stands for  incidence of a heart attack before 40.

Y2 stands for no incidence of a heart attack before 40.

X stands for the event of Blood pressure and Blood sugar beyond normal limits and cholesterol within normal limits.

Expenses on Cardiac Care

Probability and Conditional Probability

Probability and Conditional Probability

This is in continuation of the discussion on Probability and Conditional Probability of the Previous Blog.
Now we are using a general notation. Then the equation get's reduced to the following form.

Probability and Conditional Probability

Visualization of Probability & Conditional Probability

The tree diagram given in the image below helps visualize the main difference between conditional and unconditional probability. Here we continue with the example of the previous blog where conditions leading to a heart attack before 40 years are minutely analyzed.  

Visualization of conditional probability

Probability and Conditional Probability