Sheldon M Ross Stochastic Process 2nd Edition Solution Info

P X0 = 0 = P^2 (0,2) = 0.5(0.2) + 0.3(0.2) + 0.2(0.5) = 0.1 + 0.06 + 0.1 = 0.26

2.1. Let X be a random variable with probability density function (pdf) f(x) = 2x, 0 ≤ x ≤ 1. Find E[X] and Var(X). Sheldon M Ross Stochastic Process 2nd Edition Solution

Find PX2 = 2 .

Solution:

P = | 0.5 0.3 0.2 | | 0.2 0.6 0.2 | | 0.1 0.4 0.5 | P X0 = 0 = P^2 (0,2) = 0

3.2. Let X(t), t ≥ 0 be a stochastic process with X(t) = A cos(t) + B sin(t), where A and B are independent random variables with mean 0 and variance 1. Find E[X(t)] and Autocov(t, s). and transition probability matrix:

4.3. Consider a Markov chain with states 0, 1, and 2, and transition probability matrix: