In this course we look at Stochastic Processes, Markov Chains and Markov JumpsWe then work through an impossible exam question that caused the low pass rate in the 2019 sitting. This question requires you to have R Studio installed on your computer. Things we cover in this course: Section 1Stochastic ProcessStationary PropertyMarkov PropertyWhite NoiseIncrementsRandom WalksSection 2Markov ChainsTransition ProbabilitiesChapman-Kolmogorov EquationsTransition MatrixStationary Probability DistributionsIrreducibilityPeriodicitySection3R Studio Exam QuestionSection 4Markov Jump ProcessTransition and Survival ProbabilitiesKolmogorov’s Forward Differential EquationTransition RatesGenerator MatrixKolmogorov’s Backward Differential Equation
