| Chapter 9: Markov Chains | ||||||
| Duration: 1 hour, 46 minutes and 22 seconds | ||||||
| Section |
Section Notes (PDF File) |
Solution (JPG/PDF File) |
Items Covered |
Item Page |
* Video File MP4 |
Duration (minutes) |
| Section 9.1 | Introduction |
9.1a
(image) 9.1b (image) 9.1c (image) 9.1d (image) |
Pre-Chapter 9, Matrix multiplication notes | 9-1 | ch9(intro) | 06.53 |
|
Introduction to Markov Chain, examples 1, 2 and 3. Example 3 solved using the tree method |
9-4 | ch9(part1) | 06.30 | |||
|
Transition matrix, transition diagram. Example 4: solving example 3 again using Markov chain method. |
9-6 | ch9(part2) | 08.56 | |||
| Example 5 | 9-9 | ch9(par3) | 09.35 | |||
| Example 6 | 9-12 | ch9(part4) | 08.10 | |||
| Example 7 | 9-16 | ch9(part5) | 06.15 | |||
| Section 9.2 |
Regular Markov Chains |
9,2 Solution | Irreducible, regular matrices | 9-20 | ch9(part6) | 16.43 |
| Introduction to Steady State Vector | 9-26 | ch9(part7) | 09.29 | |||
| Example 6 | 9-29 | ch9(part8) | 08.21 | |||
| Example 7 | 9-31 | ch9(part9) | 07.24 | |||
| Example 8, step by step manually | 9-33 | ch9(part10) | 06.21 | |||
| Example 9, step by step manually | 9-34 | ch9(part11) | 11.38 | |||
* MP4 file you can download and save: right click, Save Target As or Save Link As
Important
Problems in the book:
Section 9.1:
#1, 3, 5, 11, 13, 15, 17, 21, 23
Section 9.2:
#1, 3, 5, 7, 9, 11, 15, 21, 23, 25, 27
Excel Template for Section 9.2 (You
can use any method to solve the equations)
Quiz Quiz Solution (try the quiz, and should not take more than 15 minutes. When you are done, check the solution)
