Skip to main content

Timeline for What are Markov chains?

Current License: CC BY-SA 3.0

4 events
when toggle format what by license comment
Mar 25, 2015 at 1:43 comment added Sasho Nikolov The last paper is quite mysterious to me because they don't use Markov chain terminology through most of the paper. It's possible that they solve a more general problem even though the motivation is Markov chains. That said, $W(s,s) = -W(s, S\setminus \{s\})$ is consistent with working with the Laplace operator (or rather its negation..for some reason).
Mar 24, 2015 at 16:30 comment added Bakuriu Thanks for the clarification about the exponential being memoryless. It makes sense. I double checked the third article and they do explicitly say that they do not assume the weights to be non-negative, because there's a peculiar definition of $W(s, s)$ (the rate of a state into itself) which is usually defined to be $-W(s, S \setminus \{s\})$ (i.e. minus the sum of rates of $s$ to all other states) which makes it, almost always, negative.
Mar 24, 2015 at 14:23 review First posts
Mar 24, 2015 at 14:28
Mar 24, 2015 at 14:22 history answered Riley CC BY-SA 3.0