The markov-chains tag has no wiki summary.
4
votes
0answers
50 views
Subgraph of a Markov Decision Process
Consider a Markov decision process $M$ with an initial state $s_0$ and a set of goal states $S_G$. We can view $M$ as a graph with two types of edges (nondeterministic and probabilistic ones). Now ...
3
votes
1answer
97 views
Improve Markov Chain results
Apologies for another Markov Chain question but this one is best given its own question to avoid confusion. I am using a Markov Chain to get the 10 best search results from the union of 3 different ...
4
votes
4answers
251 views
What are the uses of Markov Chains in CS?
We all know that Markov Chains can be used for generating real-looking text (or real-sounding music). I've also heard that Markov Chains has some applications in the image processing, is that true? ...
