A Markov chain is a probabilistic model in which the next state depends on the current state according to defined transition probabilities.
Markov chains are used in modeling sequences, stochastic processes, simulation, language modeling history, and decision analysis.