Representing states with numerical values: Markov system