"The states can be denoted by letters, symbols, or a set of integers, such as 1, 2, . . . , M ." . . . . .