<< Chapter < Page | Chapter >> Page > |
Increase by 1 and repeat the selection process for the step from to , again selecting arrows, one arrow leaving each state from . You must not re-select arrows for the steps already completed in previous runs (here, the previous run covered the step from to ) because you will introduce a bias that favors the arrows with larger probabilities. Instead, you must reuse them for every successive run of the CFTP process. Now, starting at each of the states of your state set, follow the compositions of steps from to and check for coalescence. Start new runs of CFTP, increasing by 1 for each run, until coalescence occurs (all histories from to return the same state at ). Output the state at that all histories return. Propp and Wilson have proven that this outputted state has been sampled according to the steady state distribution of the MC [link] . See [link] , which shows three runs of CFTP for the MC from [link] .
To simplify the task of choosing arrows per step of CFTP, we can instead make only one decision by selecting a random variable which we will call . The random variable may be represented in the following manner. Let be a real number in the interval with uniform distribution (every value of has the same probability of being chosen). Since the sum of all probabilities on the arrows exiting one state also add to 1, arrange these probabilities in some specific order on the interval . For each step of CFTP, select a value for and where this value lands in the interval dictates which arrows will be chosen leaving each of the states.
If is very large, the CFTP algorithm would require lots of work, since you have to follow all histories and look for coalescence of all of these (making the algorithm acutally “k-tupling" from the past). To greatly reduce the number of histories that must be followed, Propp and Wilson prove that if the stationary distribution of the MC is “monotonic" with respect to a specified partial ordering of the states, you need only to follow two histories (true “coupling"). If a stationary distribution is monotonic, the partial ordering of the state set is preserved under steps of the MC. This means that we may simply follow two histories: that of the largest state and that of the smallest state. Then with the monotonic distribution, the coalescence of these two histories implies the coalescence of all histories [link] .
To discuss the concept of a heat bath algorithm, we will first define a spin system on a vertex set, , to be the set of all spin configurations . Each configuration corresponds to a set of vertices in which each vertex is assigned either an “up” or a “down” spin. Each is given a probability, . For a configuration and denote the configurations which agree with for all where . Let denote the configuration that agrees with for all vertices and has spinning up and denote the configuration that agrees with for all and has spinning down.
Notification Switch
Would you like to follow the 'The art of the pfug' conversation and receive update notifications?