One-shot annealing of z_pres log-odds prior from -0.01 to -10.0 after 5k iterations has been added. Scale variance prior has been decreased from 0.1 to 0.02 to encourage smaller attention window sizes and discourage attending two digits with one large attention window.
One-shot annealing of z_pres log-odds prior from -0.01 to -10.0 after 5k iterations has been added. Scale variance prior has been decreased from 0.1 to 0.02 to encourage smaller attention window sizes and discourage attending two digits with one large attention window.

aakhundov/tf-attend-infer-repeat