Optimizer cleanup. SERIOUS bugfix: non of the stateful optimizers did actually preserve the state, this caused much slower convergence - fixed.
Optimizer cleanup. SERIOUS bugfix: non of the stateful optimizers did actually preserve the state, this caused much slower convergence - fixed.

domschl/syncognite,domschl/syncognite,domschl/syncognite,domschl/syncognite