- optimizer_default can be None in create_train_op_with_different_lrs - restore takes restore_itr
- optimizer_default can be None in create_train_op_with_different_lrs
- restore takes restore_itr

fab-jul/fjcommon