Moved test out of run_in_graph_and_eager_mode in contrastive_test.py (#1445)
Moved test out of run_in_graph_and_eager_mode in contrastive_test.py (#1445)

See #1328
tensorflow/addons,tensorflow/addons,tensorflow/addons