Don't fetch all remotes when releasing (#370)
Don't fetch all remotes when releasing (#370)

Instead, only fetch the remote branch we're interested in.
knative/test-infra,knative/test-infra,knative/test-infra