Deduplicate urls parsed to reduce crawl requests
Deduplicate urls parsed to reduce crawl requests

https://github.com/bazelbuild/bazel/pull/14700 added couple more URLs to fetch JDK package and seems to be causing some infrastructure as discussed in https://github.com/bazelbuild/bazel/pull/14700.

This patch workaround the issue by removing the duplicated URLs and reduce the crawl request.

Closes #14763.

PiperOrigin-RevId: 427464876

bazelbuild/bazel,ButterflyNetwork/bazel,ButterflyNetwork/bazel,bazelbuild/bazel,katre/bazel,cushon/bazel,bazelbuild/bazel,cushon/bazel,bazelbuild/bazel,ButterflyNetwork/bazel,cushon/bazel,katre/bazel,katre/bazel,ButterflyNetwork/bazel,ButterflyNetwork/bazel,cushon/bazel,cushon/bazel,bazelbuild/bazel,cushon/bazel,katre/bazel,katre/bazel,ButterflyNetwork/bazel,katre/bazel,bazelbuild/bazel