[CI] Small tweaks to improve CI time.
[CI] Small tweaks to improve CI time.

Closes: #1135

aptos-labs/aptos-core,aptos-labs/aptos-core,aptos-labs/aptos-core,aptos-labs/aptos-core,aptos-labs/aptos-core,aptos-labs/aptos-core,aptos-labs/aptos-core