Revert "Add gradle-build-action"
Revert "Add gradle-build-action"

This reverts commit 21431ad0d0c501a6928f597e1eccd7f5dfe5b34b.

The action doesn't improve build performance very much in our case

Refers to #203

michel-kraemer/gradle-download-task,michel-kraemer/gradle-download-task