Revert "layers: LX459,GH#99,#100, Fix semaphore reference count"
Revert "layers: LX459,GH#99,#100, Fix semaphore reference count"

This reverts commit 541bb5afc50581e7c765fc5c05400540369f0044.

Reverting this as the original issue is still present and being worked on
so restoring original state until correct fix is complete.

critsec/Vulkan-LoaderAndValidationLayers,elongbug/Vulkan-LoaderAndValidationLayers,sashinde/VulkanTools,Radamanthe/VulkanSamples,elongbug/Vulkan-LoaderAndValidationLayers,KhronosGroup/Vulkan-LoaderAndValidationLayers,sashinde/VulkanTools,Radamanthe/VulkanSamples,KhronosGroup/Vulkan-LoaderAndValidationLayers,critsec/Vulkan-LoaderAndValidationLayers,KhronosGroup/Vulkan-LoaderAndValidationLayers,Radamanthe/VulkanSamples,elongbug/Vulkan-LoaderAndValidationLayers,Radamanthe/VulkanSamples,Radamanthe/VulkanSamples,sashinde/VulkanTools,critsec/Vulkan-LoaderAndValidationLayers,critsec/Vulkan-LoaderAndValidationLayers,KhronosGroup/Vulkan-LoaderAndValidationLayers,sashinde/VulkanTools,Radamanthe/VulkanSamples,elongbug/Vulkan-LoaderAndValidationLayers