Don't wait for fences if we have done device wait idle.
Don't wait for fences if we have done device wait idle.

Not completely safe because we risk recycling -> wait when using
explicit fences.

Themaister/Granite,Themaister/Granite,Themaister/Granite,Themaister/Granite,Themaister/Granite,Themaister/Granite