Fix perf_client high CPU usage by avoiding unnecessary spin (#304)
Fix perf_client high CPU usage by avoiding unnecessary spin (#304)

* Avoid perf_client to spin by maintaining concurrency with one context when possible

* Minimize the attempts of acquiring lock

* Be more active on polling ready request

triton-inference-server/client,triton-inference-server/client,triton-inference-server/client,triton-inference-server/client,triton-inference-server/client,triton-inference-server/client,triton-inference-server/client