Only set GPU threads if using device=gpu - No change to GPU performance - CPU inference increased 13%-18% in some cases
Only set GPU threads if using device=gpu
- No change to GPU performance
- CPU inference increased 13%-18% in some cases

PiperOrigin-RevId: 207159608

annarev/benchmarks,annarev/benchmarks,tensorflow/benchmarks,tensorflow/benchmarks