added utils for inference in batch
added utils for inference in batch

kubeflow/code-intelligence,kubeflow/code-intelligence,kubeflow/code-intelligence,kubeflow/code-intelligence,kubeflow/code-intelligence