Poll for failed job state outside processDatums
Poll for failed job state outside processDatums

And within each datum retry, check if the context has already been cancelled, and err if so

pachyderm/pfs,pachyderm/pfs,pachyderm/pfs