Implement optionally-deterministic "perplexity eval" that computes teacher-forced perplexity, token-accuracy, sequence-accuracy.
Implement optionally-deterministic "perplexity eval" that computes teacher-forced perplexity, token-accuracy, sequence-accuracy.

PiperOrigin-RevId: 284198238

tensorflow/mesh,tensorflow/mesh