Correct explanation: meaning of attention weights
Correct explanation: meaning of attention weights

The current explanation makes it seem as though the attention weights
show the importance of queries for each key, but instead the opposite is
true: we normalize along the key dimension to show distribution of
importance of keys for any given query.

tensorflow/text,tensorflow/text,tensorflow/text