Remove inefficient computation from `AttentionPool2d` Module (#271)
Remove inefficient computation from `AttentionPool2d` Module (#271)

* fix inefficient attention computation

* remove erroneous formatting

* simplified flatten

Co-authored-by: Jong Wook Kim <a4df2aefd782f97b223f48f63357c2135618800c@nyu.edu>
openai/CLIP