Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: IsoScore: Measuring the Uniformity of Embedding Space Utilization   The recent success of distributed word representations has led to an
increased interest in analyzing the properties of their spatial distribution.
Several studies have suggested that contextualized word embedding models do not
isotropically project tokens into vector space. However, current methods
designed to measure isotropy, such as average random cosine similarity and the
partition score, have not been thoroughly analyzed and are not appropriate for
measuring isotropy. We propose IsoScore: a novel tool that quantifies the
degree to which a point cloud uniformly utilizes the ambient vector space.
Using rigorously designed tests, we demonstrate that IsoScore is the only tool
available in the literature that accurately measures how uniformly distributed
variance is across dimensions in vector space. Additionally, we use IsoScore to
challenge a number of recent conclusions in the NLP literature that have been
derived using brittle metrics of isotropy. We caution future studies from using
existing tools to measure isotropy in contextualized embedding space as
resulting conclusions will be misleading or altogether inaccurate.

26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
16
The categories of this paper are: stat
25
The categories of this paper are: patt-sol