Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Understanding Undesirable Word Embedding Associations   Word embeddings are often criticized for capturing undesirable word
associations such as gender stereotypes. However, methods for measuring and
removing such biases remain poorly understood. We show that for any embedding
model that implicitly does matrix factorization, debiasing vectors post hoc
using subspace projection (Bolukbasi et al., 2016) is, under certain
conditions, equivalent to training on an unbiased corpus. We also prove that
WEAT, the most common association test for word embeddings, systematically
overestimates bias. Given that the subspace projection method is provably
effective, we use it to derive a new measure of association called the
$\textit{relational inner product association}$ (RIPA). Experiments with RIPA
reveal that, on average, skipgram with negative sampling (SGNS) does not make
most words any more gendered than they are in the training corpus. However, for
gender-stereotyped words, SGNS actually amplifies the gender association in the
corpus.

11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int