Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Identifying and Reducing Gender Bias in Word-Level Language Models   Many text corpora exhibit socially problematic biases, which can be
propagated or amplified in the models trained on such data. For example, doctor
cooccurs more frequently with male pronouns than female pronouns. In this study
we (i) propose a metric to measure gender bias; (ii) measure bias in a text
corpus and the text generated from a recurrent neural network language model
trained on the text corpus; (iii) propose a regularization loss term for the
language model that minimizes the projection of encoder-trained embeddings onto
an embedding subspace that encodes gender; (iv) finally, evaluate efficacy of
our proposed method on reducing gender bias. We find this regularization method
to be effective in reducing gender bias up to an optimal weight assigned to the
loss term, beyond which the model becomes unstable as the perplexity increases.
We replicate this study on three training corpora---Penn Treebank, WikiText-2,
and CNN/Daily Mail---resulting in similar conclusions.

26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph