Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Entity Embeddings of Categorical Variables   We map categorical variables in a function approximation problem into
Euclidean spaces, which are the entity embeddings of the categorical variables.
The mapping is learned by a neural network during the standard supervised
training process. Entity embedding not only reduces memory usage and speeds up
neural networks compared with one-hot encoding, but more importantly by mapping
similar values close to each other in the embedding space it reveals the
intrinsic properties of the categorical variables. We applied it successfully
in a recent Kaggle competition and were able to reach the third position with
relative simple features. We further demonstrate in this paper that entity
embedding helps the neural network to generalize better when the data is sparse
and statistics is unknown. Thus it is especially useful for datasets with lots
of high cardinality features, where other methods tend to overfit. We also
demonstrate that the embeddings obtained from the trained neural network boost
the performance of all tested machine learning methods considerably when used
as the input features instead. As entity embedding defines a distance measure
for categorical variables it can be used for visualizing categorical data and
for data clustering.

31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
2
The categories of this paper are: math