Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Linear Discriminant Analysis   We introduce Deep Linear Discriminant Analysis (DeepLDA) which learns
linearly separable latent representations in an end-to-end fashion. Classic LDA
extracts features which preserve class separability and is used for
dimensionality reduction for many classification problems. The central idea of
this paper is to put LDA on top of a deep neural network. This can be seen as a
non-linear extension of classic LDA. Instead of maximizing the likelihood of
target labels for individual samples, we propose an objective function that
pushes the network to produce feature distributions which: (a) have low
variance within the same class and (b) high variance between different classes.
Our objective is derived from the general LDA eigenvalue problem and still
allows to train with stochastic gradient descent and back-propagation. For
evaluation we test our approach on three different benchmark datasets (MNIST,
CIFAR-10 and STL-10). DeepLDA produces competitive results on MNIST and
CIFAR-10 and outperforms a network trained with categorical cross entropy (same
architecture) on a supervised setting of STL-10.

16
The categories of this paper are: stat
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio