Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Sample weighting as an explanation for mode collapse in generative
  adversarial networks   Generative adversarial networks were introduced with a logistic MiniMax cost
formulation, which normally fails to train due to saturation, and a
Non-Saturating reformulation. While addressing the saturation problem, NS-GAN
also inverts the generator's sample weighting, implicitly shifting emphasis
from higher-scoring to lower-scoring samples when updating parameters. We
present both theory and empirical results suggesting that this makes NS-GAN
prone to mode dropping. We design MM-nsat, which preserves MM-GAN sample
weighting while avoiding saturation by rescaling the MM-GAN minibatch gradient
such that its magnitude approximates NS-GAN's gradient magnitude. MM-nsat has
qualitatively different training dynamics, and on MNIST and CIFAR-10 it is
stronger in terms of mode coverage, stability and FID. While the empirical
results for MM-nsat are promising and favorable also in comparison with the
LS-GAN and Hinge-GAN formulations, our main contribution is to show how and why
NS-GAN's sample weighting causes mode dropping and training collapse.

26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat