Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Limitations of First-Order Approximation in GAN Dynamics   While Generative Adversarial Networks (GANs) have demonstrated promising
performance on multiple vision tasks, their learning dynamics are not yet well
understood, both in theory and in practice. To address this issue, we study GAN
dynamics in a simple yet rich parametric model that exhibits several of the
common problematic convergence behaviors such as vanishing gradients, mode
collapse, and diverging or oscillatory behavior. In spite of the non-convex
nature of our model, we are able to perform a rigorous theoretical analysis of
its convergence behavior. Our analysis reveals an interesting dichotomy: a GAN
with an optimal discriminator provably converges, while first order
approximations of the discriminator steps lead to unstable GAN dynamics and
mode collapse. Our result suggests that using first order discriminator steps
(the de-facto standard in most existing GAN setups) might be one of the factors
that makes GAN training challenging in practice.

20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
2
The categories of this paper are: math
29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th