Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Metrics and methods for robustness evaluation of neural networks with
  generative models   Recent studies have shown that modern deep neural network classifiers are
easy to fool, assuming that an adversary is able to slightly modify their
inputs. Many papers have proposed adversarial attacks, defenses and methods to
measure robustness to such adversarial perturbations. However, most commonly
considered adversarial examples are based on $\ell_p$-bounded perturbations in
the input space of the neural network, which are unlikely to arise naturally.
Recently, especially in computer vision, researchers discovered "natural" or
"semantic" perturbations, such as rotations, changes of brightness, or more
high-level changes, but these perturbations have not yet been systematically
utilized to measure the performance of classifiers. In this paper, we propose
several metrics to measure robustness of classifiers to natural adversarial
examples, and methods to evaluate them. These metrics, called latent space
performance metrics, are based on the ability of generative models to capture
probability distributions, and are defined in their latent spaces. On three
image classification case studies, we evaluate the proposed metrics for several
classifiers, including ones trained in conventional and robust ways. We find
that the latent counterparts of adversarial robustness are associated with the
accuracy of the classifier rather than its conventional adversarial robustness,
but the latter is still reflected on the properties of found latent
perturbations. In addition, our novel method of finding latent adversarial
perturbations demonstrates that these perturbations are often perceptually
small.

2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin