Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards Understanding the Regularization of Adversarial Robustness on
  Neural Networks   The problem of adversarial examples has shown that modern Neural Network (NN)
models could be rather fragile. Among the more established techniques to solve
the problem, one is to require the model to be {\it $\epsilon$-adversarially
robust} (AR); that is, to require the model not to change predicted labels when
any given input examples are perturbed within a certain range. However, it is
observed that such methods would lead to standard performance degradation,
i.e., the degradation on natural examples. In this work, we study the
degradation through the regularization perspective. We identify quantities from
generalization analysis of NNs; with the identified quantities we empirically
find that AR is achieved by regularizing/biasing NNs towards less confident
solutions by making the changes in the feature space (induced by changes in the
instance space) of most layers smoother uniformly in all directions; so to a
certain extent, it prevents sudden change in prediction w.r.t. perturbations.
However, the end result of such smoothing concentrates samples around decision
boundaries, resulting in less confident solutions, and leads to worse standard
performance. Our studies suggest that one might consider ways that build AR
into NNs in a gentler way to avoid the problematic regularization.

3
The categories of this paper are: physics
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math