Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Evaluation of Adversarial Perturbations for Sequence-to-Sequence
  Models   Adversarial examples --- perturbations to the input of a model that elicit
large changes in the output --- have been shown to be an effective way of
assessing the robustness of sequence-to-sequence (seq2seq) models. However,
these perturbations only indicate weaknesses in the model if they do not change
the input so significantly that it legitimately results in changes in the
expected output. This fact has largely been ignored in the evaluations of the
growing body of related literature. Using the example of untargeted attacks on
machine translation (MT), we propose a new evaluation framework for adversarial
attacks on seq2seq models that takes the semantic equivalence of the pre- and
post-perturbation input into account. Using this framework, we demonstrate that
existing methods may not preserve meaning in general, breaking the
aforementioned assumption that source side perturbations should not result in
changes in the expected output. We further use this framework to demonstrate
that adding additional constraints on attacks allows for adversarial
perturbations that are more meaning-preserving, but nonetheless largely change
the output sequence. Finally, we show that performing untargeted adversarial
training with meaning-preserving attacks is beneficial to the model in terms of
adversarial robustness, without hurting test performance. A toolkit
implementing our evaluation framework is released at
https://github.com/pmichel31415/teapot-nlp.

26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph