Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Power of Abstention and Data-Driven Decision Making for
  Adversarial Robustness   We formally define a feature-space attack where the adversary can perturb
datapoints by arbitrary amounts but in restricted directions. By restricting
the attack to a small random subspace, our model provides a clean abstraction
for non-Lipschitz networks which map small input movements to large feature
movements. We prove that classifiers with the ability to abstain are provably
more powerful than those that cannot in this setting. Specifically, we show
that no matter how well-behaved the natural data is, any classifier that cannot
abstain will be defeated by such an adversary. However, by allowing abstention,
we give a parameterized algorithm with provably good performance against such
an adversary when classes are reasonably well-separated in feature space and
the dimension of the feature space is high. We further use a data-driven method
to set our algorithm parameters to optimize over the accuracy vs. abstention
trade-off with strong theoretical guarantees. Our theory has direct
applications to the technique of contrastive learning, where we empirically
demonstrate the ability of our algorithms to obtain high robust accuracy with
only small amounts of abstention in both supervised and self-supervised
settings. Our results provide a first formal abstention-based gap, and a first
provable optimization for the induced trade-off in an adversarial defense
setting.

30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
33
The categories of this paper are: plasm-ph
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio