Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Accuracy-Privacy Trade-off in Deep Ensemble: A Membership Inference
  Perspective   Deep ensemble learning has been shown to improve accuracy by training
multiple neural networks and fusing their outputs. Ensemble learning has also
been used to defend against membership inference attacks that undermine
privacy. In this paper, we empirically demonstrate a trade-off between these
two goals, namely accuracy and privacy (in terms of membership inference
attacks), in deep ensembles. Using a wide range of datasets and model
architectures, we show that the effectiveness of membership inference attacks
also increases when ensembling improves accuracy. To better understand this
trade-off, we study the impact of various factors such as prediction confidence
and agreement between models that constitute the ensemble. Finally, we evaluate
defenses against membership inference attacks based on regularization and
differential privacy. We show that while these defenses can mitigate the
effectiveness of the membership inference attack, they simultaneously degrade
ensemble accuracy. We illustrate similar trade-off in more advanced and
state-of-the-art ensembling techniques, such as snapshot ensembles and
diversified ensemble networks. The source code is available in supplementary
materials.

11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th