Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Quantifying Privacy Risks of Masked Language Models Using Membership
  Inference Attacks   The wide adoption and application of Masked language models~(MLMs) on
sensitive data (from legal to medical) necessitates a thorough quantitative
investigation into their privacy vulnerabilities -- to what extent do MLMs leak
information about their training data? Prior attempts at measuring leakage of
MLMs via membership inference attacks have been inconclusive, implying the
potential robustness of MLMs to privacy attacks. In this work, we posit that
prior attempts were inconclusive because they based their attack solely on the
MLM's model score. We devise a stronger membership inference attack based on
likelihood ratio hypothesis testing that involves an additional reference MLM
to more accurately quantify the privacy risks of memorization in MLMs. We show
that masked language models are extremely susceptible to likelihood ratio
membership inference attacks: Our empirical results, on models trained on
medical notes, show that our attack improves the AUC of prior membership
inference attacks from 0.66 to an alarmingly high 0.90 level, with a
significant improvement in the low-error region: at 1% false positive rate, our
attack is 51X more powerful than prior work.

17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con