Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mining Data Impressions from Deep Models as Substitute for the
  Unavailable Training Data   Pretrained deep models hold their learnt knowledge in the form of model
parameters. These parameters act as "memory" for the trained models and help
them generalize well on unseen data. However, in absence of training data, the
utility of a trained model is merely limited to either inference or better
initialization towards a target task. In this paper, we go further and extract
synthetic data by leveraging the learnt model parameters. We dub them "Data
Impressions", which act as proxy to the training data and can be used to
realize a variety of tasks. These are useful in scenarios where only the
pretrained models are available and the training data is not shared (e.g., due
to privacy or sensitivity concerns). We show the applicability of data
impressions in solving several computer vision tasks such as unsupervised
domain adaptation, continual learning as well as knowledge distillation. We
also study the adversarial robustness of lightweight models trained via
knowledge distillation using these data impressions. Further, we demonstrate
the efficacy of data impressions in generating data-free Universal Adversarial
Perturbations (UAPs) with better fooling rates. Extensive experiments performed
on benchmark datasets demonstrate competitive performance achieved using data
impressions in absence of original training data.

9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
19
The categories of this paper are: eess
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con