Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PROPS: Probabilistic personalization of black-box sequence models   We present PROPS, a lightweight transfer learning mechanism for sequential
data. PROPS learns probabilistic perturbations around the predictions of one or
more arbitrarily complex, pre-trained black box models (such as recurrent
neural networks). The technique pins the black-box prediction functions to
"source nodes" of a hidden Markov model (HMM), and uses the remaining nodes as
"perturbation nodes" for learning customized perturbations around those
predictions. In this paper, we describe the PROPS model, provide an algorithm
for online learning of its parameters, and demonstrate the consistency of this
estimation. We also explore the utility of PROPS in the context of personalized
language modeling. In particular, we construct a baseline language model by
training a LSTM on the entire Wikipedia corpus of 2.5 million articles (around
6.6 billion words), and then use PROPS to provide lightweight customization
into a personalized language model of President Donald J. Trump's tweeting. We
achieved good customization after only 2,000 additional words, and find that
the PROPS model, being fully probabilistic, provides insight into when
President Trump's speech departs from generic patterns in the Wikipedia corpus.
Python code (for both the PROPS training algorithm as well as experiment
reproducibility) is available at
https://github.com/cylance/perturbed-sequence-model.

21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
3
The categories of this paper are: physics
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci