Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Ensembled CTR Prediction via Knowledge Distillation   Recently, deep learning-based models have been widely studied for
click-through rate (CTR) prediction and lead to improved prediction accuracy in
many industrial applications. However, current research focuses primarily on
building complex network architectures to better capture sophisticated feature
interactions and dynamic user behaviors. The increased model complexity may
slow down online inference and hinder its adoption in real-time applications.
Instead, our work targets at a new model training strategy based on knowledge
distillation (KD). KD is a teacher-student learning framework to transfer
knowledge learned from a teacher model to a student model. The KD strategy not
only allows us to simplify the student model as a vanilla DNN model but also
achieves significant accuracy improvements over the state-of-the-art teacher
models. The benefits thus motivate us to further explore the use of a powerful
ensemble of teachers for more accurate student model training. We also propose
some novel techniques to facilitate ensembled CTR prediction, including teacher
gating and early stopping by distillation loss. We conduct comprehensive
experiments against 12 existing models and across three industrial datasets.
Both offline and online A/B testing results show the effectiveness of our
KD-based training strategy.

20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg