Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Pool of Experts: Realtime Querying Specialized Knowledge in Massive
  Neural Networks   In spite of the great success of deep learning technologies, training and
delivery of a practically serviceable model is still a highly time-consuming
process. Furthermore, a resulting model is usually too generic and heavyweight,
and hence essentially goes through another expensive model compression phase to
fit in a resource-limited device like embedded systems. Inspired by the fact
that a machine learning task specifically requested by mobile users is often
much simpler than it is supported by a massive generic model, this paper
proposes a framework, called Pool of Experts (PoE), that instantly builds a
lightweight and task-specific model without any training process. For a
realtime model querying service, PoE first extracts a pool of primitive
components, called experts, from a well-trained and sufficiently generic
network by exploiting a novel conditional knowledge distillation method, and
then performs our train-free knowledge consolidation to quickly combine
necessary experts into a lightweight network for a target task. Thanks to this
train-free property, in our thorough empirical study, PoE can build a fairly
accurate yet compact model in a realtime manner, whereas it takes a few minutes
per query for the other training methods to achieve a similar level of the
accuracy.

8
The categories of this paper are: hep-ex
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
29
The categories of this paper are: funct-an