Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation   To explore the limit of dialogue generation pre-training, we present the
models of PLATO-XL with up to 11 billion parameters, trained on both Chinese
and English social media conversations. To train such large models, we adopt
the architecture of unified transformer with high computation and parameter
efficiency. In addition, we carry out multi-party aware pre-training to better
distinguish the characteristic information in social media conversations. With
such designs, PLATO-XL successfully achieves superior performances as compared
to other approaches in both Chinese and English chitchat. We further explore
the capacity of PLATO-XL on other conversational tasks, such as knowledge
grounded dialogue and task-oriented conversation. The experimental results
indicate that PLATO-XL obtains state-of-the-art results across multiple
conversational tasks, verifying its potential as a foundation model of
conversational AI.

33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th
7
The categories of this paper are: hep-th