Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Sequence Tagging for Vietnamese Text Using Transformer-based
  Neural Models   This paper describes our study on using mutilingual BERT embeddings and some
new neural models for improving sequence tagging tasks for the Vietnamese
language. We propose new model architectures and evaluate them extensively on
two named entity recognition datasets of VLSP 2016 and VLSP 2018, and on two
part-of-speech tagging datasets of VLSP 2010 and VLSP 2013. Our proposed models
outperform existing methods and achieve new state-of-the-art results. In
particular, we have pushed the accuracy of part-of-speech tagging to 95.40% on
the VLSP 2010 corpus, to 96.77% on the VLSP 2013 corpus; and the F1 score of
named entity recognition to 94.07% on the VLSP 2016 corpus, to 90.31% on the
VLSP 2018 corpus. Our code and pre-trained models viBERT and vELECTRA are
released as open source to facilitate adoption and further research.

10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom