Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mixed SIGNals: Sign Language Production via a Mixture of Motion
  Primitives   It is common practice to represent spoken languages at their phonetic level.
However, for sign languages, this implies breaking motion into its constituent
motion primitives. Avatar based Sign Language Production (SLP) has
traditionally done just this, building up animation from sequences of hand
motions, shapes and facial expressions. However, more recent deep learning
based solutions to SLP have tackled the problem using a single network that
estimates the full skeletal structure.
  We propose splitting the SLP task into two distinct jointly-trained
sub-tasks. The first translation sub-task translates from spoken language to a
latent sign language representation, with gloss supervision. Subsequently, the
animation sub-task aims to produce expressive sign language sequences that
closely resemble the learnt spatio-temporal representation. Using a progressive
transformer for the translation sub-task, we propose a novel Mixture of Motion
Primitives (MoMP) architecture for sign language animation. A set of distinct
motion primitives are learnt during training, that can be temporally combined
at inference to animate continuous sign language sequences.
  We evaluate on the challenging RWTH-PHOENIX-Weather-2014T(PHOENIX14T)
dataset, presenting extensive ablation studies and showing that MoMP
outperforms baselines in user evaluations. We achieve state-of-the-art back
translation performance with an 11% improvement over competing results.
Importantly, and for the first time, we showcase stronger performance for a
full translation pipeline going from spoken language to sign, than from gloss
to sign.

12
The categories of this paper are: nucl-th
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat