Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Federated Domain Adaptation for ASR with Full Self-Supervision   Cross-device federated learning (FL) protects user privacy by collaboratively
training a model on user devices, therefore eliminating the need for
collecting, storing, and manually labeling user data. While important topics
such as the FL training algorithm, non-IID-ness, and Differential Privacy have
been well studied in the literature, this paper focuses on two challenges of
practical importance for improving on-device ASR: the lack of ground-truth
transcriptions and the scarcity of compute resource and network bandwidth on
edge devices. First, we propose a FL system for on-device ASR domain adaptation
with full self-supervision, which uses self-labeling together with data
augmentation and filtering techniques. The system can improve a strong
Emformer-Transducer based ASR model pretrained on out-of-domain data, using
in-domain audio without any ground-truth transcriptions. Second, to reduce the
training cost, we propose a self-restricted RNN Transducer (SR-RNN-T) loss, a
variant of alignment-restricted RNN-T that uses Viterbi alignments from
self-supervision. To further reduce the compute and network cost, we
systematically explore adapting only a subset of weights in the
Emformer-Transducer. Our best training recipe achieves a $12.9\%$ relative WER
reduction over the strong out-of-domain baseline, which equals $70\%$ of the
reduction achievable with full human supervision and centralized training.

29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg