Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Efficient Split-Mix Federated Learning for On-Demand and In-Situ
  Customization   Federated learning (FL) provides a distributed learning framework for
multiple participants to collaborate learning without sharing raw data. In many
practical FL scenarios, participants have heterogeneous resources due to
disparities in hardware and inference dynamics that require quickly loading
models of different sizes and levels of robustness. The heterogeneity and
dynamics together impose significant challenges to existing FL approaches and
thus greatly limit FL's applicability. In this paper, we propose a novel
Split-Mix FL strategy for heterogeneous participants that, once training is
done, provides in-situ customization of model sizes and robustness.
Specifically, we achieve customization by learning a set of base sub-networks
of different sizes and robustness levels, which are later aggregated on-demand
according to inference requirements. This split-mix strategy achieves
customization with high efficiency in communication, storage, and inference.
Extensive experiments demonstrate that our method provides better in-situ
customization than the existing heterogeneous-architecture FL methods. Codes
and pre-trained models are available: https://github.com/illidanlab/SplitMix.

19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga