Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: TsmoBN: Generalization for Unseen Clients in Federated Learning via
  Causal Intervention   Generalizing federated learning (FL) models to unseen clients with non-iid
data is a crucial topic, yet unsolved so far. In this work, we propose to
tackle this problem from a novel causal perspective. Specifically, we form a
training structural causal model (SCM) to explain the challenges of model
generalization in a distributed learning paradigm. Based on this, we present a
simple yet effective method using test-specific and momentum tracked batch
normalization (TsmoBN) to generalize FL models to testing clients. We give a
causal analysis by formulating another testing SCM and demonstrate that the key
factor in TsmoBN is the test-specific statistics (i.e., mean and variance) of
features. Such statistics can be seen as a surrogate variable for causal
intervention. In addition, by considering generalization bounds in FL, we show
that our TsmoBN method can reduce divergence between training and testing
feature distributions, which achieves a lower generalization gap than standard
model testing. Our extensive experimental evaluations demonstrate significant
improvements for unseen client generalization on three datasets with various
types of feature distributions and numbers of clients. It is worth noting that
our proposed approach can be flexibly applied to different state-of-the-art
federated learning algorithms and is orthogonal to existing domain
generalization methods.

26
The categories of this paper are: bayes-an
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas