Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Failure Modes of Domain Generalization Algorithms   Domain generalization algorithms use training data from multiple domains to
learn models that generalize well to unseen domains. While recently proposed
benchmarks demonstrate that most of the existing algorithms do not outperform
simple baselines, the established evaluation methods fail to expose the impact
of various factors that contribute to the poor performance. In this paper we
propose an evaluation framework for domain generalization algorithms that
allows decomposition of the error into components capturing distinct aspects of
generalization. Inspired by the prevalence of algorithms based on the idea of
domain-invariant representation learning, we extend the evaluation framework to
capture various types of failures in achieving invariance. We show that the
largest contributor to the generalization error varies across methods,
datasets, regularization strengths and even training lengths. We observe two
problems associated with the strategy of learning domain-invariant
representations. On Colored MNIST, most domain generalization algorithms fail
because they reach domain-invariance only on the training domains. On
Camelyon-17, domain-invariance degrades the quality of representations on
unseen domains. We hypothesize that focusing instead on tuning the classifier
on top of a rich representation can be a promising direction.

23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn