Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Are Bayesian neural networks intrinsically good at out-of-distribution
  detection?   The need to avoid confident predictions on unfamiliar data has sparked
interest in out-of-distribution (OOD) detection. It is widely assumed that
Bayesian neural networks (BNN) are well suited for this task, as the endowed
epistemic uncertainty should lead to disagreement in predictions on outliers.
In this paper, we question this assumption and provide empirical evidence that
proper Bayesian inference with common neural network architectures does not
necessarily lead to good OOD detection. To circumvent the use of approximate
inference, we start by studying the infinite-width case, where Bayesian
inference can be exact considering the corresponding Gaussian process.
Strikingly, the kernels induced under common architectural choices lead to
uncertainties that do not reflect the underlying data generating process and
are therefore unsuited for OOD detection. Finally, we study finite-width
networks using HMC, and observe OOD behavior that is consistent with the
infinite-width case. Overall, our study discloses fundamental problems when
naively using BNNs for OOD detection and opens interesting avenues for future
research.

10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph