Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Training independent subnetworks for robust prediction   Recent approaches to efficiently ensemble neural networks have shown that
strong robustness and uncertainty performance can be achieved with a negligible
gain in parameters over the original network. However, these methods still
require multiple forward passes for prediction, leading to a significant
computational cost. In this work, we show a surprising result: the benefits of
using multiple predictions can be achieved `for free' under a single model's
forward pass. In particular, we show that, using a multi-input multi-output
(MIMO) configuration, one can utilize a single model's capacity to train
multiple subnetworks that independently learn the task at hand. By ensembling
the predictions made by the subnetworks, we improve model robustness without
increasing compute. We observe a significant improvement in negative
log-likelihood, accuracy, and calibration error on CIFAR10, CIFAR100, ImageNet,
and their out-of-distribution variants compared to previous methods.

32
The categories of this paper are: atom-ph
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
2
The categories of this paper are: math