Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Task-Free Continual Learning   Methods proposed in the literature towards continual deep learning typically
operate in a task-based sequential learning setup. A sequence of tasks is
learned, one at a time, with all data of current task available but not of
previous or future tasks. Task boundaries and identities are known at all
times. This setup, however, is rarely encountered in practical applications.
Therefore we investigate how to transform continual learning to an online
setup. We develop a system that keeps on learning over time in a streaming
fashion, with data distributions gradually changing and without the notion of
separate tasks. To this end, we build on the work on Memory Aware Synapses, and
show how this method can be made online by providing a protocol to decide i)
when to update the importance weights, ii) which data to use to update them,
and iii) how to accumulate the importance weights at each update step.
Experimental results show the validity of the approach in the context of two
applications: (self-)supervised learning of a face recognition model by
watching soap series and learning a robot to avoid collisions.

26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat