Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Tracking as Online Decision-Making: Learning a Policy from Streaming
  Videos with Reinforcement Learning   We formulate tracking as an online decision-making process, where a tracking
agent must follow an object despite ambiguous image frames and a limited
computational budget. Crucially, the agent must decide where to look in the
upcoming frames, when to reinitialize because it believes the target has been
lost, and when to update its appearance model for the tracked object. Such
decisions are typically made heuristically. Instead, we propose to learn an
optimal decision-making policy by formulating tracking as a partially
observable decision-making process (POMDP). We learn policies with deep
reinforcement learning algorithms that need supervision (a reward signal) only
when the track has gone awry. We demonstrate that sparse rewards allow us to
quickly train on massive datasets, several orders of magnitude more than past
work. Interestingly, by treating the data source of Internet videos as
unlimited streams, we both learn and evaluate our trackers in a single, unified
computational stream.

4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph