Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning from Untrimmed Videos: Self-Supervised Video Representation
  Learning with Hierarchical Consistency   Natural videos provide rich visual contents for self-supervised learning. Yet
most existing approaches for learning spatio-temporal representations rely on
manually trimmed videos, leading to limited diversity in visual patterns and
limited performance gain. In this work, we aim to learn representations by
leveraging more abundant information in untrimmed videos. To this end, we
propose to learn a hierarchy of consistencies in videos, i.e., visual
consistency and topical consistency, corresponding respectively to clip pairs
that tend to be visually similar when separated by a short time span and share
similar topics when separated by a long time span. Specifically, a hierarchical
consistency learning framework HiCo is presented, where the visually consistent
pairs are encouraged to have the same representation through contrastive
learning, while the topically consistent pairs are coupled through a topical
classifier that distinguishes whether they are topic related. Further, we
impose a gradual sampling algorithm for proposed hierarchical consistency
learning, and demonstrate its theoretical superiority. Empirically, we show
that not only HiCo can generate stronger representations on untrimmed videos,
it also improves the representation quality when applied to trimmed videos.
This is in contrast to standard contrastive learning that fails to learn
appropriate representations from untrimmed videos.

6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
19
The categories of this paper are: eess
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn