Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving 360 Monocular Depth Estimation via Non-local Dense Prediction
  Transformer and Joint Supervised and Self-supervised Learning   Due to difficulties in acquiring ground truth depth of equirectangular (360)
images, the quality and quantity of equirectangular depth data today is
insufficient to represent the various scenes in the world. Therefore, 360 depth
estimation studies, which relied solely on supervised learning, are destined to
produce unsatisfactory results. Although self-supervised learning methods
focusing on equirectangular images (EIs) are introduced, they often have
incorrect or non-unique solutions, causing unstable performance. In this paper,
we propose 360 monocular depth estimation methods which improve on the areas
that limited previous studies. First, we introduce a self-supervised 360 depth
learning method that only utilizes gravity-aligned videos, which has the
potential to eliminate the needs for depth data during the training procedure.
Second, we propose a joint learning scheme realized by combining supervised and
self-supervised learning. The weakness of each learning is compensated, thus
leading to more accurate depth estimation. Third, we propose a non-local fusion
block, which can further retain the global information encoded by vision
transformer when reconstructing the depths. With the proposed methods, we
successfully apply the transformer to 360 depth estimations, to the best of our
knowledge, which has not been tried before. On several benchmarks, our approach
achieves significant improvements over previous works and establishes a state
of the art.

35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin