Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-Image Relational Knowledge Distillation for Semantic Segmentation   Current Knowledge Distillation (KD) methods for semantic segmentation often
guide the student to mimic the teacher's structured information generated from
individual data samples. However, they ignore the global semantic relations
among pixels across various images that are valuable for KD. This paper
proposes a novel Cross-Image Relational KD (CIRKD), which focuses on
transferring structured pixel-to-pixel and pixel-to-region relations among the
whole images. The motivation is that a good teacher network could construct a
well-structured feature space in terms of global pixel dependencies. CIRKD
makes the student mimic better structured semantic relations from the teacher,
thus improving the segmentation performance. Experimental results over
Cityscapes, CamVid and Pascal VOC datasets demonstrate the effectiveness of our
proposed approach against state-of-the-art distillation methods. The code is
available at https://github.com/winycg/CIRKD.

18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin