Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Few-shot Visual Relationship Co-localization   In this paper, given a small bag of images, each containing a common but
latent predicate, we are interested in localizing visual subject-object pairs
connected via the common predicate in each of the images. We refer to this
novel problem as visual relationship co-localization or VRC as an abbreviation.
VRC is a challenging task, even more so than the well-studied object
co-localization task. This becomes further challenging when using just a few
images, the model has to learn to co-localize visual subject-object pairs
connected via unseen predicates. To solve VRC, we propose an optimization
framework to select a common visual relationship in each image of the bag. The
goal of the optimization framework is to find the optimal solution by learning
visual relationship similarity across images in a few-shot setting. To obtain
robust visual relationship representation, we utilize a simple yet effective
technique that learns relationship embedding as a translation vector from
visual subject to visual object in a shared space. Further, to learn visual
relationship similarity, we utilize a proven meta-learning technique commonly
used for few-shot classification tasks. Finally, to tackle the combinatorial
complexity challenge arising from an exponential number of feasible solutions,
we use a greedy approximation inference algorithm that selects approximately
the best solution.
  We extensively evaluate our proposed framework on variations of bag sizes
obtained from two challenging public datasets, namely VrR-VG and VG-150, and
achieve impressive visual co-localization performance.

25
The categories of this paper are: patt-sol
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
3
The categories of this paper are: physics
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys