Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Visual Entailment: A Novel Task for Fine-Grained Image Understanding   Existing visual reasoning datasets such as Visual Question Answering (VQA),
often suffer from biases conditioned on the question, image or answer
distributions. The recently proposed CLEVR dataset addresses these limitations
and requires fine-grained reasoning but the dataset is synthetic and consists
of similar objects and sentence structures across the dataset.
  In this paper, we introduce a new inference task, Visual Entailment (VE) -
consisting of image-sentence pairs whereby a premise is defined by an image,
rather than a natural language sentence as in traditional Textual Entailment
tasks. The goal of a trained VE model is to predict whether the image
semantically entails the text. To realize this task, we build a dataset SNLI-VE
based on the Stanford Natural Language Inference corpus and Flickr30k dataset.
We evaluate various existing VQA baselines and build a model called Explainable
Visual Entailment (EVE) system to address the VE task. EVE achieves up to 71%
accuracy and outperforms several other state-of-the-art VQA based models.
Finally, we demonstrate the explainability of EVE through cross-modal attention
visualizations. The SNLI-VE dataset is publicly available at
https://github.com/ necla-ml/SNLI-VE.

19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex