Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: KAT: A Knowledge Augmented Transformer for Vision-and-Language   The primary focus of recent work with largescale transformers has been on
optimizing the amount of information packed into the model's parameters. In
this work, we ask a different question: Can multimodal transformers leverage
explicit knowledge in their reasoning? Existing, primarily unimodal, methods
have explored approaches under the paradigm of knowledge retrieval followed by
answer prediction, but leave open questions about the quality and relevance of
the retrieved knowledge used, and how the reasoning processes over implicit and
explicit knowledge should be integrated. To address these challenges, we
propose a novel model - Knowledge Augmented Transformer (KAT) - which achieves
a strong state-of-the-art result (+6 points absolute) on the open-domain
multimodal task of OK-VQA. Our approach integrates implicit and explicit
knowledge in an end to end encoder-decoder architecture, while still jointly
reasoning over both knowledge sources during answer generation. An additional
benefit of explicit knowledge integration is seen in improved interpretability
of model predictions in our analysis.

0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
16
The categories of this paper are: stat