Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data   Can we develop visually grounded dialog agents that can efficiently adapt to
new tasks without forgetting how to talk to people? Such agents could leverage
a larger variety of existing data to generalize to new tasks, minimizing
expensive data collection and annotation. In this work, we study a setting we
call "Dialog without Dialog", which requires agents to develop visually
grounded dialog models that can adapt to new tasks without language level
supervision. By factorizing intention and language, our model minimizes
linguistic drift after fine-tuning for new tasks. We present qualitative
results, automated metrics, and human studies that all show our model can adapt
to new tasks and maintain language quality. Baselines either fail to perform
well at new tasks or experience language drift, becoming unintelligible to
humans. Code has been made available at
https://github.com/mcogswell/dialog_without_dialog

34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex