Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven
  Communication   In this work, we propose a goal-driven collaborative task that combines
language, perception, and action. Specifically, we develop a Collaborative
image-Drawing game between two agents, called CoDraw. Our game is grounded in a
virtual world that contains movable clip art objects. The game involves two
players: a Teller and a Drawer. The Teller sees an abstract scene containing
multiple clip art pieces in a semantically meaningful configuration, while the
Drawer tries to reconstruct the scene on an empty canvas using available clip
art pieces. The two players communicate with each other using natural language.
We collect the CoDraw dataset of ~10K dialogs consisting of ~138K messages
exchanged between human players. We define protocols and metrics to evaluate
learned agents in this testbed, highlighting the need for a novel "crosstalk"
evaluation condition which pairs agents trained independently on disjoint
subsets of the training data. We present models for our task and benchmark them
using both fully automated evaluation and by having them play the game live
with humans.

12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph