Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Discrete and continuous representations and processing in deep learning:
  Looking forward   Discrete and continuous representations of content (e.g., of language or
images) have interesting properties to be explored for the understanding of or
reasoning with this content by machines. This position paper puts forward our
opinion on the role of discrete and continuous representations and their
processing in the deep learning field. Current neural network models compute
continuous-valued data. Information is compressed into dense, distributed
embeddings. By stark contrast, humans use discrete symbols in their
communication with language. Such symbols represent a compressed version of the
world that derives its meaning from shared contextual information.
Additionally, human reasoning involves symbol manipulation at a cognitive
level, which facilitates abstract reasoning, the composition of knowledge and
understanding, generalization and efficient learning. Motivated by these
insights, in this paper we argue that combining discrete and continuous
representations and their processing will be essential to build systems that
exhibit a general form of intelligence. We suggest and discuss several avenues
that could improve current neural networks with the inclusion of discrete
elements to combine the advantages of both types of representations.

17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
16
The categories of this paper are: stat