Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Language Models that Seek for Knowledge: Modular Search & Generation for
  Dialogue and Prompt Completion   Language models (LMs) have recently been shown to generate more factual
responses by employing modularity (Zhou et al., 2021) in combination with
retrieval (Adolphs et al., 2021). We extend the recent approach of Adolphs et
al. (2021) to include internet search as a module. Our SeeKeR (Search
engine->Knowledge->Response) method thus applies a single LM to three modular
tasks in succession: search, generating knowledge, and generating a final
response. We show that, when using SeeKeR as a dialogue model, it outperforms
the state-of-the-art model BlenderBot 2 (Chen et al., 2021) on open-domain
knowledge-grounded conversations for the same number of parameters, in terms of
consistency, knowledge and per-turn engagingness. SeeKeR applied to topical
prompt completions as a standard language model outperforms GPT2 (Radford et
al., 2019) and GPT3 (Brown et al., 2020) in terms of factuality and topicality,
despite GPT3 being a vastly larger model. Our code and models are made publicly
available.

8
The categories of this paper are: hep-ex
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
23
The categories of this paper are: solv-int
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin