Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: NovGrid: A Flexible Grid World for Evaluating Agent Response to Novelty   A robust body of reinforcement learning techniques have been developed to
solve complex sequential decision making problems. However, these methods
assume that train and evaluation tasks come from similarly or identically
distributed environments. This assumption does not hold in real life where
small novel changes to the environment can make a previously learned policy
fail or introduce simpler solutions that might never be found. To that end we
explore the concept of {\em novelty}, defined in this work as the sudden change
to the mechanics or properties of environment. We provide an ontology of for
novelties most relevant to sequential decision making, which distinguishes
between novelties that affect objects versus actions, unary properties versus
non-unary relations, and the distribution of solutions to a task. We introduce
NovGrid, a novelty generation framework built on MiniGrid, acting as a toolkit
for rapidly developing and evaluating novelty-adaptation-enabled reinforcement
learning techniques. Along with the core NovGrid we provide exemplar novelties
aligned with our ontology and instantiate them as novelty templates that can be
applied to many MiniGrid-compliant environments. Finally, we present a set of
metrics built into our framework for the evaluation of
novelty-adaptation-enabled machine-learning techniques, and show
characteristics of a baseline RL model using these metrics.

37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
29
The categories of this paper are: funct-an
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph