Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Seeing the Forest Despite the Trees: Large Scale Spatial-Temporal
  Decision Making   We introduce a challenging real-world planning problem where actions must be
taken at each location in a spatial area at each point in time. We use forestry
planning as the motivating application. In Large Scale Spatial-Temporal (LSST)
planning problems, the state and action spaces are defined as the
cross-products of many local state and action spaces spread over a large
spatial area such as a city or forest. These problems possess state
uncertainty, have complex utility functions involving spatial constraints and
we generally must rely on simulations rather than an explicit transition model.
We define LSST problems as reinforcement learning problems and present a
solution using policy gradients. We compare two different policy formulations:
an explicit policy that identifies each location in space and the action to
take there; and an abstract policy that defines the proportion of actions to
take across all locations in space. We show that the abstract policy is more
robust and achieves higher rewards with far fewer parameters than the
elementary policy. This abstract policy is also a better fit to the properties
that practitioners in LSST problem domains require for such methods to be
widely useful.

16
The categories of this paper are: stat
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat