Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Safe Exploration for Identifying Linear Systems via Robust Optimization   Safely exploring an unknown dynamical system is critical to the deployment of
reinforcement learning (RL) in physical systems where failures may have
catastrophic consequences. In scenarios where one knows little about the
dynamics, diverse transition data covering relevant regions of state-action
space is needed to apply either model-based or model-free RL. Motivated by the
cooling of Google's data centers, we study how one can safely identify the
parameters of a system model with a desired accuracy and confidence level. In
particular, we focus on learning an unknown linear system with Gaussian noise
assuming only that, initially, a nominal safe action is known. Define safety as
satisfying specific linear constraints on the state space (e.g., requirements
on process variable) that must hold over the span of an entire trajectory, and
given a Probably Approximately Correct (PAC) style bound on the estimation
error of model parameters, we show how to compute safe regions of action space
by gradually growing a ball around the nominal safe action. One can apply any
exploration strategy where actions are chosen from such safe regions.
Experiments on a stylized model of data center cooling dynamics show how
computing proper safe regions can increase the sample efficiency of safe
exploration.

9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
29
The categories of this paper are: funct-an
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph