Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: CoinDICE: Off-Policy Confidence Interval Estimation   We study high-confidence behavior-agnostic off-policy evaluation in
reinforcement learning, where the goal is to estimate a confidence interval on
a target policy's value, given only access to a static experience dataset
collected by unknown behavior policies. Starting from a function space
embedding of the linear program formulation of the $Q$-function, we obtain an
optimization problem with generalized estimating equation constraints. By
applying the generalized empirical likelihood method to the resulting
Lagrangian, we propose CoinDICE, a novel and efficient algorithm for computing
confidence intervals. Theoretically, we prove the obtained confidence intervals
are valid, in both asymptotic and finite-sample regimes. Empirically, we show
in a variety of benchmarks that the confidence interval estimates are tighter
and more accurate than existing methods.

21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph