Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: State Relevance for Off-Policy Evaluation   Importance sampling-based estimators for off-policy evaluation (OPE) are
valued for their simplicity, unbiasedness, and reliance on relatively few
assumptions. However, the variance of these estimators is often high,
especially when trajectories are of different lengths. In this work, we
introduce Omitting-States-Irrelevant-to-Return Importance Sampling (OSIRIS), an
estimator which reduces variance by strategically omitting likelihood ratios
associated with certain states. We formalize the conditions under which OSIRIS
is unbiased and has lower variance than ordinary importance sampling, and we
demonstrate these properties empirically.

7
The categories of this paper are: hep-th
14
The categories of this paper are: math-ph
4
The categories of this paper are: cond-mat
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an