Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Risk-Averse Approximate Dynamic Programming with Quantile-Based Risk
  Measures   In this paper, we consider a finite-horizon Markov decision process (MDP) for
which the objective at each stage is to minimize a quantile-based risk measure
(QBRM) of the sequence of future costs; we call the overall objective a dynamic
quantile-based risk measure (DQBRM). In particular, we consider optimizing
dynamic risk measures where the one-step risk measures are QBRMs, a class of
risk measures that includes the popular value at risk (VaR) and the conditional
value at risk (CVaR). Although there is considerable theoretical development of
risk-averse MDPs in the literature, the computational challenges have not been
explored as thoroughly. We propose data-driven and simulation-based approximate
dynamic programming (ADP) algorithms to solve the risk-averse sequential
decision problem. We address the issue of inefficient sampling for risk
applications in simulated settings and present a procedure, based on importance
sampling, to direct samples toward the "risky region" as the ADP algorithm
progresses. Finally, we show numerical results of our algorithms in the context
of an application involving risk-averse bidding for energy storage.

6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph