Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Offline and Online Satisfaction Prediction in Open-Domain Conversational
  Systems   Predicting user satisfaction in conversational systems has become critical,
as spoken conversational assistants operate in increasingly complex domains.
Online satisfaction prediction (i.e., predicting satisfaction of the user with
the system after each turn) could be used as a new proxy for implicit user
feedback, and offers promising opportunities to create more responsive and
effective conversational agents, which adapt to the user's engagement with the
agent. To accomplish this goal, we propose a conversational satisfaction
prediction model specifically designed for open-domain spoken conversational
agents, called ConvSAT. To operate robustly across domains, ConvSAT aggregates
multiple representations of the conversation, namely the conversation history,
utterance and response content, and system- and user-oriented behavioral
signals. We first calibrate ConvSAT performance against state of the art
methods on a standard dataset (Dialogue Breakdown Detection Challenge) in an
online regime, and then evaluate ConvSAT on a large dataset of conversations
with real users, collected as part of the Alexa Prize competition. Our
experimental results show that ConvSAT significantly improves satisfaction
prediction for both offline and online setting on both datasets, compared to
the previously reported state-of-the-art approaches. The insights from our
study can enable more intelligent conversational systems, which could adapt in
real-time to the inferred user satisfaction and engagement.

7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int