Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Beyond monetary incentives: experiments in paid microtask contests
  modelled as continuous-time markov chains   In this paper, we aim to gain a better understanding into how paid microtask
crowdsourcing could leverage its appeal and scaling power by using contests to
boost crowd performance and engagement. We introduce our microtask-based
annotation platform Wordsmith, which features incentives such as points,
leaderboards and badges on top of financial remuneration. Our analysis focuses
on a particular type of incentive, contests, as a means to apply crowdsourcing
in near-real-time scenarios, in which requesters need labels quickly. We model
crowdsourcing contests as a continuous-time Markov chain with the objective to
maximise the output of the crowd workers, while varying a parameter which
determines whether a worker is eligible for a reward based on their present
rank on the leaderboard. We conduct empirical experiments in which crowd
workers recruited from CrowdFlower carry out annotation microtasks on Wordsmith
- in our case, to identify named entities in a stream of Twitter posts. In the
experimental conditions, we test different reward spreads and record the total
number of annotations received. We compare the results against a control
condition in which the same annotation task was completed on CrowdFlower
without a time or contest constraint. The experiments show that rewarding only
the best contributors in a live contest could be a viable model to deliver
results faster, though quality might suffer for particular types of annotation
tasks. Increasing the reward spread leads to more work being completed,
especially by the top contestants. Overall, the experiments shed light on
possible design improvements of paid microtasks platforms to boost task
performance and speed, and make the overall experience more fair and
interesting for crowd workers.

31
The categories of this paper are: ao-sci
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
35
The categories of this paper are: mtrl-th
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex