Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Do the Hard Stuff First: Scheduling Dependent Computations in
  Data-Analytics Clusters   We present a scheduler that improves cluster utilization and job completion
times by packing tasks having multi-resource requirements and
inter-dependencies. While the problem is algorithmically very hard, we achieve
near-optimality on the job DAGs that appear in production clusters at a large
enterprise and in benchmarks such as TPC-DS. A key insight is that carefully
handling the long-running tasks and those with tough-to-pack resource needs
will produce good-enough schedules. However, which subset of tasks to treat
carefully is not clear (and intractable to discover). Hence, we offer a search
procedure that evaluates various possibilities and outputs a preferred schedule
order over tasks. An online component enforces the schedule orders desired by
the various jobs running on the cluster. In addition, it packs tasks, overbooks
the fungible resources and guarantees bounded unfairness for a variety of
desirable fairness schemes. Relative to the state-of-the art schedulers, we
speed up 50% of the jobs by over 30% each.

31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn